E-comprehension: Evaluating B2B websites using readability formulae

https://doi.org/10.1016/S0019-8501(01)00184-5Get rights and content

Abstract

The Internet has often been referred to as an “infocentric” medium. Information abounds on topics, people, products and companies. With the multiplicity and diverse variety of web pages containing information, comprehension becomes a critical issue, and a major facet of comprehension is readability of content. The study described in this paper examines the readability of the text on business-to-business (B2B) websites. First, the paper presents an overview of readability formulae. It then applies selected readability formulae to web pages in the semiconductor industry. The study explores how readability formulae can provide quick feedback to web marketers based on key indicators such as sentence length, proportion of difficult words and frequency of polysyllabic words. It also demonstrates how the relative readability of a company's web pages can be evaluated against those of its competitors. In closing, the paper considers the managerial implications associated with the use of readability formulae and offers directions for future study in this relatively under-researched domain.

Introduction

Business-to-business (B2B) marketers communicate with their customers in a variety of different ways. Salespeople call on their clients, billboards attempt to attract the attention of the executive on journeys to and from work, and television advertisements extol the virtues of products and services using the power of visual movement and sound. However, the overwhelming majority of the B2B marketer's communication efforts rely on written text. The customer hopefully reads trade journal advertising and brochures, probably reads sales proposals and almost certainly reads product manuals and safety instructions, or at least tries to. Here, the marketer makes a leap of faith: That the customer audience will not only read, but also comprehend the communicated message. If the customer does read and comprehend the message, this could lead to awareness, interest and sales, at a basic level, and then higher level outcomes such as customer satisfaction, retention and repurchase. Where comprehension is less than optimal, the outcomes for the marketer can range from indifferent to disastrous—from low awareness and poor resulting sales, to brand disdain, low product satisfaction and customer exit. Indeed, low customer comprehension of some marketing material in a B2B environment can even lead to product misuse that can be fatal.

Regardless of the medium, readability is an important issue in communication. For some time now, communicators have been concerned about the suitability of writing style and sentence structure for readers at different levels. While the concern with readability has its roots in philosophy and ancient Bible studies, it was in the domain of education that the most significant research on the subject has been conducted [1]. More recently, marketers and other professionals have become justifiably concerned with the readability of their written communication.

Advertising professionals, in particular, should be concerned with all aspects of sentence structure that may impact on effective communication. A few basic tenets of advertising copywriting are: to write in a conversational style as if talking to someone [2]; to use “the language they use every day” [3]; to rewrite copy so that it is “easier to read; i.e., using shorter sentences and replacing difficult words with easier-to-read synonyms” [4]. However, most of the advice is intuitive and not empirically tested. Despite the importance of copywriting in advertising, psycholinguistic research of advertising text has tended to focus on the semantics of advertising (i.e., word meanings) rather than the language itself (i.e., the syntax) [5]. Paradoxically then, the body of knowledge on advertising copy effectiveness has little to offer B2B marketers who have embraced the Internet.

In the B2B literature, readability has only been studied with regard to sales training manuals [6]. It was found, not unsurprisingly, that reading material that requires a disproportionately high level of reading effort causes readers to adopt a less positive view of the material and those who produced it. Now, B2B marketers are turning to the Internet in their efforts to communicate effectively and transact with customers. With the sharp rise in the use of electronic media, it is equally important for B2B marketers to ascertain how readable the information they communicate on the Internet is, for material that is less readable can easily be passed over at the click of a mouse. Indeed, the customer as reader does not even have to go to the trouble of forming a less positive view of the material or the provider: he or she simply clicks and passes on to a more appropriate site. Indeed, one may speculate that comprehension of text reaches a new level in the age of the Internet—to coin a cliché, we may term this “e-comprehension.” And e-comprehension is determined by readability. The study described in this paper will explore one method to assess the readability of web pages, by examining a selection of web pages for semiconductor companies.

Section snippets

Readability

As already stated, of interest to all organizations using written communications is the ease with which the receiver reads and understands the text. How the reader performs with text materials involves two entities—the “text” and the “reader.” Klare [7] proposed a basic model summarizing the significant variables influencing reading performance. These are represented diagrammatically in Fig. 1.

Following prior research, it is necessary to distinguish between understandability (or

Research aims

It is important to ensure that the text in web pages is written using an effective and appropriate writing style and syntactic structure that facilitates reading. This is perhaps even more important in B2B sites where visitors are often in extreme haste to peruse the site for information of relevance to them. This study explores the use of readability formulae for providing guidelines as to the ease of reading of the text in web pages. It also considers the types of analyses that can be

Readability formulae

The notion of readability raises questions of measurement, methodology and research design. In this regard, qualitative approaches to readability assessment yield richness of information that can be useful in providing improvements to the text. Unfortunately, this alternative is time consuming and costly. Thus, there is a need to have efficient, reliable and affordable quantitative measures to guide writers/web masters as to the ease of reading of their text. A number of readability formulae

Validity of readability formulae

The use of quantitative formulae has certain merits. However, one important concern focuses on whether the formulae measure what they are intended to measure—in other words, their validity. There have been numerous criticisms leveled at the various readability formulae [19], [20], [21], perhaps the most prevalent of which is that they tend to ignore other variables (such as the reader's motivation, the layout and legibility of the material) that influence the comprehension and ease of reading

The study

The sampling selection criteria for the industrial websites used in our study are (i) to evaluate dedicated B2B sites (rather than sites that also cater to end consumers), (ii) to select sites within a fairly homogeneous industry group to enable comparisons, (iii) to have more than five companies within the industry group to ensure a reasonable sample size and (iv) to select only public listed companies as revenue and profit performance are available. Utilizing the established Fortune 500

Findings and discussion

In the section below, we present and discuss the findings of the analyses of the websites selected for the study.

Sentence and word analyses

An initial stage of analysis involves examining the key variables affecting readability—sentence length, difficult words (i.e., not commonly used words) and word length (i.e., polysyllabic words). Table 1 reports the results of the sentence and word analyses based on the following:·

  • Words per sentence: This is a simple count of the average number of words per sentence. All the main formulae use this criterion in evaluating readability.•·Sentences per 100 words: The number of sentences per 100

Grade level and reading ease

Based on the literature, it is expected that there are variations in the estimation of grade levels of sample written passages as each formula takes into consideration slightly different criteria in their calculations. In examining the results in Table 2, Dale-Chall's grade level scores are at the lower-end and FOG's scores at the higher-end. Flesch's grade level scores appear to be closer to the mean of all three formulae. FOG scores appear to reinforce industry's experience with the formula

Summary and conclusions

This paper has sought to highlight the importance of evaluating the readability of B2B web pages. While there are a number of qualitative means to do so, this study explored the possibility of evaluating readability quantitatively, by using readability formulae. The study demonstrates that readability formulae can potentially yield a quick gauge as to the ease or difficulty of reading online text. Where scores indicate difficulty in the readability of online text, this should serve as a signal

References (26)

  • JW Pichert et al.

    Readability formulae may mislead you

    Patient Educ Couns

    (1985)
  • MH Morris et al.

    Assessing the structure of industrial buying centers with multivariate tools

    Ind Mark Manage

    (1999)
  • SC Rogers

    How to create advertising that works

    J Bus Ind Mark

    (1995)
  • D Higgins

    The art of writing advertising

    (1986)
  • LJ Harrison-Walker

    The import of illiteracy to marketing communications

    J Consum Mark

    (1995)
  • WH Motes et al.

    Perceptual shaping via syntax and textual layout: additional insights for US copywriters

    International Journal of Advertising

    (1995)
  • PF Kaminski et al.

    The readability of sales training manuals

    Ind Mark Manage

    (1987)
  • GR Klare

    A manual for readable writing

    (1980)
  • MJ Jones

    Readability of annual reports: Western versus Asian evidence—a comment to contextualize

    Accounting, Auditing Accountability J

    (1996)
  • M Smith et al.

    Readability and understandability: different measures of the textual complexity of accounting narratives

    Accounting, Auditing Accountability J

    (1992)
  • B Woods et al.

    A critical review of readability and comprehensibility tests

    J Tourism Stud

    (1998)
  • GR Klare
  • Cited by (33)

    • Online content match-making in B2B markets: Application of neural content modeling

      2021, Industrial Marketing Management
      Citation Excerpt :

      A B2B seller may also distribute content indirectly through earned channels, such as communities or social media pages created by customers and/or employees (Xie & Lee, 2015). In the B2B context, extant studies have focused on increasing content readability (e.g., Leong, Ewing, & Pitt, 2002) in one's own channels and ways of influencing content creation (Huotari, Ulkuniemi, Saraniemi, & Mäläskä, 2015) in both one's own and earned channels. In our study, we consider content distribution through two direct channel types.

    • Digital mediation in business-to-business marketing: A bibliometric analysis

      2020, Industrial Marketing Management
      Citation Excerpt :

      This period coincided with the emergence of the Internet. The two biggest circles describing this time period are business-to-business technology (e.g., Boyd & Spekman, 2004; Grewal, Iyer, Krishnan, & Sharma, 2003; Leong et al., 2002; Pillai & Sharma, 2004; Pires & Aisbett, 2003) and the Internet (e.g., Sharma, 2002; Sharma & Krishnan, 2002; Sharma & Tzokas, 2002). Other areas of research, with less salience (smaller circles), include exchanges (e.g., Kaplan & Sawhney, 2000), websites (e.g., Evans & King, 1999), implications (e.g., Dou & Chou, 2002), and digital marketing (e.g., Wilson & Abel, 2002).

    • Neural machine translation in AVT teaching in China: An in-depth analysis from the readability perspective

      2023, Linguistica Antverpiensia, New Series – Themes in Translation Studies
    View all citing articles on Scopus
    View full text