Definitions of Variables Identified in the Survey

Types of Variables

  1. The Search Process
    1. Search topics/tasks
    2. Search behaviors
    3. Search outcomes

  2. The Database and Search System
    1. Database coverage and structure
    2. System support of searching
    3. System support for display

  3. The Person/User
    1. Understanding/knowledge
    2. Psychological/personality characteristics
    3. Demographics

I. The Search Process

A. Search topics/tasks

Purpose for conducting the search (for user-generated search topics). The tasks in which information seeking is embedded (Pirolli & Card, 1999), such as completing a specific school assignment or planning a vacation.

The situational context of the search (for user-generated search topics). The set of organizational/social settings and cognitive structures of individuals and groups that have information needs (Allen, 1996). For example, an individual may be a member of a particular research team and within a particular phase of her doctoral work; these aspects of her context will affect her definition of her information need and how she goes about addressing that need.

Topic source (user-generated vs. assigned by the researcher). The way the search topics are administered (i.e., fully assigned, semiassigned, fully self-generated) (Bilal, 2002).

Specificity. The degree of specificity of the subject of search topics. Specificity ranges from very general or broad to very specific or narrow (Saracevic, et al., 1988).

Topic/search complexity. The number of facets involved in the query (Bilal, 2002).

Task complexity. The degree of predeterminability of task performance, including the predeterminability of its information requirements, process, and outcome (Vakkari, 1999).

Difficulty. The level of difficulty of the objective elements of a search task, which can be defined as the“hardness to be done or accomplished” (White & Iivonen, 2002).

Subject domain. The general subject or topic area in which the search topic falls (Saracevic, et al., 1988).

Time frame of information need. The period of time within which the user needs to resolve an information need.

Stage of information search process. The stage of the process in which the user is currently engaged, based on the theory that users will go through multiple stages in completing a search, evolving from vague to clear in their understanding of a topic or task and involving changing feelings and actions at each stage (Kuhlthau, 1992).

B. Search behaviors

Search terms used. Search terms that users enter into the system/database.

Types of search statements. A variety of researchers (e.g., Bates, 1979; Fidel, 1985; Wildemuth & Moore, 1995) have identified typologies for classifying search statements. They usually include specific moves for reducing the size of the set retrieved (e.g., adding another term/concept with an AND operator or limiting it to publications in English) or increasing the size of the set retrieved (e.g., adding synonyms with an OR operator or truncating a term), and may also include beginning, ending, and error moves.

Sequential sets of search statements, i.e., tactics. “A search tactic is a set of search [statements] that are temporally and semantically related” (Wildemuth, 2004, 246).

Search mediation. Whether the search was completed with the assistance of an information professional or librarian, or completed by the end user without assistance.

Types of errors. Types of errors made by users in searching information for a task, such as typographical or spelling errors, misuse of Boolean operators, or other actions that result in zero-hit retrieval sets (Connaway, Budd, & Kochtanek, 1995).

Stopping behavior. The user's rationale for terminating the search at a certain point in time (Kantor, 1987).

Number of sessions. A count of the total number of search sessions conducted by users over time when seeking information related to a particular information problem/need (Spink, 1996).

Use of help. Users' use of a 'help' command in the system/database.

Session/search length. The time or number of cycles used in a single session. A session is all the search-related actions involved in one sitting for one information problem/need.

Number of search statements per session. A search statement is an individual search command or query.

Number of pages/records displayed. A count of the total number of pages/records retrieved from the system/database, that are displayed in some way.

C. Search outcomes

Users' criteria for evaluating the items retrieved. Criteria (related to the users' information need situation) mentioned by users evaluating the information within documents (Barry, 1994).

Satisfaction with search results/outcomes. Satisfaction, in a general sense, is defined as “the fulfillment or gratification of a desire, need, or appetite, [and the] pleasure or contentment derived from such gratification” (American Heritage Dictionary, 2000). It may be experienced as part of a user's responses to the search results/outcomes (Sandore, 1990; Bruce, 1998).

Utility/value of search results. The overall value of the search results in fulfilling the user's information need (Boyce, Meadow, & Kraft, 1994), or the user's perceptions of overall system success in providing help for the user's purpose or information problem (Su, 1992).

Whether/how the search results are used. Whether and how users employ the information they have retrieved in their own lives. For example, they might cite the retrieved item in a paper or make a decision based on it.

Satisfaction with the search system/database. Satisfaction (see above) may be experienced in response to the user's interactions with the search system or the user's perceptions of the functionality of the system.

Satisfaction with search precision. Satisfaction (see above) may be experienced in response to the precision of the search results.

Precision of retrieved set(s). The ratio of the number of relevant records retrieved to the total number retrieved (Boyce, Meadow, & Kraft, 1994).

Satisfaction with search recall. Satisfaction (see above) may be experienced in response to recall, or the completeness of the search results retrieved.

II. The Database and Search System

A. Database coverage and structure

Subject/domain coverage. A description of the materials indexed or included in a database, in terms of the topics covered.

Types of documents included. A description of the materials indexed or included in a database, in terms of genre, e.g., articles, books, conference papers, photographs.

Controlled vocabulary for indexing. The amount and type of control exerted over the subject terms or descriptors assigned to items in a database. A database's indexing may be controlled by a thesaurus or by an authority list of terms that may be assigned.

Data elements/fields included. The fields or data elements recorded in the database being searched. "A field is an individual piece of information" about an item in the database (Walker & Janes, 1993, p.27)

Database structure , e.g., relational vs. hypertext. The methods or tools with which an index is created. The index terms may be assigned by a person or by a computer system or by some combination of the two (Tenopir, 1999). An index is "a tool that is used to locate information within a document" or a collection (Dalrymple, 1995, p.60).

Depth of indexing. "The degree of specificity with which the collection is 'broken down' into its components, the number of terms with which each item is tagged, and the degree of specificity of these terms" (Rothman, 1974, p.297).

Time aspects (i.e., dates) of coverage. The time period in which database materials were published/created, or were indexed,included or updated in the database.

Source of indexing (person vs. automatic indexing). The way that the materials are indexed in a database (e.g., by humans assigning subject terms, the system generating an index from the full text of a document, or some combination of human and automatic indexing).

B. System support of searching

User can provide relevance feedback. The availability of any of a variety of methods for improving "a user's query by using documents that have been assessed relevant by the user" (Ruthven et al., 2003, p.529).

Natural language queries. Natural language queries: "Natural language query creation permits entry of a prose statement or question that describes the information the user wants to find" (Hahn, 1998, p.7-8).

Query expansion (automatic or with user input). "The process of supplementing [a] query with additional terms" for the purpose of improving retrieval performance (Efthimiadis, 1996, p.122).

Specification of a particular field in which to search. "The capability of limiting a search to a specific field" (Hahn, 1998, p.8), e.g., title, author, or descriptor.

Access to online thesaurus. Whether the user has access to the database's controlled vocabulary (descriptors) or other online indexes of particular fields (e.g., the author field) to support the development of a search strategy (Hsieh-Yee, 1993).

Word proximity operators. Proximity operators "allow two or more words to be searched for as a single unit or phrase" (Hahn, 1998, p.7), or in some other way "allow a user to restrict the distance allowed between two search terms within a record" (Hahn, 1998, p.7).

Boolean operators. Database operators that "enable set intersection, set union or set differences" (Hahn, 1998, p.7). If available, they are usually expressed, respectively, as AND, OR, and NOT.

Truncation. "The masking of characters in suffixes or prefixes" to allow "searching and retrieval on part of a word" (Hahn, 1998, p.7).

History of search strategy can be displayed. The search statements previously entered by the user can be displayed for review and/or re-execution.

Help facility is available. The quality and availability of "Help" facilities in a search system.

C. System support for display

Sorting of results. The capability for the user "to alter the order in which records are output" (Walker & Janes, 1993, p.123), e.g., to sort by author, by date, or by relevance.

Specific fields can be selected for display. The capability for the user to specify which database fields will be included in the display.

Display can be customized or personalized. The capability for the system to change for individual users or groups of users. Customization usually includes changes that are at the explicit request of the user (Jørgensen & Sauer, 1990). Personalization usually includes changes that are based on the system's record of past user behaviors (Kramer, Noronha, & Vergo, 2000).

Display form can be selected: printing, filing, downloading, e-mailing, bookmarking. The user may select the form/medium in which the display is received.

Ranking of results by relevance. Search results are sorted according to the criterion of relevance, where the results that the system thinks are best in terms of topic, task and context appear toward the top of result list. (Mizzaro, 1997)

III. The Person/User

A. Understanding/knowledge

Of the search topic/domain. “A body of knowledge (e.g., history or chemistry) composed of entities and relationships” (Marchionini, 1995, 45), or "factual knowledge of a topic" (Allen, 1991, 188).

Of search strategy development. The process of “matching understanding of the task with the system selected” (Marchionini, 1995, 53). The user maps strategies and tactics onto the rules and features provided by the system interface, so as to complete the search.

Of databases/resources available. Described by Taylor (1968) as knowledge of the "rules of the game," including "the organization, structure, associations, and specific peculiarities" of the availalbe information resources (p.186).

Of system/database commands. The interaction styles (e.g., command vs. direct manipulation) and functionality supported by the search system (Marchionini, 1995), including specific command names or abbreviations.

Of database structure. How information is organized and represented within the database (Marchionini, 1995).

Of information seeking skills, i.e., information literacy. Information seeking/searching skills can be broken down to three levels: affective skills, such as "a searcher's persistent attraction to learning the information searching process and striving to improve"; cognitive skills, such as "a searcher's abilities to develop effective plans and make valid decisions"; sensorimotor skills, such as "a searcher's acuity in visual identification and prowess in maneuvering in dynamic information environments". (Jakobovits; Nahl, 1990)

B. Psychological/personality characteristics

Motivation. One's drive to carry out an activity (Davis & Wiedenbeck, 2001).

Persistence. The ability and tendency to continue to pursue a search strategy (Wiberley, Daugherty, & Danowski, 1995).

Flexibility. “[T]he quality of being adaptable or variable” (Princeton WordNet 2.0).

Cognitive style. “[T]endencies displayed by individuals consistently to adopt a particular type of information processing strategy” (Ford et al., 2002, 728). Some cognitive styles that have been included in past studies are: global versus analytic styles, field dependence versus field independence, and holist versus serialist styles.

Resourcefulness. “[T]he quality of being able to cope with a difficult situation; the ability to deal resourcefully with unusual problems” (Princeton WordNet 2.0).

Self efficacy. "The belief that one has the capability to perform a particular behavior" (Compeau & Higgins, 1995, 189).

Need for cognition. An individual's tendency to engage in and enjoy effortful cognitive tasks (Cacioppo, Petty, Feinstein, & Jarvis, 1996).

C. Demographics

Experience with the internet. Nature and scope of users' interactions with the internet (Lazonder, Biemans, & Wopereis, 2000).

Experience with computers. Nature and scope of users' interactions with computers.

Educational level. The amount of schooling the person has completed.

Domain, field or discipline. The discipline or field in which the user works. Examples: civil engineering, investment banking.

Age. The period of time the person has lived.

Occupation/job title. The specialty or nature of work performed by the user. Examples: biological researcher, intelligence analyst, clerical worker, administrative assistant, student.

Sex. Either male or female.

Experience with searching. The nature and scope of a user's interactions with search systems, including library catalogs, databases (bibliographic, statistical, etc.), the Web and other online sources.

Native language. The language that a person has spoken from earliest childhood. (WorldNet Dictionary)

 

Works Cited

American Heritage Dictionary of the English Language. (2000). 4th edition. Boston: Houghton Mifflin.

Allen, B. (1991). Topic knowledge and online catalog search formulation. Library Quarterly, 61(2), 188-213.

Allen, B. L. (1996). Information Tasks: Toward a User-Centered Approach to Information Systems. San Diego: Academic Press.

Barry, C. (1994). User-defined relevance criteria: an exploratory study. Journal of the American Society for Information Science, 45(3), 149-159.

Bates, M. J. (1979). Information search tactics. Journal of the American Society for Information Science, 30(4), 205-214.

Bilal, D. (2002). Children’s use of the Yahooligans! Web search engine. III. Cognitive and physical behaviors on full self-generated search tasks. Journal of the American Society for Information Science and Technology, 53(13), 1170-1183.

Boyce, B.R., Meadow, C.T., & Kraft, D.H. (1994). Measurement in information science. San Diego: Academic Press

Bruce, H. (1998). User satisfaction with information seeking on the internet. Journal of the American Society for Information Science, 49(6), 541-556.

Cacioppo, J. T., Petty, R. E., Feinstein, J., & Jarvis, W. B. G. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Bulletin, 119, 197 - 253.

Compeau, D. R., & Higgins, C. A. (1995). Computer self-efficacy: development of a measure and initial test. MIS Quarterly, 19(2), 189-211.

Connaway, L. S., Budd, J. M., & Kochtanek, T. R. (1995). An investigation of the use of an online catalog: user characteristics and transaction log analysis. Library Resources & Technical Services, 39(2), 142-152.

Dalrymple, P. W. (1995). Bibliographic control, organization of information, and search strategies. In Bopp, R. E., & Smith, L. C. (eds.), Reference and Information Services: An Introduction. Englewood, CO: Libraries Unlimited, 55-83.

Davis, S., & Wiedenbeck, S. (2001). The mediating effects of intrinsic motivation, ease of use and usefulness perceptions on performance in first-time and subsequent computer users. Interacting with Computers, 13(5), 549-580.

Efthimiadis, E. (1996). Query expansion. Annual Review of Information Science and Technology, 31, 121-187.

Fenichel, C. H. (1981). Online searching: measures that discriminate among users with different types of experiences. Journal of the American Society for Information Science, 32(1), 23-32.

Fidel, R. (1985). Moves in online searching. Online Review, 9(1), 61-74.

Ford, N., Wilson, T. D., Foster, A., Ellis, D., & Spink, A. (2002). Information Seeking and Mediated Searching. Part 4. Cognitive Styles in Information Seeking. Journal of the American Society for Information Science and Technology, 53(9), 728 - 735.

Ghani, J. A., Supnick, R., & Rooney, P. (1991). The experience of flow in computer-mediated and in face-to-face groups. In Proceedings of the Twelfth International Conference on Information Systems (New York, December 16-18, 1991). New York: ACM Press, 229-237.

Hahn, T. B. (1998). Text retrieval online: historical perspective on Web search engines. Bulletin of the American Society for Information Science, 24(4), 7-10.

Holscher, C., & Strube, G. (2000). Web search behavior of Internet experts and newbies. Computer Networks, 33(1-6), 337-346.

Hsieh-yee, I. (1993). Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the American Society for Information Science, 44(3), 161-174.

Jakobovits, L. A., & Nahl-Jakobovits, D. (1990). Measuring Information Searching Competence. College & Research Libraries, 51(5), 448-62.

Jarvis, W. B. G., & Petty, R. E. (1996). The need to evaluate. Journal of Personality and Social Psychology, 70, 172 - 194.

Jørgensen, A. H., & Sauer, A. (1990). The personal touch: a study of users' customization practice. In Diaper, D., et al. (eds.), Human-Computer Interaction - INTERACT '90. Amsterdam: Elsevier, 561-565.

Kantor, P. B. (1987) Brief communication: A model for the stopping behavior of users of online systems. Journal of the American Society for Information Science, 38, 211-214

Kramer, J., Noronha, S., & Vergo, J. (2000). A user-centered design approach to personalization. Communications of the ACM, 43(8), 44-48.

Kuhlthau, C. C. (1993). Seeking Meaning: A Process Approach to Library and Information Services. Norwood, NJ: Ablex.

Lazonder, A. W., Biemans, H. J. A., & Wopereis, I. (2000). Differences between novice and experienced users in searching information on the World Wide Web. Journal of the American Society for Information Science, 51(6), 576-581.

Looker, E. D., & Thiessen, V. (2003). Beyond the digital divide in Canadian schools - From access to competency in the use of information technology. Social Science Computer Review, 21(4), 475-490.

Marchionini, G. (1995). Information seeking in electronic environments. Cambridge ; New York: Cambridge University Press.

Mizzaro, S.(1997). Relevance: The whole history. Journal of the American Society for Information Science, 48(9), 810-832.

Onwuegbuzie, A. J., & Jiao, Q. G. (1998). The relationship between library anxiety and learning styles among graduate students: Implications for library instruction. Library and Information Science Research, 20(3), 235-249.

Pirolli, P., & Card, S. (1999). Information foraging. Psychological Review, 106(4), 643-675.

Princeton Wordnet 2.0. (n.d.) Cognitive Science Laboratory, Princeton University. http://www.cogsci.princeton.edu/~wn/

Rosenfeld, L., & Morville, P. (1998). Information Architecture for the World Wide Web. Cambridge: O'Reilly.

Rothman, J. (1974). Index, indexer, indexing. In Kent, A., Lancour, H., & Daily, J. E. (eds.), Encyclopedia of Library and Information Science, Volume 11, Hornbook to Information. New York: Marcel Dekker, 286-299.

Ruthven, I., Lalmas, M., & van Rijsbergen, K. (2003). Incorporating user search behavior into relevance feedback. Journal of the American Society for Information Science & Technology, 54(6), 529-549.

Sandore, Beth (1990). Online searching: what measure satisfaction? Library and Information Science Research, 12, 33-54.

Saracevic, T., et al. (1988). A study of information seeking and Retrieving. I. Background and methodology. Journal of the American Society for Information Science, 39(3), 161-176.

Spink, Amanda. (1996) Multiple search sessions model of end-user behavior: an exploratory study. Journal of the American Society for Information Science, 47(8), 603-09.

Su, L. T. (1992). Evaluation measures for interactive information retrieval. Information Processing & Management, 28(4), 503-516.

Taylor, R. S. (1968). Question-negotiation and information seeking in libraries. College & Research Libraries, 29(3), 178-194.

Tenopir, C. (1999, Nov. 1). Human or automated, indexing is important. Library Journal, 124(18), 34, 38.

Vakkari, P. (1999). Task complexity, problem structure and information actions: integrating studies on information seeking and retrieval. Information Processing & Management, 35(6), 819-837.

Walker, G., & Janes, J. (1993). Online Retrieval: A Dialogue of Theory and Practice. Englewood, CO: Libraries Unlimited.

White, M. D., & Iivonen, M. Assessing level of difficulty in web search questions. Library Quarterly, 72(2), 205-233.

Wiberley, S. E., Daugherty, R. A., & Danowski, J. A. (1995). User persistence in displaying online catalog postings: LUIS. Library Resources and Technical Services, 39(3), 247 - 264.

Wildemuth, B. M. (2004). The effects of domain knowledge on search tactic formulation. Journal of the American Society for Information Science and Technology, 53(3), 246-258.

Wildemuth, B. M., & Moore, M. E. (1995). End-user search behaviors and their relationship to search effectiveness. Bulletin of the Medical Library Association, 83(3), 294-304.

WorldNet Dictionary. http://www.webster-dictionary.org/definition/native%20language

© Barbara M. Wildemuth & Carol L. Barry, 2004.
Created with the assistance of Abe Crystal and Lili Luo.
Last updated July 20, 2004.