INLS 509:
Information Retrieval

Description: The field of information retrieval (IR) is concerned with the analysis, organization, storage, and retrieval of unstructured and semi-structured data. In this course, we will focus on mostly text. While IR systems are often associated with Web search engines (e.g., Google), IR applications also include digital library search, patent search, search for local businesses, and expert search, to name a few. Likewise, IR techniques (the underlying technology behind IR systems) are used to solve a wide range of problems, such as organizing documents into an ontology, recommending news stories to users, detecting spam, and predicting reading difficulty. This course will provide an overview of the theory, implementation, and evaluation of IR systems and IR techniques. In particular, we will explore how search engines work, how they "interpret" human language, what different users expect from them, how they are evaluated, why they sometimes fail, and how they might be improved in the future.
Prerequisites: There are no prerequisites for this course.
Expectations: Information retrieval is the study of computer-based solutions to a human problem. Thus, the first half of the course will be system-focused, while the second half will be user-focused. During the first half, you should expect to see some math (e.g., basic probability and statistics and some linear algebra). However, we will focus on the concepts rather than the details.

Students will have an opportunity to explore their interests with a open-ended literature review.

Time & Location: M, W 9:30-10:45 am, Manning 208
Instructor: Jaime Arguello (email, web)
Office Hours: T, Th 10:00-11:00 am, Manning 305
Required Textbook: Search Engines - Information Retrieval in Practice, W. B. Croft, D. Metzler, and T. Strohman. Cambridge University Press. 2009. Available at the bookstore.
Additional Resources: Foundations of Statistical Natural Language Processing. C. Manning and H Schutze. 1999.

Introduction to Information Retrieval. C. Manning, P. Raghavan and H. Schutze. 2008.
Other Readings: Selected papers and chapters from other books will sometimes be assigned for reading. These will be available online.
Course Policies: Laptops, Attendance, Participation, Collaboration, Plagiarism & Cheating, Late Policy
Grading: 30% homework (10% each)
15% midterm exam
15% final exam
30% literature review (5% proposal, 10% presentation, 15% paper)
10% participation
Grade Assignments: Letter grades will be assigned using the following scale: H 95-100%, P 80-94%, L 60-79%, and F 0-59%. All homework, exams, and the literature review will be graded on a curve.
Schedule: Subject to change! The required textbook (Croft, Metzler, and Strohman) is denoted as CMS below.
1 Wed. 1/8   Introduction to IR: The Big Picture  
2 Mon. 1/13   Course Overview: Roadmap and Expectations CMS Ch. 1
3 Wed. 1/15   Introduction To Ad-hoc Retrieval I CMS Ch. 2, 5.3.0-5.3.3, 7.1.0-7.1.1
4 Mon. 1/20 MLK Day (No class)    
5 Wed. 1/22   Introduction To Ad-hoc Retrieval II  
6 Mon. 1/27   Indexing and Query Processing  
7 Wed. 1/29   Statistical Properties of Text CMS Ch. 4.1-4.2
8 Mon. 2/3 HW1 Out Text Representation I CMS Ch. 4.3-4.7, MRS Ch. 2
9 Wed. 2/5   Text Representation II  
10 Mon. 2/10   Retrieval Models: Vector Space I CMS Ch. 7.0-7.1.2, Rasmussen '11
11 Wed. 2/12 HW1 Due Retrieval Models: Vector Space II  
12 Mon. 2/17 HW2 Out, Literature Review Proposal Due Retrieval Models: Query-likelihood I CMS Ch. 7.3
13 Wed. 2/19   Retrieval Models: Query-likelihood II  
14 Mon. 2/24   Document Priors  
15 Wed. 2/26   Evaluation Overview CMS Ch. 8
16 Mon. 3/3 HW2 Due, Midterm Review Midterm Review  
17 Wed. 3/5 Midterm Exam Midterm Exam  
18 Mon. 3/10 Spring Break (No Class)    
19 Wed. 3/12 Spring Break (No Class)    
20 Mon. 3/17   Test Collection-based Evaluation Robertson '08, Sanderson '10 (pgs. 248-298)
21 Wed. 3/19   Test Collection-based Evaluation  
22 Mon. 3/24 HW 3 Out Evaluation Metrics Hersh et al., '00, Turpin & Hersh '01, Sanderson '10 (pgs. 308-350)
23 Wed. 3/26   Evaluation Metrics (Continued)  
24 Mon. 3/31   Experimentation Smucker et al., '07, Cross-Validation, Parameter Tunning and Overfitting
25 Wed. 4/2   Experimentation (Continued)  
26 Mon. 4/7 HW 3 Due Search-log Analysis Joachims et al., '05
27 Wed. 4/9   Search-log Analysis (continued)  
28 Mon. 4/14   User Studies in Information Retrieval Kelly '09 Chapter 10 (pgs. 99-125), Golovchinsky et al., '13
29 Wed. 4/16   Student Presentations  
30 Mon. 4/21   Student Presentations  
31 Wed. 4/23   Student Presentations  
32 Fri. 4/25 Literature Review Due    
33 Tue. 4/29 Final Exam Review (optional)    
34 Fri. 5/2 Final Exam, Manning 208, 4-7pm Final Exam