The Information Retrieval Series Volume 31 Series Editor W. Bruce Croft Editorial Board ChengXiang Zhai Maarten de Rijke Nicholas J. Belkin Charles Clarke
.
Efthimis Efthimiadis Juan M. Fernández-Luna Juan F. Huete Andrew MacFarlane Editors Teaching and Learning in Information Retrieval
Editors Efthimis Efthimiadis University of Washington PO Box 352840 Seattle, WA 98195-2840 USA efthimis@u.washington.edu Juan F. Huete Juan M. Fernández-Luna Universidad de Granada Departamento de Ciencias de la Computación einteligencia Artificial C/ Periodista Daniel Saucedo Aranda, s/n. 18071 Granada Spain jhg@decsai.ugr.es jmfluna@decsai.ugr.es Andrew MacFarlane City University London Department of Information Science Northampton Square London EC1V 0HB United Kingdom andym@soi.city.ac.uk ISSN 1387-5264 ISBN 978-3-642-22510-9 e-isbn 978-3-642-22511-6 DOI 10.1007/978-3-642-22511-6 Springer Heidelberg Dordrecht London New York Library of Congress Control Number: 2011938471 ACM Computing Classification (1998): H.3, K.3.2 # Springer-Verlag Berlin Heidelberg 2011 This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilm or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable to prosecution under the German Copyright Law. The use of general descriptive names, registered names, trademarks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com)
To Efthimis
.
Acknowledgements The editors are very grateful to Rachel Woodbrook for her hard working in assembling and formatting the book from the different submissions a very arduous task! Andrew MacFarlane would like to thank the committee of the Information Retrieval Specialist group of the BCS for their continued support in the area of Teaching and Learning in IR. Each chapter was reviewed by at least two referees looking at the subject matter, coverage, appropriateness and clarity of expression. We are very grateful for the referees for taking the time to produce thorough reviews for the chapters presented in this book. The referees were as follows: David Bawden, City University London, UK Suzanne Bell, University of Rochester, USA Daniel Blank, University of Bamberg, Germany Fidel Cacheda, University of A Coruña, Spain Fazli Can, Bilkent University, Turkey Pablo Castells, Autonomous University of Madrid, Spain Anne Diekema, Utah State University, USA Ayse Goker, City University London, UK Kai Halttunen, University of Tampere, Finland Dick Hartley, Manchester Metropolitan University, UK Frances Johnson, Manchester Metropolitan University, UK Diane Kelly, University of North Carolina, USA Donald Kraft, Louisiana State University, USA Monica Landoni, University of Lugano, Switzerland Ray Larson, University of California, Berkeley, USA Fotis Lazarinis, TEI of Mesolonghi, Greece Rafael López García, University of A Coruña, Spain Juan-Antonio Martínez-Comeche, University Complutense Madrid, Spain Xiannong Meng, Bucknell University, USA Stefano Mizzaro, University of Udine, Italy vii
viii Acknowledgements Uma Murthy, Virginia Tech, USA Pauline Rafferty, Abersystwyth University, UK Edie Rassmussen, University of British Columbia, Canada Ian Ruthven, University of Strathclyde, UK Mark Sanderson, RMIT University, Australia Anabela Serrano, ESEIG/Instituto Politécnico do Porto, Portugal Debora Shaw, Indiana University Bloomington, USA Jesús Tramullas, Universidad de Zaragoza, Spain Clare Thornley, University College Dublin, Ireland Jesús Vegas, Universidad de Valladolid, Spain José Luis Vicedo, University of Alicante, Spain Seungwon Yang, Virginia Tech, USA
Contents 1 Introduction to Teaching and Learning in Information Retrieval... 1 Efthimis N. Efthimiadis, Juan M. Fernández-Luna, Juan F. Huete, and Andrew MacFarlane 2 Fostering Student Engagement in an Online IR Course... 9 Suzanne Bell 3 Teaching IR: Curricular Considerations... 31 Daniel Blank, Norbert Fuhr, Andreas Henrich, Thomas Mandl, Thomas R olleke, Hinrich Sch utze, and Benno Stein 4 Pedagogical Enhancements for Information Retrieval Courses... 47 Edward Fox, Uma Murthy, Seungwon Yang, Ricardo da S. Torres, Javier Velasco-Martin, and Gary Marchionini 5 Pedagogical Design and Evaluation of Interactive Information Retrieval Learning Environment... 61 Kai Halttunen 6 Shifting Contexts: Relating the User, Search and System in Teaching IR... 75 Frances Johnson 7 A Technical Approach to Information Retrieval Pedagogy... 89 Rafael López-García and Fidel Cacheda 8 Using Multiple Choice Questions to Assist Learning for Information Retrieval... 107 Andrew MacFarlane 9 Information Retrieval Systems Evaluation: Learning and Teaching Process... 123 Juan-Antonio Martínez-Comeche and Fidel Cacheda ix
x Contents 10 Teaching Web Information Retrieval to Computer Science Students: Concrete Approach and Its Analysis... 137 Stefano Mizzaro 11 Is a Relevant Piece of Information a Valid One? Teaching Critical Evaluation of Online Information... 153 Josiane Mothe and Gilles Sahut 12 Training Students to Evaluate Search Engines... 169 Mark Sanderson and Amy Warner 13 Teaching Information Retrieval Through Problem-Based Learning... 183 Clare Thornley 14 Educational Resource Development for Information Retrieval in a Digital Libraries Context... 199 Seungwon Yang, Sanghee Oh, Barbara M. Wildemuth, Jeffrey P. Pomerantz, and Edward Fox Index... 213
Contributors Suzanne Bell University of Rochester, Rochester, NY, USA Daniel Blank University of Bamberg, Bamberg, Germany Fidel Cacheda University of A Coruña, A Coruña, Spain Juan-Antonio Martínez-Comeche University Complutense Madrid, Madrid, Spain Efthimis N. Efthimiadis University of Washington, PO Box 35284098195-2840 Seattle, WA, USA Juan M. Fernández-Luna Departamento de Ciencias de la Computación einteligencia Artificial C/ Periodista Daniel Saucedo, Universidad de Granada, Aranda, s/n. 18071, Granada, Spain Edward Fox Virginia Tech, Blacksburg, VA, USA Norbert Fuhr University of Duisburg-Essen, Duisburg-Essen, Germany Rafael López García University of A Coruña, A Coruña, Spain Kai Halttunen University of Tampere, Tampere, Finland Andreas Henrich University of Bamberg, Bamberg, Germany Juan F. Huete Departamento de Ciencias de la Computación einteligencia Artificial C/ Periodista Daniel Saucedo, Universidad de Granada, Aranda, s/n. 18071, Granada, Spain Frances Johnson Manchester Metropolitan University, Manchester, UK xi
xii Contributors Andrew MacFarlane City University London, London, UK Thomas Mandl University of Hildesheim, Hildesheim, Germany Gary Marchionini University of North Carolina-Chapel Hill, Chapel Hill, NC, USA Stefano Mizzaro University of Udine, Udine, Italy Josiane Mothe Université de Toulouse/IRIT, Toulouse, France Uma Murthy Virginia Tech, Blacksburg, VA, USA Sanghee Oh University of North Carolina-Chapel Hill, Chapel Hill, NC, USA Jeffrey P. Pomerantz University of North Carolina-Chapel Hill, Chapel Hill, NC, USA Thomas Rolleke Queen Mary University of London, London, UK Gilles Sahut Institut Universitaire de Formation des Maîtres, Ecole Interne de l Université de Toulouse le Mirail, Université de Toulouse, CNRS-UMR5505, Cedex 9, France Mark Sanderson RMIT University, Melbourne, VIC, Australia Hinrich Sch utze University of Stuttgart, Stuttgart, Germany Benno Stein Bauhaus-Universitat Weimar, Weimar, Germany Clare Thornley University College Dublin, Dublin, Ireland Ricardo da S. Torres University of Campinas, Campinas, Sao paulo, Brazil Javier Velasco-Martin University of North Carolina-Chapel Hill, Chapel Hill, NC, USA Amy Warner The National Archives, London, UK Barbara M. Wildemuth University of North Carolina-Chapel Hill, Chapel Hill, NC, USA Seungwon Yang Virginia Tech, Blacksburg, VA, USA
About the Editors Efthimis N. Efthimiadis obtained his PhD in Information Science from City University London in 1992. His research focused on the design of front-end interfaces that improve access to databases, and on the evaluation of information retrieval systems. Further interests included the application of probabilistic techniques to information retrieval and in methods that incorporate user preferences and user interaction in the retrieval techniques. Efthimiadis research in the area of query expansion was concerned with the evaluation of ranking algorithms and the study of the searching behaviour of end users. Prof. Efthimiadis taught courses on the principles of information retrieval, database design, online search techniques, Internet access, introduction to information science, business information and medical informatics. Juan M. Fernández-Luna obtained his Computer Science degree in 1994 from the University of Granada, Spain. In 2001, he got his PhD from the same institution, working on a thesis in which several retrieval models based on Bayesian networks for Information Retrieval were designed. Currently, his main research area is XML retrieval, although he is also working in collaboration with Juan F. Huete in collaborative IR, recommender systems, learning to rank and heterogeneous data source integration. He has experience in organizing international conferences and workshops, e.g., I and II International Workshops on Teaching and Learning of Information Retrieval. He has been a co-editor of several journal special issues, highlighting the special Information Retrieval issue on Teaching and Learning of Information Retrieval. He also belongs to the programme committee of the main IR conferences. Juan F. Huete is an assistant professor at the Department of Computer Science and Artificial Intelligence at the University of Granada. He got his Ph.D. in 1995, researching on the uncertainty treatment in Artificial Intelligence under the formalism of Bayesian networks. From 1998, his research interest is Information Retrieval, designing retrieval models based on these graphical models. He is also currently working in the Recommender System field, although other fields like collaborative IR or learning to rank. He has been a co-editor of a special xiii
xiv About the Editors Information and Processing Management issue on Bayesian Networks and Information Retrieval. He has co-organized several international conferences, as well as workshops. Among these last types of events, the following three could be highlighted: I and II International Workshop on Teaching and Learning of Information Retrieval and the SIGIR 07 Workshop on Information Retrieval and Graphical Models. Andrew MacFarlane is a senior lecturer in the Department of Information Science at City University, and currently co-directs the Centre of Interactive Systems Research with Prof. Stephen Robertson of Microsoft Research Cambridge. He got his PhD Information Science from the same department under the supervision of Prof. Robertson and Dr. J.A. McCann (now at Imperial College London) in 2000. His research interests currently focus on a number of areas including parallel computing for information retrieval, disabilities and Information Retrieval (dyslexia in particular), AI techniques for Information Retrieval and Filtering, and Open Source Software Development. He is the Chair of the BCS Information Retrieval Specialist Group and is a long standing member of that SG.
Efthimis Efthimiadis: An Appreciation Efthimis Efthimiadis passed away on Thursday, 28 April 2011 at the age of 54 after a courageous battle with pancreatic cancer. Efthi was born in Athens, Greece, and received a Bachelor of Arts degree in Economics from the University of Athens and Master and Doctoral degrees from City University, London. In London, he met and married the love of his life, Jagoda. Efthi went to the USA to teach at UCLA and he and Jagoda lived in Los Angeles where their son Nicholas was born, before moving to Seattle to work for the University of Washington. Efthi was a professor in the Information Science School at the University of Washington for 14 years. Efthi is remembered by his colleagues for his intellectual curiosity and enthusiasm for research, as well as his kindness, sense of humour and infectious smile. Efthi was an active person and he loved to travel and spend time with his family. Efthi is survived by Jagoda, his son Nicholas, and his mother Veta and brother Agapios, both of Athens, Greece. Efthi s family and friends will remember Efthi for his courage, his joy in life, and his selfless commitment and loyalty to those he loved. Andy, Juan and Juanma pay tribute to Efthi s drive and enthusiasm without which it would have been very difficult to produce this book. We dedicate it to his memory. xv
.