INEX

Initiative for the Evaluation of XML retrieval

Contact Persons:

• Prof. Dr.-Ing. Norbert Fuhr
• Dipl.-Inform. Norbert Gövert
• M.Sc. Saadia Malik
• Dr. rer. nat. Ingo Frommholz
• Mounia Lalmas
• Gabriella Kazai

Involved Persons:

• El Hassane Ouardi
• Michael Hesse

Sponsored by:

• DELOS Network of Excellence for Digital Libraries
• IEEE Computer Society

Participating Institutions:

• University of Duisburg, Information Systems Group
• Queen Mary University of London,Department of Computer Science

The widespread use of XML in digital libraries, product catalogues, scientific data repositories and across the Web prompted the development of appropriate searching and browsing methods for XML documents. This initiative provides an opportunity for participants to evaluate their retrieval methods using uniform scoring procedures and a forum for participating organisations to compare their results. As part of a large-scale effort to improve the efficiency of research in information retrieval and digital libraries, this project initiates an international, coordinated effort to promote evaluation procedures for content-based XML retrieval. Participating organisations contribute to the construction of a large testbed (test collection) of XML documents. The test collection (consisting of 12,000 XML documents with about 500 megabytes of data) provides participants a means for future comparative and quantitative experiments. For additional information about this project please refer to the home pages of the annual initiatives:

• INEX 2009 iTrack
• INEX 2008
• INEX 2007
• INEX 2006
• INEX 2005
• INEX 2004
• INEX 2003
• INEX 2002

Publications

Norbert Fuhr; Mounia Lalmas; Andrew Trotman; Jaap Kamps (eds.) (2008).

Focused access to XML documents: 6th International Workshop of the Initiative for the Evaluation of XML Retrieval (INEX 2007). Number in LNCS, Springer

Norbert Fuhr; Mounia Lalmas (2007).

Advances in XML retrieval: the INEX initiative. In: IWRIDL '06: Proceedings of the 2006 international workshop on Research issues in digital libraries. ACM, New York, NY, USA.

Norbert Fuhr; Mounia Lalmas; Andrew Trotman (eds.) (2007).

Comparative Evaluation of XML Information Retrieval Systems, 5th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2006. Number 4518 in LNCSSpringer, Heidelberg et al..

Norbert Fuhr; Mounia Lalmas; Saadia Malik; Gabriella Kazai (eds.) (2006).

Advances in XML Information Retrieval and Evaluation: Fourth Workshop of the INitiative for the Evaluation of XML Retrieval (INEX 2005), Dagstuhl 28-30 November 2005, Lecture Notes in Computer Science. 3977, Springer-Verlag GmbH

Birger Larsen; Saadia Malik; Anastasios Tombros (2006).

The Interactive Track at INEX 2005. In: Advances in XML Information Retrieval and Evaluation: Fourth Workshop of the Initiative for the Evaluation of XML Retrieval (INEX 2005)

Birger Larsen; Anastasios Tombros; Saadia Malik (2006).

Is XML retrieval meaningful to users? Searcher preferences for full documents vs. elements. In: SIGIR 2006

Saadia Malik; Claus-Peter Klas; Norbert Fuhr; Birger Larsen; Anastasios Tombros (2006).

Designing a User Interface for Interactive Retrieval of Structured Documents --- Lessons Learned from the INEX Interactive Track. In: Proc. European Conference on Digital Libraries

Norbert Fuhr; Mounia Lalmas; Saadia Malik; Zoltan Szlavik (eds.) (2005).

Advances in XML Information Retrieval: Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, Germany, December 6-8, 2004, Revised Selected Papers. 3493, Springer-Verlag GmbH

Norbert Fuhr; Mounia Lalmas; Saadia Malik; Gabriella Kazai (eds.) (2005).

INEX 2005 Workshop Pre-Proceedings. Schloss Dagstuhl, November 28-30, 2005.

Saadia Malik, Mounia Lalmas, Norbert Fuhr (2005).

Overview of INEX 2004. In INEX:05

Anastasios Tombros; Birger Larsen; Saadia Malik (2005).

The Interactive Track at INEX 2004. In INEX:05

Anastosios Tombros; Saadia Malik; Birger Larsen (2005).

Report on the INEX 2004 interactive track. SIGIR Forum 39(1)

Norbert Fuhr; Saadia Malik; Mounia Lalmas (2004).

Overview of the INitiative for the Evaluation of XML Retrieval (INEX) 2003. In INEX:04

N. Fuhr; M. Lalmas (2004).

Report on the INEX 2003 Workshop. SIGIR Forum 38(1)

Norbert Fuhr; Mounia Lalmas; Saadia Malik (eds.) (2004).

INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the Second INEX Workshop. Dagstuhl, Germany, December 15--17, 2003.

B. Larsen, A. Tombros; S. Malik (2004).

End Users in Context of XML Documents:Setting up an Interactive track in INEX. In: SIGIR 2004 IRiX Workshop

Norbert Gövert; Gabriella Kazai; Norbert Fuhr; Mounia Lalmas (2003).

Evaluating the effectiveness of content-oriented XML retrieval. Technical Report, University of Dortmund, Computer Science 6

Norbert Gövert; Gabriella Kazai (2003).

Overview of the INitiative for the Evaluation of XML retrieval (INEX) 2002. In INEX:03

Norbert Fuhr; Norbert Gövert; Gabriella Kazai; Mounia Lalmas (eds.) (2003).

INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the First INEX Workshop. Dagstuhl, Germany, December 8--11, 2002. , ERCIM Workshop ProceedingsERCIM, Sophia Antipolis, France.

Gabriella Kazai; Mounia Lalmas; Norbert Fuhr; Norbert Gövert (2003).

A report on the first year of the INitiative for the Evaluation of XML Retrieval (INEX 02). Journal of the American Society for Information Science and Technology 54

G. Kazai; N. G�vert; M. Lalmas; N. Fuhr (2003)

The INEX evaluation initiative.

Norbert Fuhr; Norbert Gövert; Gabriella Kazai; Mounia Lalmas (2002).

INEX: INitiative for the Evaluation of XML Retrieval. In SIGIR/XML:02

Talks

Norbert Fuhr (2004).

XML Information Retrieval - Achievements and Challenges. Talk at the Twente Data Mangement Workshop

Diploma, master and bachelor theses

Only in german!

Eyetrackergestützte Evaluierung eines interaktiven Suchsystems

Reserved master thesis

Visualization of XML search interaction

Finished diploma thesis

Effective support for query formulation and reformulation

Finished master thesis

Related projects

DELOS

A Network of Excellence on Digital Libraries (FP6)

CLASSIX

Classification and Intelligent Search on Information in XML

DAFFODIL

Distributed Agents for User-Friendly Access of Digital Libraries

HyREX

Hyper-media Retrieval Engine for XML

Notes

Due to copyright issues, only participating organisations will have access to the constructed test collection.