NCLT/CNGL Seminar, 25th Jan 2012: DCU@FIRE 2011: SMS-Based FAQ Retrieval

DCU@FIRE 2011: SMS-Based FAQ Retrieval

Speaker: Johannes Leveling
Date: Wednesday January 25th 2012
Time: 4pm
Location: L2.21, School of Computing, DCU

Abstract:
This presentation gives an overview of the DCU participation in the SMS-based FAQ Retrieval task at FIRE, the Forum for Information Retrieval Evaluation. The objective in the SMS-based FAQ retrieval task is to find answers in a collection of frequently asked questions (FAQ) given a SMS question in "text-speak".

DCU submitted experimental runs for the monolingual English subtask. The DCU approach to this problem consists of first transforming the noisy SMS queries into a normalised, corrected form. The normalised queries are then used to retrieve a ranked list of FAQ results by combining the results from three slightly different retrieval mechanisms. Finally, using information from the retrieval results,
out-of-domain (OOD) queries are identified and tagged.

The results of our best run on the final test set are the best among 13 participating groups. We retrieved results for 70% in-domain queries correctly, identified 85.6% out-of-domain queries correctly, and obtained an MMR score of 0.896.

View further details of the NCLT/CNGL Seminar Series 2011/2012