ISTI@TREC microblog track 2011: Exploring the use of hashtag segmentation and text quality ranking

Giacomo Berardi, Andrea Esuli, Diego Marcheggiani, Fabrizio Sebastiani

Research output: Contribution to journalConference article

Abstract

In the first year of the TREC Micro Blog track, our participation has focused on building from scratch an IR system based on the Whoosh IR library. Though the design of our system (CipCipPy) is pretty standard it includes three ad-hoc solutions for the track: (i) a dedicated indexing function for hashtags that automatically recognizes the distinct words composing an hashtag, (ii) expansion of tweets based on the title of any referred Web page, and (iii) a tweet ranking function that ranks tweets in results by their content quality, which is compared against a reference corpus of Reuters news. In this preliminary paper we describe all the components of our system, and the efficacy scored by our runs. The CipCipPy system is available under a GPL license.

Original languageEnglish
JournalNIST Special Publication
Publication statusPublished - 1 Dec 2011
Event20th Text REtrieval Conference, TREC 2011 - Gaithersburg, MD, United States
Duration: 15 Nov 201118 Nov 2011

    Fingerprint

ASJC Scopus subject areas

  • Engineering(all)

Cite this