RMIT University
Browse

Fast phase querying with combined indexes

journal contribution
posted on 2024-10-31, 23:37 authored by Hugh Williams, Justin Zobel, D Bahle
Search engines need to evaluate queries extremely fast, a challenging task given the quantities of data being indexed. A significant proportion of the queries posed to search engines involve phrases. In this article we consider how phrase queries can be efficiently supported with low disk overheads. Our previous research has shown that phrase queries can be rapidly evaluated using nextword indexes, but these indexes are twice as large as conventional inverted files. Alternatively, special-purpose phrase indexes can be used, but it is not feasible to index all phrases. We propose combinations of nextword indexes and phrase indexes with inverted files as a solution to this problem. Our experiments show that combined use of a partial nextword, partial phrase, and conventional inverted index allows evaluation of phrase queries in a quarter the time required to evaluate such queries with an inverted file alone; the additional space overhead is only 26% of the size of the inverted file.

History

Journal

ACM Transactions on Information Systems

Volume

22

Issue

4

Start page

573

End page

594

Total pages

22

Publisher

Association for Computing Machinery

Place published

USA

Language

English

Copyright

© 2004 ACM

Former Identifier

2004001639

Esploro creation date

2020-06-22

Fedora creation date

2009-02-27

Usage metrics

    Scholarly Works

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC