Retrieval for text stream by random projection

Abstract

In this investigation we discuss powerful yet efficient retrieval mechanism for text stream such as news stream. Difficulty comes from the fact how to manage incremental information while keeping efficiency. Recently random projection has been paid much attention on dynamic dimensionality reduction. Here we show this novel technique is really useful for querying text stream in terms of cost and accuracy. We examine some experimental results and excellent efficiency in computation and memory usage.