[Xapian-discuss] Indexing more than 15 billion documents

Ycrux ycrux at club-internet.fr
Sun Jun 17 11:18:32 BST 2007


Hi there!

My company has more than 15 billion of web documents.
We're archiving all the web (like Internet Archive).
Last spring, we used Lucene to have a full text search capability
but we faced a limit at 500 million documents.

We're now considering XAPIAN. Could anybody share experiences
in this kind of huge dataset?

cheers
Y.



More information about the Xapian-discuss mailing list