[Xapian-discuss] Incremental indexing

[Sym Roe]

On Tue, Mar 20, 2012 at 6:01 AM, Marios Titas <redneb8888 at gmail.com> wrote:
> Hi all,
>
> I am trying to implement an Incremental indexing scheme. The problem
> is that usually the modified documents are large but the modifications
> are limited. Ideally, I would like to reindex only the modified parts
> of these documents. If I am not mistaken, xapian cannot do that. Are
> there any other approaches?

I don't know for sure, but I expect xapian is quite good at only
updating the updated parts of a document (in terms of what it writes
to disk).

> It would be nice if xapian supported something like the SQL "group
> by". If it did, then it would be possible to break large documents
> into several pieces which could be indexed independently. When
> querying, these pieces would be then combined again using some
> aggregate function similar to the SQL function sum.

Xapian::Enquire has set_collapse_key:
http://xapian.org/docs/apidoc/html/classXapian_1_1Enquire.html#117ee547f5908e952e2e72d5a986d3bb


-- 
E: sym.roe at talusdesign.co.uk
M: 07742079314
@symroe