[Xapian-discuss] Incremental indexing

[Olly Betts]

On Tue, Mar 20, 2012 at 09:41:31AM +0000, Sym Roe wrote:
> On Tue, Mar 20, 2012 at 6:01 AM, Marios Titas <redneb8888 at gmail.com> wrote:
> > I am trying to implement an Incremental indexing scheme. The problem
> > is that usually the modified documents are large but the modifications
> > are limited. Ideally, I would like to reindex only the modified parts
> > of these documents. If I am not mistaken, xapian cannot do that. Are
> > there any other approaches?
> 
> I don't know for sure, but I expect xapian is quite good at only
> updating the updated parts of a document (in terms of what it writes
> to disk).

Yes it does pretty well, assuming you're using Xapian 1.2 or later
1.0.x.  This change made a huge difference to the speed of adding and
removing tags from indexed email in notmuch.

Cheers,
    Olly