[Xapian-discuss] flush problem
jesper at krogh.cc
Sun Jan 20 19:46:38 GMT 2008
Michael A. Lewis wrote:
> I am having a problem with flushing a database. I am adding N records
> to the DB (which amounts to 1 - 2000). At then end of the run, I
> issue a flush() call. The problem is that the flush call never seems
> to do anything. Every 10000 additions to the database and the library
> performs a flush (which can take up to 3 hours on a 560,000 document
> database) as if my flush call was never performed.
Not that I have a solution, but I have a similar problem with my Xapian
database. (doccount 8millions) flushtime is fairly long (over 10 minutes
on a 16 SAS disk array for 1000 documents added) and monitoring vmstat
(and top) I can see that it neither saturates 1 cpu or anything near the
block input/output that the disk can deliver (uses around 5MB/s in
block/in and out), viewing "top" only around 8-12% IO wait.
All of above is measured when Xapian is "flushing".
Still running xapian 1.0.4 (with perl-bindings)
More information about the Xapian-discuss