[Xapian-discuss] Ticket #342: Omega: Add option to avoid reindexing unchanged files

James Aylett james-xapian at tartarus.org
Tue May 26 22:58:59 BST 2009


On Fri, May 22, 2009 at 03:17:38PM +0100, Olly Betts wrote:

> > > And again, webservers don't check the inode for "If-Modified-Since"...
> > 
> > No, but many do for ETag (If-None-Match); it's the default in Apache I
> > believe. It's not a particularly *good* default, but that's another
> > issue entirely.
> 
> Interesting - I've never looked at the details of ETag, but had assumed
> it would be a checksum of the file.  But as you say, Apache defaults to
> using the inode, mtime, and size.

It's cheap, and works okay in simple situations. Causes havoc in
others, of course.

> I still think it's probably not good for us, as we'd need to store the
> inode for each document and this isn't useful for anything else (unlike
> the file size).

Yeah, I'm inclined to agree that it's the wrong route.

J

-- 
  James Aylett

  talktorex.co.uk - xapian.org - uncertaintydivision.org



More information about the Xapian-discuss mailing list