simon-svn: agedu: simon

[Commits to Tartarus CVS repository.]

SVN root:       svn://svn.tartarus.org/sgt
Changes by:     simon
Revision:       8288
Date:           2008-11-07 19:44:27 +0000 (Fri, 07 Nov 2008)

Log message (16 lines):
With the new cut-down index, my previous upper-bound estimate on
index file size is now laughably inaccurate, and worse still it may
now prove to be the limiting factor on the size of index that can be
handled (if it causes address space to run out long before actual
memory is in danger). I've tried and failed to think of a way of
estimating the upper bound more accurately in the new circumstances,
so instead I'm giving up: instead of padding out the index file to
the maximum size that could possibly be needed, we extend it bit by
bit, re-mmapping as we go.

I've also retired --full, because I now realise it's utterly
unnecessary: the only thing it might have been useful for would have
been running queries based on a single file - and if we wanted to do
that, we could simply pick one entry out of the trie and not go to
the index at all. So full indexes are a thing of the past, and good
riddance.

Modified files:
U   agedu/TODO
U   agedu/agedu.but
U   agedu/agedu.c
U   agedu/index.c
U   agedu/index.h
U   agedu/trie.c
U   agedu/trie.h

Links:
http://svn.tartarus.org/sgt/?rev=8288&view=rev
http://svn.tartarus.org/sgt/agedu/TODO?rev=8288&r1=8287&r2=8288
http://svn.tartarus.org/sgt/agedu/agedu.but?rev=8288&r1=8287&r2=8288
http://svn.tartarus.org/sgt/agedu/agedu.c?rev=8288&r1=8287&r2=8288
http://svn.tartarus.org/sgt/agedu/index.c?rev=8288&r1=8287&r2=8288
http://svn.tartarus.org/sgt/agedu/index.h?rev=8288&r1=8287&r2=8288
http://svn.tartarus.org/sgt/agedu/trie.c?rev=8288&r1=8287&r2=8288
http://svn.tartarus.org/sgt/agedu/trie.h?rev=8288&r1=8287&r2=8288