[Xapian-discuss] Long query times

[tech at dbx.co.uk]

Eureka! It's the sorting that does it -shows how it helps to talk to people
even if it only gets me thinking. All I need to do now is work out how to
get around the sorting, maybe I'll try doing it myself after I've got the
results.

Here's the 'ls -l' anyway.

 ls -l xapian_dirs
total 6363884
-rw-r--r--    1 jeremy   staff          10 Sep 28 10:45 meta
-rw-r--r--    1 jeremy   staff           0 Sep 28 10:45 position_DB
-rw-r--r--    1 jeremy   staff          14 Sep 28 22:09 position_baseA
-rw-r--r--    1 jeremy   staff          14 Sep 28 22:12 position_baseB
-rw-r--r--    1 jeremy   staff    2959417344 Sep 28 22:12 postlist_DB
-rw-r--r--    1 jeremy   staff       45178 Sep 28 22:09 postlist_baseA
-rw-r--r--    1 jeremy   staff       45178 Sep 28 22:12 postlist_baseB
-rw-r--r--    1 jeremy   staff    28377088 Sep 28 22:12 record_DB
-rw-r--r--    1 jeremy   staff         450 Sep 28 22:09 record_baseA
-rw-r--r--    1 jeremy   staff         428 Sep 28 22:12 record_baseB
-rw-r--r--    1 jeremy   staff    3469115392 Sep 28 22:12 termlist_DB
-rw-r--r--    1 jeremy   staff       52955 Sep 28 22:09 termlist_baseA
-rw-r--r--    1 jeremy   staff       52955 Sep 28 22:12 termlist_baseB
-rw-r--r--    1 jeremy   staff    53084160 Sep 28 22:12 value_DB
-rw-r--r--    1 jeremy   staff         827 Sep 28 22:09 value_baseA
-rw-r--r--    1 jeremy   staff         827 Sep 28 22:12 value_baseB


Original Message:
-----------------
From: Olly Betts olly at survex.com
Date: Thu, 29 Sep 2005 16:49:23 +0100
To: xapian-discuss at lists.xapian.org, tech at dbx.co.uk
Subject: Re: [Xapian-discuss] Long query times


On Thu, Sep 29, 2005 at 04:36:37PM +0100, James Aylett wrote:
> On Thu, Sep 29, 2005 at 04:32:51PM +0100, Olly Betts wrote:
> > The database size sounds rather large for 800K documents.  Can you post
> > an ls -l of the database directory to give us an idea which tables are
> > large?
> 
> I'm guessing record. That's very much a finger in the air approach
> though :-)

A large record table shouldn't matter though - we'll only be reading the
record table entries needed to show the search results, which is usually
10 or so.  Unless Jeremy's code is reading the document data for all
the matching documents...

Cheers,
    Olly


--------------------------------------------------------------------
mail2web - Check your email from the web at
http://mail2web.com/ .