[Xapian-discuss] Performance of remote database

[Rafael SDM Sierra]

On 11/7/06, Olly Betts <olly at survex.com> wrote:
>
> On Tue, Nov 07, 2006 at 06:27:28PM +0000, Rafael SDM Sierra wrote:
> > While I'm trying the remote database I found one problem: performance
> > While with local database I can insert "infinites" document per second,
> with
> > remote database the average is 5, and I'm using my own ip to test it,
> the
> > same machine, then I think:
> >
> > 1 - The problem is with my network
>
> Try using "127.0.0.1" as the IP address to ensure you're using the
> loopback interface.  That eliminates any effect from the network
> itself (though the TCP stack is still involved).


Yes, I will try it

> 2 - The problem is with the serializator of xapian
> > 3 - The problem is with the xapian-tcpsrv in some place
>
> It's quite possible that either of these are at fault - I've not
> done any profiling work in remote writing yet.
>
> Another thing to try is using xapian-progsrv instead of xapian-tcpsrv.
> That will still be serialising documents and using the same remote
> protocol, but across a pipe instead of a TCP socket.


I just need replace the program? insted start ./xapian-tcpsrv I need only
start the xapian-progsrv? Or need more something? Anyway I will try it too

If we can work out where the overhead is coming from, it'll be much
> easier to address it.
>
> > 4 - There are no problems, it's right
>
> It's inevitably going to be slower to add documents to a remote
> database, but 5 per second sounds much too slow to me, especially
> as it's nowhere near as slow for a local database.


Yeah, and with replace_document(docid, document) it goes to 1 per second oO"

ps.: The replace_document(term, document) no work (yet) becouse
"RemoteDatabase::do_open_post_list not implemented" ;)
-- 
SDM Underlinux
Garimpar.com
--
PEP-8
Só existem 3 tipos de pessoas no mundo, as que sabem contar, e as que não
sabem.
There are only 3 kinds of people in the world, who know count, and who don't
know