[Xapian-discuss] Compressed Btrees
Arjen van der Meijden
arjen at glas.its.tudelft.nl
Thu Dec 23 13:25:04 GMT 2004
I've taken some snapshots of our load-graphs and such. From december
14th I made it use compressed files.
The cpu-usage seems to have trended a bit up:
The disk-io (it are the "iops for read" not the bytes/sec orso) seems to
have trended a bit down:
But less clear than the load with has decreased as well:
Note that position_DB is not compressed, so anything that can decrease
that one in size will probably yield similar results as well.
Arjen van der Meijden wrote:
> It turns out that the position-table took much more than 3 hours to
> compress using the zlib-layer with minimal compression results. I don't
> know the exact times, but I killed it after it had run for 3:38u while
> it had only done 4.7G of the data. An earlier non-zlib run took a bit
> over 1:15u on the same machine with a similar load.
> So for the next runs I won't be compressing that table anymore. The
> termlist took only 3 minutes more orso to generate.
> Best regards,
More information about the Xapian-discuss