[Snowball-discuss] evaluation of Snowball stemmers

Oleg Bartunov oleg at sai.msu.su
Fri Dec 10 22:35:34 GMT 2004


Here s a paper which compare several stemmers (including snowball) on
russian corpus.
http://company.yandex.ru/articles/iseg-las-vegas.html

My own experience is good.

 	Oleg
On Fri, 10 Dec 2004, Martin Porter wrote:

>
> Fred,
>
> Do you mean you got a 29%/56% average precision improvement when you
> switched stemming off? Anything is possible, but this does surprise me: I
> would have expected Russian, with its highly (and regularly) inflected
> vocabulary to do quite well under stemming.
>
> If you look at the paper at
>
> http://clef.isti.cnr.it/2004/working_notes/WorkingNotes2004/16.pdf
>
> (Mono- and Crosslingual Retrieval Experiments at the University of
> Hildesheim  - Ren? Hackl, Thomas Mandl and  Christa Womser-Hacker) the
> evidence, for Finnish, points the other way ("the snowball stemmer works
> very well"). Their Russian experiments were not unfortunately taken to
> conclusion, but I feel much more confidence myself in the snowball Russian
> stemmer than the snowball Finnish stemmer.
>
> On the other hand I have had verbal notice (which I did not entirely trust!)
> of the Finnish stemmer doing badly in some other tests.
>
> I should point out that although the version of the stemmer you picked up
> works for KOI-8, Snowball is designed to make switching to other character
> codes as easy as possible. See the notes at
>
> http://snowball.tartarus.org/codesets/guide.html
>
> Martin
>
>
>
>
>
>
> _______________________________________________
> Snowball-discuss mailing list
> Snowball-discuss at lists.tartarus.org
> http://lists.tartarus.org/mailman/listinfo/snowball-discuss
>

 	Regards,
 		Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg at sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83



More information about the Snowball-discuss mailing list