[Snowball-discuss] More patches

Olly Betts olly at survex.com
Fri Feb 16 13:17:27 GMT 2007


On Fri, Feb 16, 2007 at 01:02:25PM +0000, Martin Porter wrote:
> As the stemmers stand, upper case can be used as a way of bypassing
> stemming.

That doesn't work in general though - for example, the english stemmer
converts "Yay" to "yay" and "HAPPY" to "HAPPi".  The same issue affects
several of the other stemmers too.

If using upper case to bypass stemming is intended to work, the stemmers
really need to change characters to others which aren't going to occur
in incoming terms.  There aren't any characters which can't, but control
characters are in general very unlikely to occur I guess.

Cheers,
    Olly



More information about the Snowball-discuss mailing list