[Snowball-discuss] Minor bug in utf-8 handling

Martin Porter martin.porter at grapeshot.co.uk
Wed Feb 14 13:49:36 GMT 2007


Yes that's a bug. many thanks Olly. I think we've been fortunate to get
away with that one all this time.

On Tue, 2007-02-13 at 17:01 +0000, Olly Betts wrote:
> I think I've spotted a bug in the handling of 3 byte utf-8 sequences
> while reading the code.  Both get_utf8 and get_b_utf8 fetch the third
> byte with *p when they should use p[c].

. . . . .

> In current stemmers, this is probably harmless, as the characters in use
> in the languages snowball has stemmers for encode as one or two byte
> utf-8 sequences.
> 





More information about the Snowball-discuss mailing list