[Snowball-discuss] Download tarball inconsistencies

Olly Betts olly at survex.com
Sun Sep 10 04:59:24 BST 2006


There are inconsistencies in which .sbl files are included in the
different downloads available.  Here's a list (the first number is the
file size):

1817 May 23  2005 snowball_all/algorithms/danish/stem-MS-DOS-Latin-I.sbl
1814 May 23  2005 snowball_all/algorithms/danish/stem.sbl
3085 Apr 12  2005 snowball_all/algorithms/dutch/stem-MS-DOS-Latin-I.sbl
3082 Apr 12  2005 snowball_all/algorithms/dutch/stem.sbl
4975 Jan  9  2006 snowball_all/algorithms/english/stem.sbl
5207 May 23  2005 snowball_all/algorithms/finnish/stem.sbl
6046 Apr 12  2005 snowball_all/algorithms/french/stem-MS-DOS-Latin-I.sbl
6043 Apr 12  2005 snowball_all/algorithms/french/stem.sbl
2491 May 23  2005 snowball_all/algorithms/german/stem-MS-DOS-Latin-I.sbl
2488 May 23  2005 snowball_all/algorithms/german/stem.sbl
2615 Apr 12  2005 snowball_all/algorithms/german2/stem.sbl
5295 Sep  4 15:06 snowball_all/algorithms/hungarian/stem.sbl
4899 Jun 16  2005 snowball_all/algorithms/italian/stem-MS-DOS-Latin-I.sbl
4896 Jun 15  2005 snowball_all/algorithms/italian/stem.sbl
5672 Apr 12  2005 snowball_all/algorithms/kraaij_pohlmann/stem.sbl
8195 Apr 12  2005 snowball_all/algorithms/lovins/stem.sbl
1530 May 23  2005 snowball_all/algorithms/norwegian/stem-MS-DOS-Latin-I.sbl
1541 May 24  2005 snowball_all/algorithms/norwegian/stem.sbl
2980 Apr 12  2005 snowball_all/algorithms/porter/stem.sbl
5612 Jun 16  2005 snowball_all/algorithms/portuguese/stem-MS-DOS-Latin-I.sbl
5609 Jun 15  2005 snowball_all/algorithms/portuguese/stem.sbl
5153 Sep  5 15:28 snowball_all/algorithms/romanian1/stem.sbl
4167 Sep  5 15:28 snowball_all/algorithms/romanian2/stem.sbl
6124 Sep  5 17:38 snowball_all/algorithms/russian/stem-KOI8-R.sbl
6017 May 23  2005 snowball_all/algorithms/russian/stem-Unicode.sbl
6124 May 23  2005 snowball_all/algorithms/russian/stem.sbl
5876 Jun 16  2005 snowball_all/algorithms/spanish/stem-MS-DOS-Latin-I.sbl
5873 Jun 15  2005 snowball_all/algorithms/spanish/stem.sbl
1500 May 23  2005 snowball_all/algorithms/swedish/stem-MS-DOS-Latin-I.sbl
1493 Aug  9  2005 snowball_all/algorithms/swedish/stem.sbl

1814 Sep  5 17:39 snowball_code/algorithms/danish/stem.sbl
3082 Sep  5 17:39 snowball_code/algorithms/dutch/stem.sbl
4975 Sep  5 17:39 snowball_code/algorithms/english/stem.sbl
5207 Sep  5 17:39 snowball_code/algorithms/finnish/stem.sbl
6043 Sep  5 17:39 snowball_code/algorithms/french/stem.sbl
2488 Sep  5 17:39 snowball_code/algorithms/german/stem.sbl
2615 Sep  5 17:39 snowball_code/algorithms/german2/stem.sbl
5295 Sep  5 17:39 snowball_code/algorithms/hungarian/stem.sbl
4896 Sep  5 17:39 snowball_code/algorithms/italian/stem.sbl
5672 Sep  5 17:39 snowball_code/algorithms/kraaij_pohlmann/stem.sbl
8195 Sep  5 17:39 snowball_code/algorithms/lovins/stem.sbl
1541 Sep  5 17:39 snowball_code/algorithms/norwegian/stem.sbl
2980 Sep  5 17:39 snowball_code/algorithms/porter/stem.sbl
5609 Sep  5 17:39 snowball_code/algorithms/portuguese/stem.sbl
5153 Sep  5 17:39 snowball_code/algorithms/romanian1/stem.sbl
4167 Sep  5 17:39 snowball_code/algorithms/romanian2/stem.sbl
6124 Sep  5 17:39 snowball_code/algorithms/russian/stem.sbl
5873 Sep  5 17:39 snowball_code/algorithms/spanish/stem.sbl
1493 Sep  5 17:39 snowball_code/algorithms/swedish/stem.sbl

1817 May 23  2005 snowball_web_and_code/algorithms/danish/stem-MS-DOS-Latin-I.sbl
1814 May 23  2005 snowball_web_and_code/algorithms/danish/stem.sbl
3085 Apr 12  2005 snowball_web_and_code/algorithms/dutch/stem-MS-DOS-Latin-I.sbl
3082 Apr 12  2005 snowball_web_and_code/algorithms/dutch/stem.sbl
4975 Jan  9  2006 snowball_web_and_code/algorithms/english/stem.sbl
5207 May 23  2005 snowball_web_and_code/algorithms/finnish/stem.sbl
6046 Apr 12  2005 snowball_web_and_code/algorithms/french/stem-MS-DOS-Latin-I.sbl
6043 Apr 12  2005 snowball_web_and_code/algorithms/french/stem.sbl
2491 May 23  2005 snowball_web_and_code/algorithms/german/stem-MS-DOS-Latin-I.sbl
2488 May 23  2005 snowball_web_and_code/algorithms/german/stem.sbl
2615 Apr 12  2005 snowball_web_and_code/algorithms/german2/stem.sbl
5295 Sep  4 15:06 snowball_web_and_code/algorithms/hungarian/stem.sbl
4899 Jun 16  2005 snowball_web_and_code/algorithms/italian/stem-MS-DOS-Latin-I.sbl
4896 Jun 15  2005 snowball_web_and_code/algorithms/italian/stem.sbl
5672 Apr 12  2005 snowball_web_and_code/algorithms/kraaij_pohlmann/stem.sbl
8195 Apr 12  2005 snowball_web_and_code/algorithms/lovins/stem.sbl
1530 May 23  2005 snowball_web_and_code/algorithms/norwegian/stem-MS-DOS-Latin-I.sbl
1541 May 24  2005 snowball_web_and_code/algorithms/norwegian/stem.sbl
2980 Apr 12  2005 snowball_web_and_code/algorithms/porter/stem.sbl
5612 Jun 16  2005 snowball_web_and_code/algorithms/portuguese/stem-MS-DOS-Latin-I.sbl
5609 Jun 15  2005 snowball_web_and_code/algorithms/portuguese/stem.sbl
5153 Sep  5 15:28 snowball_web_and_code/algorithms/romanian1/stem.sbl
4167 Sep  5 15:28 snowball_web_and_code/algorithms/romanian2/stem.sbl
6124 Sep  5 17:38 snowball_web_and_code/algorithms/russian/stem-KOI8-R.sbl
6017 May 23  2005 snowball_web_and_code/algorithms/russian/stem-Unicode.sbl
6124 May 23  2005 snowball_web_and_code/algorithms/russian/stem.sbl
5876 Jun 16  2005 snowball_web_and_code/algorithms/spanish/stem-MS-DOS-Latin-I.sbl
5873 Jun 15  2005 snowball_web_and_code/algorithms/spanish/stem.sbl
1500 May 23  2005 snowball_web_and_code/algorithms/swedish/stem-MS-DOS-Latin-I.sbl
1493 Aug  9  2005 snowball_web_and_code/algorithms/swedish/stem.sbl

I find it somewhat suprising that they don't contain exactly the same
set of .sbl files!

I'm also somewhat confused since when I look at CVS, I only see stem.sbl
in any language directory (and there are no directories for the romanian
stemmers).  So where are these other versions of the .sbl files coming
from?  And how are the new Romanian stemmers getting in there?

Cheers,
    Olly



More information about the Snowball-discuss mailing list