Msieve v1.46 feedback - Page 4

Batalov · 2010-08-12, 21:27

Yeah, but what's the platform and the zlib version?

Also, there may be a mismatch between zlib.h and libz.so ...? Could you attempt to build zlib , copy zlib.h to msieve/trunk/include and libz.a to msieve/trunk/ and link as ./libz.a ? That's what I would do (and did, for test purposes).

jasonp · 2010-08-12, 22:09

My system runs Fedora Core 2 from ~2004, so it's entirely possible that my zlib version is too old.

Jeff: Yes, the extra speedup is due entirely to a small patch that Greg has been using on his local sources for a while now, basically you throw more memory at the filtering to reduce the number of clique removal passes. Adding a disk-based clique removal pass would be even better for extremely large problems, maybe half the filtering time goes into doing tons of clique removal passes now.

jrk · 2010-08-12, 22:30

Quote:

Originally Posted by jasonp

My system runs Fedora Core 2 from ~2004, so it's entirely possible that my zlib version is too old.

Whoa. And I thought my Fedora 10 system was getting old.

Batalov · 2010-08-12, 22:34

Well, as I've set up myself for this, I will check out how the really old -lz versions behave. 1.2.3 seems to be the version with the least amount of hassle.

In 1.2.5 extra defines are needed and some (probably insignificant for our use) sophistication in internal 64-bit functions gzseek, gztell, which we don't use. The library worked with >4Gb files in 1.2.3 (and before), but gzseek, gztell were probably broken.

I'll check what the popular distros have (ubuntu etc...) I run a SUSE 11.1, .2, .3, and SLES 11+ flavors. They all have >=1.2.3 installed forever.

jrk · 2010-08-12, 23:15

Quote:

Originally Posted by Batalov

I'll check what the popular distros have (ubuntu etc...) I run a SUSE 11.1, .2, .3, and SLES 11+ flavors. They all have >=1.2.3 installed forever.

Fedora versions from 7 to 13 (and possibly earlier) have zlib 1.2.3. Fedora 14 has has 1.2.5.

1.2.4 has known security problems.

em99010pepe · 2010-08-12, 23:36

Quote:

Originally Posted by jasonp

Carlos: as far as I know msieve.exe is an ordinary windows console application; I have no idea why an explorer window would be popping up, unless maybe the LA chews up a lot of memory and your system starts to misbehave because of that.

A windows explorer.exe service pops up not an explorer window. I have plenty of memory, 8 GB.

Batalov · 2010-08-13, 00:28

Quote:

Originally Posted by Batalov

Also, there may be a mismatch between zlib.h and libz.so ...? Could you attempt to build zlib , copy zlib.h to msieve/trunk/include and libz.a to msieve/trunk/ and link as ./libz.a ? That's what I would do (and did, for test purposes).

Correction:
wget http://zlib.net/zlib-1.2.5.tar.gz
# tar xfz, etc...
./configure ; make
...copy zlib.h and zconf.h to msieve/trunk/include
(otherwise an old incompatible zconf.h from older installation will break this build)

That all comes into play when one doesn't have root privileges to install systemwide. Otherwise, make install. Note: distros apparently don't care about 1.2.5 and keep propagating 1.2.3.

jasonp · 2010-08-13, 00:44

Quote:

Originally Posted by jrk

Whoa. And I thought my Fedora 10 system was getting old.

At any given time I work with two systems at home, an everyday one and a higher-performance one. The everyday one has been:

1996: Pentium 200 MMX
2002: Athlon 1GHz
2007: Core2Duo 1.86GHz

The high-performance one was:

1999: Alpha EV6 466MHz, 2GB RAM
2004: 2x2GHz Opteron, 6GB RAM

There hasn't been a replacement high-performance system because I've stopped doing large computations at home, plus it's futile to stay on the high-performance curve when expensive systems get replaced so rarely.

Batalov · 2010-08-13, 03:33

Quote:

Originally Posted by jrk

Fedora versions from 7 to 13 (and possibly earlier) have zlib 1.2.3. Fedora 14 has has 1.2.5.

1.2.4 has known security problems.

Thank you for Fedora data - that's the one I don't have.The other distros:

ubuntu: in package manager, install zlib1g-dev (and zlib1g?). It will be 1.2.3 (note: zlibc is another thing)
OpenSUSE: has zlib 1.2.3 (up to 11.3, no update to 1.2.5).
CygWin: has zlib 1.2.3 (or rerun setup.exe and add it -- in Devel::zlib-devel).

frmky · 2010-08-13, 04:01

The Lonestar and Abe clusters use version 1.2.1.2 dated September 9, 2004, and do not have gzdirect.

Batalov · 2010-08-13, 06:13

Your wish is my command - no gzdirect() anymore. Try it sometime later.

2010-08-13, 04:01	#43
frmky Jul 2003 So Cal 2·3⁴·13 Posts	The Lonestar and Abe clusters use version 1.2.1.2 dated September 9, 2004, and do not have gzdirect. Last fiddled with by frmky on 2010-08-13 at 04:02

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Msieve 1.53 feedback	xilman	Msieve	149	2018-11-12 06:37
Msieve 1.50 feedback	firejuggler	Msieve	99	2013-02-17 11:53
Msieve 1.43 feedback	Jeff Gilchrist	Msieve	47	2009-11-24 15:53
Msieve 1.42 feedback	Andi47	Msieve	167	2009-10-18 19:37
Msieve 1.41 Feedback	Batalov	Msieve	130	2009-06-09 16:01

2010-08-12, 21:27	#34
Batalov "Serge" Mar 2008 Phi(4,2^7658614+1)/2 10010100000101₂ Posts	Yeah, but what's the platform and the zlib version? Also, there may be a mismatch between zlib.h and libz.so ...? Could you attempt to build zlib , copy zlib.h to msieve/trunk/include and libz.a to msieve/trunk/ and link as ./libz.a ? That's what I would do (and did, for test purposes).

2010-08-12, 22:09	#35
jasonp Tribal Bullet Oct 2004 3,541 Posts	My system runs Fedora Core 2 from ~2004, so it's entirely possible that my zlib version is too old. Jeff: Yes, the extra speedup is due entirely to a small patch that Greg has been using on his local sources for a while now, basically you throw more memory at the filtering to reduce the number of clique removal passes. Adding a disk-based clique removal pass would be even better for extremely large problems, maybe half the filtering time goes into doing tons of clique removal passes now.

2010-08-12, 22:34	#37
Batalov "Serge" Mar 2008 Phi(4,2^7658614+1)/2 3⁶·13 Posts	Well, as I've set up myself for this, I will check out how the really old -lz versions behave. 1.2.3 seems to be the version with the least amount of hassle. In 1.2.5 extra defines are needed and some (probably insignificant for our use) sophistication in internal 64-bit functions gzseek, gztell, which we don't use. The library worked with >4Gb files in 1.2.3 (and before), but gzseek, gztell were probably broken. I'll check what the popular distros have (ubuntu etc...) I run a SUSE 11.1, .2, .3, and SLES 11+ flavors. They all have >=1.2.3 installed forever.

2010-08-13, 06:13	#44
Batalov "Serge" Mar 2008 Phi(4,2^7658614+1)/2 2505₁₆ Posts	Your wish is my command - no gzdirect() anymore. Try it sometime later.