No. It terminated before the end of the file. I'll look into it.

[QUOTE=wombatman;357744]Here's what I get running your command (limited to the end part, of course), Frmky:

[CODE]Mon Oct 28 12:20:16 2013 31.5M unique relns 1.59M duplicate relns (+0.05M, avg D/U ratio in block was 9.4%)
Found 31809992 unique, 1617420 duplicate (4.8% of total), and 181942 bad relations.
Largest dimension used: 147 of 800
Average dimension used: 97.1 of 800
Terminating program at Mon Oct 28 12:20:18 2013[/CODE]

Does that seem right to you?[/QUOTE]
Based on this report, you don't need [I]dim[/I] value (hash depth) to be above 150. (you may have run out of memory with dim=800.)

Could you retry with
[FONT="Courier New"]zcat rels.dat.gz | remdups4 [B][COLOR="DarkRed"]150[/COLOR][/B] -v > msieve.dat[/FONT]

Here's the result:

[CODE]Found 31809992 unique, 1617420 duplicate (4.8% of total), and 181942 bad relations.
Largest dimension used: 147 of 150
Average dimension used: 97.1 of 150
Terminating program at Mon Oct 28 13:31:32 2013[/CODE]

Just confirmed that the remdups binary works properly on an older, smaller relations file (17M or so relations). It found exactly the same number of duplicates that msieve did.

I got my relations to work with:
[CODE]remdups 600 GC_12_206.dat msieve.dat[/CODE]Copied the remdups.c from the link into the cross platform IDE "Code::Block" and pressed compile. "Code::Block" used "mingw32-gcc" with parameter "-march=core2" for compiling I believe, so it's 32bit unfortunately. "800" therefore gave me an out of memory message, but "600" worked just fine too. I attached the file, hope it runs for others too. Linear Algebra is now at 5.8% .

I tried Victor's exe and a rebuilt exe using both "-m64" and "-march=corei7". All of them end at the same point with the same number of dupes and unique relations.

31.8M unique relations out of 120M+ relations indeed seems incorrect.
Wombatman are you able to construct a matrix and proceed with the LA, or are you stuck at the relations filtering?

Stuck on the filtering as far as I can tell unless there's a way to skip that part.

Worked for me. Odd...

Uploading msieve.dat.gz now. Should be ready to download in a half hour or so.

Very strange. Maybe a Windows/Linux line ending issue or something? Don't know why it would pop up only now.

One doesn't simply [STRIKE]walk into Mordor[/STRIKE] debug Windows.

Ben & Victor:

Could I ask you to email me your NFS@Home results in future please? Somewhat more trouble for you but much more reliable and much less hassle for me than the alternatives. I thjnk I managed to scrape your factors from the NFS@Home site and the factordb can't be certain that I got all the details correct. Neither are the reports made particularly promptly.

Thanks!

The GCW web pages will be updated later today, all being well.

Paul