[QUOTE=Xyzzy;412654]Argument: With 'remdups4', if you have spare memory, use a silly high DIM value.
[/QUOTE]
Sure thing - it can work (except for [I][B]very [/B][/I]silly values ;-)

[QUOTE=chris2be8;412670]Is there a reason to use cat? [/QUOTE]
I use zcat. My usual command is
zcat downloaded.dat.gz | ./remdups4 5000 -v | gzip > unique.dat.gz

C179_139_61 Factored
 

[code]
prp77 factor: 19278688728973001029978745880633137900591347635095227151640124052070378170353
prp103 factor: 3898622746686035477416150726184408504546871018711873369978053453646167443129745119369687945141881572203
[/code]

C200_118_77 factors
 

C200_118_77
[code]prp57 factor: 471288736153998521542622677712183430204675950031435405821
prp143 factor: 80479440557596959564357885225091525208088355423126072895140230671368085212335657452106102688837257204553939780014899023133974107543069557229923[/code]7.32M matrix with Target_density=125, ~35h on 4 cores (i7 3770k), log attached.

C190_147_34
 

[CODE]prp83 factor: 78290132810376625886951564903796780005770126942806739136719163149275857832012707719
prp107 factor: 20573515731231061151650777908864157539172540969900081129120612355571765660814722959857286276988875141221447[/CODE]

We will do F1415 next.

F1405 done
 

[code]
Fri Oct 16 10:01:45 2015 p58 factor: 2760658868161752397151556084505052457146474924423164947541
Fri Oct 16 10:01:45 2015 p63 factor: 155916003251865463312050460882181765664475933822047142492769161
Fri Oct 16 10:01:45 2015 p115 factor: 3708806696759426498601784197838963030603968213288115313873091782112769996865115868199195740302996516019045694936701
[/code]

85 hours for 13.8M matrix with density 120 on eight threads Xeon E5-2650v2. Log attached.

The default target density is 70, so it's tuned for jobs without huge amounts of oversieving. I picked 70 because that's what the 1999 team settled on as the matrix density when factoring RSA512. It's a silly reason to choose the default. If sieving on one machine, for all but the largest problems the target density is whatever produces a matrix first, it's too expensive to do more sieving compared to the savings in linear algebra time.

Taking C222_124_67.

[QUOTE=Xyzzy;412829]We will do F1415 next.[/QUOTE]All of a sudden more relations are coming in for this. How will we know when it is done? It is not listed on the status page.

:mike:

F1415 is here ([URL]http://escatter11.fullerton.edu/nfs/crunching_e.php[/URL]) listed. I would wait until the "Est. Pending Rels" is below 1M.