Running Msieve - Page 6

Andi47 · 2007-05-17, 19:30

Quote:

Originally Posted by Andi47

Can you please upload a 1.21b containing this fix for windows users?

I have just startet another "race": a c101 with GNFS and a c102 with SIQS, both started within 5 minutes on my Core 2 Duo Laptop. (http://www.mersenneforum.org/showpos...50&postcount=9)

jasonp · 2007-05-17, 20:45

Quote:

Originally Posted by Andi47

I have just startet another "race": a c101 with GNFS and a c102 with SIQS, both started within 5 minutes on my Core 2 Duo Laptop.

The C101 will take about 12 hours, the C102 will probably take 80-90 hours. It's much faster to just ask me :)

Andi47 · 2007-05-18, 04:41

Quote:

Originally Posted by jasonp

The C101 will take about 12 hours, the C102 will probably take 80-90 hours. It's much faster to just ask me :)

after 9:40 hours with msieve 1.21 on my Core 2 Duo @ 2 GHz:

c101 (with GNFS): found 653314 relations, need 3723754 (17.5 %)

c102 (with QS): found 29143 relations, need 112596 (25.8 %)

So I guess, the c102 will win the race.

P.S.: Could you please upload a version for windows users which contains the fix you mentioned in Post #116

smh · 2007-05-18, 06:30

Quote:

Originally Posted by jasonp

The C101 will take about 12 hours, the C102 will probably take 80-90 hours. It's much faster to just ask me :)

I guess you meant the c101 taking 80-90 hours and the c102 12 hours?

smh · 2007-05-18, 07:02

Quote:

Originally Posted by jasonp

Good to hear. Could you PM me the logfile? If msieve did not do any sieving then changing S[RA]TFBITS shouldn't have had any effect. I would expect to have to lower S[RA]LPMAX though.

Call me stupid, but i didn't see a way to attach a file in a PM.

Quote:

Originally Posted by jasonp

I'm most of the way through adding multithread support to the linear algebra, at least the basic kind. Depending on how smoothly it goes, I'll try to push out the next release tomorrow morning.

I'll keep the relations and will try again with the new version on a dual core cpu.

jasonp · 2007-05-18, 14:14

Quote:

Originally Posted by Andi47

P.S.: Could you please upload a version for windows users which contains the fix you mentioned in Post #116

Now available here. This is compiled from my latest develpment sources, and includes the bug fix plus code for multithreaded linear algebra. For the latter, run with '-t <number_of_threads>'. Note that I've only tested the multithreading on a single matrix, and I'm not convinced it worked. For a matrix of size 1.1M, using two threads on a core2duo looks to be about 20% faster, probably because one thread already soaks up most of the bandwidth available to the processor. Without the -t option no threads get spawned at all, so the binary should still work as before if you don't want to play on the bleeding edge.

@smh: yes, I meant that GNFS is still 8-10x slower than QS at the moment. I've seen enough NFS postprocessing bugs so far that tracking them down is going to take more time than I thought.

Andi47 · 2007-05-18, 14:30

Quote:

Originally Posted by jasonp

Now available here. This is compiled from my latest develpment sources, and includes the bug fix plus code for multithreaded linear algebra. For the latter, run with '-t <number_of_threads>'. Note that I've only tested the multithreading on a single matrix, and I'm not convinced it worked. For a matrix of size 1.1M, using two threads on a core2duo looks to be about 20% faster, probably because one thread already soaks up most of the bandwidth available to the processor. Without the -t option no threads get spawned at all, so the binary should still work as before if you don't want to play on the bleeding edge.

Thanks.

I will try without -t first, but maybe I will grab another c10x and try with the -t option next week.

P.S.: If I would let 1.21 finish the current run (or I finish it with 1.22alpha), would the relations be kept so that I can do a second (test-) run with the -t2 option?

jasonp · 2007-05-18, 14:40

Quote:

Originally Posted by Andi47

P.S.: If I would let 1.21 finish the current run (or I finish it with 1.22alpha), would the relations be kept so that I can do a second (test-) run with the -t2 option?

Yes, I'd recommend completing the run, then rerunning just the linear algebra and square root with two threads (via '-t 2 -nc2 -nc3')

smh · 2007-05-18, 18:32

Quote:

Originally Posted by jasonp

Now available here. This is compiled from my latest develpment sources, and includes the bug fix plus code for multithreaded linear algebra. For the latter, run with '-t <number_of_threads>'. Note that I've only tested the multithreading on a single matrix, and I'm not convinced it worked. For a matrix of size 1.1M, using two threads on a core2duo looks to be about 20% faster, probably because one thread already soaks up most of the bandwidth available to the processor.

I did the postprocessing with the same dataset (from GGNFS) on the same hardware:

msieve -v -nc

Thu May 17 12:32:29 2007 Msieve v. 1.21
Thu May 17 12:35:10 2007 commencing linear algebra
Thu May 17 12:54:29 2007 commencing square root phase

19:19

msieve -v -t 2 -nc

Fri May 18 19:28:50 2007 Msieve v. 1.22
Fri May 18 19:31:31 2007 commencing linear algebra
Fri May 18 19:46:28 2007 commencing square root phase

14:57

Andi47 · 2007-05-18, 19:05

Quote:

Originally Posted by smh

I guess you meant the c101 taking 80-90 hours and the c102 12 hours?

the c102 took approx. 17 cpu-hours on my core 2 duo laptop @ 2 GHz.

c101 still running, found approx. 1M relations, need 3.7M

JHansen · 2007-05-21, 10:20

Relations collected with Franke's siever, rest handled by msieve122alpha. Max mem usage was 418MB, memory usage during squareroot was around 200-240MB.

Code:

Mon May 21 10:23:34 2007  
Mon May 21 10:23:34 2007  
Mon May 21 10:23:34 2007  Msieve v. 1.22
Mon May 21 10:23:34 2007  random seeds: 793540ac a66d8668
Mon May 21 10:23:34 2007  factoring 419623832897771350700010781466963547592960694394751245814861806724281650265191070069221647901484064031010752997237754619 (120 digits)
Mon May 21 10:23:34 2007  commencing number field sieve (120-digit input)
Mon May 21 10:23:34 2007  R0: -143733799094117939873204
Mon May 21 10:23:34 2007  R1:  1571675241229
Mon May 21 10:23:34 2007  A0: -13301770869023917069542383757
Mon May 21 10:23:34 2007  A1: -3354843473866079084112555
Mon May 21 10:23:34 2007  A2: -86225108642303173709
Mon May 21 10:23:34 2007  A3:  180020813747795
Mon May 21 10:23:34 2007  A4:  13713426042
Mon May 21 10:23:34 2007  A5:  6840
Mon May 21 10:23:34 2007  size score = 2.310744e-012, Murphy alpha = -5.755155, combined = 1.573605e-011
Mon May 21 10:24:38 2007  restarting with 11439640 relations
Mon May 21 10:24:38 2007  
Mon May 21 10:24:38 2007  commencing relation filtering
Mon May 21 10:24:38 2007  commencing duplicate removal, pass 1
Mon May 21 10:25:00 2007  error -8 reading relation 1953368
Mon May 21 10:25:19 2007  error -14 reading relation 3649203
Mon May 21 10:25:34 2007  error -1 reading relation 5007053
Mon May 21 10:25:49 2007  error -14 reading relation 6285657
Mon May 21 10:26:47 2007  found 2336237 hash collisions in 11439636 relations
Mon May 21 10:26:47 2007  commencing duplicate removal, pass 2
Mon May 21 10:27:20 2007  found 2177677 duplicates and 9261959 unique relations
Mon May 21 10:27:20 2007  memory use: 65.3 MB
Mon May 21 10:27:23 2007  ignoring smallest 338783 rational and 338444 algebraic ideals
Mon May 21 10:27:23 2007  filtering rational ideals above 4851242
Mon May 21 10:27:23 2007  filtering algebraic ideals above 4851242
Mon May 21 10:27:23 2007  need 1151285 more relations than ideals
Mon May 21 10:27:23 2007  commencing singleton removal, pass 1
Mon May 21 10:29:13 2007  relations with 0 large ideals: 91070
Mon May 21 10:29:13 2007  relations with 1 large ideals: 725678
Mon May 21 10:29:13 2007  relations with 2 large ideals: 2235162
Mon May 21 10:29:13 2007  relations with 3 large ideals: 3288920
Mon May 21 10:29:13 2007  relations with 4 large ideals: 2319517
Mon May 21 10:29:13 2007  relations with 5 large ideals: 601612
Mon May 21 10:29:13 2007  relations with 6 large ideals: 0
Mon May 21 10:29:13 2007  relations with 7+ large ideals: 0
Mon May 21 10:29:13 2007  9261959 relations and about 8108366 large ideals
Mon May 21 10:29:13 2007  commencing singleton removal, pass 2
Mon May 21 10:31:06 2007  found 3638953 singletons
Mon May 21 10:31:06 2007  current dataset: 5623006 relations and about 3984646 large ideals
Mon May 21 10:31:06 2007  commencing singleton removal, pass 3
Mon May 21 10:32:19 2007  found 556127 singletons
Mon May 21 10:32:19 2007  current dataset: 5066879 relations and about 3409173 large ideals
Mon May 21 10:32:19 2007  commencing singleton removal, pass 4
Mon May 21 10:33:27 2007  found 107259 singletons
Mon May 21 10:33:27 2007  current dataset: 4959620 relations and about 3301026 large ideals
Mon May 21 10:33:27 2007  commencing singleton removal, pass 5
Mon May 21 10:34:34 2007  found 20725 singletons
Mon May 21 10:34:34 2007  current dataset: 4938895 relations and about 3280271 large ideals
Mon May 21 10:34:34 2007  commencing singleton removal, final pass
Mon May 21 10:35:43 2007  memory use: 176.8 MB
Mon May 21 10:35:43 2007  commencing in-memory singleton removal
Mon May 21 10:35:43 2007  begin with 4938895 relations and 3461211 unique ideals
Mon May 21 10:35:48 2007  reduce to 4628274 relations and 3147113 ideals in 9 passes
Mon May 21 10:35:48 2007  max relations containing the same ideal: 36
Mon May 21 10:35:50 2007  removing 736159 relations and 571221 ideals in 164938 cliques
Mon May 21 10:35:51 2007  commencing in-memory singleton removal
Mon May 21 10:35:51 2007  begin with 3892115 relations and 3147113 unique ideals
Mon May 21 10:35:54 2007  reduce to 3842675 relations and 2524654 ideals in 7 passes
Mon May 21 10:35:54 2007  max relations containing the same ideal: 31
Mon May 21 10:35:56 2007  removing 558803 relations and 393865 ideals in 164938 cliques
Mon May 21 10:35:56 2007  commencing in-memory singleton removal
Mon May 21 10:35:56 2007  begin with 3283872 relations and 2524654 unique ideals
Mon May 21 10:35:58 2007  reduce to 3244606 relations and 2090017 ideals in 6 passes
Mon May 21 10:35:58 2007  max relations containing the same ideal: 28
Mon May 21 10:36:00 2007  removing 19018 relations and 15715 ideals in 3303 cliques
Mon May 21 10:36:00 2007  commencing in-memory singleton removal
Mon May 21 10:36:00 2007  begin with 3225588 relations and 2090017 unique ideals
Mon May 21 10:36:01 2007  reduce to 3225545 relations and 2074259 ideals in 3 passes
Mon May 21 10:36:01 2007  max relations containing the same ideal: 28
Mon May 21 10:36:02 2007  dataset has 70.0% excess relations
Mon May 21 10:36:05 2007  ignoring smallest 307120 rational and 306977 algebraic ideals
Mon May 21 10:36:05 2007  filtering rational ideals above 4366117
Mon May 21 10:36:05 2007  filtering algebraic ideals above 4366117
Mon May 21 10:36:05 2007  need 1036157 more relations than ideals
Mon May 21 10:36:05 2007  commencing singleton removal, final pass
Mon May 21 10:36:53 2007  memory use: 116.0 MB
Mon May 21 10:36:53 2007  commencing in-memory singleton removal
Mon May 21 10:36:53 2007  begin with 3225545 relations and 2137146 unique ideals
Mon May 21 10:36:55 2007  reduce to 3223702 relations and 2135303 ideals in 5 passes
Mon May 21 10:36:55 2007  max relations containing the same ideal: 28
Mon May 21 10:36:56 2007  removing 105890 relations and 79769 ideals in 26121 cliques
Mon May 21 10:36:56 2007  commencing in-memory singleton removal
Mon May 21 10:36:56 2007  begin with 3117812 relations and 2135303 unique ideals
Mon May 21 10:36:57 2007  reduce to 3116174 relations and 2053883 ideals in 4 passes
Mon May 21 10:36:57 2007  max relations containing the same ideal: 27
Mon May 21 10:36:59 2007  removing 93113 relations and 66992 ideals in 26121 cliques
Mon May 21 10:36:59 2007  commencing in-memory singleton removal
Mon May 21 10:36:59 2007  begin with 3023061 relations and 2053883 unique ideals
Mon May 21 10:37:00 2007  reduce to 3021572 relations and 1985388 ideals in 4 passes
Mon May 21 10:37:00 2007  max relations containing the same ideal: 27
Mon May 21 10:37:01 2007  dataset has 53.0% excess relations
Mon May 21 10:37:03 2007  ignoring smallest 275335 rational and 274990 algebraic ideals
Mon May 21 10:37:03 2007  filtering rational ideals above 3880993
Mon May 21 10:37:03 2007  filtering algebraic ideals above 3880993
Mon May 21 10:37:03 2007  need 828947 more relations than ideals
Mon May 21 10:37:03 2007  commencing singleton removal, final pass
Mon May 21 10:37:50 2007  memory use: 93.5 MB
Mon May 21 10:37:50 2007  commencing in-memory singleton removal
Mon May 21 10:37:51 2007  begin with 3021572 relations and 2049013 unique ideals
Mon May 21 10:37:52 2007  reduce to 3020216 relations and 2047657 ideals in 4 passes
Mon May 21 10:37:52 2007  max relations containing the same ideal: 28
Mon May 21 10:37:53 2007  removing 221509 relations and 149703 ideals in 71806 cliques
Mon May 21 10:37:53 2007  commencing in-memory singleton removal
Mon May 21 10:37:54 2007  begin with 2798707 relations and 2047657 unique ideals
Mon May 21 10:37:55 2007  reduce to 2789483 relations and 1888533 ideals in 5 passes
Mon May 21 10:37:55 2007  max relations containing the same ideal: 28
Mon May 21 10:37:57 2007  removing 223916 relations and 152110 ideals in 71806 cliques
Mon May 21 10:37:57 2007  commencing in-memory singleton removal
Mon May 21 10:37:57 2007  begin with 2565567 relations and 1888533 unique ideals
Mon May 21 10:37:58 2007  reduce to 2556066 relations and 1726719 ideals in 6 passes
Mon May 21 10:37:58 2007  max relations containing the same ideal: 27
Mon May 21 10:38:00 2007  removing 2398 relations and 1999 ideals in 399 cliques
Mon May 21 10:38:00 2007  commencing in-memory singleton removal
Mon May 21 10:38:00 2007  begin with 2553668 relations and 1726719 unique ideals
Mon May 21 10:38:00 2007  reduce to 2553666 relations and 1724718 ideals in 2 passes
Mon May 21 10:38:00 2007  max relations containing the same ideal: 27
Mon May 21 10:38:01 2007  dataset has 22.4% excess relations
Mon May 21 10:38:03 2007  ignoring smallest 243263 rational and 243102 algebraic ideals
Mon May 21 10:38:03 2007  filtering rational ideals above 3395869
Mon May 21 10:38:03 2007  filtering algebraic ideals above 3395869
Mon May 21 10:38:03 2007  need 731405 more relations than ideals
Mon May 21 10:38:03 2007  commencing singleton removal, final pass
Mon May 21 10:38:44 2007  memory use: 93.5 MB
Mon May 21 10:38:44 2007  commencing in-memory singleton removal
Mon May 21 10:38:44 2007  begin with 2553666 relations and 1788501 unique ideals
Mon May 21 10:38:45 2007  reduce to 2552321 relations and 1787156 ideals in 4 passes
Mon May 21 10:38:45 2007  max relations containing the same ideal: 27
Mon May 21 10:38:46 2007  removing 64286 relations and 47406 ideals in 16880 cliques
Mon May 21 10:38:46 2007  commencing in-memory singleton removal
Mon May 21 10:38:46 2007  begin with 2488035 relations and 1787156 unique ideals
Mon May 21 10:38:47 2007  reduce to 2487165 relations and 1738876 ideals in 4 passes
Mon May 21 10:38:47 2007  max relations containing the same ideal: 27
Mon May 21 10:38:48 2007  removing 56645 relations and 39765 ideals in 16880 cliques
Mon May 21 10:38:49 2007  commencing in-memory singleton removal
Mon May 21 10:38:49 2007  begin with 2430520 relations and 1738876 unique ideals
Mon May 21 10:38:50 2007  reduce to 2429693 relations and 1698276 ideals in 4 passes
Mon May 21 10:38:50 2007  max relations containing the same ideal: 27
Mon May 21 10:38:50 2007  dataset has 8.0% excess relations
Mon May 21 10:38:50 2007  relations with 0 large ideals: 30057
Mon May 21 10:38:50 2007  relations with 1 large ideals: 228328
Mon May 21 10:38:50 2007  relations with 2 large ideals: 644711
Mon May 21 10:38:50 2007  relations with 3 large ideals: 832055
Mon May 21 10:38:50 2007  relations with 4 large ideals: 518572
Mon May 21 10:38:50 2007  relations with 5 large ideals: 153691
Mon May 21 10:38:50 2007  relations with 6 large ideals: 20917
Mon May 21 10:38:50 2007  relations with 7+ large ideals: 1362
Mon May 21 10:38:50 2007  commencing 2-way merge
Mon May 21 10:38:53 2007  merged 662039 relations
Mon May 21 10:38:53 2007  reduce to 1767654 relation sets and 1036237 unique ideals
Mon May 21 10:38:53 2007  commencing full merge
Mon May 21 10:39:24 2007  found 893204 cycles, need 650437
Mon May 21 10:39:24 2007  weight of 650437 cycles is about 42490446 (65.33/cycle)
Mon May 21 10:39:24 2007  distribution of cycle lengths:
Mon May 21 10:39:24 2007  1 relations: 50144
Mon May 21 10:39:24 2007  2 relations: 65060
Mon May 21 10:39:24 2007  3 relations: 71744
Mon May 21 10:39:24 2007  4 relations: 74948
Mon May 21 10:39:24 2007  5 relations: 75798
Mon May 21 10:39:24 2007  6 relations: 72801
Mon May 21 10:39:24 2007  7 relations: 69054
Mon May 21 10:39:24 2007  8 relations: 63695
Mon May 21 10:39:24 2007  9 relations: 54969
Mon May 21 10:39:24 2007  10+ relations: 52224
Mon May 21 10:39:24 2007  heaviest cycle: 12 relations
Mon May 21 10:39:24 2007  commencing cycle optimization
Mon May 21 10:39:25 2007  start with 3531842 relations
Mon May 21 10:39:33 2007  pruned 84318 relations
Mon May 21 10:39:33 2007  distribution of cycle lengths:
Mon May 21 10:39:33 2007  1 relations: 50144
Mon May 21 10:39:33 2007  2 relations: 66558
Mon May 21 10:39:33 2007  3 relations: 74676
Mon May 21 10:39:33 2007  4 relations: 77413
Mon May 21 10:39:33 2007  5 relations: 78943
Mon May 21 10:39:33 2007  6 relations: 75983
Mon May 21 10:39:33 2007  7 relations: 71901
Mon May 21 10:39:33 2007  8 relations: 63883
Mon May 21 10:39:33 2007  9 relations: 51114
Mon May 21 10:39:33 2007  10+ relations: 39822
Mon May 21 10:39:33 2007  heaviest cycle: 12 relations
Mon May 21 10:39:34 2007  
Mon May 21 10:39:34 2007  commencing linear algebra
Mon May 21 10:39:34 2007  factor base loaded:
Mon May 21 10:39:34 2007  330960 rational ideals (max prime = 4730729)
Mon May 21 10:39:34 2007  330655 algebraic ideals (max prime = 4730729)
Mon May 21 10:39:35 2007  read 650437 cycles
Mon May 21 10:39:36 2007  cycles contain 1753098 unique relations
Mon May 21 10:40:06 2007  read 1753098 relations
Mon May 21 10:40:09 2007  using 32 quadratic characters above 134215748
Mon May 21 10:41:13 2007  matrix is 649383 x 650437 with weight 60572277 (avg 93.13/col)
Mon May 21 10:41:18 2007  filtering completed in 3 passes
Mon May 21 10:41:18 2007  matrix is 646284 x 646484 with weight 60100338 (avg 92.96/col)
Mon May 21 10:41:22 2007  saving the first 48 matrix rows for later
Mon May 21 10:41:23 2007  matrix is 646236 x 646484 with weight 46217476 (avg 71.49/col)
Mon May 21 10:41:23 2007  matrix includes 64 packed rows
Mon May 21 10:41:23 2007  using block size 65536 for processor cache size 2048 kB
Mon May 21 10:41:23 2007  using 2 threads
Mon May 21 11:31:33 2007  lanczos halted after 10222 iterations
Mon May 21 11:31:35 2007  recovered 40 nontrivial dependencies
Mon May 21 11:31:35 2007  
Mon May 21 11:31:35 2007  commencing square root phase
Mon May 21 11:31:35 2007  reading relations for dependency 1
Mon May 21 11:31:36 2007  read 323387 cycles
Mon May 21 11:31:37 2007  cycles contain 1076277 unique relations
Mon May 21 11:31:59 2007  read 1076277 relations
Mon May 21 11:32:05 2007  algebraic side is not a square!
Mon May 21 11:32:05 2007  reading relations for dependency 2
Mon May 21 11:32:06 2007  read 323013 cycles
Mon May 21 11:32:06 2007  cycles contain 1076578 unique relations
Mon May 21 11:32:29 2007  read 1076578 relations
Mon May 21 11:32:35 2007  algebraic side is not a square!
Mon May 21 11:32:35 2007  reading relations for dependency 3
Mon May 21 11:32:35 2007  read 323271 cycles
Mon May 21 11:32:36 2007  cycles contain 1077693 unique relations
Mon May 21 11:33:00 2007  read 1077693 relations
Mon May 21 11:33:05 2007  algebraic side is not a square!
Mon May 21 11:33:05 2007  reading relations for dependency 4
Mon May 21 11:33:06 2007  read 323075 cycles
Mon May 21 11:33:07 2007  cycles contain 1075904 unique relations
Mon May 21 11:33:30 2007  read 1075904 relations
Mon May 21 11:33:37 2007  multiplying 1707572 relations
Mon May 21 11:41:18 2007  multiply complete, coefficients have about 77.36 million bits
Mon May 21 11:41:22 2007  initial square root is modulo 357347
Mon May 21 11:51:04 2007  reading relations for dependency 5
Mon May 21 11:51:05 2007  read 322723 cycles
Mon May 21 11:51:06 2007  cycles contain 1076407 unique relations
Mon May 21 11:51:29 2007  read 1076407 relations
Mon May 21 11:51:34 2007  algebraic side is not a square!
Mon May 21 11:51:35 2007  reading relations for dependency 6
Mon May 21 11:51:35 2007  read 322524 cycles
Mon May 21 11:51:36 2007  cycles contain 1073994 unique relations
Mon May 21 11:51:58 2007  read 1073994 relations
Mon May 21 11:52:06 2007  multiplying 1703546 relations
Mon May 21 11:59:48 2007  multiply complete, coefficients have about 77.18 million bits
Mon May 21 11:59:52 2007  initial square root is modulo 346831
Mon May 21 12:09:36 2007  prp56 factor: 10331079714165495587348393993849306277311230762925348159
Mon May 21 12:09:36 2007  prp65 factor: 40617616406773309930157031809690324332672374273933632071917743941
Mon May 21 12:09:36 2007  elapsed time 01:46:02

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
error when running msieve 1.53 with cuda	aein	Msieve	9	2019-02-25 14:09
Help need to running Msieve	appleseed	Msieve	12	2016-04-10 02:31
Problem in running msieve with CUDA	mohamed	Msieve	20	2013-08-01 08:27
CUDA_ERROR_LAUNCH_OUT_OF_RESOURCES when running msieve 1.5.0 with CUDA	ryanp	Msieve	3	2012-06-12 03:27
Trouble Running Msieve	Sab	Msieve	4	2009-07-07 06:19