Linear algebra reservations, progress and results - Page 222

swellman · 2018-02-08, 11:52

Reserving C233_133_86 for postprocessing. Thank you.

richs · 2018-02-08, 15:10

Quote:

Originally Posted by richs

Reserving Phi_3(Phi_11(Phi_3(794191)/small)/small)/small.

aka C160_114xxx461_3.

Code:

p75 factor: 104653668506096276421425077072910351711487258276864163977467534767592397439
p86 factor: 27895417369071658122647213059002481429646601518449649335072887342974960085047937667549

57.9 hours on 2 threads Core i3-2310M with 4 GB memory for a 5.98M matrix at TD = 70 (didn't bother to try 130). Log attached and at https://pastebin.com/sRKad8Tb

fivemack · 2018-02-08, 20:03

Code:

p62 factor: 15415954084900364323268807850169781151239504513806412289297301
p138 factor: 341347647921572982181378183150497363220453323323286540351339229240390778153708987279830900344167018890832438234781584675855750316088483601

19.5 hours on 6 threads i7/5820K for 6.83M density-120 (not 122) matrix. Log attached and at https://pastebin.com/3Vhrv3vb

fivemack · 2018-02-08, 20:06

Taking C232_146_49

fivemack · 2018-02-09, 17:25

Taking C197_219xx857_5

pinhodecarlos · 2018-02-10, 12:09

Quote:

Originally Posted by RichD

Looks like the GCW number (9_266+.C255) in the 14e queue can use a few more relations. Currently the 32-bit job is at 345M.

Are you going to do this one?

swellman · 2018-02-10, 22:34

Quote:

Originally Posted by VBCurtis

I think the 92.85/cycle at the end of filtering is the number that's expected to be equal to TD.

I also believe you'll get a matrix smaller by 8-10% in dimension, and shorter in solve time by slightly less (say, 5-9%) if you chop off 20M relations and re-run the filtering.

If you have disk space, keep this matrix and re-run filtering in another folder, so that if I'm wrong you can pick this one back up where it is?

Results.

Code:

Sat Feb 10 12:01:48 2018  
Sat Feb 10 12:01:48 2018  
Sat Feb 10 12:01:48 2018  Msieve v. 1.52 (SVN unknown)
Sat Feb 10 12:01:48 2018  random seeds: bcfbbf68 cf2f23f0
Sat Feb 10 12:01:48 2018  factoring 2234378048249495869632277535776778536491220070872178334323257257984004715599817130218098631993983409929561189021862530161860248402011281511389799252654886688065574453902542653717067012722454732217367978217338892307708541470519239077 (232 digits)
Sat Feb 10 12:01:49 2018  no P-1/P+1/ECM available, skipping
Sat Feb 10 12:01:49 2018  commencing number field sieve (232-digit input)
Sat Feb 10 12:01:49 2018  R0: 2892546549760000000000
Sat Feb 10 12:01:49 2018  R1: -53653278865596927234911463541904971226579
Sat Feb 10 12:01:49 2018  A0: 487340
Sat Feb 10 12:01:49 2018  A1: 0
Sat Feb 10 12:01:49 2018  A2: 0
Sat Feb 10 12:01:49 2018  A3: 0
Sat Feb 10 12:01:49 2018  A4: 0
Sat Feb 10 12:01:49 2018  A5: 0
Sat Feb 10 12:01:49 2018  A6: 1
Sat Feb 10 12:01:49 2018  skew 8.87, size 1.061e-012, alpha -0.098, combined = 1.277e-013 rroots = 0
Sat Feb 10 12:01:49 2018  
Sat Feb 10 12:01:49 2018  commencing relation filtering
Sat Feb 10 12:01:49 2018  setting max relations to 440000000
Sat Feb 10 12:01:49 2018  setting target matrix density to 128.0
Sat Feb 10 12:01:49 2018  estimated available RAM is 16316.6 MB
Sat Feb 10 12:01:49 2018  commencing duplicate removal, pass 1
Sat Feb 10 12:08:02 2018  error -15 reading relation 41705422
Sat Feb 10 12:08:47 2018  error -15 reading relation 46842753
Sat Feb 10 12:08:48 2018  error -9 reading relation 46863751
Sat Feb 10 12:08:49 2018  error -15 reading relation 47047448
Sat Feb 10 13:06:42 2018  error -9 reading relation 439588204
Sat Feb 10 13:06:43 2018  error -15 reading relation 439648219
Sat Feb 10 13:06:44 2018  error -9 reading relation 439724594
Sat Feb 10 13:06:45 2018  error -9 reading relation 439883298
Sat Feb 10 13:06:46 2018  error -9 reading relation 439978479
Sat Feb 10 13:06:46 2018  skipped 19 relations with b > 2^32
Sat Feb 10 13:06:46 2018  found 90012979 hash collisions in 439998409 relations
Sat Feb 10 13:06:46 2018  commencing duplicate removal, pass 2
Sat Feb 10 13:18:17 2018  found 78356557 duplicates and 361641852 unique relations
Sat Feb 10 13:18:17 2018  memory use: 2387.0 MB
Sat Feb 10 13:18:17 2018  reading ideals above 388038656
Sat Feb 10 13:18:17 2018  commencing singleton removal, initial pass
Sat Feb 10 14:16:56 2018  memory use: 6024.0 MB
Sat Feb 10 14:16:56 2018  reading all ideals from disk
Sat Feb 10 14:18:02 2018  memory use: 5762.6 MB
Sat Feb 10 14:18:13 2018  commencing in-memory singleton removal
Sat Feb 10 14:18:24 2018  begin with 361641852 relations and 292955978 unique ideals
Sat Feb 10 14:20:37 2018  reduce to 226089518 relations and 142675170 ideals in 16 passes
Sat Feb 10 14:20:37 2018  max relations containing the same ideal: 42
Sat Feb 10 14:20:51 2018  reading ideals above 720000
Sat Feb 10 14:20:52 2018  commencing singleton removal, initial pass
Sat Feb 10 15:07:51 2018  memory use: 5512.0 MB
Sat Feb 10 15:07:51 2018  reading large ideals from disk
Sat Feb 10 15:11:40 2018  keeping 165708379 ideals with weight <= 20, target excess is 18405417
Sat Feb 10 15:15:31 2018  memory use: 5259.5 MB
Sat Feb 10 15:15:31 2018  commencing in-memory singleton removal
Sat Feb 10 15:15:40 2018  begin with 226089519 relations and 165708379 unique ideals
Sat Feb 10 15:17:36 2018  reduce to 225885995 relations and 165504811 ideals in 11 passes
Sat Feb 10 15:17:36 2018  max relations containing the same ideal: 20
Sat Feb 10 15:18:39 2018  removing 12676235 relations and 10676235 ideals in 2000000 cliques
Sat Feb 10 15:18:42 2018  commencing in-memory singleton removal
Sat Feb 10 15:18:51 2018  begin with 213209760 relations and 165504811 unique ideals
Sat Feb 10 15:20:28 2018  reduce to 212638988 relations and 154251121 ideals in 10 passes
Sat Feb 10 15:20:28 2018  max relations containing the same ideal: 20
Sat Feb 10 15:21:27 2018  removing 9436120 relations and 7436120 ideals in 2000000 cliques
Sat Feb 10 15:21:30 2018  commencing in-memory singleton removal
Sat Feb 10 15:21:38 2018  begin with 203202868 relations and 154251121 unique ideals
Sat Feb 10 15:22:52 2018  reduce to 202832486 relations and 146440833 ideals in 8 passes
Sat Feb 10 15:22:52 2018  max relations containing the same ideal: 20
Sat Feb 10 15:23:49 2018  removing 8449147 relations and 6449147 ideals in 2000000 cliques
Sat Feb 10 15:23:52 2018  commencing in-memory singleton removal
Sat Feb 10 15:24:00 2018  begin with 194383339 relations and 146440833 unique ideals
Sat Feb 10 15:25:09 2018  reduce to 194065187 relations and 139670388 ideals in 8 passes
Sat Feb 10 15:25:09 2018  max relations containing the same ideal: 20
Sat Feb 10 15:26:03 2018  removing 7921337 relations and 5921337 ideals in 2000000 cliques
Sat Feb 10 15:26:05 2018  commencing in-memory singleton removal
Sat Feb 10 15:26:13 2018  begin with 186143850 relations and 139670388 unique ideals
Sat Feb 10 15:27:19 2018  reduce to 185850604 relations and 133452884 ideals in 8 passes
Sat Feb 10 15:27:19 2018  max relations containing the same ideal: 20
Sat Feb 10 15:28:10 2018  removing 7604477 relations and 5604477 ideals in 2000000 cliques
Sat Feb 10 15:28:13 2018  commencing in-memory singleton removal
Sat Feb 10 15:28:20 2018  begin with 178246127 relations and 133452884 unique ideals
Sat Feb 10 15:29:15 2018  reduce to 177971140 relations and 127570526 ideals in 7 passes
Sat Feb 10 15:29:15 2018  max relations containing the same ideal: 20
Sat Feb 10 15:30:04 2018  removing 7349926 relations and 5349926 ideals in 2000000 cliques
Sat Feb 10 15:30:07 2018  commencing in-memory singleton removal
Sat Feb 10 15:30:13 2018  begin with 170621214 relations and 127570526 unique ideals
Sat Feb 10 15:31:06 2018  reduce to 170347543 relations and 121943937 ideals in 7 passes
Sat Feb 10 15:31:06 2018  max relations containing the same ideal: 20
Sat Feb 10 15:31:52 2018  removing 7191517 relations and 5191517 ideals in 2000000 cliques
Sat Feb 10 15:31:55 2018  commencing in-memory singleton removal
Sat Feb 10 15:32:01 2018  begin with 163156026 relations and 121943937 unique ideals
Sat Feb 10 15:32:58 2018  reduce to 162892381 relations and 116485880 ideals in 8 passes
Sat Feb 10 15:32:58 2018  max relations containing the same ideal: 20
Sat Feb 10 15:33:42 2018  removing 7019644 relations and 5019644 ideals in 2000000 cliques
Sat Feb 10 15:33:45 2018  commencing in-memory singleton removal
Sat Feb 10 15:33:50 2018  begin with 155872737 relations and 116485880 unique ideals
Sat Feb 10 15:34:37 2018  reduce to 155598810 relations and 111189123 ideals in 7 passes
Sat Feb 10 15:34:37 2018  max relations containing the same ideal: 20
Sat Feb 10 15:35:20 2018  removing 6962199 relations and 4962199 ideals in 2000000 cliques
Sat Feb 10 15:35:22 2018  commencing in-memory singleton removal
Sat Feb 10 15:35:27 2018  begin with 148636611 relations and 111189123 unique ideals
Sat Feb 10 15:36:12 2018  reduce to 148370278 relations and 105957318 ideals in 7 passes
Sat Feb 10 15:36:12 2018  max relations containing the same ideal: 20
Sat Feb 10 15:36:52 2018  removing 6870101 relations and 4870101 ideals in 2000000 cliques
Sat Feb 10 15:36:54 2018  commencing in-memory singleton removal
Sat Feb 10 15:36:59 2018  begin with 141500177 relations and 105957318 unique ideals
Sat Feb 10 15:37:46 2018  reduce to 141227531 relations and 100811110 ideals in 8 passes
Sat Feb 10 15:37:46 2018  max relations containing the same ideal: 20
Sat Feb 10 15:38:25 2018  removing 6786384 relations and 4786384 ideals in 2000000 cliques
Sat Feb 10 15:38:27 2018  commencing in-memory singleton removal
Sat Feb 10 15:38:32 2018  begin with 134441147 relations and 100811110 unique ideals
Sat Feb 10 15:39:10 2018  reduce to 134157357 relations and 95737145 ideals in 7 passes
Sat Feb 10 15:39:10 2018  max relations containing the same ideal: 20
Sat Feb 10 15:39:47 2018  removing 6783134 relations and 4783134 ideals in 2000000 cliques
Sat Feb 10 15:39:49 2018  commencing in-memory singleton removal
Sat Feb 10 15:39:53 2018  begin with 127374223 relations and 95737145 unique ideals
Sat Feb 10 15:40:30 2018  reduce to 127087796 relations and 90663540 ideals in 7 passes
Sat Feb 10 15:40:30 2018  max relations containing the same ideal: 20
Sat Feb 10 15:41:04 2018  removing 6708028 relations and 4708028 ideals in 2000000 cliques
Sat Feb 10 15:41:06 2018  commencing in-memory singleton removal
Sat Feb 10 15:41:10 2018  begin with 120379768 relations and 90663540 unique ideals
Sat Feb 10 15:41:44 2018  reduce to 120073402 relations and 85644416 ideals in 7 passes
Sat Feb 10 15:41:44 2018  max relations containing the same ideal: 20
Sat Feb 10 15:42:16 2018  removing 6661710 relations and 4661710 ideals in 2000000 cliques
Sat Feb 10 15:42:18 2018  commencing in-memory singleton removal
Sat Feb 10 15:42:22 2018  begin with 113411692 relations and 85644416 unique ideals
Sat Feb 10 15:42:54 2018  reduce to 113081740 relations and 80647429 ideals in 7 passes
Sat Feb 10 15:42:54 2018  max relations containing the same ideal: 19
Sat Feb 10 15:43:24 2018  removing 6727394 relations and 4727394 ideals in 2000000 cliques
Sat Feb 10 15:43:26 2018  commencing in-memory singleton removal
Sat Feb 10 15:43:30 2018  begin with 106354346 relations and 80647429 unique ideals
Sat Feb 10 15:44:03 2018  reduce to 106026002 relations and 75586220 ideals in 8 passes
Sat Feb 10 15:44:03 2018  max relations containing the same ideal: 19
Sat Feb 10 15:44:31 2018  removing 6688311 relations and 4688311 ideals in 2000000 cliques
Sat Feb 10 15:44:33 2018  commencing in-memory singleton removal
Sat Feb 10 15:44:36 2018  begin with 99337691 relations and 75586220 unique ideals
Sat Feb 10 15:45:07 2018  reduce to 98972663 relations and 70526301 ideals in 8 passes
Sat Feb 10 15:45:07 2018  max relations containing the same ideal: 19
Sat Feb 10 15:45:33 2018  removing 6657393 relations and 4657393 ideals in 2000000 cliques
Sat Feb 10 15:45:35 2018  commencing in-memory singleton removal
Sat Feb 10 15:45:38 2018  begin with 92315270 relations and 70526301 unique ideals
Sat Feb 10 15:46:06 2018  reduce to 91907375 relations and 65452975 ideals in 8 passes
Sat Feb 10 15:46:06 2018  max relations containing the same ideal: 18
Sat Feb 10 15:46:30 2018  removing 6772580 relations and 4772580 ideals in 2000000 cliques
Sat Feb 10 15:46:32 2018  commencing in-memory singleton removal
Sat Feb 10 15:46:34 2018  begin with 85134795 relations and 65452975 unique ideals
Sat Feb 10 15:47:02 2018  reduce to 84709951 relations and 60246671 ideals in 9 passes
Sat Feb 10 15:47:02 2018  max relations containing the same ideal: 18
Sat Feb 10 15:47:25 2018  removing 6751558 relations and 4751558 ideals in 2000000 cliques
Sat Feb 10 15:47:26 2018  commencing in-memory singleton removal
Sat Feb 10 15:47:29 2018  begin with 77958393 relations and 60246671 unique ideals
Sat Feb 10 15:47:54 2018  reduce to 77475388 relations and 55001126 ideals in 9 passes
Sat Feb 10 15:47:54 2018  max relations containing the same ideal: 17
Sat Feb 10 15:48:14 2018  removing 4039879 relations and 2915901 ideals in 1123978 cliques
Sat Feb 10 15:48:15 2018  commencing in-memory singleton removal
Sat Feb 10 15:48:17 2018  begin with 73435509 relations and 55001126 unique ideals
Sat Feb 10 15:48:38 2018  reduce to 73201847 relations and 51847563 ideals in 8 passes
Sat Feb 10 15:48:38 2018  max relations containing the same ideal: 17
Sat Feb 10 15:49:00 2018  relations with 0 large ideals: 3636128
Sat Feb 10 15:49:00 2018  relations with 1 large ideals: 16504799
Sat Feb 10 15:49:00 2018  relations with 2 large ideals: 26620434
Sat Feb 10 15:49:00 2018  relations with 3 large ideals: 18839501
Sat Feb 10 15:49:00 2018  relations with 4 large ideals: 6371744
Sat Feb 10 15:49:00 2018  relations with 5 large ideals: 1106778
Sat Feb 10 15:49:00 2018  relations with 6 large ideals: 113486
Sat Feb 10 15:49:00 2018  relations with 7+ large ideals: 8977
Sat Feb 10 15:49:00 2018  commencing 2-way merge
Sat Feb 10 15:49:27 2018  reduce to 44947729 relation sets and 23593445 unique ideals
Sat Feb 10 15:49:27 2018  commencing full merge
Sat Feb 10 15:53:36 2018  memory use: 2145.8 MB
Sat Feb 10 15:53:41 2018  found 21810559 cycles, need 19443617
Sat Feb 10 15:53:43 2018  weight of 19443617 cycles is about 1998872945 (102.80/cycle)
Sat Feb 10 15:53:43 2018  distribution of cycle lengths:
Sat Feb 10 15:53:43 2018  1 relations: 3640317
Sat Feb 10 15:53:43 2018  2 relations: 1621033
Sat Feb 10 15:53:43 2018  3 relations: 1260516
Sat Feb 10 15:53:43 2018  4 relations: 1130614
Sat Feb 10 15:53:43 2018  5 relations: 1093049
Sat Feb 10 15:53:43 2018  6 relations: 1057335
Sat Feb 10 15:53:43 2018  7 relations: 1039569
Sat Feb 10 15:53:43 2018  8 relations: 1010345
Sat Feb 10 15:53:43 2018  9 relations: 981143
Sat Feb 10 15:53:43 2018  10+ relations: 6609696
Sat Feb 10 15:53:43 2018  heaviest cycle: 21 relations
Sat Feb 10 15:53:44 2018  commencing cycle optimization
Sat Feb 10 15:54:12 2018  start with 141431620 relations
Sat Feb 10 15:59:30 2018  pruned 10462633 relations
Sat Feb 10 15:59:30 2018  memory use: 3893.6 MB
Sat Feb 10 15:59:30 2018  distribution of cycle lengths:
Sat Feb 10 15:59:30 2018  1 relations: 3640317
Sat Feb 10 15:59:30 2018  2 relations: 1687035
Sat Feb 10 15:59:30 2018  3 relations: 1344115
Sat Feb 10 15:59:30 2018  4 relations: 1220138
Sat Feb 10 15:59:30 2018  5 relations: 1200687
Sat Feb 10 15:59:30 2018  6 relations: 1174640
Sat Feb 10 15:59:30 2018  7 relations: 1165984
Sat Feb 10 15:59:30 2018  8 relations: 1132602
Sat Feb 10 15:59:30 2018  9 relations: 1097990
Sat Feb 10 15:59:30 2018  10+ relations: 5780109
Sat Feb 10 15:59:30 2018  heaviest cycle: 21 relations
Sat Feb 10 16:00:14 2018  RelProcTime: 14305
Sat Feb 10 16:00:14 2018  
Sat Feb 10 16:00:14 2018  commencing linear algebra
Sat Feb 10 16:00:17 2018  read 19443617 cycles
Sat Feb 10 16:00:50 2018  cycles contain 61729232 unique relations
Sat Feb 10 16:13:09 2018  read 61729232 relations
Sat Feb 10 16:14:58 2018  using 20 quadratic characters above 4294917296
Sat Feb 10 16:19:25 2018  building initial matrix
Sat Feb 10 16:30:36 2018  memory use: 7832.2 MB
Sat Feb 10 16:30:58 2018  read 19443617 cycles
Sat Feb 10 16:31:04 2018  matrix is 19441927 x 19443617 (7607.4 MB) with weight 2195299526 (112.91/col)
Sat Feb 10 16:31:04 2018  sparse part has weight 1780348408 (91.56/col)
Sat Feb 10 16:36:44 2018  filtering completed in 3 passes
Sat Feb 10 16:36:50 2018  matrix is 19401095 x 19401295 (7598.5 MB) with weight 2192592875 (113.01/col)
Sat Feb 10 16:36:50 2018  sparse part has weight 1778494929 (91.67/col)
Sat Feb 10 16:39:07 2018  matrix starts at (0, 0)
Sat Feb 10 16:39:12 2018  matrix is 19401095 x 19401295 (7598.5 MB) with weight 2192592875 (113.01/col)
Sat Feb 10 16:39:12 2018  sparse part has weight 1778494929 (91.67/col)
Sat Feb 10 16:39:12 2018  saving the first 48 matrix rows for later
Sat Feb 10 16:39:17 2018  matrix includes 64 packed rows
Sat Feb 10 16:39:20 2018  matrix is 19401047 x 19401295 (7269.1 MB) with weight 1833426013 (94.50/col)
Sat Feb 10 16:39:20 2018  sparse part has weight 1711547679 (88.22/col)
Sat Feb 10 16:39:20 2018  using block size 8192 and superblock size 393216 for processor cache size 4096 kB
Sat Feb 10 16:41:08 2018  commencing Lanczos iteration (8 threads)
Sat Feb 10 16:41:08 2018  memory use: 6195.0 MB
Sat Feb 10 16:43:52 2018  linear algebra at 0.0%, ETA 558h 4m
Sat Feb 10 16:44:47 2018  checkpointing every 40000 dimensions

RichD · 2018-02-10, 23:03

Quote:

Originally Posted by pinhodecarlos

Are you going to do this one?

No, I picked another one that was ready to go. And I still have 206 hours remaining on another one. But if it is still available in a week I may look at it again.

VBCurtis · 2018-02-11, 01:25

Quote:

Originally Posted by swellman

Results.

If I'm reading the logs correctly, 460M raw relations got you a 20.0M matrix at actual density of 78, ETA 560 hours. 440M raw relations got you 19.4M matrix at actual density 92, ETA 556 hours.

420M or 425M relations would likely build you a density 120+ matrix, but I have no reason to forecast a time savings from doing so. Seems in this case, extra relations above ~430M raw are useless, but didn't hurt your LA time meaningfully.

RichD · 2018-02-12, 01:11

Taking C197_765xx099_5

fivemack · 2018-02-12, 10:06

Code:

Sat Feb 10 15:03:00 2018  p82 factor: 1095193141328015162716493532106123782950723869553949291490820009007510135749910083
Sat Feb 10 15:03:00 2018  p146 factor: 23926079189061260400618041569502760850075373745086217777983400666870108043229761716731216586642611068237798960489517087770451062881601266623583271

27.8 hours on 7 threads E5-2650v2 for 7.44M density-130 (not 132) matrix

Log attached and at https://pastebin.com/63GvANHg

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
restarting nfs linear algebra	cubaq	YAFU	2	2017-04-02 11:35
Linear algebra at 600%	CRGreathouse	Msieve	8	2009-08-05 07:25
Linear algebra crashes	10metreh	Msieve	3	2009-02-02 08:34
Linear algebra proof	Damian	Math	8	2007-02-12 22:25
Linear algebra in MPQS	R1zZ1	Factoring	2	2007-02-02 06:45

2018-02-08, 11:52	#2432
swellman Jun 2012 6023₈ Posts	Reserving C233_133_86 for postprocessing. Thank you.

2018-02-08, 20:06	#2435
fivemack (loop (#_fork)) Feb 2006 Cambridge, England 1918₁₆ Posts	Taking C232_146_49

2018-02-09, 17:25	#2436
fivemack (loop (#_fork)) Feb 2006 Cambridge, England 2³×11×73 Posts	Taking C197_219xx857_5

2018-02-12, 01:11	#2441
RichD Sep 2008 Kansas 2×3×5×113 Posts	Taking C197_765xx099_5