[QUOTE=bsquared;140775]Yeah, I followed all that in the code - it is a very clever way of counting/tracking full from partial relations. Much better than my code, which sorts a list and iterates to count pairs. If the bug is indeed duplication due to XOR'ing, then my code should have the same bug because it builds the matrix pretty much the same way as yours. But it doesn't (at least, I haven't seen it fail yet in the same way). My Guassian elimination is quite a bit different, which is maybe how it avoids the problem.
[/QUOTE]
Maybe it's time to go back to the entire tiny algorithm and make the code suck less; in the case of the relation counting, I assumed the code could be sloppy and throw away relations, in return for becoming simpler and faster on average. For larger size problems when relations are more rare, that kind of frivolous discarding isn't productive and you really should be saving everything.

If you want *really* clever code, try deciphering the SIQS implementation of the GGNFS lattice siever. Some of the stuff in there is just sublime.
[QUOTE]
By the way, how did you design the hash function for doing the partial relation storing? Does that particular function minimize collisions in the interval you are mapping to somehow?[/QUOTE]
It's a fairly standard multiplicative hash; see [url="http://uwsg.iu.edu/hypermail/linux/kernel/9904.0/0927.html"]here[/url]

[QUOTE=jasonp;140780]Maybe it's time to go back to the entire tiny algorithm and make the code suck less; [/QUOTE]

No need on my part, you can add it to your to-do list. My loop 100 times until the number is cracked works just fine. The problem rarely happens and the numbers are so small that running the code several times is no big deal.

[quote=jasonp;140780]... in the case of the relation counting, I assumed the code could be sloppy and throw away relations, in return for becoming simpler and faster on average. [/quote]

I don't think the performance is hurt much at all due to throwing away the occasional relation due to a hash collision, for the size numbers we're talking about here. The opposite, probably. I'm not advocating you get rid of that at all.

[quote=jasonp;140780]
If you want *really* clever code, try deciphering the SIQS implementation of the GGNFS lattice siever. Some of the stuff in there is just sublime.
[/quote]
I've looked at that before, yeah. Most of it made my head hurt.
[quote=jasonp;140780]
It's a fairly standard multiplicative hash; see [URL="http://uwsg.iu.edu/hypermail/linux/kernel/9904.0/0927.html"]here[/URL][/quote]
Thanks.

[QUOTE=jasonp;140389]Great, this had me worried.

You guys are going to give me an ulcer with these huge jobs :) On the one hand, Tom and friends have a big head start, but on the other hand the two of you have enormous resources.[/QUOTE]

We've switched the clusters to an NFSNET number. My sieving objective
was to do 5p389 C265, difficulty 272, with a matrix no more difficult than
7p311. For that one, msieve reports

[QUOTE]
Sat Jun 14 08:38:27 2008 restarting with 183896572 relations
Sat Jun 14 08:38:29 2008 added 45974 free relations [/QUOTE]

with no duplicates. The final count for 389p was 200,780,817 nonduplicate;
although I ended up going out to 40M algebraic (50M-90M), and went further
than my initial estimate, completing 20M-600M rational. The best
nonduplicate result on the algebraic side was 80M-90M, but it lost
badly to 480M-490M rational, and even out at 520M-530M rational:

[QUOTE]
add080a: 166476974 - 164805519 = 1,671,455
add520r: 168594194 - 166476974 = 2,117,220 [/QUOTE]

After collecting "189192636 unique" for 7p313, the start date for
7m313 was June 23; then 6p392 started on July 12; 5p389 on Aug 2
(that was June 12 to June 23 for 7p313). Looks like the .poly post
for 5, 421- is July 21.

With the objective of obtaining a matrix no worse than for 7p311, two of
these were substantially over-sieved. For 7m313, there were
"202.6M, all unique," with

[QUOTE]
matrix of dimension 16180785 x 16181033 (4660.9 MB) with weight 1162384107 (71.84/col) [/QUOTE]

For 6p392, the number of nonduplicates appeared to be above 230M
(perhaps as much as 237M, pending a filtering report?). The snfs
difficulties were 262 and 265, twice. That's below the 272 for 5p389,
but .66*262 still looks above a c170 gnfs. -Bruce

Jason,

Some random 1.37 "feelings" (not scientific facts; for scientific facts I should repeat old runs with new msieve, but life is too short).

Not only the filtering is nicer (the initial matrix is built with less relationships than before), but the sqrt is noticeably faster! I compared the sqrt times of some ~5.5M matrices and the running time shrunk from 4.2 hours per sqrt to just 2 hours. Maybe the hidden data structure determines the sqrt time (rather than just size), but I am happy anyway.

And of course, thanks for finally implementing finding the factorization of the very first dependency. :rolleyes: Finally! (in the spirit of [URL="http://mersenneforum.org/showthread.php?t=9978"]that thread[/URL])

Thanks for the great stuff.

--Serge

[QUOTE=Batalov;143298]
Not only the filtering is nicer (the initial matrix is built with less relationships than before), but the sqrt is noticeably faster! I compared the sqrt times of some ~5.5M matrices and the running time shrunk from 4.2 hours per sqrt to just 2 hours. Maybe the hidden data structure determines the sqrt time (rather than just size), but I am happy anyway.

And of course, thanks for finally implementing finding the factorization of the very first dependency. :rolleyes: Finally! (in the spirit of [URL="http://mersenneforum.org/showthread.php?t=9978"]that thread[/URL])

Thanks for the great stuff.
[/QUOTE]
My pleasure, but I don't see what in v1.37 could have made the square root so much faster. The next version will have filtering changes that handle large excess better, and square root changes that really do double the speed and halve the memory use of the NFS square root (Paul Zimmermann and I have been trading optimizations :)

I have noticed that people have been going through more dependencies than usual to get the answer they need, perhaps they should be using luckier dice :)

[QUOTE=jasonp;143301]My pleasure, but I don't see what in v1.37 could have made the square root so much faster. The next version will have filtering changes that handle large excess better, and square root changes that really do double the speed and halve the memory use of the NFS square root (Paul Zimmermann and I have been trading optimizations :)

I have noticed that people have been going through more dependencies than usual to get the answer they need, perhaps they should be using luckier dice :)[/QUOTE]

I look forward to 1.38! For your reading pleasure, here's the log for 7,313+ including a 21.5 hour square root run, with post-multiply coefficients of 1183.37 million bits.

Greg

[CODE]Sat Jun 28 12:46:40 2008 Msieve v. 1.36
Sat Jun 28 12:46:40 2008 random seeds: 17a03b32 ea087561
Sat Jun 28 12:46:40 2008 factoring 409823197542297503216161647865376032214385529358894751862304291868712197216175369592274928569578876152382555077477130553079988651737367581007139968262008094847510731049892377516641261443488944792954771177714811031897011366576098105498726018771910782614950431283801 (264 digits)
Sat Jun 28 12:46:45 2008 no P-1/P+1/ECM available, skipping
Sat Jun 28 12:46:45 2008 commencing number field sieve (264-digit input)
Sat Jun 28 12:46:45 2008 R0: -88124787089723195184393736687912818113311201
Sat Jun 28 12:46:45 2008 R1: 1
Sat Jun 28 12:46:45 2008 A0: 1
Sat Jun 28 12:46:45 2008 A1: 0
Sat Jun 28 12:46:45 2008 A2: 0
Sat Jun 28 12:46:45 2008 A3: 0
Sat Jun 28 12:46:45 2008 A4: 0
Sat Jun 28 12:46:45 2008 A5: 0
Sat Jun 28 12:46:45 2008 A6: 7
Sat Jun 28 12:46:45 2008 size score = 9.394910e-13, Murphy alpha = 1.964246, combined = 5.359952e-13
Sat Jun 28 12:48:32 2008 restarting with 189192636 relations
Sat Jun 28 12:48:36 2008 added 45974 free relations
Sat Jun 28 12:48:36 2008
Sat Jun 28 12:48:36 2008 commencing relation filtering
Sat Jun 28 12:48:36 2008 commencing duplicate removal, pass 1

Sat Jun 28 13:26:38 2008 found 43887486 hash collisions in 189236638 relations
Sat Jun 28 13:26:38 2008 commencing duplicate removal, pass 2
Sat Jun 28 14:18:47 2008 found 0 duplicates and 189236638 unique relations
Sat Jun 28 14:18:47 2008 memory use: 1911.0 MB
Sat Jun 28 14:19:42 2008 ignoring smallest 5708505 rational and 5706148 algebraic ideals
Sat Jun 28 14:19:42 2008 filtering rational ideals above 99024896
Sat Jun 28 14:19:42 2008 filtering algebraic ideals above 99024896
Sat Jun 28 14:19:42 2008 need 17121979 more relations than ideals
Sat Jun 28 14:19:42 2008 commencing singleton removal, pass 1
Sat Jun 28 15:01:46 2008 relations with 0 large ideals: 1069629
Sat Jun 28 15:01:46 2008 relations with 1 large ideals: 8497399
Sat Jun 28 15:01:46 2008 relations with 2 large ideals: 30506273
Sat Jun 28 15:01:46 2008 relations with 3 large ideals: 59021922
Sat Jun 28 15:01:46 2008 relations with 4 large ideals: 61549637
Sat Jun 28 15:01:46 2008 relations with 5 large ideals: 28591778
Sat Jun 28 15:01:46 2008 relations with 6 large ideals: 0
Sat Jun 28 15:01:46 2008 relations with 7+ large ideals: 0
Sat Jun 28 15:01:46 2008 189236638 relations and about 95679784 large ideals
Sat Jun 28 15:01:46 2008 commencing singleton removal, pass 2
Sat Jun 28 15:43:31 2008 found 14499330 singletons
Sat Jun 28 15:43:31 2008 current dataset: 174737308 relations and about 80737645 large ideals
Sat Jun 28 15:43:31 2008 commencing singleton removal, pass 3
Sat Jun 28 16:23:02 2008 relations with 0 large ideals: 1069629
Sat Jun 28 16:23:02 2008 relations with 1 large ideals: 8305844
Sat Jun 28 16:23:02 2008 relations with 2 large ideals: 29115540
Sat Jun 28 16:23:02 2008 relations with 3 large ideals: 54979687
Sat Jun 28 16:23:02 2008 relations with 4 large ideals: 55924675
Sat Jun 28 16:23:02 2008 relations with 5 large ideals: 25341933
Sat Jun 28 16:23:02 2008 relations with 6 large ideals: 0
Sat Jun 28 16:23:02 2008 relations with 7+ large ideals: 0
Sat Jun 28 16:23:02 2008 174737308 relations and about 114646811 large ideals
Sat Jun 28 16:23:02 2008 commencing singleton removal, pass 4

Sat Jun 28 17:02:55 2008 found 22036964 singletons
Sat Jun 28 17:02:55 2008 current dataset: 152700344 relations and about 91460095 large ideals
Sat Jun 28 17:02:56 2008 commencing singleton removal, pass 5
Sat Jun 28 17:38:43 2008 relations with 0 large ideals: 1069629
Sat Jun 28 17:38:43 2008 relations with 1 large ideals: 7997409
Sat Jun 28 17:38:43 2008 relations with 2 large ideals: 26914509
Sat Jun 28 17:38:43 2008 relations with 3 large ideals: 48725955
Sat Jun 28 17:38:43 2008 relations with 4 large ideals: 47440479
Sat Jun 28 17:38:43 2008 relations with 5 large ideals: 20552363
Sat Jun 28 17:38:43 2008 relations with 6 large ideals: 0
Sat Jun 28 17:38:43 2008 relations with 7+ large ideals: 0
Sat Jun 28 17:38:43 2008 152700344 relations and about 111128596 large ideals
Sat Jun 28 17:38:43 2008 commencing singleton removal, pass 6
Sat Jun 28 18:14:27 2008 found 17314292 singletons
Sat Jun 28 18:14:27 2008 current dataset: 135386052 relations and about 93011379 large ideals
Sat Jun 28 18:14:27 2008 commencing singleton removal, pass 7
Sat Jun 28 18:45:53 2008 found 3606976 singletons
Sat Jun 28 18:45:53 2008 current dataset: 131779076 relations and about 89364266 large ideals
Sat Jun 28 18:45:53 2008 commencing singleton removal, pass 8
Sat Jun 28 19:16:37 2008 found 657942 singletons
Sat Jun 28 19:16:37 2008 current dataset: 131121134 relations and about 88704940 large ideals
Sat Jun 28 19:16:37 2008 commencing singleton removal, pass 9
Sat Jun 28 19:48:04 2008 found 112018 singletons
Sat Jun 28 19:48:04 2008 current dataset: 131009116 relations and about 88592870 large ideals
Sat Jun 28 19:48:04 2008 commencing singleton removal, final pass
Sat Jun 28 20:48:49 2008 memory use: 2610.3 MB
Sat Jun 28 20:48:51 2008 commencing in-memory singleton removal
Sat Jun 28 20:49:57 2008 begin with 131009116 relations and 100996926 unique ideals
Sat Jun 28 21:07:20 2008 reduce to 122096502 relations and 91953132 ideals in 14 passes
Sat Jun 28 21:07:20 2008 max relations containing the same ideal: 39
Sat Jun 28 21:12:49 2008 removing 3471969 relations and 3071969 ideals in 400000 cliques
Sat Jun 28 21:12:59 2008 commencing in-memory singleton removal
Sat Jun 28 21:13:59 2008 begin with 118624533 relations and 91953132 unique ideals
Sat Jun 28 21:23:09 2008 reduce to 118574627 relations and 88831019 ideals in 7 passes
Sat Jun 28 21:23:09 2008 max relations containing the same ideal: 38
Sat Jun 28 21:31:36 2008 removing 2606920 relations and 2206920 ideals in 400000 cliques
Sat Jun 28 21:31:49 2008 commencing in-memory singleton removal
Sat Jun 28 21:33:23 2008 begin with 115967707 relations and 88831019 unique ideals
Sat Jun 28 21:44:46 2008 reduce to 115936474 relations and 86592740 ideals in 6 passes
Sat Jun 28 21:44:46 2008 max relations containing the same ideal: 36
Sat Jun 28 21:50:56 2008 removing 2323810 relations and 1923810 ideals in 400000 cliques
Sat Jun 28 21:51:04 2008 commencing in-memory singleton removal
Sat Jun 28 21:51:55 2008 begin with 113612664 relations and 86592740 unique ideals
Sat Jun 28 21:58:40 2008 reduce to 113587010 relations and 84643191 ideals in 6 passes
Sat Jun 28 21:58:40 2008 max relations containing the same ideal: 36
Sat Jun 28 22:03:47 2008 removing 2155996 relations and 1755996 ideals in 400000 cliques
Sat Jun 28 22:03:54 2008 commencing in-memory singleton removal
Sat Jun 28 22:04:50 2008 begin with 111431014 relations and 84643191 unique ideals
Sat Jun 28 22:14:43 2008 reduce to 111407436 relations and 82863562 ideals in 6 passes
Sat Jun 28 22:14:43 2008 max relations containing the same ideal: 35
Sat Jun 28 22:22:28 2008 removing 2038371 relations and 1638371 ideals in 400000 cliques
Sat Jun 28 22:22:39 2008 commencing in-memory singleton removal
Sat Jun 28 22:24:04 2008 begin with 109369065 relations and 82863562 unique ideals
Sat Jun 28 22:32:12 2008 reduce to 109348098 relations and 81204150 ideals in 5 passes
Sat Jun 28 22:32:12 2008 max relations containing the same ideal: 34
Sat Jun 28 22:37:14 2008 removing 1950498 relations and 1550498 ideals in 400000 cliques
Sat Jun 28 22:37:20 2008 commencing in-memory singleton removal
Sat Jun 28 22:38:08 2008 begin with 107397600 relations and 81204150 unique ideals
Sat Jun 28 22:44:06 2008 reduce to 107377585 relations and 79633570 ideals in 6 passes
Sat Jun 28 22:44:06 2008 max relations containing the same ideal: 33
Sat Jun 28 22:48:31 2008 removing 1876492 relations and 1476492 ideals in 400000 cliques
Sat Jun 28 22:48:38 2008 commencing in-memory singleton removal
Sat Jun 28 22:49:25 2008 begin with 105501093 relations and 79633570 unique ideals
Sat Jun 28 22:59:31 2008 reduce to 105482356 relations and 78138284 ideals in 6 passes
Sat Jun 28 22:59:31 2008 max relations containing the same ideal: 33
Sat Jun 28 23:06:40 2008 removing 1825431 relations and 1425431 ideals in 400000 cliques
Sat Jun 28 23:06:50 2008 commencing in-memory singleton removal
Sat Jun 28 23:08:10 2008 begin with 103656925 relations and 78138284 unique ideals
Sat Jun 28 23:17:38 2008 reduce to 103638225 relations and 76694088 ideals in 7 passes
Sat Jun 28 23:17:38 2008 max relations containing the same ideal: 33
Sat Jun 28 23:21:56 2008 removing 1768317 relations and 1368317 ideals in 400000 cliques
Sat Jun 28 23:22:03 2008 commencing in-memory singleton removal
Sat Jun 28 23:22:45 2008 begin with 101869908 relations and 76694088 unique ideals
Sat Jun 28 23:28:22 2008 reduce to 101851718 relations and 75307517 ideals in 6 passes
Sat Jun 28 23:28:22 2008 max relations containing the same ideal: 33
Sat Jun 28 23:32:37 2008 removing 1731647 relations and 1331647 ideals in 400000 cliques
Sat Jun 28 23:32:46 2008 commencing in-memory singleton removal
Sat Jun 28 23:33:58 2008 begin with 100120071 relations and 75307517 unique ideals
Sat Jun 28 23:41:42 2008 reduce to 100103183 relations and 73958917 ideals in 5 passes
Sat Jun 28 23:41:42 2008 max relations containing the same ideal: 32
Sat Jun 28 23:48:13 2008 removing 1694194 relations and 1294194 ideals in 400000 cliques
Sat Jun 28 23:48:22 2008 commencing in-memory singleton removal
Sat Jun 28 23:49:33 2008 begin with 98408989 relations and 73958917 unique ideals
Sat Jun 28 23:56:52 2008 reduce to 98391816 relations and 72647499 ideals in 5 passes
Sat Jun 28 23:56:52 2008 max relations containing the same ideal: 32
Sun Jun 29 00:01:23 2008 removing 1667857 relations and 1267857 ideals in 400000 cliques
Sun Jun 29 00:01:30 2008 commencing in-memory singleton removal
Sun Jun 29 00:02:13 2008 begin with 96723959 relations and 72647499 unique ideals
Sun Jun 29 00:06:37 2008 reduce to 96707206 relations and 71362819 ideals in 5 passes
Sun Jun 29 00:06:37 2008 max relations containing the same ideal: 32
Sun Jun 29 00:10:19 2008 removing 1630698 relations and 1230698 ideals in 400000 cliques
Sun Jun 29 00:10:26 2008 commencing in-memory singleton removal
Sun Jun 29 00:11:08 2008 begin with 95076508 relations and 71362819 unique ideals
Sun Jun 29 00:16:06 2008 reduce to 95058680 relations and 70114243 ideals in 5 passes
Sun Jun 29 00:16:06 2008 max relations containing the same ideal: 32
Sun Jun 29 00:22:26 2008 removing 1619532 relations and 1219532 ideals in 400000 cliques
Sun Jun 29 00:22:35 2008 commencing in-memory singleton removal
Sun Jun 29 00:23:44 2008 begin with 93439148 relations and 70114243 unique ideals
Sun Jun 29 00:32:28 2008 reduce to 93423805 relations and 68879306 ideals in 6 passes
Sun Jun 29 00:32:28 2008 max relations containing the same ideal: 31
Sun Jun 29 00:38:30 2008 removing 1586050 relations and 1186050 ideals in 400000 cliques
Sun Jun 29 00:38:38 2008 commencing in-memory singleton removal
Sun Jun 29 00:39:28 2008 begin with 91837755 relations and 68879306 unique ideals
Sun Jun 29 00:44:26 2008 reduce to 91822341 relations and 67677777 ideals in 5 passes
Sun Jun 29 00:44:26 2008 max relations containing the same ideal: 31
Sun Jun 29 00:47:55 2008 removing 1560732 relations and 1160732 ideals in 400000 cliques
Sun Jun 29 00:47:59 2008 commencing in-memory singleton removal
Sun Jun 29 00:48:40 2008 begin with 90261609 relations and 67677777 unique ideals
Sun Jun 29 00:52:39 2008 reduce to 90244713 relations and 66500079 ideals in 5 passes
Sun Jun 29 00:52:39 2008 max relations containing the same ideal: 31
Sun Jun 29 00:56:22 2008 removing 1548179 relations and 1148179 ideals in 400000 cliques
Sun Jun 29 00:56:28 2008 commencing in-memory singleton removal
Sun Jun 29 00:57:31 2008 begin with 88696534 relations and 66500079 unique ideals
Sun Jun 29 01:04:22 2008 reduce to 88679874 relations and 65335153 ideals in 5 passes
Sun Jun 29 01:04:22 2008 max relations containing the same ideal: 30
Sun Jun 29 01:10:10 2008 removing 1537679 relations and 1137679 ideals in 400000 cliques
Sun Jun 29 01:10:20 2008 commencing in-memory singleton removal
Sun Jun 29 01:11:21 2008 begin with 87142195 relations and 65335153 unique ideals
Sun Jun 29 01:18:00 2008 reduce to 87126058 relations and 64181261 ideals in 5 passes
Sun Jun 29 01:18:00 2008 max relations containing the same ideal: 30
Sun Jun 29 01:22:35 2008 removing 1509583 relations and 1109583 ideals in 400000 cliques
Sun Jun 29 01:22:41 2008 commencing in-memory singleton removal
Sun Jun 29 01:23:20 2008 begin with 85616475 relations and 64181261 unique ideals
Sun Jun 29 01:27:13 2008 reduce to 85599662 relations and 63054785 ideals in 5 passes
Sun Jun 29 01:27:13 2008 max relations containing the same ideal: 30
Sun Jun 29 01:30:30 2008 removing 1500733 relations and 1100733 ideals in 400000 cliques
Sun Jun 29 01:30:36 2008 commencing in-memory singleton removal
Sun Jun 29 01:31:08 2008 begin with 84098929 relations and 63054785 unique ideals
Sun Jun 29 01:35:31 2008 reduce to 84081167 relations and 61936203 ideals in 6 passes
Sun Jun 29 01:35:31 2008 max relations containing the same ideal: 30
Sun Jun 29 01:38:52 2008 removing 1482410 relations and 1082410 ideals in 400000 cliques
Sun Jun 29 01:39:02 2008 commencing in-memory singleton removal
Sun Jun 29 01:40:01 2008 begin with 82598757 relations and 61936203 unique ideals
Sun Jun 29 01:46:16 2008 reduce to 82580457 relations and 60835408 ideals in 5 passes
Sun Jun 29 01:46:16 2008 max relations containing the same ideal: 29
Sun Jun 29 01:51:33 2008 removing 1467793 relations and 1067793 ideals in 400000 cliques
Sun Jun 29 01:51:43 2008 commencing in-memory singleton removal
Sun Jun 29 01:52:40 2008 begin with 81112664 relations and 60835408 unique ideals
Sun Jun 29 01:58:44 2008 reduce to 81094552 relations and 59749425 ideals in 5 passes
Sun Jun 29 01:58:44 2008 max relations containing the same ideal: 29
Sun Jun 29 02:03:39 2008 removing 1466160 relations and 1066160 ideals in 400000 cliques
Sun Jun 29 02:03:44 2008 commencing in-memory singleton removal
Sun Jun 29 02:04:25 2008 begin with 79628392 relations and 59749425 unique ideals
Sun Jun 29 02:08:17 2008 reduce to 79611719 relations and 58666518 ideals in 5 passes
Sun Jun 29 02:08:17 2008 max relations containing the same ideal: 29
Sun Jun 29 02:11:23 2008 removing 1442343 relations and 1042343 ideals in 400000 cliques
Sun Jun 29 02:11:28 2008 commencing in-memory singleton removal
Sun Jun 29 02:12:01 2008 begin with 78169376 relations and 58666518 unique ideals
Sun Jun 29 02:16:00 2008 reduce to 78152523 relations and 57607223 ideals in 6 passes
Sun Jun 29 02:16:00 2008 max relations containing the same ideal: 28
Sun Jun 29 02:18:55 2008 removing 1432256 relations and 1032256 ideals in 400000 cliques
Sun Jun 29 02:19:00 2008 commencing in-memory singleton removal
Sun Jun 29 02:19:32 2008 begin with 76720267 relations and 57607223 unique ideals
Sun Jun 29 02:23:03 2008 reduce to 76702535 relations and 56557136 ideals in 5 passes
Sun Jun 29 02:23:03 2008 max relations containing the same ideal: 28
Sun Jun 29 02:27:51 2008 removing 1429624 relations and 1029624 ideals in 400000 cliques
Sun Jun 29 02:27:57 2008 commencing in-memory singleton removal
Sun Jun 29 02:28:51 2008 begin with 75272911 relations and 56557136 unique ideals
Sun Jun 29 02:34:14 2008 reduce to 75255445 relations and 55509966 ideals in 5 passes
Sun Jun 29 02:34:14 2008 max relations containing the same ideal: 28
Sun Jun 29 02:38:53 2008 removing 1418300 relations and 1018300 ideals in 400000 cliques
Sun Jun 29 02:38:58 2008 commencing in-memory singleton removal
Sun Jun 29 02:39:50 2008 begin with 73837145 relations and 55509966 unique ideals
Sun Jun 29 02:45:11 2008 reduce to 73818628 relations and 54473069 ideals in 5 passes
Sun Jun 29 02:45:11 2008 max relations containing the same ideal: 28
Sun Jun 29 02:49:01 2008 removing 1412066 relations and 1012066 ideals in 400000 cliques
Sun Jun 29 02:49:06 2008 commencing in-memory singleton removal
Sun Jun 29 02:49:42 2008 begin with 72406562 relations and 54473069 unique ideals
Sun Jun 29 02:53:20 2008 reduce to 72387195 relations and 53441523 ideals in 5 passes
Sun Jun 29 02:53:20 2008 max relations containing the same ideal: 27
Sun Jun 29 02:56:19 2008 removing 1408135 relations and 1008135 ideals in 400000 cliques
Sun Jun 29 02:56:22 2008 commencing in-memory singleton removal
Sun Jun 29 02:56:55 2008 begin with 70979060 relations and 53441523 unique ideals
Sun Jun 29 03:00:17 2008 reduce to 70959570 relations and 52413781 ideals in 5 passes
Sun Jun 29 03:00:17 2008 max relations containing the same ideal: 27
Sun Jun 29 03:03:09 2008 removing 1394575 relations and 994575 ideals in 400000 cliques
Sun Jun 29 03:03:14 2008 commencing in-memory singleton removal
Sun Jun 29 03:03:44 2008 begin with 69564995 relations and 52413781 unique ideals
Sun Jun 29 03:08:22 2008 reduce to 69544424 relations and 51398516 ideals in 5 passes
Sun Jun 29 03:08:22 2008 max relations containing the same ideal: 27
Sun Jun 29 03:12:48 2008 removing 1406298 relations and 1006298 ideals in 400000 cliques
Sun Jun 29 03:12:56 2008 commencing in-memory singleton removal
Sun Jun 29 03:13:40 2008 begin with 68138126 relations and 51398516 unique ideals
Sun Jun 29 03:18:39 2008 reduce to 68118604 relations and 50372586 ideals in 5 passes
Sun Jun 29 03:18:39 2008 max relations containing the same ideal: 26
Sun Jun 29 03:22:59 2008 removing 1394291 relations and 994291 ideals in 400000 cliques
Sun Jun 29 03:23:07 2008 commencing in-memory singleton removal
Sun Jun 29 03:23:51 2008 begin with 66724313 relations and 50372586 unique ideals
Sun Jun 29 03:28:30 2008 reduce to 66704611 relations and 49358449 ideals in 5 passes
Sun Jun 29 03:28:30 2008 max relations containing the same ideal: 26
Sun Jun 29 03:31:26 2008 removing 852094 relations and 627912 ideals in 224182 cliques
Sun Jun 29 03:31:31 2008 commencing in-memory singleton removal
Sun Jun 29 03:32:02 2008 begin with 65852517 relations and 49358449 unique ideals
Sun Jun 29 03:34:32 2008 reduce to 65845925 relations and 48723919 ideals in 4 passes
Sun Jun 29 03:34:32 2008 max relations containing the same ideal: 26
Sun Jun 29 03:34:58 2008 filtering rational ideals above 720000
Sun Jun 29 03:34:58 2008 filtering algebraic ideals above 720000
Sun Jun 29 03:34:58 2008 need 115821 more relations than ideals
Sun Jun 29 03:34:58 2008 commencing singleton removal, final pass
Sun Jun 29 11:22:52 2008 keeping 94197666 ideals with weight <= 20, new excess is 9170105
Sun Jun 29 11:34:18 2008 memory use: 3649.3 MB
Sun Jun 29 11:34:20 2008 commencing in-memory singleton removal
Sun Jun 29 11:35:26 2008 begin with 122096502 relations and 94197666 unique ideals
Sun Jun 29 11:43:50 2008 reduce to 122096193 relations and 94197357 ideals in 6 passes
Sun Jun 29 11:43:50 2008 max relations containing the same ideal: 20
Sun Jun 29 11:51:49 2008 removing 3472098 relations and 3072098 ideals in 400000 cliques
Sun Jun 29 11:52:04 2008 commencing in-memory singleton removal
Sun Jun 29 11:54:22 2008 begin with 118624095 relations and 94197357 unique ideals
Sun Jun 29 12:13:22 2008 reduce to 118574153 relations and 91075080 ideals in 7 passes
Sun Jun 29 12:13:22 2008 max relations containing the same ideal: 20
Sun Jun 29 12:21:59 2008 removing 2607156 relations and 2207156 ideals in 400000 cliques
Sun Jun 29 12:22:10 2008 commencing in-memory singleton removal
Sun Jun 29 12:23:50 2008 begin with 115966997 relations and 91075080 unique ideals
Sun Jun 29 12:31:59 2008 reduce to 115935760 relations and 88836564 ideals in 6 passes
Sun Jun 29 12:31:59 2008 max relations containing the same ideal: 20
Sun Jun 29 12:36:59 2008 removing 2323712 relations and 1923712 ideals in 400000 cliques
Sun Jun 29 12:37:07 2008 commencing in-memory singleton removal
Sun Jun 29 12:38:05 2008 begin with 113612048 relations and 88836564 unique ideals
Sun Jun 29 12:49:42 2008 reduce to 113586390 relations and 86887110 ideals in 6 passes
Sun Jun 29 12:49:42 2008 max relations containing the same ideal: 20
Sun Jun 29 13:00:39 2008 removing 2156538 relations and 1756538 ideals in 400000 cliques
Sun Jun 29 13:00:51 2008 commencing in-memory singleton removal
Sun Jun 29 13:02:59 2008 begin with 111429852 relations and 86887110 unique ideals
Sun Jun 29 13:15:20 2008 reduce to 111406367 relations and 85107031 ideals in 6 passes
Sun Jun 29 13:15:20 2008 max relations containing the same ideal: 20
Sun Jun 29 13:21:36 2008 removing 2038087 relations and 1638087 ideals in 400000 cliques
Sun Jun 29 13:21:44 2008 commencing in-memory singleton removal
Sun Jun 29 13:22:39 2008 begin with 109368280 relations and 85107031 unique ideals
Sun Jun 29 13:28:21 2008 reduce to 109347261 relations and 83447847 ideals in 5 passes
Sun Jun 29 13:28:21 2008 max relations containing the same ideal: 20
Sun Jun 29 13:33:00 2008 removing 1950865 relations and 1550865 ideals in 400000 cliques
Sun Jun 29 13:33:06 2008 commencing in-memory singleton removal
Sun Jun 29 13:34:04 2008 begin with 107396396 relations and 83447847 unique ideals
Sun Jun 29 13:48:49 2008 reduce to 107376400 relations and 81876923 ideals in 6 passes
Sun Jun 29 13:48:49 2008 max relations containing the same ideal: 20
Sun Jun 29 13:59:18 2008 removing 1877103 relations and 1477103 ideals in 400000 cliques
Sun Jun 29 13:59:30 2008 commencing in-memory singleton removal
Sun Jun 29 14:01:10 2008 begin with 105499297 relations and 81876923 unique ideals
Sun Jun 29 14:12:40 2008 reduce to 105480620 relations and 80381089 ideals in 6 passes
Sun Jun 29 14:12:40 2008 max relations containing the same ideal: 20
Sun Jun 29 14:17:53 2008 removing 1825031 relations and 1425031 ideals in 400000 cliques
Sun Jun 29 14:18:01 2008 commencing in-memory singleton removal
Sun Jun 29 14:18:57 2008 begin with 103655589 relations and 80381089 unique ideals
Sun Jun 29 14:27:19 2008 reduce to 103636809 relations and 78937211 ideals in 7 passes
Sun Jun 29 14:27:19 2008 max relations containing the same ideal: 20
Sun Jun 29 14:33:36 2008 removing 1768620 relations and 1368620 ideals in 400000 cliques
Sun Jun 29 14:33:48 2008 commencing in-memory singleton removal
Sun Jun 29 14:35:47 2008 begin with 101868189 relations and 78937211 unique ideals
Sun Jun 29 14:50:26 2008 reduce to 101849924 relations and 77550265 ideals in 6 passes
Sun Jun 29 14:50:26 2008 max relations containing the same ideal: 20
Sun Jun 29 14:59:16 2008 removing 1731983 relations and 1331983 ideals in 400000 cliques
Sun Jun 29 14:59:27 2008 commencing in-memory singleton removal
Sun Jun 29 15:00:53 2008 begin with 100117941 relations and 77550265 unique ideals
Sun Jun 29 15:09:33 2008 reduce to 100101044 relations and 76201322 ideals in 5 passes
Sun Jun 29 15:09:33 2008 max relations containing the same ideal: 20
Sun Jun 29 15:14:18 2008 removing 1693925 relations and 1293925 ideals in 400000 cliques
Sun Jun 29 15:14:24 2008 commencing in-memory singleton removal
Sun Jun 29 15:15:11 2008 begin with 98407119 relations and 76201322 unique ideals
Sun Jun 29 15:20:17 2008 reduce to 98389846 relations and 74890072 ideals in 5 passes
Sun Jun 29 15:20:17 2008 max relations containing the same ideal: 20
Sun Jun 29 15:24:31 2008 removing 1668621 relations and 1268621 ideals in 400000 cliques
Sun Jun 29 15:24:38 2008 commencing in-memory singleton removal
Sun Jun 29 15:25:26 2008 begin with 96721225 relations and 74890072 unique ideals
Sun Jun 29 15:36:19 2008 reduce to 96704360 relations and 73604516 ideals in 5 passes
Sun Jun 29 15:36:19 2008 max relations containing the same ideal: 20
Sun Jun 29 15:45:42 2008 removing 1631255 relations and 1231255 ideals in 400000 cliques
Sun Jun 29 15:45:54 2008 commencing in-memory singleton removal
Sun Jun 29 15:47:43 2008 begin with 95073105 relations and 73604516 unique ideals
Sun Jun 29 15:56:28 2008 reduce to 95055270 relations and 72355366 ideals in 5 passes
Sun Jun 29 15:56:28 2008 max relations containing the same ideal: 20
Sun Jun 29 16:03:14 2008 removing 1618624 relations and 1218624 ideals in 400000 cliques
Sun Jun 29 16:03:22 2008 commencing in-memory singleton removal
Sun Jun 29 16:04:29 2008 begin with 93436646 relations and 72355366 unique ideals
Sun Jun 29 16:10:45 2008 reduce to 93421051 relations and 71121086 ideals in 6 passes
Sun Jun 29 16:10:45 2008 max relations containing the same ideal: 20
Sun Jun 29 16:14:41 2008 removing 1587338 relations and 1187338 ideals in 400000 cliques
Sun Jun 29 16:14:46 2008 commencing in-memory singleton removal
Sun Jun 29 16:15:31 2008 begin with 91833713 relations and 71121086 unique ideals
Sun Jun 29 16:20:20 2008 reduce to 91818315 relations and 69918282 ideals in 5 passes
Sun Jun 29 16:20:20 2008 max relations containing the same ideal: 20
Sun Jun 29 16:27:55 2008 removing 1561002 relations and 1161002 ideals in 400000 cliques
Sun Jun 29 16:28:07 2008 commencing in-memory singleton removal
Sun Jun 29 16:29:46 2008 begin with 90257313 relations and 69918282 unique ideals
Sun Jun 29 16:40:15 2008 reduce to 90240613 relations and 68740507 ideals in 5 passes
Sun Jun 29 16:40:15 2008 max relations containing the same ideal: 20
Sun Jun 29 16:47:52 2008 removing 1548012 relations and 1148012 ideals in 400000 cliques
Sun Jun 29 16:48:02 2008 commencing in-memory singleton removal
Sun Jun 29 16:49:17 2008 begin with 88692601 relations and 68740507 unique ideals
Sun Jun 29 16:56:55 2008 reduce to 88676043 relations and 67575862 ideals in 5 passes
Sun Jun 29 16:56:55 2008 max relations containing the same ideal: 20
Sun Jun 29 17:01:35 2008 removing 1538173 relations and 1138173 ideals in 400000 cliques
Sun Jun 29 17:01:41 2008 commencing in-memory singleton removal
Sun Jun 29 17:02:23 2008 begin with 87137870 relations and 67575862 unique ideals
Sun Jun 29 17:06:35 2008 reduce to 87121857 relations and 66421602 ideals in 5 passes
Sun Jun 29 17:06:35 2008 max relations containing the same ideal: 20
Sun Jun 29 17:10:09 2008 removing 1511128 relations and 1111128 ideals in 400000 cliques
Sun Jun 29 17:10:15 2008 commencing in-memory singleton removal
Sun Jun 29 17:10:56 2008 begin with 85610729 relations and 66421602 unique ideals
Sun Jun 29 17:16:11 2008 reduce to 85594050 relations and 65293721 ideals in 5 passes
Sun Jun 29 17:16:11 2008 max relations containing the same ideal: 20
Sun Jun 29 17:23:51 2008 removing 1497906 relations and 1097906 ideals in 400000 cliques
Sun Jun 29 17:24:01 2008 commencing in-memory singleton removal
Sun Jun 29 17:25:30 2008 begin with 84096144 relations and 65293721 unique ideals
Sun Jun 29 17:36:13 2008 reduce to 84078000 relations and 64177589 ideals in 6 passes
Sun Jun 29 17:36:13 2008 max relations containing the same ideal: 20
Sun Jun 29 17:43:10 2008 removing 1487286 relations and 1087286 ideals in 400000 cliques
Sun Jun 29 17:43:19 2008 commencing in-memory singleton removal
Sun Jun 29 17:44:24 2008 begin with 82590714 relations and 64177589 unique ideals
Sun Jun 29 17:52:32 2008 reduce to 82572798 relations and 63072292 ideals in 6 passes
Sun Jun 29 17:52:32 2008 max relations containing the same ideal: 20
Sun Jun 29 17:56:11 2008 removing 1464344 relations and 1064344 ideals in 400000 cliques
Sun Jun 29 17:56:16 2008 commencing in-memory singleton removal
Sun Jun 29 17:56:52 2008 begin with 81108454 relations and 63072292 unique ideals
Sun Jun 29 18:00:33 2008 reduce to 81089884 relations and 61989289 ideals in 5 passes
Sun Jun 29 18:00:33 2008 max relations containing the same ideal: 20
Sun Jun 29 18:03:44 2008 removing 1468708 relations and 1068708 ideals in 400000 cliques
Sun Jun 29 18:03:48 2008 commencing in-memory singleton removal
Sun Jun 29 18:04:23 2008 begin with 79621176 relations and 61989289 unique ideals
Sun Jun 29 18:08:00 2008 reduce to 79604341 relations and 60903672 ideals in 5 passes
Sun Jun 29 18:08:00 2008 max relations containing the same ideal: 20
Sun Jun 29 18:14:10 2008 removing 1444903 relations and 1044903 ideals in 400000 cliques
Sun Jun 29 18:14:18 2008 commencing in-memory singleton removal
Sun Jun 29 18:15:38 2008 begin with 78159438 relations and 60903672 unique ideals
Sun Jun 29 18:23:49 2008 reduce to 78142513 relations and 59841754 ideals in 5 passes
Sun Jun 29 18:23:49 2008 max relations containing the same ideal: 20
Sun Jun 29 18:30:43 2008 removing 1429353 relations and 1029353 ideals in 400000 cliques
Sun Jun 29 18:30:52 2008 commencing in-memory singleton removal
Sun Jun 29 18:32:06 2008 begin with 76713160 relations and 59841754 unique ideals
Sun Jun 29 18:38:49 2008 reduce to 76695105 relations and 58794238 ideals in 5 passes
Sun Jun 29 18:38:49 2008 max relations containing the same ideal: 20
Sun Jun 29 18:44:12 2008 removing 1433464 relations and 1033464 ideals in 400000 cliques
Sun Jun 29 18:44:20 2008 commencing in-memory singleton removal
Sun Jun 29 18:45:18 2008 begin with 75261641 relations and 58794238 unique ideals
Sun Jun 29 18:49:38 2008 reduce to 75244442 relations and 57743486 ideals in 5 passes
Sun Jun 29 18:49:38 2008 max relations containing the same ideal: 20
Sun Jun 29 18:52:34 2008 removing 1415261 relations and 1015261 ideals in 400000 cliques
Sun Jun 29 18:52:39 2008 commencing in-memory singleton removal
Sun Jun 29 18:53:09 2008 begin with 73829181 relations and 57743486 unique ideals
Sun Jun 29 18:56:25 2008 reduce to 73810716 relations and 56709666 ideals in 5 passes
Sun Jun 29 18:56:25 2008 max relations containing the same ideal: 20
Sun Jun 29 18:59:18 2008 removing 1419172 relations and 1019172 ideals in 400000 cliques
Sun Jun 29 18:59:23 2008 commencing in-memory singleton removal
Sun Jun 29 18:59:53 2008 begin with 72391544 relations and 56709666 unique ideals
Sun Jun 29 19:03:16 2008 reduce to 72372516 relations and 55671367 ideals in 5 passes
Sun Jun 29 19:03:16 2008 max relations containing the same ideal: 20
Sun Jun 29 19:08:20 2008 removing 1406510 relations and 1006510 ideals in 400000 cliques
Sun Jun 29 19:08:27 2008 commencing in-memory singleton removal
Sun Jun 29 19:09:34 2008 begin with 70966006 relations and 55671367 unique ideals
Sun Jun 29 19:16:34 2008 reduce to 70946545 relations and 54645268 ideals in 5 passes
Sun Jun 29 19:16:34 2008 max relations containing the same ideal: 20
Sun Jun 29 19:22:35 2008 removing 1402038 relations and 1002038 ideals in 400000 cliques
Sun Jun 29 19:22:43 2008 commencing in-memory singleton removal
Sun Jun 29 19:23:51 2008 begin with 69544507 relations and 54645268 unique ideals
Sun Jun 29 19:30:20 2008 reduce to 69524485 relations and 53623089 ideals in 5 passes
Sun Jun 29 19:30:20 2008 max relations containing the same ideal: 20
Sun Jun 29 19:35:13 2008 removing 1395688 relations and 995688 ideals in 400000 cliques
Sun Jun 29 19:35:21 2008 commencing in-memory singleton removal
Sun Jun 29 19:36:13 2008 begin with 68128797 relations and 53623089 unique ideals
Sun Jun 29 19:41:44 2008 reduce to 68108319 relations and 52606808 ideals in 5 passes
Sun Jun 29 19:41:44 2008 max relations containing the same ideal: 20
Sun Jun 29 19:45:04 2008 removing 1400252 relations and 1000252 ideals in 400000 cliques
Sun Jun 29 19:45:09 2008 commencing in-memory singleton removal
Sun Jun 29 19:45:38 2008 begin with 66708067 relations and 52606808 unique ideals
Sun Jun 29 19:48:28 2008 reduce to 66687832 relations and 51586186 ideals in 5 passes
Sun Jun 29 19:48:28 2008 max relations containing the same ideal: 20
Sun Jun 29 19:51:04 2008 removing 1390491 relations and 990491 ideals in 400000 cliques
Sun Jun 29 19:51:10 2008 commencing in-memory singleton removal
Sun Jun 29 19:51:36 2008 begin with 65297341 relations and 51586186 unique ideals
Sun Jun 29 19:54:26 2008 reduce to 65276629 relations and 50574832 ideals in 5 passes
Sun Jun 29 19:54:26 2008 max relations containing the same ideal: 20
Sun Jun 29 19:56:56 2008 removing 1384893 relations and 984893 ideals in 400000 cliques
Sun Jun 29 19:57:01 2008 commencing in-memory singleton removal
Sun Jun 29 19:57:27 2008 begin with 63891736 relations and 50574832 unique ideals
Sun Jun 29 20:02:33 2008 reduce to 63870728 relations and 49568801 ideals in 5 passes
Sun Jun 29 20:02:33 2008 max relations containing the same ideal: 20
Sun Jun 29 20:07:58 2008 removing 1382794 relations and 982794 ideals in 400000 cliques
Sun Jun 29 20:08:06 2008 commencing in-memory singleton removal
Sun Jun 29 20:09:04 2008 begin with 62487934 relations and 49568801 unique ideals
Sun Jun 29 20:15:16 2008 reduce to 62465981 relations and 48563882 ideals in 5 passes
Sun Jun 29 20:15:16 2008 max relations containing the same ideal: 20
Sun Jun 29 20:20:25 2008 removing 1381944 relations and 981944 ideals in 400000 cliques
Sun Jun 29 20:20:34 2008 commencing in-memory singleton removal
Sun Jun 29 20:21:29 2008 begin with 61084037 relations and 48563882 unique ideals
Sun Jun 29 20:26:33 2008 reduce to 61061394 relations and 47559111 ideals in 5 passes
Sun Jun 29 20:26:33 2008 max relations containing the same ideal: 20
Sun Jun 29 20:30:40 2008 removing 1379093 relations and 979093 ideals in 400000 cliques
Sun Jun 29 20:30:45 2008 commencing in-memory singleton removal
Sun Jun 29 20:31:30 2008 begin with 59682301 relations and 47559111 unique ideals
Sun Jun 29 20:35:00 2008 reduce to 59658529 relations and 46556067 ideals in 4 passes
Sun Jun 29 20:35:00 2008 max relations containing the same ideal: 20
Sun Jun 29 20:38:18 2008 removing 1378226 relations and 978226 ideals in 400000 cliques
Sun Jun 29 20:38:22 2008 commencing in-memory singleton removal
Sun Jun 29 20:38:49 2008 begin with 58280303 relations and 46556067 unique ideals
Sun Jun 29 20:41:26 2008 reduce to 58256025 relations and 45553349 ideals in 5 passes
Sun Jun 29 20:41:26 2008 max relations containing the same ideal: 20
Sun Jun 29 20:43:37 2008 removing 1375943 relations and 975943 ideals in 400000 cliques
Sun Jun 29 20:43:41 2008 commencing in-memory singleton removal
Sun Jun 29 20:44:02 2008 begin with 56880082 relations and 45553349 unique ideals
Sun Jun 29 20:46:28 2008 reduce to 56854435 relations and 44551520 ideals in 5 passes
Sun Jun 29 20:46:28 2008 max relations containing the same ideal: 19
Sun Jun 29 20:48:37 2008 removing 1377998 relations and 977998 ideals in 400000 cliques
Sun Jun 29 20:48:40 2008 commencing in-memory singleton removal
Sun Jun 29 20:49:02 2008 begin with 55476437 relations and 44551520 unique ideals
Sun Jun 29 20:51:20 2008 reduce to 55450310 relations and 43547156 ideals in 5 passes
Sun Jun 29 20:51:20 2008 max relations containing the same ideal: 19
Sun Jun 29 20:53:26 2008 removing 1379396 relations and 979396 ideals in 400000 cliques
Sun Jun 29 20:53:31 2008 commencing in-memory singleton removal
Sun Jun 29 20:53:51 2008 begin with 54070914 relations and 43547156 unique ideals
Sun Jun 29 20:59:59 2008 reduce to 54043885 relations and 42540490 ideals in 7 passes
Sun Jun 29 20:59:59 2008 max relations containing the same ideal: 19
Sun Jun 29 21:04:26 2008 removing 1380915 relations and 980915 ideals in 400000 cliques
Sun Jun 29 21:04:33 2008 commencing in-memory singleton removal
Sun Jun 29 21:05:21 2008 begin with 52662970 relations and 42540490 unique ideals
Sun Jun 29 21:10:20 2008 reduce to 52635012 relations and 41531340 ideals in 5 passes
Sun Jun 29 21:10:20 2008 max relations containing the same ideal: 19
Sun Jun 29 21:14:39 2008 removing 1383142 relations and 983142 ideals in 400000 cliques
Sun Jun 29 21:14:47 2008 commencing in-memory singleton removal
Sun Jun 29 21:15:35 2008 begin with 51251870 relations and 41531340 unique ideals
Sun Jun 29 21:19:56 2008 reduce to 51223155 relations and 40519195 ideals in 5 passes
Sun Jun 29 21:19:56 2008 max relations containing the same ideal: 19
Sun Jun 29 21:23:18 2008 removing 305491 relations and 238853 ideals in 66638 cliques
Sun Jun 29 21:23:23 2008 commencing in-memory singleton removal
Sun Jun 29 21:23:59 2008 begin with 50917664 relations and 40519195 unique ideals
Sun Jun 29 21:27:03 2008 reduce to 50916585 relations and 40279263 ideals in 4 passes
Sun Jun 29 21:27:03 2008 max relations containing the same ideal: 19
Sun Jun 29 21:27:44 2008 relations with 0 large ideals: 673010
Sun Jun 29 21:27:44 2008 relations with 1 large ideals: 4291461
Sun Jun 29 21:27:44 2008 relations with 2 large ideals: 11817123
Sun Jun 29 21:27:44 2008 relations with 3 large ideals: 16698836
Sun Jun 29 21:27:44 2008 relations with 4 large ideals: 12381109
Sun Jun 29 21:27:44 2008 relations with 5 large ideals: 4495384
Sun Jun 29 21:27:44 2008 relations with 6 large ideals: 529228
Sun Jun 29 21:27:44 2008 relations with 7+ large ideals: 30434
Sun Jun 29 21:27:44 2008 commencing 2-way merge
Sun Jun 29 21:31:43 2008 reduce to 36413344 relation sets and 25776022 unique ideals
Sun Jun 29 21:31:43 2008 commencing full merge
Sun Jun 29 21:54:52 2008 memory use: 2374.4 MB
Sun Jun 29 21:54:57 2008 found 19019201 cycles, need 17552222
Sun Jun 29 21:55:22 2008 weight of 17552222 cycles is about 1228854275 (70.01/cycle)
Sun Jun 29 21:55:22 2008 distribution of cycle lengths:
Sun Jun 29 21:55:23 2008 1 relations: 1703713
Sun Jun 29 21:55:23 2008 2 relations: 2146763
Sun Jun 29 21:55:23 2008 3 relations: 2455677
Sun Jun 29 21:55:23 2008 4 relations: 2399057
Sun Jun 29 21:55:23 2008 5 relations: 2274063
Sun Jun 29 21:55:23 2008 6 relations: 1973776
Sun Jun 29 21:55:23 2008 7 relations: 1658485
Sun Jun 29 21:55:23 2008 8 relations: 1311212
Sun Jun 29 21:55:23 2008 9 relations: 980379
Sun Jun 29 21:55:23 2008 10+ relations: 649097
Sun Jun 29 21:55:23 2008 heaviest cycle: 11 relations
Sun Jun 29 21:55:38 2008 commencing cycle optimization
Sun Jun 29 21:58:54 2008 start with 83612281 relations
Sun Jun 29 22:12:28 2008 pruned 1551368 relations
Sun Jun 29 22:12:30 2008 memory use: 2848.3 MB
Sun Jun 29 22:12:30 2008 distribution of cycle lengths:
Sun Jun 29 22:12:30 2008 1 relations: 1703713
Sun Jun 29 22:12:30 2008 2 relations: 2184418
Sun Jun 29 22:12:30 2008 3 relations: 2535321
Sun Jun 29 22:12:30 2008 4 relations: 2456193
Sun Jun 29 22:12:30 2008 5 relations: 2337978
Sun Jun 29 22:12:30 2008 6 relations: 2010181
Sun Jun 29 22:12:30 2008 7 relations: 1671069
Sun Jun 29 22:12:30 2008 8 relations: 1277101
Sun Jun 29 22:12:30 2008 9 relations: 887462
Sun Jun 29 22:12:30 2008 10+ relations: 488786
Sun Jun 29 22:12:30 2008 heaviest cycle: 11 relations
Sun Jun 29 22:14:31 2008
Sun Jun 29 22:15:06 2008 commencing linear algebra
Sun Jun 29 22:15:11 2008 read 17552222 cycles
Sun Jun 29 22:27:32 2008 cycles contain 46828066 unique relations
Sun Jun 29 22:37:37 2008 read 46828066 relations
Sun Jun 29 22:44:42 2008 using 32 quadratic characters above 2147483630
Sun Jun 29 22:56:37 2008 building initial matrix
Mon Jun 30 00:15:01 2008 memory use: 6071.0 MB
Mon Jun 30 00:15:29 2008 read 17552222 cycles
Mon Jun 30 00:16:00 2008 matrix is 17551760 x 17552222 (5276.9 MB) with weight 1622323775 (92.43/col)
Mon Jun 30 00:16:00 2008 sparse part has weight 1190223841 (67.81/col)
Mon Jun 30 00:55:27 2008 filtering completed in 3 passes
Mon Jun 30 00:55:39 2008 matrix is 17516334 x 17516534 (5272.8 MB) with weight 1620810005 (92.53/col)
Mon Jun 30 00:55:39 2008 sparse part has weight 1189559600 (67.91/col)
Mon Jun 30 01:01:03 2008 read 17516534 cycles
Mon Jun 30 01:01:33 2008 matrix is 17516334 x 17516534 (5272.8 MB) with weight 1620810005 (92.53/col)
Mon Jun 30 01:01:33 2008 sparse part has weight 1189559600 (67.91/col)
Mon Jun 30 01:01:34 2008 saving the first 48 matrix rows for later
Mon Jun 30 01:02:00 2008 matrix is 17516286 x 17516534 (5050.2 MB) with weight 1242199788 (70.92/col)
Mon Jun 30 01:02:01 2008 sparse part has weight 1148718869 (65.58/col)
Mon Jun 30 01:02:01 2008 matrix includes 64 packed rows
Mon Jun 30 01:02:01 2008 using block size 65536 for processor cache size 2048 kB
Mon Jun 30 01:05:03 2008 commencing Lanczos iteration
Mon Jun 30 01:05:03 2008 memory use: 4978.3 MB
Mon Jun 30 11:32:21 2008 lanczos halted after 547 iterations (dim = 34622)

... a few restarts removed ...

Sun Aug 24 16:19:48 2008
Sun Aug 24 16:19:48 2008 Msieve v. 1.36
Sun Aug 24 16:19:48 2008 random seeds: 619999c1 da4c554f
Sun Aug 24 16:19:48 2008 factoring 409823197542297503216161647865376032214385529358894751862304291868712197216175369592274928569578876152382555077477130553079988651737367581007139968262008094847510731049892377516641261443488944792954771177714811031897011366576098105498726018771910782614950431283801 (264 digits)
Sun Aug 24 16:19:52 2008 no P-1/P+1/ECM available, skipping
Sun Aug 24 16:19:53 2008 commencing number field sieve (264-digit input)
Sun Aug 24 16:19:53 2008 R0: -88124787089723195184393736687912818113311201
Sun Aug 24 16:19:53 2008 R1: 1
Sun Aug 24 16:19:53 2008 A0: 1
Sun Aug 24 16:19:53 2008 A1: 0
Sun Aug 24 16:19:53 2008 A2: 0
Sun Aug 24 16:19:53 2008 A3: 0
Sun Aug 24 16:19:53 2008 A4: 0
Sun Aug 24 16:19:53 2008 A5: 0
Sun Aug 24 16:19:53 2008 A6: 7
Sun Aug 24 16:19:53 2008 size score = 9.394910e-13, Murphy alpha = 1.964246, combined = 5.359952e-13
Sun Aug 24 16:19:53 2008
Sun Aug 24 16:19:53 2008 commencing linear algebra
Sun Aug 24 16:20:13 2008 read 17516534 cycles
Sun Aug 24 16:24:19 2008 matrix is 17516334 x 17516534 (5272.8 MB) with weight 1620810005 (92.53/col)
Sun Aug 24 16:24:19 2008 sparse part has weight 1189559600 (67.91/col)
Sun Aug 24 16:24:20 2008 saving the first 48 matrix rows for later
Sun Aug 24 16:24:38 2008 matrix is 17516286 x 17516534 (5050.2 MB) with weight 1242199788 (70.92/col)
Sun Aug 24 16:24:38 2008 sparse part has weight 1148718869 (65.58/col)
Sun Aug 24 16:24:38 2008 matrix includes 64 packed rows
Sun Aug 24 16:24:38 2008 using block size 65536 for processor cache size 2048 kB
Sun Aug 24 16:27:14 2008 commencing Lanczos iteration (8 threads)
Sun Aug 24 16:27:14 2008 memory use: 5913.8 MB
Sun Aug 24 16:27:24 2008 restarting at iteration 203285 (dim = 12854883)
Sat Sep 20 03:08:57 2008 lanczos halted after 276999 iterations (dim = 17516284)
Sat Sep 20 03:10:44 2008 recovered 45 nontrivial dependencies
Sat Sep 20 03:10:46 2008
Sat Sep 20 03:10:46 2008 commencing square root phase
Sat Sep 20 03:10:46 2008 reading relations for dependency 1
Sat Sep 20 03:11:00 2008 read 8759041 cycles
Sat Sep 20 03:16:10 2008 cycles contain 28802530 unique relations
Sat Sep 20 03:25:11 2008 read 28802530 relations
Sat Sep 20 03:54:55 2008 multiplying 41018894 relations
Sat Sep 20 09:49:26 2008 multiply complete, coefficients have about 1183.37 million bits
Sat Sep 20 09:50:10 2008 initial square root is modulo 203383
Sun Sep 21 00:46:01 2008 prp76 factor: 2975299737951435964540299996898411217993568426081224805202105572310472987267
Sun Sep 21 00:46:01 2008 prp189 factor: 137741818854348583884185387895829731532755157992504981233434514906522897328661266349593048714205323208173427503632881246417304040292597529414966939921057660532055795650129085411468978166003
Sun Sep 21 00:46:01 2008 elapsed time 656:26:13[/CODE]

Most excellent. Will post v1.38 soon; the square root can be used independently of whatever version did the linear algebra so you're not stuck with the older version for the factorizations you have in progress. When do you expect the next matrix job to complete?

The matrix for 6,392+ will finish in about a week. The matrix for it is a bit smaller, 14392377 x 14392625 (4048.1 MB) with weight 998345063 (69.37/col). I also still have the files for 7,313+ sitting here, so I'll give it a try as soon as you release it.

Speaking of which, I'll run the 1.37 filtering on the 7,313+ relations now to see how the result compares to what 1.36 produced. The file already has the free relations 1.36 produced. Hopefully that won't cause any problems...

Greg

It won't cause any problems, but I expect the result to be just about identical except the matrix should end up slightly smaller. The filtering changes in v1.38 will only affect datasets with a large amount of excess relations.

factMsieve.pl (most probable) trouble, not msieve'
 

One thing I noticed (for the iterative reruns of the matrix stage) is that the [I]*.fb[/I] file gets slightly bigger after an attempted matrix build and later cannot be used (or the [I]*.dat[/I] file will be [U]emptied[/U] by the binary -- something somewhere doesn't match and that signals [I]msieve[/I] that this is a new project, so off everything goes). Free relations? But these are probably added to [I]*.dat[/I] file, not to [I]*.fb[/I]. This may be caused by the [I]factMsieve.pl[/I] script and not the binary. Is this a known effect?

(I am sure that you are not using the perl script though. I do, out of laziness; it prepares all the prerequisites in an empty directory, where I then pile up all parallel-sieved rels >> [I]*.dat . [/I]Because [I]*.dat[/I] file may become empty after [I]msieve[/I] is run and because I haven't figured out why/when **it happens, I always treat all the files in such a matrix build directory as expendable.)

Pardon for a half-chewed piece of thought. If this is not a known problem, then I can ruminate on it and describe it properly.

A parallel thought: Greg, could you please post a blessed version (if you have one, the latest and greatest) of the [I]factMsieve.pl[/I] attached to one of your messages here - and maybe by eyeballing it I will understand my folly? I got mine from the Files section of the ggnfs yahoo group (kinda work in progress and labeled as such, dated Jan 21, 2008; it works if not messed with - not stopped etc; but of course I do stop it, try to restart it and then trouble steps in - if this is between important stages).

--Serge