mersenneforum.org

mersenneforum.org (https://www.mersenneforum.org/index.php)
-   Factoring (https://www.mersenneforum.org/forumdisplay.php?f=19)
-   -   New GGNFS problem (https://www.mersenneforum.org/showthread.php?t=11039)

10metreh 2008-11-27 11:08

New GGNFS problem
 
When I try to run procrels, it finds one factor and then a Windows error window appears:

"procrels.exe has encountered a problem and needs to close. We are sorry about this inconvenience. Please tell Microsoft about this problem."

We have all encountered this message. The only question is, what caused procrels to stop working?

smh 2008-11-27 13:34

Don't use procrels anymore. pol51 and especially msieve produce much better polynomials.

henryzz 2008-11-27 15:12

[quote=smh;150959]Don't use procrels anymore. pol51 and especially msieve produce much better polynomials.[/quote]
procrels processes relations not finds polynomials

smh 2008-11-27 18:59

[QUOTE=henryzz;150965]procrels processes relations not finds polynomials[/QUOTE]:ouch2:Dunno how i confussed this with the old polyselect:blush:

10metreh 2008-11-27 19:54

I am now using factLat.pl but an error message appears:

Could not find default parameter file c:/Programme/Primes/ggnfs/def-par.txt!

The path here has the slashes the wrong way round and is nothing like my filepath. def-par.txt is in my gnfs folder. So why does factLat.pl think def-par.txt is not there?

henryzz 2008-11-27 19:59

[quote=10metreh;151021]I am now using factLat.pl but an error message appears:

Could not find default parameter file c:/Programme/Primes/ggnfs/def-par.txt!

The path here has the slashes the wrong way round and is nothing like my filepath. def-par.txt is in my gnfs folder. So why does factLat.pl think def-par.txt is not there?[/quote]
you need to edit the paths in factlat.pl to what you want them to be

smh 2008-11-27 21:42

May I advise you to use factmsieve.pl

henryzz 2008-11-28 09:23

[quote=smh;151031]May I advise you to use factmsieve.pl[/quote]
factmsieve.pl drives me up the wall because it does not output factors to the log file
for the size of numbers we are going to be doing (100-~110) factlat.pl wont be too much slower
there are too many bugs in it and i dont really trust it

10metreh 2008-11-28 15:46

Do you mean edit the script?

If so, in how many places is a path mentioned?

henryzz 2008-11-28 17:20

[quote=10metreh;151105]Do you mean edit the script?

If so, in how many places is a path mentioned?[/quote]
yes i do

two

10metreh 2008-11-28 18:10

I am not a GNFS expert. When you make a poly with msieve, it has R0 and R1 values. Which one do you use for a GGNFS "m" value? When using R0 I get a polynomial error. Same with R1.

10metreh

P.S. Henry, I think my joining has induced an increase in your posting rate. Do you agree?

Andi47 2008-11-28 18:40

[QUOTE=10metreh;151118]I am not a GNFS expert. When you make a poly with msieve, it has R0 and R1 values. Which one do you use for a GGNFS "m" value? When using R0 I get a polynomial error. Same with R1.

10metreh

P.S. Henry, I think my joining has induced an increase in your posting rate. Do you agree?[/QUOTE]

The R0 and R1 are called Y0 and Y1 in GGNFS, the A0, A1, etc. are called c0, c1, etc. in GGNFS. You need not specify an "m" value for GGNFS.

(Feature request to either GGNFS or msieve (or both): input / output polynomials in the same format.)

henryzz 2008-11-28 19:01

[quote=10metreh;151118]I am not a GNFS expert. When you make a poly with msieve, it has R0 and R1 values. Which one do you use for a GGNFS "m" value? When using R0 I get a polynomial error. Same with R1.

10metreh

P.S. Henry, I think my joining has induced an increase in your posting rate. Do you agree?[/quote]
yes it has although i have posted more recently in other things as well

if you cant get the msieve polynomials to work in ggnfs dont worry the ggnfs polynomial selection isnt that rubbish:smile:
it will help much more for larger jobs
with the size we are doing convinience plays a large part in what we do
i would probably waste the time i save by using the msieve polynomial selection in converting it to the ggnfs format

10metreh 2008-11-28 19:47

I have converted the msieve poly and it runs 4 times faster than the best poly that polyselect has found in the same time! :smile:

I haven't tested pol51 but I will stick to msieve for the time being.

P.S. I hope closing the program will save the relations to spairs.out so I can restart - I am trying to save energy.

P.P.S. Currently I am on "total yield: 375000, q=945000" (values not exact). How high do these have to get?

henryzz 2008-11-28 20:29

[quote=10metreh;151129]I have converted the msieve poly and it runs 4 times faster than the best poly that polyselect has found in the same time! :smile:

I haven't tested pol51 but I will stick to msieve for the time being.

P.S. I hope closing the program will save the relations to spairs.out so I can restart - I am trying to save energy.

P.P.S. Currently I am on "total yield: 375000, q=945000" (values not exact). How high do these have to get?[/quote]
polyselect is rubbish
pol51 is much better and only a little worse than msieve although i dont think msieve is anywhere near as good as it will get

re P.S.
it wont save the relations
especially if they arent using the same polys

re P.P.S.
as a vague estimate q will get to 1.5mil for this factorization
but dont rely on it as it is as vague as my estimate the other day(which was about half my estimate)

smh 2008-11-28 21:26

[QUOTE=10metreh;151129]... it runs 4 times faster than the best poly that polyselect has found in the same time![/QUOTE]Told you!!

The only advantage of polyselect is that it can find deg. 4 poly's, but a deg5 poly from pol51/msieve will be better than a deg4 poly from polyselect.

Even running msieve's QS will be faster!

10metreh 2008-11-29 08:25

The relations do get saved, but in a file called spairs.add. This suggests that there is a way of resuming work, but I have not found it yet: using factLat.pl as before starts the sieving from the beginning, and saving the spairs.add file as spairs.out is no help. How do I resume?

henryzz 2008-11-29 10:22

i am just doing the linear algebra on a 100 digit gnfs for my aliquot sequence
q went up to 1.4M and that produced 3.6M relations

it will save the relations, at the 100 digit level, every 100k q values
it will also do a postprocessing run to see if you have sieved enough

schickel 2008-11-29 10:42

[QUOTE=10metreh;151191]The relations do get saved, but in a file called spairs.add. This suggests that there is a way of resuming work, but I have not found it yet: using factLat.pl as before starts the sieving from the beginning, and saving the spairs.add file as spairs.out is no help. How do I resume?[/QUOTE]If you are interrupting the siever before the end of the sieve block, yes, it is supposed to resume from where it left off and add in all the relations it found before it was interrupted. I have never had it work correctly for me, so I found the easiest way is to interrupt only [i]after[/i] a block has finished and procrels has run. If you interrupt it [i]before[/i] procrels runs, the job file is not updated and it will start the block over again.

Probably the best way is to change the range of each block to bring the completion time to a value where you could interrupt it a little easier. What is the digit level of the job and how long does each block take? On my bigger jobs, I usually have the "qstep" set to 100000 which seems to take ~4 hours on my NFS machines. After a couple of blocks you can get a feel for what the relation yield is for each block so that you can tell approximately how far a block is along as the job progresses. On my XP machine the output doesn't scroll while a job is running, so you can tell what the start/end values are, but on my 98 machine, the progress lines scroll the screen, so the only way to tell how far along is know what the yield is for each block.

I run all my machines 24/7, so it doesn't matter how long the blocks are, anyway. (They help keep the bedroom warm this time of year, but do make it hard to keep cool during the summer.....)

Frank

10metreh 2008-11-29 10:49

The procrels error I mentioned in post #1 has recurred. How can I fix it?

henryzz 2008-11-29 10:52

[quote=10metreh;151213]The procrels error I mentioned in post #1 has recurred. How can I fix it?[/quote]
could you post your ggnfs.log

schickel 2008-11-29 10:57

[QUOTE=10metreh;151213]The procrels error I mentioned in post #1 has recurred. How can I fix it?[/QUOTE]Are you trying to run procrels manually or is it crashing under the control of the script?

Frank

10metreh 2008-11-29 11:15

I've tried both ways and it crashed both times. Perhaps there is a bug in the code?

Here is all in my log that is relevant (I started this last night, but it did not want to resume this morning):

[code]
[11/28 18:48:44] GGNFS-0.77.1-20060722-pentium4 : makefb
[11/28 18:48:50] name:
[11/28 18:48:50] n=1230055008086286534595627201713118974133964495903086531402839064679655229427876182135719467916304601 (100 digits)
[11/28 18:48:50] c0: 4404605767354605876157364
[11/28 18:48:50] c1: -1198874897864449346549
[11/28 18:48:50] c2: 36988141245696361
[11/28 18:48:50] c3: 7321780823831
[11/28 18:48:50] c4: -140496168
[11/28 18:48:50] c5: 1260
[11/28 18:48:50] RFBsize: 135072 (upto 1799999)
[11/28 18:48:50] AFBsize: 134534 (upto 1799999)
[11/28 18:48:50] maxNumLargeRatPrimes: 3
[11/28 18:48:50] maxLargeRatPrime: 67108864
[11/28 18:48:50] maxNumLargeAlgPrimes: 3
[11/28 18:48:50] maxLargeAlgPrime: 67108864
-> minimum number of FF's: 302030
-> minimum number of FF's: 302030
-> minimum number of FF's: 302030
LatSieveTime: 8956
[11/29 10:49:05] GGNFS-0.77.1-20060722-pentium4 : procrels
-> minimum number of FF's: 302030

[/code]

VIE (very important edit): I have downloaded another version of procrels and it works! There was a bug! I will have to redo 2 1/2 hours worth of sieving, though.

schickel 2008-11-29 11:38

[QUOTE=10metreh;151219]VIE (very important edit): I have downloaded another version of procrels and it works! There was a bug! I will have to redo 2 1/2 hours worth of sieving, though.[/QUOTE]Hmmm, very likely the version you had was compiled for a different architecture. That'll usually result in that "quiet" type of crash (no error reported).[QUOTE=10metreh]LatSieveTime: 8956[/QUOTE]If you're not comfortable with 2-1/2 hours per block, you can always reduce the "qstep" value to 1/2 that or so.....

Frank

henryzz 2008-11-29 11:58

[quote=schickel;151221]Hmmm, very likely the version you had was compiled for a different architecture.[/quote]
the link i gave him for binaries was an recent svn version for p4
he had said previously that he was running on a 1.7 Ghz p4

i have been using the exact same svn version complied for core 2
maybe that p4 build was compiled for prescott and his isnt a prescott?????

@10metreh
it seems like you pc does siieving at 1/5th of the speed of my pc

10metreh 2008-11-29 12:03

Perhaps. The lattice siever, polyselect :no: and makefb all worked fine.

ET_ 2008-11-29 12:50

[QUOTE=henryzz;151207]i am just doing the linear algebra on a 100 digit gnfs for my aliquot sequence
q went up to 1.4M and that produced 3.6M relations

it will save the relations, at the 100 digit level, every 100k q values
it will also do a postprocessing run to see if you have sieved enough[/QUOTE]

Wouldn't it be quicker using msieve QS on C100?

Luigi

henryzz 2008-11-29 12:56

[quote=ET_;151232]Wouldn't it be quicker using msieve QS on C100?

Luigi[/quote]
maybe he has never completed a gnfs before so it is worth him starting small
also as the difference isnt much you could use something like RDS's arguments and say what can you learn from QS
there is a lot more to learn from doing a gnfs factorization that a QS

ET_ 2008-11-29 13:02

[QUOTE=henryzz;151233]maybe he has never completed a gnfs before so it is worth him starting small
also as the difference isnt much you could use something like RDS's arguments and say what can you learn from QS
there is a lot more to learn from doing a gnfs factorization that a QS[/QUOTE]

I see what you mean...
I started my first GNFS with a C123 and now I can say that I've chosen a big candidate to start with. :redface:

Luigi

henryzz 2008-11-29 13:06

[quote=ET_;151235]I see what you mean...
I started my first GNFS with a C123 and now I can say that I've chosen a big candidate to start with. :redface:

Luigi[/quote]
what hardware was that with
my current record is C121 although that was with my old 3800+
i could do lots better with my newish Q6600 but i am waiting for the new version of ggnfs before i break that record

10metreh 2008-11-29 13:07

On my PC msieve QS is SOOOO slow. :sad:

henryzz 2008-11-29 13:16

[quote=10metreh;151237]On my PC msieve QS is SOOOO slow. :sad:[/quote]
QS seems slow to start off with but seems to speed up
the amount a QS factorization is done seems to me to be based on how many partial rels need to be found
unfortunately that number is different for different length numbers
just recently i have looked in my msieve.log for how many partial rels were needed for other factoizations and have been able to make a good guess at how many partial rels are needed for a specific factorization

can someone more knowledgable than me confirm that the rate of producing partial rels with msieve is linear throughout a factorization

jasonp 2008-11-29 13:40

Yes, partial relations are expected to accumulate at an approximately linear rate, but you do not know in advance what that rate will be with great accuracy, or how many partial relations will be 'enough'. There is code to determine when 'enough' has accumulated, so that you will not sieve more than you have to, but it's tricky to find out how long it will take to get there.

What matters with QS is not the number of partial relations collected but how many cycles (full relations) they form. Cycles initially form incredibly slowly but the rate accelerates as sieving progresses. At the 100-digit level I think you need about 1.5-2 million relations, and on a modern PC it takes 11-12 hours. Individual numbers can be better or worse than that, sometimes by a significant factor. If waiting 12 hours for a factor sounds like too much to bear, that's a different problem.

henryzz 2008-11-29 14:03

[quote=jasonp;151242]Yes, partial relations are expected to accumulate at an approximately linear rate, but you do not know in advance what that rate will be with great accuracy, or how many partial relations will be 'enough'. There is code to determine when 'enough' has accumulated, so that you will not sieve more than you have to, but it's tricky to find out how long it will take to get there.

What matters with QS is not the number of partial relations collected but how many cycles (full relations) they form. Cycles initially form incredibly slowly but the rate accelerates as sieving progresses. At the 100-digit level I think you need about 1.5-2 million relations, and on a modern PC it takes 11-12 hours. Individual numbers can be better or worse than that, sometimes by a significant factor. If waiting 12 hours for a factor sounds like too much to bear, that's a different problem.[/quote]
as far as i understand the rate at which you find partial relations can be different for different numbers of the same length but the number of partial relations needed in a factorization to create enough full relations is similar for to the numbers of other factorizations of the same length
in other words i think you can say that if one 88 digit needs 820k partial relations then another 88-digit factorization will need ~820k partial relations

ET_ 2008-11-29 14:23

[QUOTE=henryzz;151236]what hardware was that with
my current record is C121 although that was with my old 3800+
i could do lots better with my newish Q6600 but i am waiting for the new version of ggnfs before i break that record[/QUOTE]

I'm using one core on my Athlon XP2 3800, one AMD 64, one Pentium4 @2.6GHz, a T7100 dual core and an old but valid Centrino @ 1.8GHz

Luigi

henryzz 2008-11-29 14:36

[quote=ET_;151246]I'm using one core on my Athlon XP2 3800, one AMD 64, one Pentium4 @2.6GHz, a T7100 dual core and an old but valid Centrino @ 1.8GHz

Luigi[/quote]
thinking about it i did have a 3000+ help with some sievng
it took me several weeks to finish:smile:

10metreh 2008-11-30 09:00

It turns out that there is a dll bug in matsolve. I have all my relations though. How do I convert the files so I can use msieve for the postprocessing?

henryzz 2008-11-30 09:15

[quote=10metreh;151338]It turns out that there is a dll bug in matsolve. I have all my relations though. How do I convert the files so I can use msieve for the postprocessing?[/quote]
is it just wanting another dll
if so download it like you did the other one

10metreh 2008-11-30 10:07

It's slightly different, but I'll try that. Anyway, how do you convert the files and use msieve?

henryzz 2008-11-30 11:16

[quote=10metreh;151341]It's slightly different, but I'll try that. Anyway, how do you convert the files and use msieve?[/quote]
i dont know if you can
you can do the other way because the msieve data file is just all the spairs.out files put together with a line added at the beginning
i dont know if procrels changes the format of the files as well as sorting and spliting the files

edit:
what is the exact error message

10metreh 2008-11-30 13:52

I have received a PM from bearnol with a link to a Blogspot page with info on what to do. However, it tells me to put the poly in a file called "msieve.fb". This looks like a factor base file, not a poly file. Also, what format must the poly be in?

fivemack 2008-11-30 13:54

An example msieve.fb file might be

[code]
N 57935987372136483490920868637496989793253957704773020664231348177235315499760770915805111178249998523552665625493027256226450699872037675117751
A5 7216320
A4 -129583820248
A3 -803179631479086866
A2 530219673548549782703
A1 9116716972584175890041876418
A0 -171036670463698531307416446517695
R1 1618246013897711
R0 -1516793739861106227914021468
[/code]

The 'R' are the 'Y' from ggnfs format poly files, the 'A' are the 'c'. No colons.

henryzz 2008-11-30 14:08

[quote=fivemack;151359]An example msieve.fb file might be

[code]
N 57935987372136483490920868637496989793253957704773020664231348177235315499760770915805111178249998523552665625493027256226450699872037675117751
A5 7216320
A4 -129583820248
A3 -803179631479086866
A2 530219673548549782703
A1 9116716972584175890041876418
A0 -171036670463698531307416446517695
R1 1618246013897711
R0 -1516793739861106227914021468
[/code]The 'R' are the 'Y' from ggnfs format poly files, the 'A' are the 'c'. No colons.[/quote]
i think he already has this poly in msieve format:smile:
he used msieve poly selection i think:smile:

good luck
how much memory do you have
could you post the link

10metreh 2008-11-30 14:40

Sadly I've deleted the message. :exclaim:

henryzz 2008-11-30 14:47

[quote=10metreh;151364]Sadly I've deleted the message. :exclaim:[/quote]
would you mind looking in your browser history
i would like to see that page

schickel 2008-11-30 15:57

1 Attachment(s)
[QUOTE=10metreh;151338]It turns out that there is a dll bug in matsolve. I have all my relations though. How do I convert the files so I can use msieve for the postprocessing?[/QUOTE]10metreh,
Here is a script to take the GGNFS files and convert to msieve to do the post-processing.

Save the file and rename to nfs2ms.pl and then just run "perl nfs2ms.pl" and it will take it from there. I use it all the time.

Let me know how it works out.

Later,[INDENT]Frank[/INDENT]
PS. you need to edit the paths to point procrels. Just change the path to the same as your factlat script.....

10metreh 2008-11-30 18:05

[URL="http://factorization.blogspot.com/2007/11/c12711336.html"]factorization.blogspot.com/2007/11/c12711336.html[/URL] is the one you are looking for.

henryzz 2008-11-30 18:25

[quote=10metreh;151378][URL="http://factorization.blogspot.com/2007/11/c12711336.html"]factorization.blogspot.com/2007/11/c12711336.html[/URL] is the one you are looking for.[/quote]
he pmed it to me as well
thanks anyway
how far did you sieve

henryzz 2008-12-01 08:38

1 Attachment(s)
i think i know what your problem was
was that matprune.exe is missing
for some reason all the build of ggnfs i have found dont include matprune.exe
i had this problem for ages
i built it myself a while back on a athlon 64 in 32bit windows
it works on my core 2 but it might not on your p4
if it dosent i will have a go at compiling for p4(and core 2 for myself)
i have attached it below
i was very close to the max forum upload limit

10metreh 2008-12-01 15:22

Incorrect. Matprune was there. Only factLat didn't use it when it said it should, it only did more sieving still. I terminated it when it started sieving up to q = 1.7m.

henryzz 2008-12-01 15:40

[quote=10metreh;151487]Incorrect. Matprune was there. Only factLat didn't use it when it said it should, it only did more sieving still. I terminated it when it started sieving up to q = 1.7m.[/quote]
it should run after the matbuild program if matbuild found enough full relations
what was the output from matbuild

10metreh 2008-12-02 18:39

I have adjusted the script, but this error message appears:

"C:/Documents" is not recognized as an internal or external command, operable program or batch file.

My path starts C:/Documents and Settings/, like a lot of people's. Perhaps the space is what confused the program?

factLat does not recognize the backward slash, so I used forward slashes. Perhaps using forward slashes here was the problem.

henryzz 2008-12-02 19:14

[quote=10metreh;151673]I have adjusted the script, but this error message appears:

"C:/Documents" is not recognized as an internal or external command, operable program or batch file.

My path starts C:/Documents and Settings/, like a lot of people's. Perhaps the space is what confused the program?

factLat does not recognize the backward slash, so I used forward slashes. Perhaps using forward slashes here was the problem.[/quote]
i am currently using paths of ""
this works if everything is in the same directory

10metreh 2008-12-02 19:23

It finds the directory this time, but it doesn't find procrels.

P.S. Who holds the record for the fastest first 200 posts?

henryzz 2008-12-02 19:28

[quote=10metreh;151685]It finds the directory this time, but it doesn't find procrels.

P.S. Who holds the record for the fastest first 200 posts?[/quote]
dunno but i reckon you might have it:smile:

99.94 2008-12-02 19:42

[QUOTE=henryzz;151689]dunno but i reckon you might have it:smile:[/QUOTE]
Don't feed the troll.

schickel 2008-12-02 20:22

[QUOTE=10metreh;151673]I have adjusted the script, but this error message appears:

"C:/Documents" is not recognized as an internal or external command, operable program or batch file.

My path starts C:/Documents and Settings/, like a lot of people's. Perhaps the space is what confused the program?[/QUOTE]I would say that Perl might be having a problem with a path with spaces in it. It might be easiest if you move the binaries to a space-less path.[QUOTE]factLat does not recognize the backward slash, so I used forward slashes. Perhaps using forward slashes here was the problem.[/QUOTE]Actually, the backslash is an "escape" character in Perl, if you use backslashes in the path, double them. My path is "c:\\ggnfs\\binaries".

10metreh 2008-12-06 07:59

I managed to get nfs2ms.pl working, but this error occurs in msieve:

[CODE]
Fri Dec 05 18:51:00 2008
Fri Dec 05 18:51:00 2008
Fri Dec 05 18:51:00 2008 Msieve v. 1.39
Fri Dec 05 18:51:00 2008 random seeds: f39eaa3c 38081b9a
Fri Dec 05 18:51:00 2008 factoring 1230055008086286534595627201713118974133964495903086531402839064679655229427876182135719467916304601 (100 digits)
Fri Dec 05 18:51:02 2008 searching for 15-digit factors
Fri Dec 05 18:51:05 2008 commencing number field sieve (100-digit input)
Fri Dec 05 18:51:05 2008 R0: -15773125315071790929
Fri Dec 05 18:51:05 2008 R1: 11328469279
Fri Dec 05 18:51:05 2008 A0: 4404605767354605876157364
Fri Dec 05 18:51:05 2008 A1: -1198874897864449346549
Fri Dec 05 18:51:05 2008 A2: 36988141245696361
Fri Dec 05 18:51:05 2008 A3: 7321780823831
Fri Dec 05 18:51:05 2008 A4: -140496168
Fri Dec 05 18:51:05 2008 A5: 1260
Fri Dec 05 18:51:05 2008 skew 1.00, size 2.378186e-010, alpha -6.135467, combined = 1.838424e-009
Fri Dec 05 18:51:06 2008
Fri Dec 05 18:51:06 2008 commencing relation filtering
Fri Dec 05 18:51:06 2008 commencing duplicate removal, pass 1
Fri Dec 05 18:53:11 2008 found 51425 hash collisions in 5301527 relations
Fri Dec 05 18:54:10 2008 added 31721 free relations
Fri Dec 05 18:54:11 2008 commencing duplicate removal, pass 2
Fri Dec 05 18:59:23 2008 found 0 duplicates and 5333248 unique relations
Fri Dec 05 18:59:33 2008 memory use: 37.8 MB
Fri Dec 05 18:59:37 2008 reading rational ideals above 1638400
Fri Dec 05 18:59:37 2008 reading algebraic ideals above 1638400
Fri Dec 05 18:59:37 2008 commencing singleton removal, pass 1
Fri Dec 05 19:08:17 2008 relations with 0 large ideals: 87496
Fri Dec 05 19:08:23 2008 relations with 1 large ideals: 688874
Fri Dec 05 19:08:23 2008 relations with 2 large ideals: 1857420
Fri Dec 05 19:08:23 2008 relations with 3 large ideals: 1982577
Fri Dec 05 19:08:23 2008 relations with 4 large ideals: 678233
Fri Dec 05 19:08:23 2008 relations with 5 large ideals: 7949
Fri Dec 05 19:08:23 2008 relations with 6 large ideals: 30699
Fri Dec 05 19:08:23 2008 relations with 7+ large ideals: 0
Fri Dec 05 19:08:23 2008 5333248 relations and about 4527036 large ideals
Fri Dec 05 19:08:23 2008 commencing singleton removal, pass 2
Fri Dec 05 19:16:49 2008 found 1965955 singletons
Fri Dec 05 19:16:57 2008 current dataset: 3367293 relations and about 2275258 large ideals
Fri Dec 05 19:17:03 2008 commencing singleton removal, pass 3
Fri Dec 05 19:24:51 2008 found 314633 singletons
Fri Dec 05 19:25:05 2008 current dataset: 3052660 relations and about 1950829 large ideals
Fri Dec 05 19:25:15 2008 commencing singleton removal, final pass
Fri Dec 05 19:28:45 2008 memory use: 50.4 MB
Fri Dec 05 19:28:57 2008 commencing in-memory singleton removal
Fri Dec 05 19:28:58 2008 begin with 3052660 relations and 2007755 unique ideals
Fri Dec 05 19:29:06 2008 reduce to 2899324 relations and 1852807 ideals in 9 passes
Fri Dec 05 19:29:06 2008 max relations containing the same ideal: 28
Fri Dec 05 19:29:18 2008 reading rational ideals above 720000
Fri Dec 05 19:29:18 2008 reading algebraic ideals above 720000
Fri Dec 05 19:29:18 2008 commencing singleton removal, final pass
Fri Dec 05 19:31:36 2008 keeping 1921561 ideals with weight <= 20, new excess is 184602
Fri Dec 05 19:32:52 2008 memory use: 65.0 MB
Fri Dec 05 19:32:59 2008 commencing in-memory singleton removal
Fri Dec 05 19:33:01 2008 begin with 2900386 relations and 1921561 unique ideals
Fri Dec 05 19:33:06 2008 reduce to 2899318 relations and 1915407 ideals in 5 passes
Fri Dec 05 19:33:06 2008 max relations containing the same ideal: 20
Fri Dec 05 19:33:16 2008 removing 1053969 relations and 669083 ideals in 384886 cliques
Fri Dec 05 19:33:18 2008 commencing in-memory singleton removal
Fri Dec 05 19:33:19 2008 begin with 1845349 relations and 1915407 unique ideals
Fri Dec 05 19:33:23 2008 reduce to 1696326 relations and 1073398 ideals in 8 passes
Fri Dec 05 19:33:23 2008 max relations containing the same ideal: 19
Fri Dec 05 19:33:27 2008 removing 757191 relations and 421940 ideals in 335251 cliques
Fri Dec 05 19:33:28 2008 commencing in-memory singleton removal
Fri Dec 05 19:33:28 2008 begin with 939135 relations and 1073398 unique ideals
Fri Dec 05 19:33:30 2008 reduce to 835935 relations and 534151 ideals in 8 passes
Fri Dec 05 19:33:30 2008 max relations containing the same ideal: 15
Fri Dec 05 19:33:32 2008 removing 238872 relations and 151227 ideals in 87645 cliques
Fri Dec 05 19:33:32 2008 commencing in-memory singleton removal
Fri Dec 05 19:33:32 2008 begin with 597063 relations and 534151 unique ideals
Fri Dec 05 19:33:33 2008 reduce to 547494 relations and 327905 ideals in 6 passes
Fri Dec 05 19:33:33 2008 max relations containing the same ideal: 14
Fri Dec 05 19:33:34 2008 relations with 0 large ideals: 53234
Fri Dec 05 19:33:34 2008 relations with 1 large ideals: 168041
Fri Dec 05 19:33:34 2008 relations with 2 large ideals: 199201
Fri Dec 05 19:33:34 2008 relations with 3 large ideals: 102764
Fri Dec 05 19:33:34 2008 relations with 4 large ideals: 22533
Fri Dec 05 19:33:34 2008 relations with 5 large ideals: 1451
Fri Dec 05 19:33:34 2008 relations with 6 large ideals: 270
Fri Dec 05 19:33:34 2008 relations with 7+ large ideals: 0
Fri Dec 05 19:33:34 2008 commencing 2-way merge
Fri Dec 05 19:33:36 2008 reduce to 401006 relation sets and 181417 unique ideals
Fri Dec 05 19:33:36 2008 commencing full merge
Fri Dec 05 19:33:40 2008 memory use: 12.9 MB
Fri Dec 05 19:33:47 2008 found 217126 cycles, need 184802
Fri Dec 05 19:33:47 2008 weight of 184802 cycles is about 8318528 (45.01/cycle)
Fri Dec 05 19:33:47 2008 distribution of cycle lengths:
Fri Dec 05 19:33:47 2008 1 relations: 53234
Fri Dec 05 19:33:47 2008 2 relations: 27065
Fri Dec 05 19:33:47 2008 3 relations: 20134
Fri Dec 05 19:33:47 2008 4 relations: 16501
Fri Dec 05 19:33:47 2008 5 relations: 14229
Fri Dec 05 19:33:47 2008 6 relations: 12082
Fri Dec 05 19:33:47 2008 7 relations: 10537
Fri Dec 05 19:33:47 2008 8 relations: 8915
Fri Dec 05 19:33:47 2008 9 relations: 7503
Fri Dec 05 19:33:47 2008 10+ relations: 14602
Fri Dec 05 19:33:47 2008 heaviest cycle: 14 relations
Fri Dec 05 19:33:47 2008 matrix can improve, retrying
Fri Dec 05 19:33:49 2008 reading rational ideals above 720000
Fri Dec 05 19:33:49 2008 reading algebraic ideals above 720000
Fri Dec 05 19:33:49 2008 commencing singleton removal, final pass
Fri Dec 05 19:38:18 2008 keeping 1927571 ideals with weight <= 25, new excess is 178592
Fri Dec 05 19:39:06 2008 memory use: 65.0 MB
Fri Dec 05 19:39:06 2008 commencing in-memory singleton removal
Fri Dec 05 19:39:08 2008 begin with 2900386 relations and 1927571 unique ideals
Fri Dec 05 19:39:13 2008 reduce to 2899318 relations and 1921417 ideals in 5 passes
Fri Dec 05 19:39:13 2008 max relations containing the same ideal: 25
Fri Dec 05 19:39:24 2008 removing 1054931 relations and 669564 ideals in 385367 cliques
Fri Dec 05 19:39:26 2008 commencing in-memory singleton removal
Fri Dec 05 19:39:27 2008 begin with 1844387 relations and 1921417 unique ideals
Fri Dec 05 19:39:31 2008 reduce to 1695166 relations and 1078700 ideals in 8 passes
Fri Dec 05 19:39:31 2008 max relations containing the same ideal: 23
Fri Dec 05 19:39:35 2008 removing 756682 relations and 421738 ideals in 334944 cliques
Fri Dec 05 19:39:36 2008 commencing in-memory singleton removal
Fri Dec 05 19:39:36 2008 begin with 938484 relations and 1078700 unique ideals
Fri Dec 05 19:39:38 2008 reduce to 835361 relations and 539757 ideals in 8 passes
Fri Dec 05 19:39:38 2008 max relations containing the same ideal: 16
Fri Dec 05 19:39:40 2008 removing 240413 relations and 151976 ideals in 88437 cliques
Fri Dec 05 19:39:40 2008 commencing in-memory singleton removal
Fri Dec 05 19:39:40 2008 begin with 594948 relations and 539757 unique ideals
Fri Dec 05 19:39:41 2008 reduce to 544785 relations and 332080 ideals in 6 passes
Fri Dec 05 19:39:41 2008 max relations containing the same ideal: 15
Fri Dec 05 19:39:42 2008 relations with 0 large ideals: 48702
Fri Dec 05 19:39:42 2008 relations with 1 large ideals: 160074
Fri Dec 05 19:39:42 2008 relations with 2 large ideals: 198740
Fri Dec 05 19:39:42 2008 relations with 3 large ideals: 108973
Fri Dec 05 19:39:42 2008 relations with 4 large ideals: 26050
Fri Dec 05 19:39:42 2008 relations with 5 large ideals: 1955
Fri Dec 05 19:39:42 2008 relations with 6 large ideals: 291
Fri Dec 05 19:39:42 2008 relations with 7+ large ideals: 0
Fri Dec 05 19:39:42 2008 commencing 2-way merge
Fri Dec 05 19:39:44 2008 reduce to 398483 relation sets and 185778 unique ideals
Fri Dec 05 19:39:44 2008 commencing full merge
Fri Dec 05 19:39:51 2008 memory use: 13.0 MB
Fri Dec 05 19:39:51 2008 found 212212 cycles, need 180292
Fri Dec 05 19:39:51 2008 weight of 180292 cycles is about 8433935 (46.78/cycle)
Fri Dec 05 19:39:51 2008 distribution of cycle lengths:
Fri Dec 05 19:39:51 2008 1 relations: 48706
Fri Dec 05 19:39:51 2008 2 relations: 24945
Fri Dec 05 19:39:51 2008 3 relations: 19254
Fri Dec 05 19:39:51 2008 4 relations: 16421
Fri Dec 05 19:39:51 2008 5 relations: 14538
Fri Dec 05 19:39:51 2008 6 relations: 12458
Fri Dec 05 19:39:51 2008 7 relations: 10997
Fri Dec 05 19:39:51 2008 8 relations: 9561
Fri Dec 05 19:39:51 2008 9 relations: 8211
Fri Dec 05 19:39:51 2008 10+ relations: 15201
Fri Dec 05 19:39:51 2008 heaviest cycle: 13 relations
Fri Dec 05 19:39:51 2008 matrix can improve, retrying
Fri Dec 05 19:39:53 2008 reading rational ideals above 720000
Fri Dec 05 19:39:53 2008 reading algebraic ideals above 720000
Fri Dec 05 19:39:53 2008 commencing singleton removal, final pass
Fri Dec 05 19:41:52 2008 keeping 1931318 ideals with weight <= 30, new excess is 174845
Fri Dec 05 19:43:43 2008 memory use: 65.0 MB
Fri Dec 05 19:43:44 2008 commencing in-memory singleton removal
Fri Dec 05 19:43:46 2008 begin with 2900386 relations and 1931318 unique ideals
Fri Dec 05 19:43:51 2008 reduce to 2899318 relations and 1925164 ideals in 5 passes
Fri Dec 05 19:43:51 2008 max relations containing the same ideal: 30
Fri Dec 05 19:44:06 2008 removing 1055531 relations and 669864 ideals in 385667 cliques
Fri Dec 05 19:44:07 2008 commencing in-memory singleton removal
Fri Dec 05 19:44:08 2008 begin with 1843787 relations and 1925164 unique ideals
Fri Dec 05 19:44:13 2008 reduce to 1694399 relations and 1081967 ideals in 8 passes
Fri Dec 05 19:44:13 2008 max relations containing the same ideal: 26
Fri Dec 05 19:44:16 2008 removing 756316 relations and 421573 ideals in 334743 cliques
Fri Dec 05 19:44:17 2008 commencing in-memory singleton removal
Fri Dec 05 19:44:18 2008 begin with 938083 relations and 1081967 unique ideals
Fri Dec 05 19:44:20 2008 reduce to 835051 relations and 543307 ideals in 8 passes
Fri Dec 05 19:44:20 2008 max relations containing the same ideal: 19
Fri Dec 05 19:44:21 2008 removing 241413 relations and 152490 ideals in 88923 cliques
Fri Dec 05 19:44:22 2008 commencing in-memory singleton removal
Fri Dec 05 19:44:22 2008 begin with 593638 relations and 543307 unique ideals
Fri Dec 05 19:44:23 2008 reduce to 543060 relations and 334659 ideals in 6 passes
Fri Dec 05 19:44:23 2008 max relations containing the same ideal: 15
Fri Dec 05 19:44:24 2008 relations with 0 large ideals: 45906
Fri Dec 05 19:44:24 2008 relations with 1 large ideals: 154697
Fri Dec 05 19:44:24 2008 relations with 2 large ideals: 197849
Fri Dec 05 19:44:24 2008 relations with 3 large ideals: 112755
Fri Dec 05 19:44:24 2008 relations with 4 large ideals: 28889
Fri Dec 05 19:44:24 2008 relations with 5 large ideals: 2633
Fri Dec 05 19:44:24 2008 relations with 6 large ideals: 331
Fri Dec 05 19:44:24 2008 relations with 7+ large ideals: 0
Fri Dec 05 19:44:24 2008 commencing 2-way merge
Fri Dec 05 19:44:25 2008 reduce to 397034 relation sets and 188633 unique ideals
Fri Dec 05 19:44:25 2008 commencing full merge
Fri Dec 05 19:44:33 2008 memory use: 13.0 MB
Fri Dec 05 19:44:33 2008 found 209641 cycles, need 178045
Fri Dec 05 19:44:33 2008 weight of 178045 cycles is about 8495839 (47.72/cycle)
Fri Dec 05 19:44:33 2008 distribution of cycle lengths:
Fri Dec 05 19:44:33 2008 1 relations: 45942
Fri Dec 05 19:44:33 2008 2 relations: 23832
Fri Dec 05 19:44:33 2008 3 relations: 18959
Fri Dec 05 19:44:33 2008 4 relations: 16507
Fri Dec 05 19:44:33 2008 5 relations: 14796
Fri Dec 05 19:44:33 2008 6 relations: 12928
Fri Dec 05 19:44:33 2008 7 relations: 11281
Fri Dec 05 19:44:33 2008 8 relations: 9970
Fri Dec 05 19:44:33 2008 9 relations: 8454
Fri Dec 05 19:44:33 2008 10+ relations: 15376
Fri Dec 05 19:44:33 2008 heaviest cycle: 13 relations
Fri Dec 05 19:44:33 2008 matrix can improve, retrying
Fri Dec 05 19:44:35 2008 reading rational ideals above 720000
Fri Dec 05 19:44:35 2008 reading algebraic ideals above 720000
Fri Dec 05 19:44:35 2008 commencing singleton removal, final pass
Fri Dec 05 19:48:05 2008 keeping 1935771 ideals with weight <= 35, new excess is 170392
Fri Dec 05 19:48:38 2008 memory use: 65.0 MB
Fri Dec 05 19:48:39 2008 commencing in-memory singleton removal
Fri Dec 05 19:48:40 2008 begin with 2900386 relations and 1935771 unique ideals
Fri Dec 05 19:48:46 2008 reduce to 2899318 relations and 1929617 ideals in 5 passes
Fri Dec 05 19:48:46 2008 max relations containing the same ideal: 35
Fri Dec 05 19:49:00 2008 removing 1056243 relations and 670220 ideals in 386023 cliques
Fri Dec 05 19:49:02 2008 commencing in-memory singleton removal
Fri Dec 05 19:49:03 2008 begin with 1843075 relations and 1929617 unique ideals
Fri Dec 05 19:49:07 2008 reduce to 1693502 relations and 1085866 ideals in 8 passes
Fri Dec 05 19:49:07 2008 max relations containing the same ideal: 31
Fri Dec 05 19:49:11 2008 removing 755934 relations and 421410 ideals in 334524 cliques
Fri Dec 05 19:49:12 2008 commencing in-memory singleton removal
Fri Dec 05 19:49:12 2008 begin with 937568 relations and 1085866 unique ideals
Fri Dec 05 19:49:14 2008 reduce to 834561 relations and 547419 ideals in 8 passes
Fri Dec 05 19:49:14 2008 max relations containing the same ideal: 22
Fri Dec 05 19:49:16 2008 removing 242515 relations and 153028 ideals in 89487 cliques
Fri Dec 05 19:49:16 2008 commencing in-memory singleton removal
Fri Dec 05 19:49:16 2008 begin with 592046 relations and 547419 unique ideals
Fri Dec 05 19:49:17 2008 reduce to 541127 relations and 337822 ideals in 6 passes
Fri Dec 05 19:49:17 2008 max relations containing the same ideal: 16
Fri Dec 05 19:49:18 2008 relations with 0 large ideals: 42423
Fri Dec 05 19:49:18 2008 relations with 1 large ideals: 147945
Fri Dec 05 19:49:18 2008 relations with 2 large ideals: 195914
Fri Dec 05 19:49:18 2008 relations with 3 large ideals: 117699
Fri Dec 05 19:49:18 2008 relations with 4 large ideals: 32962
Fri Dec 05 19:49:18 2008 relations with 5 large ideals: 3742
Fri Dec 05 19:49:18 2008 relations with 6 large ideals: 439
Fri Dec 05 19:49:18 2008 relations with 7+ large ideals: 3
Fri Dec 05 19:49:18 2008 commencing 2-way merge
Fri Dec 05 19:49:20 2008 reduce to 395435 relation sets and 192130 unique ideals
Fri Dec 05 19:49:20 2008 commencing full merge
Fri Dec 05 19:49:28 2008 memory use: 13.2 MB
Fri Dec 05 19:49:28 2008 found 205893 cycles, need 175092
Fri Dec 05 19:49:28 2008 weight of 175092 cycles is about 8703399 (49.71/cycle)
Fri Dec 05 19:49:28 2008 distribution of cycle lengths:
Fri Dec 05 19:49:28 2008 1 relations: 42523
Fri Dec 05 19:49:28 2008 2 relations: 22544
Fri Dec 05 19:49:28 2008 3 relations: 18360
Fri Dec 05 19:49:28 2008 4 relations: 16169
Fri Dec 05 19:49:28 2008 5 relations: 14856
Fri Dec 05 19:49:28 2008 6 relations: 13037
Fri Dec 05 19:49:28 2008 7 relations: 11346
Fri Dec 05 19:49:28 2008 8 relations: 10146
Fri Dec 05 19:49:28 2008 9 relations: 8608
Fri Dec 05 19:49:28 2008 10+ relations: 17503
Fri Dec 05 19:49:28 2008 heaviest cycle: 14 relations
Fri Dec 05 19:49:28 2008 matrix can improve, retrying
Fri Dec 05 19:49:30 2008 reading rational ideals above 720000
Fri Dec 05 19:49:30 2008 reading algebraic ideals above 720000
Fri Dec 05 19:49:30 2008 commencing singleton removal, final pass
Fri Dec 05 19:51:56 2008 keeping 1939494 ideals with weight <= 40, new excess is 166669
Fri Dec 05 19:52:34 2008 memory use: 65.0 MB
Fri Dec 05 19:52:35 2008 commencing in-memory singleton removal
Fri Dec 05 19:52:36 2008 begin with 2900386 relations and 1939494 unique ideals
Fri Dec 05 19:52:42 2008 reduce to 2899318 relations and 1933340 ideals in 5 passes
Fri Dec 05 19:52:42 2008 max relations containing the same ideal: 40
Fri Dec 05 19:53:28 2008 removing 1056839 relations and 670518 ideals in 386321 cliques
Fri Dec 05 19:53:30 2008 commencing in-memory singleton removal
Fri Dec 05 19:53:31 2008 begin with 1842479 relations and 1933340 unique ideals
Fri Dec 05 19:53:36 2008 reduce to 1692775 relations and 1089135 ideals in 8 passes
Fri Dec 05 19:53:36 2008 max relations containing the same ideal: 34
Fri Dec 05 19:53:39 2008 removing 755580 relations and 421228 ideals in 334352 cliques
Fri Dec 05 19:53:40 2008 commencing in-memory singleton removal
Fri Dec 05 19:53:40 2008 begin with 937195 relations and 1089135 unique ideals
Fri Dec 05 19:53:43 2008 reduce to 834192 relations and 550889 ideals in 8 passes
Fri Dec 05 19:53:43 2008 max relations containing the same ideal: 23
Fri Dec 05 19:53:44 2008 removing 243459 relations and 153493 ideals in 89966 cliques
Fri Dec 05 19:53:44 2008 commencing in-memory singleton removal
Fri Dec 05 19:53:45 2008 begin with 590733 relations and 550889 unique ideals
Fri Dec 05 19:53:46 2008 reduce to 539480 relations and 340446 ideals in 6 passes
Fri Dec 05 19:53:46 2008 max relations containing the same ideal: 20
Fri Dec 05 19:53:47 2008 relations with 0 large ideals: 39364
Fri Dec 05 19:53:47 2008 relations with 1 large ideals: 141456
Fri Dec 05 19:53:47 2008 relations with 2 large ideals: 194211
Fri Dec 05 19:53:47 2008 relations with 3 large ideals: 121964
Fri Dec 05 19:53:47 2008 relations with 4 large ideals: 36823
Fri Dec 05 19:53:47 2008 relations with 5 large ideals: 5066
Fri Dec 05 19:53:47 2008 relations with 6 large ideals: 591
Fri Dec 05 19:53:47 2008 relations with 7+ large ideals: 5
Fri Dec 05 19:53:47 2008 commencing 2-way merge
Fri Dec 05 19:53:49 2008 reduce to 394174 relation sets and 195140 unique ideals
Fri Dec 05 19:53:49 2008 commencing full merge
Fri Dec 05 19:53:57 2008 memory use: 13.3 MB
Fri Dec 05 19:53:57 2008 found 203055 cycles, need 172869
Fri Dec 05 19:53:57 2008 weight of 172869 cycles is about 8884107 (51.39/cycle)
Fri Dec 05 19:53:57 2008 distribution of cycle lengths:
Fri Dec 05 19:53:57 2008 1 relations: 39620
Fri Dec 05 19:53:57 2008 2 relations: 21495
Fri Dec 05 19:53:57 2008 3 relations: 17958
Fri Dec 05 19:53:57 2008 4 relations: 16062
Fri Dec 05 19:53:57 2008 5 relations: 14780
Fri Dec 05 19:53:57 2008 6 relations: 13094
Fri Dec 05 19:53:57 2008 7 relations: 11523
Fri Dec 05 19:53:57 2008 8 relations: 10436
Fri Dec 05 19:53:57 2008 9 relations: 8896
Fri Dec 05 19:53:57 2008 10+ relations: 19005
Fri Dec 05 19:53:57 2008 heaviest cycle: 14 relations
Fri Dec 05 19:53:57 2008 matrix not dense enough, retrying
Fri Dec 05 19:54:01 2008
Fri Dec 05 19:54:01 2008
Fri Dec 05 19:54:01 2008 Msieve v. 1.39
Fri Dec 05 19:54:01 2008 random seeds: 152aa3a0 b5c3f988
Fri Dec 05 19:54:01 2008 factoring 1230055008086286534595627201713118974133964495903086531402839064679655229427876182135719467916304601 (100 digits)
Fri Dec 05 19:54:03 2008 searching for 15-digit factors
Fri Dec 05 19:54:06 2008 commencing number field sieve (100-digit input)
Fri Dec 05 19:54:06 2008 R0: -15773125315071790929
Fri Dec 05 19:54:06 2008 R1: 11328469279
Fri Dec 05 19:54:06 2008 A0: 4404605767354605876157364
Fri Dec 05 19:54:06 2008 A1: -1198874897864449346549
Fri Dec 05 19:54:06 2008 A2: 36988141245696361
Fri Dec 05 19:54:06 2008 A3: 7321780823831
Fri Dec 05 19:54:06 2008 A4: -140496168
Fri Dec 05 19:54:06 2008 A5: 1260
Fri Dec 05 19:54:06 2008 skew 1.00, size 2.378186e-010, alpha -6.135467, combined = 1.838424e-009
Fri Dec 05 19:54:06 2008
Fri Dec 05 19:54:06 2008 commencing relation filtering
Fri Dec 05 19:54:06 2008 commencing duplicate removal, pass 1
Fri Dec 05 19:57:47 2008 found 52054 hash collisions in 5333248 relations
Fri Dec 05 19:58:40 2008 commencing duplicate removal, pass 2
Fri Dec 05 20:00:39 2008 found 0 duplicates and 5333248 unique relations
Fri Dec 05 20:01:11 2008 memory use: 37.8 MB
Fri Dec 05 20:01:16 2008 reading rational ideals above 1638400
Fri Dec 05 20:01:16 2008 reading algebraic ideals above 1638400
Fri Dec 05 20:01:16 2008 commencing singleton removal, pass 1
Fri Dec 05 20:09:56 2008 relations with 0 large ideals: 87496
Fri Dec 05 20:10:07 2008 relations with 1 large ideals: 688874
Fri Dec 05 20:10:07 2008 relations with 2 large ideals: 1857420
Fri Dec 05 20:10:07 2008 relations with 3 large ideals: 1982577
Fri Dec 05 20:10:07 2008 relations with 4 large ideals: 678233
Fri Dec 05 20:10:07 2008 relations with 5 large ideals: 7949
Fri Dec 05 20:10:07 2008 relations with 6 large ideals: 30699
Fri Dec 05 20:10:07 2008 relations with 7+ large ideals: 0
Fri Dec 05 20:10:07 2008 5333248 relations and about 4527036 large ideals
Fri Dec 05 20:10:07 2008 commencing singleton removal, pass 2
Fri Dec 05 20:19:39 2008 found 1965955 singletons
Fri Dec 05 20:19:49 2008 current dataset: 3367293 relations and about 2275258 large ideals
Fri Dec 05 20:19:53 2008 commencing singleton removal, pass 3
Fri Dec 05 20:27:39 2008 found 314633 singletons
Fri Dec 05 20:27:57 2008 current dataset: 3052660 relations and about 1950829 large ideals
Fri Dec 05 20:28:05 2008 commencing singleton removal, final pass
Fri Dec 05 20:35:55 2008 memory use: 50.4 MB
Fri Dec 05 20:36:04 2008 commencing in-memory singleton removal
Fri Dec 05 20:36:05 2008 begin with 3052660 relations and 2007755 unique ideals
Fri Dec 05 20:36:14 2008 reduce to 2899324 relations and 1852807 ideals in 9 passes
Fri Dec 05 20:36:14 2008 max relations containing the same ideal: 28
Fri Dec 05 20:36:20 2008 reading rational ideals above 720000
Fri Dec 05 20:36:21 2008 reading algebraic ideals above 720000
Fri Dec 05 20:36:21 2008 commencing singleton removal, final pass
Fri Dec 05 20:40:44 2008 keeping 1921561 ideals with weight <= 20, new excess is 184602
Fri Dec 05 20:42:36 2008 memory use: 65.0 MB
Fri Dec 05 20:42:41 2008 commencing in-memory singleton removal
Fri Dec 05 20:42:42 2008 begin with 2900386 relations and 1921561 unique ideals
Fri Dec 05 20:42:48 2008 reduce to 2899318 relations and 1915407 ideals in 5 passes
Fri Dec 05 20:42:48 2008 max relations containing the same ideal: 20
Fri Dec 05 20:42:58 2008 removing 1053969 relations and 669083 ideals in 384886 cliques
Fri Dec 05 20:42:59 2008 commencing in-memory singleton removal
Fri Dec 05 20:43:00 2008 begin with 1845349 relations and 1915407 unique ideals
Fri Dec 05 20:43:06 2008 reduce to 1696326 relations and 1073398 ideals in 8 passes
Fri Dec 05 20:43:06 2008 max relations containing the same ideal: 19
Fri Dec 05 20:43:10 2008 removing 757191 relations and 421940 ideals in 335251 cliques
Fri Dec 05 20:43:11 2008 commencing in-memory singleton removal
Fri Dec 05 20:43:11 2008 begin with 939135 relations and 1073398 unique ideals
Fri Dec 05 20:43:14 2008 reduce to 835935 relations and 534151 ideals in 8 passes
Fri Dec 05 20:43:14 2008 max relations containing the same ideal: 15
Fri Dec 05 20:43:15 2008 removing 238872 relations and 151227 ideals in 87645 cliques
Fri Dec 05 20:43:16 2008 commencing in-memory singleton removal
Fri Dec 05 20:43:16 2008 begin with 597063 relations and 534151 unique ideals
Fri Dec 05 20:43:17 2008 reduce to 547494 relations and 327905 ideals in 6 passes
Fri Dec 05 20:43:17 2008 max relations containing the same ideal: 14
Fri Dec 05 20:43:18 2008 relations with 0 large ideals: 53234
Fri Dec 05 20:43:18 2008 relations with 1 large ideals: 168041
Fri Dec 05 20:43:18 2008 relations with 2 large ideals: 199201
Fri Dec 05 20:43:18 2008 relations with 3 large ideals: 102764
Fri Dec 05 20:43:18 2008 relations with 4 large ideals: 22533
Fri Dec 05 20:43:18 2008 relations with 5 large ideals: 1451
Fri Dec 05 20:43:18 2008 relations with 6 large ideals: 270
Fri Dec 05 20:43:18 2008 relations with 7+ large ideals: 0
Fri Dec 05 20:43:18 2008 commencing 2-way merge
Fri Dec 05 20:43:20 2008 reduce to 401006 relation sets and 181417 unique ideals
Fri Dec 05 20:43:20 2008 commencing full merge
Fri Dec 05 20:43:26 2008 memory use: 12.9 MB
Fri Dec 05 20:43:26 2008 found 217126 cycles, need 184802
Fri Dec 05 20:43:26 2008 weight of 184802 cycles is about 8318528 (45.01/cycle)
Fri Dec 05 20:43:26 2008 distribution of cycle lengths:
Fri Dec 05 20:43:26 2008 1 relations: 53234
Fri Dec 05 20:43:26 2008 2 relations: 27065
Fri Dec 05 20:43:26 2008 3 relations: 20134
Fri Dec 05 20:43:26 2008 4 relations: 16501
Fri Dec 05 20:43:26 2008 5 relations: 14229
Fri Dec 05 20:43:26 2008 6 relations: 12082
Fri Dec 05 20:43:26 2008 7 relations: 10537
Fri Dec 05 20:43:26 2008 8 relations: 8915
Fri Dec 05 20:43:26 2008 9 relations: 7503
Fri Dec 05 20:43:26 2008 10+ relations: 14602
Fri Dec 05 20:43:26 2008 heaviest cycle: 14 relations
Fri Dec 05 20:43:26 2008 matrix can improve, retrying
Fri Dec 05 20:43:28 2008 reading rational ideals above 720000
Fri Dec 05 20:43:28 2008 reading algebraic ideals above 720000
Fri Dec 05 20:43:28 2008 commencing singleton removal, final pass
Fri Dec 05 20:46:58 2008 keeping 1927571 ideals with weight <= 25, new excess is 178592
Fri Dec 05 20:47:38 2008 memory use: 65.0 MB
Fri Dec 05 20:47:38 2008 commencing in-memory singleton removal
Fri Dec 05 20:47:40 2008 begin with 2900386 relations and 1927571 unique ideals
Fri Dec 05 20:47:46 2008 reduce to 2899318 relations and 1921417 ideals in 5 passes
Fri Dec 05 20:47:46 2008 max relations containing the same ideal: 25
Fri Dec 05 20:48:00 2008 removing 1054931 relations and 669564 ideals in 385367 cliques
Fri Dec 05 20:48:01 2008 commencing in-memory singleton removal
Fri Dec 05 20:48:02 2008 begin with 1844387 relations and 1921417 unique ideals
Fri Dec 05 20:48:08 2008 reduce to 1695166 relations and 1078700 ideals in 8 passes
Fri Dec 05 20:48:08 2008 max relations containing the same ideal: 23
Fri Dec 05 20:48:12 2008 removing 756682 relations and 421738 ideals in 334944 cliques
Fri Dec 05 20:48:13 2008 commencing in-memory singleton removal
Fri Dec 05 20:48:13 2008 begin with 938484 relations and 1078700 unique ideals
Fri Dec 05 20:48:16 2008 reduce to 835361 relations and 539757 ideals in 8 passes
Fri Dec 05 20:48:16 2008 max relations containing the same ideal: 16
Fri Dec 05 20:48:17 2008 removing 240413 relations and 151976 ideals in 88437 cliques
Fri Dec 05 20:48:18 2008 commencing in-memory singleton removal
Fri Dec 05 20:48:18 2008 begin with 594948 relations and 539757 unique ideals
Fri Dec 05 20:48:19 2008 reduce to 544785 relations and 332080 ideals in 6 passes
Fri Dec 05 20:48:19 2008 max relations containing the same ideal: 15
Fri Dec 05 20:48:20 2008 relations with 0 large ideals: 48702
Fri Dec 05 20:48:20 2008 relations with 1 large ideals: 160074
Fri Dec 05 20:48:20 2008 relations with 2 large ideals: 198740
Fri Dec 05 20:48:20 2008 relations with 3 large ideals: 108973
Fri Dec 05 20:48:20 2008 relations with 4 large ideals: 26050
Fri Dec 05 20:48:20 2008 relations with 5 large ideals: 1955
Fri Dec 05 20:48:20 2008 relations with 6 large ideals: 291
Fri Dec 05 20:48:20 2008 relations with 7+ large ideals: 0
Fri Dec 05 20:48:20 2008 commencing 2-way merge
Fri Dec 05 20:48:22 2008 reduce to 398483 relation sets and 185778 unique ideals
Fri Dec 05 20:48:22 2008 commencing full merge
Fri Dec 05 20:48:30 2008 memory use: 13.0 MB
Fri Dec 05 20:48:30 2008 found 212212 cycles, need 180292
Fri Dec 05 20:48:31 2008 weight of 180292 cycles is about 8433935 (46.78/cycle)
Fri Dec 05 20:48:31 2008 distribution of cycle lengths:
Fri Dec 05 20:48:31 2008 1 relations: 48706
Fri Dec 05 20:48:31 2008 2 relations: 24945
Fri Dec 05 20:48:31 2008 3 relations: 19254
Fri Dec 05 20:48:31 2008 4 relations: 16421
Fri Dec 05 20:48:31 2008 5 relations: 14538
Fri Dec 05 20:48:31 2008 6 relations: 12458
Fri Dec 05 20:48:31 2008 7 relations: 10997
Fri Dec 05 20:48:31 2008 8 relations: 9561
Fri Dec 05 20:48:31 2008 9 relations: 8211
Fri Dec 05 20:48:31 2008 10+ relations: 15201
Fri Dec 05 20:48:31 2008 heaviest cycle: 13 relations
Fri Dec 05 20:48:31 2008 matrix can improve, retrying
Fri Dec 05 20:48:33 2008 reading rational ideals above 720000
Fri Dec 05 20:48:33 2008 reading algebraic ideals above 720000
Fri Dec 05 20:48:33 2008 commencing singleton removal, final pass
Fri Dec 05 20:50:56 2008 keeping 1931318 ideals with weight <= 30, new excess is 174845
Fri Dec 05 20:52:20 2008 memory use: 65.0 MB
Fri Dec 05 20:52:28 2008 commencing in-memory singleton removal
Fri Dec 05 20:52:29 2008 begin with 2900386 relations and 1931318 unique ideals
Fri Dec 05 20:52:36 2008 reduce to 2899318 relations and 1925164 ideals in 5 passes
Fri Dec 05 20:52:36 2008 max relations containing the same ideal: 30
Fri Dec 05 20:52:51 2008 removing 1055531 relations and 669864 ideals in 385667 cliques
Fri Dec 05 20:52:53 2008 commencing in-memory singleton removal
Fri Dec 05 20:52:54 2008 begin with 1843787 relations and 1925164 unique ideals
Fri Dec 05 20:52:59 2008 reduce to 1694399 relations and 1081967 ideals in 8 passes
Fri Dec 05 20:53:00 2008 max relations containing the same ideal: 26
Fri Dec 05 20:53:03 2008 removing 756316 relations and 421573 ideals in 334743 cliques
Fri Dec 05 20:53:04 2008 commencing in-memory singleton removal
Fri Dec 05 20:53:05 2008 begin with 938083 relations and 1081967 unique ideals
Fri Dec 05 20:53:07 2008 reduce to 835051 relations and 543307 ideals in 8 passes
Fri Dec 05 20:53:08 2008 max relations containing the same ideal: 19
Fri Dec 05 20:53:09 2008 removing 241413 relations and 152490 ideals in 88923 cliques
Fri Dec 05 20:53:10 2008 commencing in-memory singleton removal
Fri Dec 05 20:53:10 2008 begin with 593638 relations and 543307 unique ideals
Fri Dec 05 20:53:11 2008 reduce to 543060 relations and 334659 ideals in 6 passes
Fri Dec 05 20:53:11 2008 max relations containing the same ideal: 15
Fri Dec 05 20:53:12 2008 relations with 0 large ideals: 45906
Fri Dec 05 20:53:12 2008 relations with 1 large ideals: 154697
Fri Dec 05 20:53:12 2008 relations with 2 large ideals: 197849
Fri Dec 05 20:53:12 2008 relations with 3 large ideals: 112755
Fri Dec 05 20:53:12 2008 relations with 4 large ideals: 28889
Fri Dec 05 20:53:12 2008 relations with 5 large ideals: 2633
Fri Dec 05 20:53:12 2008 relations with 6 large ideals: 331
Fri Dec 05 20:53:12 2008 relations with 7+ large ideals: 0
Fri Dec 05 20:53:12 2008 commencing 2-way merge
Fri Dec 05 20:53:14 2008 reduce to 397034 relation sets and 188633 unique ideals
Fri Dec 05 20:53:14 2008 commencing full merge
Fri Dec 05 20:53:22 2008 memory use: 13.0 MB
Fri Dec 05 20:53:23 2008 found 209641 cycles, need 178045
Fri Dec 05 20:53:23 2008 weight of 178045 cycles is about 8495839 (47.72/cycle)
Fri Dec 05 20:53:23 2008 distribution of cycle lengths:
Fri Dec 05 20:53:23 2008 1 relations: 45942
Fri Dec 05 20:53:23 2008 2 relations: 23832
Fri Dec 05 20:53:23 2008 3 relations: 18959
Fri Dec 05 20:53:23 2008 4 relations: 16507
Fri Dec 05 20:53:23 2008 5 relations: 14796
Fri Dec 05 20:53:23 2008 6 relations: 12928
Fri Dec 05 20:53:23 2008 7 relations: 11281
Fri Dec 05 20:53:23 2008 8 relations: 9970
Fri Dec 05 20:53:23 2008 9 relations: 8454
Fri Dec 05 20:53:23 2008 10+ relations: 15376
Fri Dec 05 20:53:23 2008 heaviest cycle: 13 relations
Fri Dec 05 20:53:23 2008 matrix can improve, retrying
Fri Dec 05 20:53:25 2008 reading rational ideals above 720000
Fri Dec 05 20:53:25 2008 reading algebraic ideals above 720000
Fri Dec 05 20:53:25 2008 commencing singleton removal, final pass
Fri Dec 05 20:56:48 2008 keeping 1935771 ideals with weight <= 35, new excess is 170392
Fri Dec 05 20:57:16 2008 memory use: 65.0 MB
Fri Dec 05 20:57:17 2008 commencing in-memory singleton removal
Fri Dec 05 20:57:19 2008 begin with 2900386 relations and 1935771 unique ideals
Fri Dec 05 20:57:25 2008 reduce to 2899318 relations and 1929617 ideals in 5 passes
Fri Dec 05 20:57:25 2008 max relations containing the same ideal: 35
Fri Dec 05 20:57:54 2008 removing 1056243 relations and 670220 ideals in 386023 cliques
Fri Dec 05 20:57:56 2008 commencing in-memory singleton removal
Fri Dec 05 20:57:57 2008 begin with 1843075 relations and 1929617 unique ideals
Fri Dec 05 20:58:03 2008 reduce to 1693502 relations and 1085866 ideals in 8 passes
Fri Dec 05 20:58:03 2008 max relations containing the same ideal: 31
Fri Dec 05 20:58:07 2008 removing 755934 relations and 421410 ideals in 334524 cliques
Fri Dec 05 20:58:08 2008 commencing in-memory singleton removal
Fri Dec 05 20:58:08 2008 begin with 937568 relations and 1085866 unique ideals
Fri Dec 05 20:58:11 2008 reduce to 834561 relations and 547419 ideals in 8 passes
Fri Dec 05 20:58:11 2008 max relations containing the same ideal: 22
Fri Dec 05 20:58:13 2008 removing 242515 relations and 153028 ideals in 89487 cliques
Fri Dec 05 20:58:13 2008 commencing in-memory singleton removal
Fri Dec 05 20:58:13 2008 begin with 592046 relations and 547419 unique ideals
Fri Dec 05 20:58:15 2008 reduce to 541127 relations and 337822 ideals in 6 passes
Fri Dec 05 20:58:15 2008 max relations containing the same ideal: 16
Fri Dec 05 20:58:16 2008 relations with 0 large ideals: 42423
Fri Dec 05 20:58:16 2008 relations with 1 large ideals: 147945
Fri Dec 05 20:58:16 2008 relations with 2 large ideals: 195914
Fri Dec 05 20:58:16 2008 relations with 3 large ideals: 117699
Fri Dec 05 20:58:16 2008 relations with 4 large ideals: 32962
Fri Dec 05 20:58:16 2008 relations with 5 large ideals: 3742
Fri Dec 05 20:58:16 2008 relations with 6 large ideals: 439
Fri Dec 05 20:58:16 2008 relations with 7+ large ideals: 3
Fri Dec 05 20:58:16 2008 commencing 2-way merge
Fri Dec 05 20:58:19 2008 reduce to 395435 relation sets and 192130 unique ideals
Fri Dec 05 20:58:19 2008 commencing full merge
Fri Dec 05 20:58:28 2008 memory use: 13.2 MB
Fri Dec 05 20:58:29 2008 found 205893 cycles, need 175092
Fri Dec 05 20:58:29 2008 weight of 175092 cycles is about 8703399 (49.71/cycle)
Fri Dec 05 20:58:29 2008 distribution of cycle lengths:
Fri Dec 05 20:58:29 2008 1 relations: 42523
Fri Dec 05 20:58:29 2008 2 relations: 22544
Fri Dec 05 20:58:29 2008 3 relations: 18360
Fri Dec 05 20:58:29 2008 4 relations: 16169
Fri Dec 05 20:58:29 2008 5 relations: 14856
Fri Dec 05 20:58:29 2008 6 relations: 13037
Fri Dec 05 20:58:29 2008 7 relations: 11346
Fri Dec 05 20:58:29 2008 8 relations: 10146
Fri Dec 05 20:58:29 2008 9 relations: 8608
Fri Dec 05 20:58:29 2008 10+ relations: 17503
Fri Dec 05 20:58:29 2008 heaviest cycle: 14 relations
Fri Dec 05 20:58:29 2008 matrix can improve, retrying
Fri Dec 05 20:58:31 2008 reading rational ideals above 720000
Fri Dec 05 20:58:31 2008 reading algebraic ideals above 720000
Fri Dec 05 20:58:31 2008 commencing singleton removal, final pass
Fri Dec 05 21:01:57 2008 keeping 1939494 ideals with weight <= 40, new excess is 166669
Fri Dec 05 21:02:20 2008 memory use: 65.0 MB
Fri Dec 05 21:02:22 2008 commencing in-memory singleton removal
Fri Dec 05 21:02:23 2008 begin with 2900386 relations and 1939494 unique ideals
Fri Dec 05 21:02:29 2008 reduce to 2899318 relations and 1933340 ideals in 5 passes
Fri Dec 05 21:02:29 2008 max relations containing the same ideal: 40
Fri Dec 05 21:02:49 2008 removing 1056839 relations and 670518 ideals in 386321 cliques
Fri Dec 05 21:02:51 2008 commencing in-memory singleton removal
Fri Dec 05 21:02:52 2008 begin with 1842479 relations and 1933340 unique ideals
Fri Dec 05 21:02:58 2008 reduce to 1692775 relations and 1089135 ideals in 8 passes
Fri Dec 05 21:02:58 2008 max relations containing the same ideal: 34
Fri Dec 05 21:03:01 2008 removing 755580 relations and 421228 ideals in 334352 cliques
Fri Dec 05 21:03:03 2008 commencing in-memory singleton removal
Fri Dec 05 21:03:03 2008 begin with 937195 relations and 1089135 unique ideals
Fri Dec 05 21:03:06 2008 reduce to 834192 relations and 550889 ideals in 8 passes
Fri Dec 05 21:03:06 2008 max relations containing the same ideal: 23
Fri Dec 05 21:03:08 2008 removing 243459 relations and 153493 ideals in 89966 cliques
Fri Dec 05 21:03:08 2008 commencing in-memory singleton removal
Fri Dec 05 21:03:08 2008 begin with 590733 relations and 550889 unique ideals
Fri Dec 05 21:03:09 2008 reduce to 539480 relations and 340446 ideals in 6 passes
Fri Dec 05 21:03:09 2008 max relations containing the same ideal: 20
Fri Dec 05 21:03:11 2008 relations with 0 large ideals: 39364
Fri Dec 05 21:03:11 2008 relations with 1 large ideals: 141456
Fri Dec 05 21:03:11 2008 relations with 2 large ideals: 194211
Fri Dec 05 21:03:11 2008 relations with 3 large ideals: 121964
Fri Dec 05 21:03:11 2008 relations with 4 large ideals: 36823
Fri Dec 05 21:03:11 2008 relations with 5 large ideals: 5066
Fri Dec 05 21:03:11 2008 relations with 6 large ideals: 591
Fri Dec 05 21:03:11 2008 relations with 7+ large ideals: 5
Fri Dec 05 21:03:11 2008 commencing 2-way merge
Fri Dec 05 21:03:12 2008 reduce to 394174 relation sets and 195140 unique ideals
Fri Dec 05 21:03:13 2008 commencing full merge
Fri Dec 05 21:03:22 2008 memory use: 13.3 MB
Fri Dec 05 21:03:22 2008 found 203055 cycles, need 172869
Fri Dec 05 21:03:22 2008 weight of 172869 cycles is about 8884107 (51.39/cycle)
Fri Dec 05 21:03:22 2008 distribution of cycle lengths:
Fri Dec 05 21:03:22 2008 1 relations: 39620
Fri Dec 05 21:03:22 2008 2 relations: 21495
Fri Dec 05 21:03:22 2008 3 relations: 17958
Fri Dec 05 21:03:22 2008 4 relations: 16062
Fri Dec 05 21:03:22 2008 5 relations: 14780
Fri Dec 05 21:03:22 2008 6 relations: 13094
Fri Dec 05 21:03:22 2008 7 relations: 11523
Fri Dec 05 21:03:22 2008 8 relations: 10436
Fri Dec 05 21:03:22 2008 9 relations: 8896
Fri Dec 05 21:03:22 2008 10+ relations: 19005
Fri Dec 05 21:03:22 2008 heaviest cycle: 14 relations
Fri Dec 05 21:03:22 2008 matrix not dense enough, retrying

[/CODE]

Is this a result of my oversieving or what?

schickel 2008-12-06 09:22

[QUOTE=10metreh;152180]I managed to get nfs2ms.pl working, but this error occurs in msieve:[CODE]Fri Dec 05 18:59:23 2008 found 0 duplicates and 5333248 unique relations
...
...
...
Fri Dec 05 21:03:22 2008 matrix not dense enough, retrying[/CODE]
Is this a result of my oversieving or what?[/QUOTE]Probably. For 100 digits, you really only need <3.75 million relations (at least on the jobs I've run).

To proceed, you can try dropping some of the relations. Either copy only ~4 million relations to a new msieve.dat file, or run (you don't have to re-run the script, since the files have all been converted to msieve's format):[code]msieve -nc1 0,4000000[/code]which will only use the first 4 million relations, and should allow msieve to build a matrix. If you do it with the "-nc1" switch, then you'll have to run the linear algebra and square root steps by hand also. Or you could just write a small batch to call msieve with the switches in order.

jasonp 2008-12-06 13:26

Note that the arguments to -nc1 have changed, and you cannot specify using fewer relations anymore (I figured nobody needed to). You basically have to construct a smaller relation file. With cygwin or MinGW:

head -3750000 msieve.dat > msieve.dat.new
msieve -v -s msieve.dat.new -nc1
msieve -v -s msieve.dat.new -nc2
msieve -v -s msieve.dat.new -nc3

10metreh 2008-12-06 15:33

I was using the binary, not a compiled version. Can I just delete some of the relations from the file?

henryzz 2008-12-06 16:18

[quote=10metreh;152240]I was using the binary, not a compiled version. Can I just delete some of the relations from the file?[/quote]
yes but make a backup first
do you have cygwin or mingw to do the head -3750000 msieve.dat > msieve.dat.new command with

10metreh 2008-12-06 17:15

[quote=henryzz;152247]do you have cygwin or mingw to do the head -3750000 msieve.dat > msieve.dat.new command with[/quote]

No, I don't. Otherwise why would I ask my question?

jasonp 2008-12-06 17:49

Yes, you can manually delete relations from the relations file. But without any unix tools, or a freeware really nice editor, you will probably have a lot of trouble opening up multi-hundred-megabyte text files. I personally find it very useful to install MinGW and Msys, and put their binary directories in my windows path; the stack of utilities you get is just too useful for me, but then again I've worked in unix a lot.

10metreh 2008-12-06 18:27

From what I've done so far, my file will take about 20 minutes to open. I'll probably spend the time playing snooker.

henryzz 2008-12-06 21:14

[quote=10metreh;152271]From what I've done so far, my file will take about 20 minutes to open. I'll probably spend the time playing snooker.[/quote]
[url]http://www.textpad.com/download/index.html[/url] will open a file of several hundred mb quickly


All times are UTC. The time now is 10:35.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.