[QUOTE=Joshua2;202511]so it was missing carriage return. I edited my previous post to have all the latest wc lines 58130798. how many relations we need? if I filter once will it have to refilter stage 1 again or i need to wait?[/QUOTE]

Go ahead and filter, but we're nowhere near the number of relations for a matrix. Once the relations are all in, you'll have to filter again, but that won't take more than a couple of hours.

Filtering now will give you a picture of how close you are to a matrix, in terms of unique relations, and number of relations vs. number of ideals.

[quote=Joshua2;202507][code]
[B] 229871 229875 24012800 alq4788.2509_20M0.20M2.tar[/B]
116158 116158 12131437 alq4788.2509_20M1.20M2.out
227519 227519 24175175 alq4788.2509_70.71a.out
222767 222767 23667254 alq4788.2509_70.71b.out
335863 335863 35683311 alq4788.2509_70.71c.out
[B] 335863 335863 35683311 alq4788.2509_70.71c.out.dat[/B]
336738 336738 35785213 alq4788.2509_70.71d.out
[B] 336738 336738 35785213 alq4788.2509_70.71d.out.dat[/B]
[/code][/quote]
Looks like you got all posted files downloaded, but...
You included a .tar and a couple duplicate files in your latest merging. I'm counting that you should have 57228329 relations, which is what your total would be (within one or two) without the files I bolded.
Msieve shouldn't really blow up, (I just tried out similar files, and it's quite silent about the whole thing...just a couple unreadable lines from the .tar formatting; now if it were a compression and not simply an archive, like .bz2 or .zip instead of .tar, it would be unable to read that part of the file and so complain with many errors) but it is throwing off your line count a bit. You can rebuild the .dat completely or not, whatever you want.
[quote=Joshua2;202511]how many relations we need?[/quote]
I don't really know, but 10metreh said we should sieve 20M-120M. You've only got the relations from approximately 20M-70M.
[quote=Joshua2;202511]if I filter once will it have to refilter stage 1 again or i need to wait?[/quote]
It will have to do all filtering again. There is no real benefit to filtering yet, besides checking that everything's set up right and there are no major problems with any necessary files.
If you know enough about what msieve is telling you to know how close you are to a matrix, then you can learn that from it. (as FactorEyes said)

almost enough?[code]
commencing relation filtering
estimated available RAM is 8191.2 MB
commencing duplicate removal, pass 1
error -1 reading relation 33017179
error -15 reading relation 34376408
error -15 reading relation 34713146
found 10990849 hash collisions in 58130793 relations
added 122614 free relations
commencing duplicate removal, pass 2
found 10570473 duplicates and 47682934 unique relations
memory use: 330.4 MB
reading ideals above 70975488
commencing singleton removal, initial pass
memory use: 1506.0 MB
reading all ideals from disk
memory use: 804.9 MB
commencing in-memory singleton removal
begin with 47682934 relations and 60169029 unique ideals
reduce to 4001494 relations and 1852382 ideals in 19 passes
max relations containing the same ideal: 8
reading ideals above 100000
commencing singleton removal, initial pass
memory use: 188.3 MB
reading all ideals from disk
memory use: 176.3 MB
keeping 8701422 ideals with weight <= 200, target excess is 22159
commencing in-memory singleton removal
begin with 4011071 relations and 8701422 unique ideals
reduce to 84 relations and 0 ideals in 5 passes
max relations containing the same ideal: 0
filtering wants 1000000 more relations
elapsed time 00:29:09[/code]

Not there, yet
 

[CODE]begin with 47682934 relations and 60169029 unique ideals[/CODE]

This looks about right - you're halfway there, as far as raw relations.

Once the remaining 50% of relations come in, you'll have around 85-90 million unique relations and somewhere between 70 and 80 million ideals, which will give you a matrix.

[QUOTE=Joshua2;202516]almost enough?[/QUOTE]

Not even close :smile:

67-70 is ~80% done, ~2.7M relations so far.

[QUOTE=Mini-Geek;202510]Try this for msieve.fb instead:
[code]N 8519618226197093878278613851429334276607578086560582046132272468491047228903383713809367142607155237315475444625223025926760239272565192820910356755196796601078683
SKEW 82092126.77
A0 -4506332652721281857439312883465578850580235
A1 1546557538158535979212952557252545273
A2 -493361789599381258970904335
A3 -1674326900805118095209
A4 -406958861894
A5 22800
R0 -51819960992313118269272571928496
R1 813459549425076319
FAMAX 12500000
FRMAX 12500000
SALPMAX 134217728
SRLPMAX 134217728
[/code](the last 4 lines are new)[/QUOTE]
Those last 4 lines are not necessary for postprocessing.

As was mentioned before, there must be a newline at the end of each line, or it won't be read correctly. Which text editor failed to write the last newline?

[quote=jrk;202555]Those last 4 lines are not necessary for postprocessing.[/quote]
Yeah, I noticed. Hence my edit. :smile: I thought about taking out what I posted that was wrong, but never did.
[quote=jrk;202555]As was mentioned before, there must be a newline at the end of each line, or it won't be read correctly. Which text editor failed to write the last newline?[/quote]
Most likely, the text editor was just doing what it was told. If you didn't copy it in a way that included the newline at the end, (and didn't put it there yourself) then it doesn't know there should be a newline at the end, and it won't write a newline at the end. In any case, shouldn't msieve be able to read it even without the final newline? (just to not avoid the question: I used Metapad. I don't know what Joshua2 used, but I'd guess it's a pretty common occurrence.)

I used notepad, most people with windows would use that prob

[quote=Mini-Geek;202575]... Most likely, the text editor was just doing what it was told. If you didn't copy it in a way that included the newline at the end, (and didn't put it there yourself) then it doesn't know there should be a newline at the end, and it won't write a newline at the end. In any case, shouldn't msieve be able to read it even without the final newline? (just to not avoid the question: I used Metapad. I don't know what Joshua2 used, but I'd guess it's a pretty common occurrence.)[/quote]

This is an issue I really have to keep track of here, using both winXP and linux machines. For the linux ones, I need to ensure there isn't anything extra, while the winXP needs an extra CR/LF. If I mess up in either direction the particular machine scolds me.:smile:
[SIZE=1]
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
For those who may have noticed that my avatar is spinning counter to the proper rotation, it is an optical illusion, due to the incompatible shutter speed with which the galaxy was originally recorded.[/SIZE]

The RSALS server has now received almost 3400 results out of 3900.