[QUOTE=Joshua2;202749]should I keep it or delete it[/QUOTE]

Doesn't matter. If it's there, msieve will zap it the next time you filter, anyway.

I am in the habit of keeping my relations files in a subdirectory, with no other type of file allowed in that directory. It makes it easier to do relation counts and backups, and it reduces the chance of accidental deletion.

When I'm ready to filter, I just cat them all into a single .dat file in the main directory, and then filter using that file.

could someone explain this output to me?
[code]commencing duplicate removal, pass 1
error -15 reading relation 33810676 //whats this?
found 10351595 hash collisions in 57228325 relations //what is a relation vs a free relation vs unique relation
added 122614 free relations
commencing duplicate removal, pass 2
found 9668004 duplicates and 47682935 unique relations
reading ideals above 50003968
commencing singleton removal, initial pass
commencing in-memory singleton removal
begin with 47682935 relations and 62501316 unique ideals
reduce to 1596536 relations and 753242 ideals in 26 passes //what is an ideal
max relations containing the same ideal: 8
reading ideals above 30000
commencing singleton removal, initial pass
keeping 5218095 ideals with weight <= 200, target excess is 8625 //what is weight
commencing in-memory singleton removal
begin with 1665848 relations and 5218095 unique ideals
reduce to 34 relations and 0 ideals in 4 passes
max relations containing the same ideal: 0
filtering wants 1000000 more relations
elapsed time 00:23:30[/code]

This won't be completely enlightening, but it's the best I can do in a couple of minutes.

[QUOTE=Joshua2;202776]
error -15 reading relation 33810676 //whats this?[/QUOTE]
One of the relations is naughty: perhaps an error in the format, or the (a,b) pair doesn't factor over the primes named in the relation
[QUOTE]
found 10351595 hash collisions in 57228325 relations //what is a relation vs a free relation vs unique relation[/QUOTE]
Relations are lists of primes (numbers or ideals) which factor the non-linear polynomial value for the value a, and the linear polynomial for the value b. Free relations are the ones which fall out of the factor base without any sieving - there are only a few of them. Unique relations are what's left over after the duplicates have been dumped.
[QUOTE]reduce to 1596536 relations and 753242 ideals in 26 passes //what is an ideal[/QUOTE]
An ideal is a subset of the real numbers lying between Q and R with some nice properties. A semester of abstract algebra plus a basic course in algebraic number theory should tell you all you need to know :razz:
For our purposes, an ideal is sort of a prime number, but in a ring (look it up!) which is not the integers but shares some abstract properties with the integers.
[QUOTE]keeping 5218095 ideals with weight <= 200, target excess is 8625 //what is weight[/QUOTE]
Weight is the number of relations in which an ideal makes an appearance. Again, think of relations as lists of primes which factor the values of our non-linear and linear polynomials, where, in the case of the non-linear polynomial, "primes" means "ideals".

This is a simple (!) explanation of what is going on here, and certainly contains some inaccuracies. I have no doubt that someone will step in to correct any errors I have made - this forum is not known for being chock full of painfully-reticent shrinking violets.

:smile::nuke:

67-70 done, I will upload the relations tonight.

[CODE]67-68.5: 1711677 relations
68.5-70: 1708114 relations
[B]total:[/B] 3419791 relations[/CODE]

A few small corrections to what FactorEyes wrote: Both the rational and algebraic polynomials are evaluated at both the 'a' and 'b' values for each relation; the value of the rational polynomial at (a,b) is factored into primes, and the value of the algebraic polynomial at (a,b) is factored into 'things' that have a 1:1 correspondence with ideals.

Your job as the postprocessing guy is to choose a collection of relations such that every prime and every 'thing' appears an even number of times. Then the number field that generated the algebraic polynomial has a 'trap door' that moves from number-field-land back to the integers. This gives you two different numbers whose squares are identical modulo the number N being factored, which leads to a factor of N about half the time. Just to be confusing, the filtering calls both primes and 'things' [i]ideals[/i], as a proxy for things-that-be-made-even. The primes and the things are all tossed into a giant bucket and treated identically.

The job of the filtering is to set up a huge linear algebra problem, by throwing away relations whose primes-and-things occur too often to be useful. The ones that are left lead to a linear algebra problem that is smaller and better behaved. Solving the matrix created leads to the collection of relations described above.

When the filtering works, it will be because the number of unique relations exceeds the number of unique ideals by at least a certain amount, leading to a matrix that is large enough. The difference between the number of relations and number of ideals (what the code calls 'the excess') is the minimum size of matrix that can be made from the current dataset.

Also, the .lp file is basically a compressed representation of each relation, which is useful for speeding up the filtering. It's recreated from scratch whenever the filtering runs.

[url=http://www.sendspace.com/file/k48btl]115-119 done[/url]: 3811160 relations.

[QUOTE=Andi47;202815]67-70 done, I will upload the relations tonight.

[CODE]67-68.5: 1711677 relations
68.5-70: 1708114 relations
[B]total:[/B] 3419791 relations[/CODE][/QUOTE]

119-119.4 done:

119.0-119.2: 186858 relations
119.2-119.4: 190525 relations

edit: link to a tar.bz2 archive which holds the ranges 67-70 and 119-119.4:

[url]http://www.sendspace.com/file/hgsp8g[/url]

Nearly 3800 out of 3900 results for RSALS.
To whom should I send the information that enables downloading the data directly from the RSALS server ?

[quote=debrouxl;202846]Nearly 3800 out of 3900 results for RSALS.
To whom should I send the information that enables downloading the data directly from the RSALS server ?[/quote]
Joshua2. Here's the link to PM him:
[url]http://www.mersenneforum.org/private.php?do=newpm&u=1286[/url]

What is the status of postprocessing? We should have enough relations by now?

[QUOTE=Andi47;203085]What is the status of postprocessing? We should have enough relations by now?[/QUOTE]

Joshua2 has probably started the linalg but is unable to do anything on the computer because of it. Looking at the "Last Activity" on his profile, that may well be the case.