LMH status - Page 24

lycorn · 2009-07-27, 14:35

Also note that getting detailed factoring data from the server has now become, unless I´m missing something, considerably more cumbersome than it was before. To get the number of exponents factored to each level was just a matter of downloading the nofactor.zip file and do some trivial text processing. Now that file no longer exists and, AFAIK, there is no way of downloading that information from the server in a compact form.

chalsall · 2009-07-27, 15:05

Quote:

Originally Posted by lycorn

To get the number of exponents factored to each level was just a matter of downloading the nofactor.zip file and do some trivial text processing. Now that file no longer exists and, AFAIK, there is no way of downloading that information from the server in a compact form.

The data is available, but no, not in a compact form.

I could produce this data for you if you'd like. I have my own database derived from Primenet. Give me a couple of days.

BTW, I had some time this weekend to play some more... http://www.wabbit.com/trialfactored.cgi

lycorn · 2009-07-27, 16:35

OK, thanks for the offer.
Is your replication(?) of GIMPS database updated on a periodic basis, or is it some form of query you may run whenever you wish?
I remember a thread in this forum (http://www.mersenneforum.org/showthread.php?t=4372), started by jhagerson, that had a compact table with the number of exponents at each bith depth, and the evolution from each update to the next one. It was a hard and fast way of tracking progress, and it was straightforward to produce using the nofactor.zip. Given we are now working with a pool of 50M+ exponents, do you think that a similar table, and its subsequent and regular updates, could currently be produced with a reasonable effort (I leave the definition of "reasonable" to your consideration...

)?

chalsall · 2009-07-27, 17:14

Quote:

Originally Posted by lycorn

Is your replication(?) of GIMPS database updated on a periodic basis, or is it some form of query you may run whenever you wish?

What one sees over on wabbit.com is an abstract of the database kept on another one of my servers, which is itself a dataset periodically updated by the occasional spidering of PrimeNet (and a great deal of PERL), and the work that my own swarm of "workers" does.

I don't want to put too much load on PrimeNet, so I only update every few days. I have, however, figured out a way to keep my dataset no more than 24 hours out of date, while minimizing the queries to PrimeNet.

And, just so you all know, there are currently 25,046,640 records in my main Exponent table. This does not include Exponents cleared (read: factored) before I started this work. 24,665,077 Exponents remain unfactored.

I'm happy to share this dataset with everyone. It is, after all, public domain knowledge.

cheesehead · 2009-07-27, 21:39

Quote:

Originally Posted by chalsall

BTW, I had some time this weekend to play some more... http://www.wabbit.com/trialfactored.cgi

Hey, that's quite an improvement! I have little trouble matching the colors since there's additional "spatial" information to go by.

10metreh · 2009-07-28, 07:13

One little snag: some of the "tall towers" block the view of the stuff behind.

markr · 2009-08-01, 01:26

Quote:

Originally Posted by chalsall

BTW, I had some time this weekend to play some more... http://www.wabbit.com/trialfactored.cgi

Nice - I particularly like being able to zoom in on a section of interest. Thank you!

markr · 2009-08-03, 02:05

A small glitch: in two charts, for 0 to 10M & 0 to 100M, the bars for <60 & 60 in the first row (0M) are ~10x too high. Just those two bars in those two charts, as far as I can tell. I've attached one.

Would it be difficult to make your "abstracted" data available? That is, counts by bit-level by 0.01M range, which is your deepest zoom. My interest is mostly up to 100M, but a text-format file from the entire PrimeNet range should be only a few MB. Updated frequently is not important to me. Just asking...

Then again, maybe this is something that could be added to PrimeNet? Perhaps a report for user-specified exponent range and grouping interval eg 0.01M or 1M.

chalsall · 2009-08-04, 12:37

Quote:

Originally Posted by markr

A small glitch: in two charts, for 0 to 10M & 0 to 100M, the bars for <60 & 60 in the first row (0M) are ~10x too high. Just those two bars in those two charts, as far as I can tell. I've attached one.

Would it be difficult to make your "abstracted" data available? That is, counts by bit-level by 0.01M range, which is your deepest zoom. My interest is mostly up to 100M, but a text-format file from the entire PrimeNet range should be only a few MB. Updated frequently is not important to me. Just asking...

Thanks for catching the error in the dataset. It was a few bad records in my Summary table caused during early development. Fixed.

And yes, I can (and will) make this data available in raw format shortly. I had hoped to have it done over the long weekend, but a client needed my attention. Later this week for sure.

cheesehead · 2009-08-04, 19:26

chalsall,

Again -- thanks for your work. GIMPS is the sum of its participants' individual contributions, and you're part of this first successful large-scale Internet distributed computing project.

chalsall · 2009-08-05, 15:27

Quote:

Originally Posted by cheesehead

Again -- thanks for your work. GIMPS is the sum of its participants' individual contributions, and you're part of this first successful large-scale Internet distributed computing project.

Thanks for the kind words Cheesehead. I am standing on the shoulders of giants.

2009-07-27, 16:35	#256
lycorn Sep 2002 Oeiras, Portugal 1451₁₀ Posts	OK, thanks for the offer. Is your replication(?) of GIMPS database updated on a periodic basis, or is it some form of query you may run whenever you wish? I remember a thread in this forum (http://www.mersenneforum.org/showthread.php?t=4372), started by jhagerson, that had a compact table with the number of exponents at each bith depth, and the evolution from each update to the next one. It was a hard and fast way of tracking progress, and it was straightforward to produce using the nofactor.zip. Given we are now working with a pool of 50M+ exponents, do you think that a similar table, and its subsequent and regular updates, could currently be produced with a reasonable effort (I leave the definition of "reasonable" to your consideration...)?

2009-08-03, 02:05	#261
markr "Mark" Feb 2003 Sydney 3×191 Posts	A small glitch: in two charts, for 0 to 10M & 0 to 100M, the bars for <60 & 60 in the first row (0M) are ~10x too high. Just those two bars in those two charts, as far as I can tell. I've attached one. Would it be difficult to make your "abstracted" data available? That is, counts by bit-level by 0.01M range, which is your deepest zoom. My interest is mostly up to 100M, but a text-format file from the entire PrimeNet range should be only a few MB. Updated frequently is not important to me. Just asking... Then again, maybe this is something that could be added to PrimeNet? Perhaps a report for user-specified exponent range and grouping interval eg 0.01M or 1M. Attached Thumbnails

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Status	Primeinator	Operation Billion Digits	5	2011-12-06 02:35
62 bit status	1997rj7	Lone Mersenne Hunters	27	2008-09-29 13:52
OBD Status	Uncwilly	Operation Billion Digits	22	2005-10-25 14:05
1-2M LLR status	paulunderwood	3*2^n-1 Search	2	2005-03-13 17:03
Status of 26.0M - 26.5M	1997rj7	Lone Mersenne Hunters	25	2004-06-18 16:46

2009-07-27, 14:35	#254
lycorn Sep 2002 Oeiras, Portugal 10110101011₂ Posts	Also note that getting detailed factoring data from the server has now become, unless I´m missing something, considerably more cumbersome than it was before. To get the number of exponents factored to each level was just a matter of downloading the nofactor.zip file and do some trivial text processing. Now that file no longer exists and, AFAIK, there is no way of downloading that information from the server in a compact form.

2009-07-28, 07:13	#259
10metreh Nov 2008 4422₈ Posts	One little snag: some of the "tall towers" block the view of the stuff behind.

2009-08-04, 19:26	#263
cheesehead "Richard B. Woods" Aug 2002 Wisconsin USA 17014₈ Posts	chalsall, Again -- thanks for your work. GIMPS is the sum of its participants' individual contributions, and you're part of this first successful large-scale Internet distributed computing project.