mersenneforum.org

mersenneforum.org (https://www.mersenneforum.org/index.php)
-   Lone Mersenne Hunters (https://www.mersenneforum.org/forumdisplay.php?f=12)
-   -   LMH status (https://www.mersenneforum.org/showthread.php?t=908)

lycorn 2009-07-27 14:35

Also note that getting detailed factoring data from the server has now become, unless I´m missing something, considerably more cumbersome than it was before. To get the number of exponents factored to each level was just a matter of downloading the nofactor.zip file and do some trivial text processing. Now that file no longer exists and, AFAIK, there is no way of downloading that information from the server in a compact form.

chalsall 2009-07-27 15:05

1 Attachment(s)
[QUOTE=lycorn;182970]To get the number of exponents factored to each level was just a matter of downloading the nofactor.zip file and do some trivial text processing. Now that file no longer exists and, AFAIK, there is no way of downloading that information from the server in a compact form.[/QUOTE]

The data is available, but no, not in a compact form.

I could produce this data for you if you'd like. I have my own database derived from Primenet. Give me a couple of days.

BTW, I had some time this weekend to play some more... [URL="http://www.wabbit.com/trialfactored.cgi"][COLOR="black"]http://www.wabbit.com/trialfactored.cgi[/COLOR][/URL]

lycorn 2009-07-27 16:35

OK, thanks for the offer.
Is your replication(?) of GIMPS database updated on a periodic basis, or is it some form of query you may run whenever you wish?
I remember a thread in this forum ([url]http://www.mersenneforum.org/showthread.php?t=4372[/url]), started by jhagerson, that had a compact table with the number of exponents at each bith depth, and the evolution from each update to the next one. It was a hard and fast way of tracking progress, and it was straightforward to produce using the nofactor.zip. Given we are now working with a pool of 50M+ exponents, do you think that a similar table, and its subsequent and regular updates, could currently be produced with a reasonable effort (I leave the definition of "reasonable" to your consideration...:smile:)?

chalsall 2009-07-27 17:14

[QUOTE=lycorn;182993]Is your replication(?) of GIMPS database updated on a periodic basis, or is it some form of query you may run whenever you wish?[/QUOTE]

What one sees over on wabbit.com is an abstract of the database kept on another one of my servers, which is itself a dataset periodically updated by the occasional spidering of PrimeNet (and a great deal of PERL), and the work that my own swarm of "workers" does.

I don't want to put too much load on PrimeNet, so I only update every few days. I have, however, figured out a way to keep my dataset no more than 24 hours out of date, while minimizing the queries to PrimeNet.

And, just so you all know, there are currently 25,046,640 records in my main Exponent table. This does not include Exponents cleared (read: factored) before I started this work. 24,665,077 Exponents remain unfactored.

I'm happy to share this dataset with everyone. It is, after all, public domain knowledge.

cheesehead 2009-07-27 21:39

[quote=chalsall;182978]BTW, I had some time this weekend to play some more... [URL="http://www.wabbit.com/trialfactored.cgi"][COLOR=black]http://www.wabbit.com/trialfactored.cgi[/COLOR][/URL][/quote]Hey, that's quite an improvement! I have little trouble matching the colors since there's additional "spatial" information to go by.

10metreh 2009-07-28 07:13

One little snag: some of the "tall towers" block the view of the stuff behind.

markr 2009-08-01 01:26

[QUOTE=chalsall;182978]BTW, I had some time this weekend to play some more... [URL="http://www.wabbit.com/trialfactored.cgi"][COLOR="black"]http://www.wabbit.com/trialfactored.cgi[/COLOR][/URL][/QUOTE]
Nice - I particularly like being able to zoom in on a section of interest. Thank you!

markr 2009-08-03 02:05

1 Attachment(s)
A small glitch: in two charts, for 0 to 10M & 0 to 100M, the bars for <60 & 60 in the first row (0M) are ~10x too high. Just those two bars in those two charts, as far as I can tell. I've attached one.

Would it be difficult to make your "abstracted" data available? That is, counts by bit-level by 0.01M range, which is your deepest zoom. My interest is mostly up to 100M, but a text-format file from the entire PrimeNet range should be only a few MB. Updated frequently is not important to me. Just asking...

Then again, maybe this is something that could be added to PrimeNet? Perhaps a report for user-specified exponent range and grouping interval eg 0.01M or 1M.

chalsall 2009-08-04 12:37

[QUOTE=markr;183783]A small glitch: in two charts, for 0 to 10M & 0 to 100M, the bars for <60 & 60 in the first row (0M) are ~10x too high. Just those two bars in those two charts, as far as I can tell. I've attached one.

Would it be difficult to make your "abstracted" data available? That is, counts by bit-level by 0.01M range, which is your deepest zoom. My interest is mostly up to 100M, but a text-format file from the entire PrimeNet range should be only a few MB. Updated frequently is not important to me. Just asking...[/QUOTE]

Thanks for catching the error in the dataset. It was a few bad records in my Summary table caused during early development. Fixed.

And yes, I can (and will) make this data available in raw format shortly. I had hoped to have it done over the long weekend, but a client needed my attention. Later this week for sure.

cheesehead 2009-08-04 19:26

chalsall,

Again -- thanks for your work. GIMPS is the sum of its participants' individual contributions, and you're part of this first successful large-scale Internet distributed computing project.

chalsall 2009-08-05 15:27

[QUOTE=cheesehead;184097]Again -- thanks for your work. GIMPS is the sum of its participants' individual contributions, and you're part of this first successful large-scale Internet distributed computing project.[/QUOTE]

Thanks for the kind words Cheesehead. I am standing on the shoulders of giants.


All times are UTC. The time now is 10:25.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.