mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > PrimeNet

Reply
 
Thread Tools
Old 2016-01-15, 08:26   #1
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

3×29×83 Posts
Default XML api?

How does one access the XML api?
Dubslow is offline   Reply With Quote
Old 2016-01-15, 22:43   #2
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

63578 Posts
Default

Quote:
Originally Posted by Dubslow View Post
How does one access the XML api?
Depends on what exactly you're after.

There are a couple of undocumented XML things available.
  1. Daily (and annual) dumps of all results from clients. e.g. http://www.mersenne.org/result_archi...-01-14.xml.bz2
  2. Exponent reports available in XML format. e.g. http://www.mersenne.org/report_expon...xp_lo=37397431
(you can also set exp_hi=xx on the exponent report to return a range)

I'm still considering the exponent report as experimental even though I'm pretty sure it works okay. That's why there aren't any links from the site itself to those pages yet, or a button to toggle that kind of output when submitting, etc.

Eventually I'd like to re-write that entire exponent report page (the HTML version) and have it use the same XML data. Right now the XML generates super fast but the HTML version of the data comes from an old and not-very-optimized query using large sets of data pumped into a PHP array... it can be pretty slow.

For fast data collection I recommend the XML.

And then the daily XML of result logs are for those folks who would normally spider the "recent results" page every hour hoping to get it all. Now they can get it in one archive and not worry about missing something.
Madpoo is offline   Reply With Quote
Old 2016-01-15, 22:53   #3
Mark Rose
 
Mark Rose's Avatar
 
"/X\(‘-‘)/X\"
Jan 2013

B7416 Posts
Default

What is the url for the annual version of the results xml? I'd be interested in that :)
Mark Rose is offline   Reply With Quote
Old 2016-01-16, 01:18   #4
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

63578 Posts
Default

Quote:
Originally Posted by Mark Rose View Post
What is the url for the annual version of the results xml? I'd be interested in that :)
e.g. http://www.mersenne.org/result_archive/2015.7z

(available for years going back to 1997)

Each annual 7z file contains all of the separate bz2 archives for each day.

Some of the years are pretty big... 2010 is 165MB for instance.
Madpoo is offline   Reply With Quote
Old 2016-01-16, 01:42   #5
0PolarBearsHere
 
0PolarBearsHere's Avatar
 
Oct 2015

2·7·19 Posts
Default

Quote:
Originally Posted by Madpoo View Post
e.g. http://www.mersenne.org/result_archive/2015.7z

(available for years going back to 1997)

Each annual 7z file contains all of the separate bz2 archives for each day.

Some of the years are pretty big... 2010 is 165MB for instance.
And gets even bigger (by a lot) when you decompress it :P
0PolarBearsHere is offline   Reply With Quote
Old 2016-01-16, 02:07   #6
Mark Rose
 
Mark Rose's Avatar
 
"/X\(‘-‘)/X\"
Jan 2013

55648 Posts
Default

Quote:
Originally Posted by Madpoo View Post
e.g. http://www.mersenne.org/result_archive/2015.7z

(available for years going back to 1997)

Each annual 7z file contains all of the separate bz2 archives for each day.

Some of the years are pretty big... 2010 is 165MB for instance.
Thanks :)
Mark Rose is offline   Reply With Quote
Old 2017-01-10, 14:22   #7
tmorrow
 
tmorrow's Avatar
 
Jan 2004

6716 Posts
Default

Is this a manual or automated process? I notice that http://www.mersenne.org/result_archive/2016.7z is not yet available. When can we expect it? Also thanks for making this data available, much appreciated.
tmorrow is offline   Reply With Quote
Old 2017-01-11, 03:44   #8
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

7·11·43 Posts
Default

Quote:
Originally Posted by tmorrow View Post
Is this a manual or automated process? I notice that http://www.mersenne.org/result_archive/2016.7z is not yet available. When can we expect it? Also thanks for making this data available, much appreciated.
Ah, good reminder...I should do that.

Give it a try in an hour and it should be there (I'll get it compressing now, so just to be safe try after maybe 05:00 UTC on Jan 11)

EDIT: It's done now. I thought it'd take longer but it just stores the individual bz2 files. Lickety split.

Last fiddled with by Madpoo on 2017-01-11 at 03:50
Madpoo is offline   Reply With Quote
Old 2017-01-11, 15:17   #9
tmorrow
 
tmorrow's Avatar
 
Jan 2004

103 Posts
Default

Many thanks, downloaded and unpacked with no problems.
tmorrow is offline   Reply With Quote
Old 2017-01-13, 05:39   #10
snme2pm1
 
"Graham uses ISO 8601"
Mar 2014
AU, Sydney

111100112 Posts
Default

Quote:
Originally Posted by Madpoo View Post
Depends on what exactly you're after.
There are a couple of undocumented XML things available.
As a programmer I abhor the hazards of data or definition duplication.
Just curious for purposes of derivative data sanity, what is the operational regime upon a deemed instance of faked submission of results that have already been accrued to such summaries?
Are the summaries regenerated?
There have been instances of abuse in the past, and there may be further such instances requiring data wind back going forward.
A similar question might be asked in respect of mersenne.ca data holdings.
snme2pm1 is offline   Reply With Quote
Old 2017-01-27, 10:36   #11
Lorenzo
 
Lorenzo's Avatar
 
Aug 2010
Republic of Belarus

2·89 Posts
Default

Quote:
Originally Posted by Madpoo View Post
Depends on what exactly you're after.

There are a couple of undocumented XML things available.
  1. Exponent reports available in XML format. e.g. http://www.mersenne.org/report_expon...xp_lo=37397431
(you can also set exp_hi=xx on the exponent report to return a range)
Could i get somewhere a full data (for all exponents from 2 to 999999937 that supported by PrimeNet) in such XML format (or in another format)?

For sure i can create many requests to get all current data for each exponent. But i think it would be nice to just download it.
Lorenzo is offline   Reply With Quote
Reply



All times are UTC. The time now is 01:25.


Sat Jul 17 01:25:07 UTC 2021 up 49 days, 23:12, 1 user, load averages: 1.71, 1.24, 1.23

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.