![]() |
XML api?
How does one access the XML api?
|
[QUOTE=Dubslow;422527]How does one access the XML api?[/QUOTE]
Depends on what exactly you're after. There are a couple of undocumented XML things available. [LIST=1][*]Daily (and annual) dumps of all results from clients. e.g. [url]http://www.mersenne.org/result_archive/2016/2016-01-14.xml.bz2[/url][*]Exponent reports available in XML format. e.g. [url]http://www.mersenne.org/report_exponent/default.xml.php?exp_lo=37397431[/url][/LIST](you can also set exp_hi=xx on the exponent report to return a range) I'm still considering the exponent report as experimental even though I'm pretty sure it works okay. That's why there aren't any links from the site itself to those pages yet, or a button to toggle that kind of output when submitting, etc. Eventually I'd like to re-write that entire exponent report page (the HTML version) and have it use the same XML data. Right now the XML generates super fast but the HTML version of the data comes from an old and not-very-optimized query using large sets of data pumped into a PHP array... it can be pretty slow. For fast data collection I recommend the XML. And then the daily XML of result logs are for those folks who would normally spider the "recent results" page every hour hoping to get it all. Now they can get it in one archive and not worry about missing something. |
What is the url for the annual version of the results xml? I'd be interested in that :)
|
[QUOTE=Mark Rose;422621]What is the url for the annual version of the results xml? I'd be interested in that :)[/QUOTE]
e.g. [url]http://www.mersenne.org/result_archive/2015.7z[/url] (available for years going back to 1997) Each annual 7z file contains all of the separate bz2 archives for each day. Some of the years are pretty big... 2010 is 165MB for instance. |
[QUOTE=Madpoo;422636]e.g. [url]http://www.mersenne.org/result_archive/2015.7z[/url]
(available for years going back to 1997) Each annual 7z file contains all of the separate bz2 archives for each day. Some of the years are pretty big... 2010 is 165MB for instance.[/QUOTE] And gets even bigger (by a lot) when you decompress it :P |
[QUOTE=Madpoo;422636]e.g. [url]http://www.mersenne.org/result_archive/2015.7z[/url]
(available for years going back to 1997) Each annual 7z file contains all of the separate bz2 archives for each day. Some of the years are pretty big... 2010 is 165MB for instance.[/QUOTE] Thanks :) |
Is this a manual or automated process? I notice that [url]http://www.mersenne.org/result_archive/2016.7z[/url] is not yet available. When can we expect it? Also thanks for making this data available, much appreciated.
|
[QUOTE=tmorrow;450748]Is this a manual or automated process? I notice that [url]http://www.mersenne.org/result_archive/2016.7z[/url] is not yet available. When can we expect it? Also thanks for making this data available, much appreciated.[/QUOTE]
Ah, good reminder...I should do that. Give it a try in an hour and it should be there (I'll get it compressing now, so just to be safe try after maybe 05:00 UTC on Jan 11) EDIT: It's done now. I thought it'd take longer but it just stores the individual bz2 files. Lickety split. |
Many thanks, downloaded and unpacked with no problems.
|
[QUOTE=Madpoo;422619]Depends on what exactly you're after.
There are a couple of undocumented XML things available. [/QUOTE] As a programmer I abhor the hazards of data or definition duplication. Just curious for purposes of derivative data sanity, what is the operational regime upon a deemed instance of faked submission of results that have already been accrued to such summaries? Are the summaries regenerated? There have been instances of abuse in the past, and there may be further such instances requiring data wind back going forward. A similar question might be asked in respect of mersenne.ca data holdings. |
[QUOTE=Madpoo;422619]Depends on what exactly you're after.
There are a couple of undocumented XML things available. [LIST=1][*]Exponent reports available in XML format. e.g. [url]http://www.mersenne.org/report_exponent/default.xml.php?exp_lo=37397431[/url][/LIST](you can also set exp_hi=xx on the exponent report to return a range) [/QUOTE] Could i get somewhere a full data (for all exponents from 2 to 999999937 that supported by PrimeNet) in such XML format (or in another format)? For sure i can create many requests to get all current data for each exponent. But i think it would be nice to just download it. :smile: |
| All times are UTC. The time now is 04:56. |
Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.