mersenneforum.org

mersenneforum.org (https://www.mersenneforum.org/index.php)
-   GPU to 72 (https://www.mersenneforum.org/forumdisplay.php?f=95)
-   -   Automatic Submission Spider for Workers... (https://www.mersenneforum.org/showthread.php?t=16334)

James Heinrich 2012-05-07 16:09

[QUOTE=Dubslow;298050]So... the reason I did my append hack was so that I could submit results to Mersenne-aries after PrimeNet, but it just now occurred to me, why not automate that too?[/QUOTE]I actually came to this thread to see if there was any interest in that.

The results parser was currently hardcoded to use POST specifically, but it would be trivial to let it accept GET results as well (subject, of course, to the 4kB GET limit). In fact, I have done so.

Please let me know if there's anything you'd like me to do on my side to make automated submission easier.

Dubslow 2012-05-07 16:20

[QUOTE=James Heinrich;298685]I actually came to this thread to see if there was any interest in that.

The results parser was currently hardcoded to use POST specifically, but it would be trivial to let it accept GET results as well (subject, of course, to the 4kB GET limit). In fact, I have done so.

Please let me know if there's anything you'd like me to do on my side to make automated submission easier.[/QUOTE]

In Python, POST is actually just as easy as GET, in fact doing GET is more or less just hacking the POST data onto the url. Uploading a file via POST is what's harder :razz:

As for easiness, perhaps a list of all the html that can be produced when a result is uploaded? Or perhaps even a super-simplified page to be loaded with a specific User-Agent. That would be fun and easy :smile:

James Heinrich 2012-05-07 17:03

[QUOTE=Dubslow;298690]Or perhaps even a super-simplified page to be loaded with a specific User-Agent. That would be fun and easy :smile:[/QUOTE]Easy for who? :unsure:

But yes, that is exactly what I was thinking of. I can make a simplified text-only submission page, I just need to know what data is useful to you. Since it would be for automated submissions, I guess all you really care about is success / failure, either globally or specific lines.

Please provide me a sample of what you'd like to see as the output of the page after you POST some data to it (including success and failure, possibly including things like number of lines processed, result types, factor count, GHz-days, unrecognized lines). Include whatever processing-complete check you'd like to see at the end of the output.

Dubslow 2012-05-07 17:06

I think I'll wait for chalsall to answer, 'cause I don't really feel like porting his thingy to Python. But, we're fooding; if he hasn't replied by half an hour from now, I'll elaborate.

chalsall 2012-05-07 17:12

[QUOTE=Dubslow;298696]I think I'll wait for chalsall to answer, 'cause I don't really feel like porting his thingy to Python. But, we're fooding; if he hasn't replied by half an hour from now, I'll elaborate.[/QUOTE]

Probably the easiest thing to do is plan for a single submission per request (does that make sense?), and simply return a success/failure code.

And in Perl doing POSTs is almost as easy as GETs. But since the Spider already deals with just GETs for PrimeNet, why don't we stick with that for now?

Edit: I must make an observation (one of my favorites): "Like a poem, software is never finished; only abandoned..."

kracker 2012-06-16 19:40

Reading though several forum posts it seems setting this up in Windows is hard.... Actually though it is very easy, if you know what to do.:banana:

chalsall 2012-06-16 21:05

[QUOTE=kracker;302467]Reading though several forum posts it seems setting this up in Windows is hard.... Actually though it is very easy, if you know what to do.:banana:[/QUOTE]

Care to write it up? It would be nice having some guiding language on the site. (And I don't do Windows.)

James Heinrich 2012-06-16 21:42

[QUOTE=chalsall;302471]Care to write it up? (And I don't do Windows.)[/QUOTE]Please, I would also appreciate it. I'm sure I could figure it out, I've just never bothered. If it was written in PHP I would've been running it long ago, but I've never looked into how to run Perl on Windows. A brief guide would be helpful to the lazy. :smile:

kracker 2012-06-16 23:12

[QUOTE=James Heinrich;302473]Please, I would also appreciate it. I'm sure I could figure it out, I've just never bothered. If it was written in PHP I would've been running it long ago, but I've never looked into how to run Perl on Windows. A brief guide would be helpful to the lazy. :smile:[/QUOTE]

Sure, I'll be happy to... in a few hours (maybe) :( Kinda on the run now, can't do it now.

[SIZE=1](My possible useless post.)[/SIZE]

LaurV 2012-06-17 02:09

[QUOTE=James Heinrich;302473]Please, I would also appreciate it. I'm sure I could figure it out, I've just never bothered. If it was written in PHP I would've been running it long ago, but I've never looked into how to run Perl on Windows. A brief guide would be helpful to the lazy. :smile:[/QUOTE]
[offtopic]running perl on windoze is easy, dld srawberry or active perl from their momma sites, put it somewhere in your comp, add a path to it. Try it with yoyo's script or with pari's help. If it runs with them, it runs with anything.
[/offtopic]

kracker 2012-06-17 02:53

[QUOTE=LaurV;302481][offtopic]running perl on windoze is easy, dld srawberry or active perl from their momma sites, put it somewhere in your comp, add a path to it. Try it with yoyo's script or with pari's help. If it runs with them, it runs with anything.
[/offtopic][/QUOTE]

You're right, I use strawberry perl, just install, reboot, edit the submission script to your needs, and run :P (it sets associations, if you use it that way.)


All times are UTC. The time now is 10:22.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.