Automatic Submission Spider for Workers...

[James Heinrich]

Originally Posted by Dubslow

So... the reason I did my append hack was so that I could submit results to Mersenne-aries after PrimeNet, but it just now occurred to me, why not automate that too?

I actually came to this thread to see if there was any interest in that.

The results parser was currently hardcoded to use POST specifically, but it would be trivial to let it accept GET results as well (subject, of course, to the 4kB GET limit). In fact, I have done so.

Please let me know if there's anything you'd like me to do on my side to make automated submission easier.

[Dubslow]

Originally Posted by James Heinrich

I actually came to this thread to see if there was any interest in that.

The results parser was currently hardcoded to use POST specifically, but it would be trivial to let it accept GET results as well (subject, of course, to the 4kB GET limit). In fact, I have done so.

Please let me know if there's anything you'd like me to do on my side to make automated submission easier.

In Python, POST is actually just as easy as GET, in fact doing GET is more or less just hacking the POST data onto the url. Uploading a file via POST is what's harder

As for easiness, perhaps a list of all the html that can be produced when a result is uploaded? Or perhaps even a super-simplified page to be loaded with a specific User-Agent. That would be fun and easy

[James Heinrich]

Originally Posted by Dubslow

Or perhaps even a super-simplified page to be loaded with a specific User-Agent. That would be fun and easy

Easy for who?

But yes, that is exactly what I was thinking of. I can make a simplified text-only submission page, I just need to know what data is useful to you. Since it would be for automated submissions, I guess all you really care about is success / failure, either globally or specific lines.

Please provide me a sample of what you'd like to see as the output of the page after you POST some data to it (including success and failure, possibly including things like number of lines processed, result types, factor count, GHz-days, unrecognized lines). Include whatever processing-complete check you'd like to see at the end of the output.

[Dubslow]

I think I'll wait for chalsall to answer, 'cause I don't really feel like porting his thingy to Python. But, we're fooding; if he hasn't replied by half an hour from now, I'll elaborate.

[chalsall]

Originally Posted by Dubslow

I think I'll wait for chalsall to answer, 'cause I don't really feel like porting his thingy to Python. But, we're fooding; if he hasn't replied by half an hour from now, I'll elaborate.

Probably the easiest thing to do is plan for a single submission per request (does that make sense?), and simply return a success/failure code.

And in Perl doing POSTs is almost as easy as GETs. But since the Spider already deals with just GETs for PrimeNet, why don't we stick with that for now?

Edit: I must make an observation (one of my favorites): "Like a poem, software is never finished; only abandoned..."

[kracker]

Reading though several forum posts it seems setting this up in Windows is hard.... Actually though it is very easy, if you know what to do.

[chalsall]

Originally Posted by kracker

Reading though several forum posts it seems setting this up in Windows is hard.... Actually though it is very easy, if you know what to do.

Care to write it up? It would be nice having some guiding language on the site. (And I don't do Windows.)

[James Heinrich]

Originally Posted by chalsall

Care to write it up? (And I don't do Windows.)

Please, I would also appreciate it. I'm sure I could figure it out, I've just never bothered. If it was written in PHP I would've been running it long ago, but I've never looked into how to run Perl on Windows. A brief guide would be helpful to the lazy.

[kracker]

Originally Posted by James Heinrich

Please, I would also appreciate it. I'm sure I could figure it out, I've just never bothered. If it was written in PHP I would've been running it long ago, but I've never looked into how to run Perl on Windows. A brief guide would be helpful to the lazy.

Sure, I'll be happy to... in a few hours (maybe) :( Kinda on the run now, can't do it now.

(My possible useless post.)

[LaurV]

Originally Posted by James Heinrich

Please, I would also appreciate it. I'm sure I could figure it out, I've just never bothered. If it was written in PHP I would've been running it long ago, but I've never looked into how to run Perl on Windows. A brief guide would be helpful to the lazy.

[offtopic]running perl on windoze is easy, dld srawberry or active perl from their momma sites, put it somewhere in your comp, add a path to it. Try it with yoyo's script or with pari's help. If it runs with them, it runs with anything.
[/offtopic]

[kracker]

Originally Posted by LaurV

[offtopic]running perl on windoze is easy, dld srawberry or active perl from their momma sites, put it somewhere in your comp, add a path to it. Try it with yoyo's script or with pari's help. If it runs with them, it runs with anything.
[/offtopic]

You're right, I use strawberry perl, just install, reboot, edit the submission script to your needs, and run :P (it sets associations, if you use it that way.)