Manual stats import discussion

[henryzz]

Originally Posted by mdettweiler

Whoops--I had forgotten to change that. It's fixed now.

look at the first paragraph as well

[mdettweiler]

Originally Posted by henryzz

look at the first paragraph as well

Ah, good catch! Fixed.

[mdettweiler]

Originally Posted by Mini-Geek

If a lot of the work is finding which ranges were done by who, wouldn't sending him results directly (in whatever size chunks it be, unless extremely small) be a lot easier than you giving him an unsorted 20K chunk, because he knows it's all manual and by the one that just sent it to him?

I could probably help Max out with some of the manual results processing if the process and scripts aren't too complicated and there'd be no problems with a non-admin doing something like that. Just send me a 20K chunk along with any applicable scripts and/or instructions and I'll take a shot at it.

Originally Posted by gd_barnes

The 20K chunks are sorted by n-value and separated by drive. That's how I store them on my machines. You can imagine how much data I have already. Keeping it in separate n=1K or 2K chunks for manually processed ranges was just too cumbersome to try to match everything up with the original sieve files and verify the primes at various places.

...

Check with Max and see if he would like some help. If he has the automated "pulling out of manual ranges" process set up already, I suspect that it will be easier for one person to do it then to coordinate and train another person on helping out but I couldn't say for sure.

Actually, believe it or not, the process of sorting out the ranges from the big files is not quite as automated as you guys were thinking. I'm actually just loading the files up in a text editor and using copy/paste to put individual reservations into their own files, then running them through a Perl script that takes all of the info not contained in the results file (username and date/time) on the command line, and outputs them in normal LLRnet format. I'll then be sending the LLRnet-formatted results files to Dave for importing.

So, given that, I probably could benefit from a bit of help on these. Mini-Geek, I'll send more details in response to your PM; maybe you could take the 2nd Drive (since I'm splitting up the job by drives; currently I'm working on the 3rd Drive).

Max

[IronBits]

Can the manual configurations be modified to output true llrnet server output?

Could you all look out for all references to nplb.ironbits.net and change them to noprimeleftbehind.net in directions on how to setup clients and the Server Address/Port sections?

[kar_bon]

Originally Posted by IronBits

Can the manual configurations be modified to output true llrnet server output?

what do you mean?

the output from LLR V3.7.1.c?

if so, perhaps J.Penné can do that!

[mdettweiler]

Originally Posted by IronBits

Can the manual configurations be modified to output true llrnet server output?

Could you all look out for all references to nplb.ironbits.net and change them to noprimeleftbehind.net in directions on how to setup clients and the Server Address/Port sections?

Hmm...interesting idea. However, as Karsten said, it would require some modification of the manual LLRnet client that might be more trouble than it's worth. Maybe it would be simpler to instead just develop an online submission form that plops the results directly in the DB? Manual LLR results are essentially the same as LLRnet ones, just without the lines for username and date/time. It wouldn't be hard for a CGI script to fill that info in for a manual file submitted through an HTML form. A box for the user to enter their username, and grabbing the current date/time as of the submission, should do the trick.

[gd_barnes]

Originally Posted by kar_bon

what do you mean?

the output from LLR V3.7.1.c?

if so, perhaps J.Penné can do that!

David is referring to the conversion from manual to LLRnet results. Max is taking care of that and is setting up scripts for it. He'll probably just plug the date and time with something estimated and will get the UserID from whomever reserved the ranges in the various drives.

Max, before sending the converted manual results to the David's, could you forward some of them to Karsten or me for review? We definitely don't want to have any problems with it.


Gary

[kar_bon]

i will ask Jean, if he can implement such thing for LLR:

- like a switch/ini-entry and LLR will output 2 extra lines with the user-name (defined in the ini) and the date/timestamp of the current result!

[henryzz]

Originally Posted by kar_bon

i will ask Jean, if he can implement such thing for LLR:

- like a switch/ini-entry and LLR will output 2 extra lines with the user-name (defined in the ini) and the date/timestamp of the current result!

we might be able to do it ourselves
the source is available

[Brucifer]

So where are we at in this endeavor? Are the manual stats going to be imported into the same system as the online stats? I sure hope that is the intent.

[AMDave]

That is the current intent.
It requires a number of changes to be made to the stats platform.
The requirements are staring to 'gel'.
Development and testing will be spread out over a few weeks due to time resource, but it is definitely off the drawing board and onto the workbench