mersenneforum.org  

Go Back   mersenneforum.org > Prime Search Projects > No Prime Left Behind

Reply
 
Thread Tools
Old 2009-02-11, 09:11   #199
IronBits
I ♥ BOINC!
 
IronBits's Avatar
 
Oct 2002
Glendale, AZ. (USA)

111310 Posts
Default

The stats server won't be able to run updates every hour like it does now without the copy-off/converter going every hour...

If we had the conversion script here, we could take the raw file, convert and import in one shot, every hour.

I know I asked for the log file format a few weeks ago and still waiting so we could do the conversion/import/hourly and be ahead of the game, but, looks like we are behind the 8 ball now.

Edit: saw Kar_bon's input, sounds like a much better solution to me - business as usual with the hourly copy-offs

Last fiddled with by IronBits on 2009-02-11 at 09:12
IronBits is offline   Reply With Quote
Old 2009-02-11, 14:52   #200
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3×2,083 Posts
Default

Quote:
Originally Posted by kar_bon View Post
Max, your conversion is quite good but to much complicated for the purpose!

think about this:

because Rogue(Mark) wrote the PRPnet-client/server, i think he's able to include an option like

-L make LLRnet-server ouput-format (3 lines per k/n-pair)

so you won't need any script or new ghost-LLRnet-server to convert them.
with those there would be more chances of fails like ghost-server crashes or script won't started correctly!

my opinion to the use of a new program!
Hmm, I wasn't aware of that option. Was it introduced in the latest version or something?

Anyway, this is perfect. I'll look into using that option and see about getting the server set up sometime later today.

However, the -L option only would help for the results files part of the task. PRPnet still doesn't produce an LLR-like knpairs.txt file listing only the k/n pairs remaining in the server; instead, its prpserver.candidates file simply marks each number as "completed" when it's done, and leaves it in the file. So, thus it would be a lot harder to write a script to get the same information from a prpserver.candidates file natively that we usually get from knpairs.txt for the status reports.

That's the main reason why I was thinking of using the "helper server" setup--because that would allow us to pull our status data from knpairs.txt as always. I admit it is a little on the clunky side, but the only other option I can think of would be to completely re-write my status page script for PRPnet, which would be very, very difficult due to the type of format it uses.

Oh, wait--I just remembered something! Last I heard Rogue was working on a built-in status page generator for the PRPnet server (sort of like what ECMnet does, since PRPnet is based on ECMnet). A while back I sent him some test data from the CRUS G3000 server so he could test that function; I don't know if he's managed to finish it yet. I'll go and ask over in the PRPnet thread at CRUS.

I don't know why I didn't think of that before--that would solve all of our status page problems completely! That, combined with the -L option for generating LLRnet-style results files, should mean that we don't have any need for any converter scripts or helper servers whatsoever.

Max
mdettweiler is offline   Reply With Quote
Old 2009-02-11, 15:22   #201
Mini-Geek
Account Deleted
 
Mini-Geek's Avatar
 
"Tim Sorbera"
Aug 2006
San Antonio, TX USA

10000101010112 Posts
Default

Quote:
Originally Posted by mdettweiler View Post
Hmm, I wasn't aware of that option. Was it introduced in the latest version or something?

Anyway, this is perfect. I'll look into using that option and see about getting the server set up sometime later today.
Quote:
Originally Posted by kar_bon View Post
because Rogue(Mark) wrote the PRPnet-client/server, i think he's able to include an option like

-L make LLRnet-server ouput-format (3 lines per k/n-pair)
i.e. it's not included yet. Karsten's just commenting on that Rogue could include it.
Mini-Geek is offline   Reply With Quote
Old 2009-02-11, 15:25   #202
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3·2,083 Posts
Default

Quote:
Originally Posted by Mini-Geek View Post
i.e. it's not included yet. Karsten's just commenting on that Rogue could include it.
Oh, duh! *bangs head* Whoops, my bad--I was skimming people's posts again.

No problem--the conversion script, in fact, is the least problematic of all these systems. All it has to do is just feed in the input and output files on the command line, and every time I've tested it it's run perfectly. It wouldn't be hard to set it up in the copy-off script.

The biggest issue is trying to get a status page generated. However, as I mentioned earlier, I think Rogue is currently working on a built-in solution for that, so that is probably just the easiest way to go.
mdettweiler is offline   Reply With Quote
Old 2009-02-11, 15:43   #203
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

101·103 Posts
Default

Let's hold off on the PRPnet server for now until there is more time for a detailed technical analysis.

Go ahead and load the 6 k's for n=600K-700K into LLRnet port G8000. In the mean time, you can take your time coordinating with people on the PRPnet server and getting it set up the way we want. When the drive has completed to n=700K, then we can load n>700K into a PRPnet server assuming that it is ready at that point.


Gary
gd_barnes is offline   Reply With Quote
Old 2009-02-11, 16:00   #204
IronBits
I ♥ BOINC!
 
IronBits's Avatar
 
Oct 2002
Glendale, AZ. (USA)

3×7×53 Posts
Default

Whew!
IronBits is offline   Reply With Quote
Old 2009-02-11, 16:59   #205
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

101·103 Posts
Default

k=325 is now back open for reservations for the enitre n-range.
gd_barnes is offline   Reply With Quote
Old 2009-02-11, 21:37   #206
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3·2,083 Posts
Default

Quote:
Originally Posted by gd_barnes View Post
Let's hold off on the PRPnet server for now until there is more time for a detailed technical analysis.

Go ahead and load the 6 k's for n=600K-700K into LLRnet port G8000. In the mean time, you can take your time coordinating with people on the PRPnet server and getting it set up the way we want. When the drive has completed to n=700K, then we can load n>700K into a PRPnet server assuming that it is ready at that point.


Gary
Okay, that sounds good. I agree, holding off on the PRPnet server would be best for now--at least until Rogue releases a new version of PRPnet that includes the status-page code.

Running this mini-drive on G8000 should work fine since I've already got all the status page linkups in place. I'll get the server loaded with 600K-700K later today.
mdettweiler is offline   Reply With Quote
Old 2009-02-12, 05:19   #207
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3·2,083 Posts
Default

Hi all,

I am pleased to announce that LLRnet server G8000 is now loaded up and ready for action. (Just to reiterate exactly what it's loaded with: it's got the range of n=600K-700K for the 6-k k=300-400 drive.) This is now reflected on the http://nplb-gb1.no-ip.org/llrnet/ status page, and it should show up at http://stats.ironbits.net as soon as results are submitted.

I'll get it added to the LLRnet servers thread shortly.

Max

P.S.: Oops, I just noticed that the http://nplb-gb1.no-ip.org/llrnet/ page still shows port 8000 as "for future use" instead of as "NPLB k=300-400 mini-drive". Oh well--that's only a cosmetic blooper, I'll fix it tomorrow.
mdettweiler is offline   Reply With Quote
Old 2009-02-12, 07:40   #208
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

101×103 Posts
Default

Quote:
Originally Posted by mdettweiler View Post
Hi all,

I am pleased to announce that LLRnet server G8000 is now loaded up and ready for action. (Just to reiterate exactly what it's loaded with: it's got the range of n=600K-700K for the 6-k k=300-400 drive.) This is now reflected on the http://nplb-gb1.no-ip.org/llrnet/ status page, and it should show up at http://stats.ironbits.net as soon as results are submitted.

I'll get it added to the LLRnet servers thread shortly.

Max

P.S.: Oops, I just noticed that the http://nplb-gb1.no-ip.org/llrnet/ page still shows port 8000 as "for future use" instead of as "NPLB k=300-400 mini-drive". Oh well--that's only a cosmetic blooper, I'll fix it tomorrow.

Cool! Just to clarify, we will be searching k=315, 321, 327, 333, 339, & 345 from n=600K-950K with the mini-drive. I'll pull a couple of cores off of port 4000 to put on it to get us going while I'm on my trip.

Max, there is a dead link on the status page. It is the one for "Today's results processing log" at the bottom of the page. The link is http://nplb-gb1.no-ip.org/llrnet/tod...essing_log.txt Can you fix that at the same time you fix the heading for port 8000? Thanks.


Gary

Last fiddled with by gd_barnes on 2009-02-12 at 07:41
gd_barnes is offline   Reply With Quote
Old 2009-02-12, 15:11   #209
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3×2,083 Posts
Default

Quote:
Originally Posted by gd_barnes View Post
Max, there is a dead link on the status page. It is the one for "Today's results processing log" at the bottom of the page. The link is http://nplb-gb1.no-ip.org/llrnet/tod...essing_log.txt Can you fix that at the same time you fix the heading for port 8000? Thanks.
Okay. I think I'll just remove the link--it was meant originally to link to a logfile similar to the one for David's servers, but my scripts work somewhat differently and thus simply can't produce the same information to put down in a log file nearly as easily (for example, they screen for primes during the 15-minute status page updates, not at the end-of-day results file copy-off). And besides, even David's servers don't have a log like that posted anymore.
mdettweiler is offline   Reply With Quote
Reply



Similar Threads
Thread Thread Starter Forum Replies Last Post
Individual-k reservations k=300-400 n=1M-3M gd_barnes No Prime Left Behind 273 2021-01-26 12:08
Individual overall statistics graphs Chuck GPU to 72 4 2012-08-20 23:58
Distinquishing Team from Individual accounts strates Teams 5 2006-12-17 20:50
What is the largest individual effort currently under way? Gary Edstrom Lounge 10 2004-04-20 19:55
Individual Account Report queries shu_the_genius PrimeNet 5 2003-12-19 18:00

All times are UTC. The time now is 09:22.


Tue Jul 27 09:22:23 UTC 2021 up 4 days, 3:51, 0 users, load averages: 2.30, 2.02, 1.79

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.