mersenneforum.org  

Go Back   mersenneforum.org > Prime Search Projects > No Prime Left Behind > Raiders of the Lost Primes

Reply
 
Thread Tools
Old 2010-02-22, 06:54   #34
kar_bon
 
kar_bon's Avatar
 
Mar 2006
Germany

2,801 Posts
Default

you can delete the "do_tosend.awk" in your distribution!
kar_bon is offline   Reply With Quote
Old 2010-02-22, 07:22   #35
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

3·11·307 Posts
Default

Outstanding and fast work Max! I can feel it. The end of our long, tortured wait is nearing an end for a server that will run a more up-to-date version of LLR.

I'm beat tonight and am going to bed shortly but my Monday afternoon will be dedicated to attempting to break it in every way possible. I'll also fiddle around by loading different size tests in the server. I may even set up a 2nd test server to make it easier to go back and forth between the 2. I'll probably load some super small n=5K or 10K tests in there and run a gob of cores on it just to see what happens. :-)


Gary
gd_barnes is offline   Reply With Quote
Old 2010-02-22, 07:31   #36
MyDogBuster
 
MyDogBuster's Avatar
 
May 2008
Wilmington, DE

22×709 Posts
Default

Quote:
Ian, can you please post here some more details.
I ran some CRUS stuff thru a test. 4 cores - range was from n=2.5K to n=10K about 9500 tests in all. I had 2 cores doing 5 tests each in a cache and the other 2 cores doing 100 tests each in a cache. I stopped them many times and restarted them with no problems. I even made sure I had 2 cores looking for work at the same time. I even tested all 4 error messages at the end of the script and each message showed up when it should have and the tests restarted where they should have. Found 3 primes and ran them against PFGW to verify.

I also ran about 1500 tests against the NPLB setup that came with the download. There I had a cache of 100 tests. Even found a prime on that one.

At the present time I don't have any cores available to test anymore. I'm trying to cleanup my CRUS stuff so that I can go back to NPLB and the upcoming k>300<400 drive. Time to go prime hunting again.
MyDogBuster is offline   Reply With Quote
Old 2010-02-22, 08:12   #37
kar_bon
 
kar_bon's Avatar
 
Mar 2006
Germany

53618 Posts
Default

@Ian:
thanks for the information and an amazing wide range of testing. thanks.

@Max;
i had a closer look to you WIN-perl script.
if i understand perl correct, the function checkForPrimes will write found primes in the dedicated file when $individualPrimeLog = true. but you test to if($line != "") so if i'm right every time (workfile.res exists when cllr is done but if no prime is found, contains only the header line!) the header will be backuped, too!
i've not tested it running yet, but will do today.
nice quick work!
kar_bon is offline   Reply With Quote
Old 2010-02-22, 15:21   #38
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3×2,083 Posts
Default

Quote:
Originally Posted by kar_bon View Post
@Max;
i had a closer look to you WIN-perl script.
if i understand perl correct, the function checkForPrimes will write found primes in the dedicated file when $individualPrimeLog = true. but you test to if($line != "") so if i'm right every time (workfile.res exists when cllr is done but if no prime is found, contains only the header line!) the header will be backuped, too!
i've not tested it running yet, but will do today.
nice quick work!
That's what this is for a few lines earlier:
Code:
  # Open workfile.res and throw out the first line (the NewPGen header) - we don't need it
  open(RES, "workfile.res");
  $foo = <RES>;
It reads the first line of workfile.res to the variable $foo, which isn't used later.

Meanwhile, I just uncovered an actual bug: looking at the if($line != "") part (which is intended to copy off any line in workfile.res after the header that isn't blank), I see that it should be if($line ne "") instead (you use eq and ne instead of == and != for strings in Perl). It's been a little while since I last used Perl for anything big, as you might have noticed.

I'll have a fix online in a moment.

Edit: I've uploaded the fix, same places as before. Note that this prime-logging code is one area that I haven't been able to test, so be prepared for possible errors. If I can I'll do some additional testing of my own on it today.

Last fiddled with by mdettweiler on 2010-02-22 at 15:29
mdettweiler is offline   Reply With Quote
Old 2010-02-22, 18:01   #39
kar_bon
 
kar_bon's Avatar
 
Mar 2006
Germany

2,801 Posts
Default

so when will we start a major test?

say 10000 kn-pairs with one third at about n=5k,100k and 500k or something like this and many primes, too.
other testcase: at rieselprime, there's a file with all primes. what about a piece of that.
what about testing for twins: different header not tested yet with the script!

Last fiddled with by kar_bon on 2010-02-22 at 18:02
kar_bon is offline   Reply With Quote
Old 2010-02-22, 19:14   #40
mdettweiler
A Sunny Moo
 
mdettweiler's Avatar
 
Aug 2007
USA (GMT-5)

3×2,083 Posts
Default

Quote:
Originally Posted by kar_bon View Post
so when will we start a major test?

say 10000 kn-pairs with one third at about n=5k,100k and 500k or something like this and many primes, too.
other testcase: at rieselprime, there's a file with all primes. what about a piece of that.
what about testing for twins: different header not tested yet with the script!
Agreed, all of those would be good test cases. Gary, what do you say we try to do a big test later today with all of those worktypes? We could load them all in together (under the twin header, to test that).

We've already tested Karsten's batch script quite a bit, though it surely won't hurt to test it more. I'll test both it and my Perl script on my Windows box here.
mdettweiler is offline   Reply With Quote
Old 2010-02-22, 19:50   #41
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

3×11×307 Posts
Default

OK, guys, here's the timeframe:

It's 1:45 PM CST here now. I've had a good night's rest and am going to go eat some breakfast now. :-)

At about 2:15 PM I'll start copying the latest client to all of my Linux machines. I've got the equivalent of about 3 Linux quads on CRUS right now so I won't bother those for now. But that still leaves 8 Linux quads for this test. This process will take take about 30 mins.

So at ~2:45-3 PM, it will take me ~20-45 minutes to set up the servers with the proper test cases. I'll also create a 2nd test server for this, which will save quite a bit of time and allow specific situations to be tested more easily if there is a problem with one of them.

So the bottom line is that I'll start the cores up around 3:30 PM CST. That would be around 10:30 PM in Germany.

Nice work on the test cases Karsten. That's exactly what I like to see. I will be testing every one of those situations. I'll put something like 60-70 primes at the beginning of one of the tests so that each core is likely to get more than one prime. I want to see it write to the prime file with more than one prime per core all combined into one big primes file on a machine. That will be interesting. It's important that it works if primes come in from 2 different cores at the same time. I don't want to see it overlay itself if that happens and inadvertantly drop a prime.


Gary

Last fiddled with by gd_barnes on 2010-02-22 at 19:52
gd_barnes is offline   Reply With Quote
Old 2010-02-22, 20:28   #42
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

1013110 Posts
Default

Quote:
Originally Posted by mdettweiler View Post
Behold: the long-awaited Linux/Perl version of the script is ready! I've tested it somewhat heavily on a Windows machine, though I haven't yet tested it on Linux. I'm pretty sure it will work, though; there's not really any OS-specific code in there and it works great on Windows. Gary and Ian, feel free to stress test the heck out of it.

Here's download links for Windows and Linux versions. The only difference between the two is which OS the LLR and LLRnet binaries are compiled for; swap those out and you can quite easily turn one into the other. All necessary instructions are included in readme.txt.
Windows: http://www.noprimeleftbehind.net/dow...0.61-win32.zip
Linux: http://www.noprimeleftbehind.net/dow...61-linux32.zip

OK, I'm a little confused. Will we be using Karsten's or Max's script for the Window's client? Regardless, I'll only be testing the Linux client this afternoon.


Gary
gd_barnes is offline   Reply With Quote
Old 2010-02-22, 20:36   #43
kar_bon
 
kar_bon's Avatar
 
Mar 2006
Germany

280110 Posts
Default

i think there's one reason a prime would not be written in the general primes.txt:

if one client found a prime and writes it into that file it will be locked and a second client found a prime the same moment could not write the same file: perhaps an error like 'file not found' should occur.
i'm thinking of a later optimization about the primes.txt:
show the client in that file,too!
how to: the llr-clientconfig.txt contains an option 'serviceName' and i named them like "LLRnet-G 995x" with x the number of the core/client. so the primes.txt looks like:

[2010-02-18 00:25:38] LLRnet-G 9951 found 2001 58406

i'm with the test with my Vista Quad. hope all test are positive, so we can provide it to our standard users (not much by now, but if this works, perhaps there'll be more again).
kar_bon is offline   Reply With Quote
Old 2010-02-22, 20:39   #44
kar_bon
 
kar_bon's Avatar
 
Mar 2006
Germany

2,801 Posts
Default

Quote:
Originally Posted by gd_barnes View Post
OK, I'm a little confused. Will we be using Karsten's or Max's script for the Window's client? Regardless, I'll only be testing the Linux client this afternoon.
i think, we should test all 3 versions! i'm with the normal DOS-script.
the reason i used this: perl has to be downloaded and installed first, an the customizing could call others errors a non-expert user could not handle!
so the normal DOS-version is ready to go on WIN-platforms without any external programs!

Last fiddled with by kar_bon on 2010-02-22 at 20:41
kar_bon is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Anti-poverty drug testing vs "high" tax deduction testing kladner Soap Box 3 2016-10-14 18:43
What am I testing? GARYP166 Information & Answers 9 2009-02-18 22:41
k=243 testing ?? gd_barnes Riesel Prime Search 20 2007-11-08 21:13
Testing grobie Marin's Mersenne-aries 1 2006-05-15 12:26
Speed of P-1 testing vs. Trial Factoring testing eepiccolo Math 6 2006-03-28 20:53

All times are UTC. The time now is 11:03.

Sat Jun 6 11:03:47 UTC 2020 up 73 days, 8:36, 0 users, load averages: 2.06, 1.95, 1.83

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.