mersenneforum.org

mersenneforum.org (https://www.mersenneforum.org/index.php)
-   No Prime Left Behind (https://www.mersenneforum.org/forumdisplay.php?f=82)
-   -   Report top-5000 primes for all k<=1001 (https://www.mersenneforum.org/showthread.php?t=9891)

vaughan 2009-05-06 21:28

Added 88113 : 675*2^653795-1 (196815 digits)

IronBits 2009-05-07 01:54

Added 88120 : 423*2^673728-1 (202815 digits)

gd_barnes 2009-05-07 02:38

755*2^653850-1 is prime

IronBits 2009-05-07 03:58

Added 88125 : 503*2^674214-1 (202962 digits)

vaughan 2009-05-08 11:14

Added 88140 : 745*2^657911-1 (198054 digits)

gd_barnes 2009-05-09 00:32

727*2^658245-1 is prime

MyDogBuster 2009-05-09 07:25

965*2^679780-1 is prime

vaughan 2009-05-10 01:03

Added 88159 : 713*2^660750-1 (198909 digits)

gd_barnes 2009-05-10 04:04

After about 20,000 tests on my 6 k's finally:

357*2^672930-1 is prime

vaughan 2009-05-10 21:55

Added 88184 : 605*2^663508-1 (199739 digits)
Added 88185 : 783*2^663015-1 (199591 digits)

IronBits 2009-05-11 05:39

Added 88193 : 515*2^680196-1 (204763 digits)

MyDogBuster 2009-05-11 13:12

829*2^680777-1 is prime

gd_barnes 2009-05-13 21:17

683*2^670454-1 is prime

gd_barnes 2009-05-14 05:10

607*2^670861-1 is prime

IronBits 2009-05-15 01:03

Added 88284 : 563*2^683292-1 (205695 digits)

IronBits 2009-05-15 02:14

Added 88285 : 543*2^683355-1 (205714 digits)

gd_barnes 2009-05-15 04:14

A nice pair David. One for me too:

605*2^672972-1 is prime

vaughan 2009-05-15 09:30

Added 88290 : 513*2^683547-1 (205771 digits)

MyDogBuster 2009-05-15 21:57

909*2^683019-1 is prime

IronBits 2009-05-16 03:17

Added 88309 : 651*2^674785-1 (203134 digits)

gd_barnes 2009-05-16 18:50

709*2^675411-1 is prime

kar_bon 2009-05-16 22:20

from the 6 k's:

333*2^832611-1 is prime!

IronBits 2009-05-17 05:57

Added 88326 : 481*2^684665-1 (206108 digits)

IronBits 2009-05-17 14:04

Added 88329 : 625*2^677325-1 (203898 digits)

IronBits 2009-05-18 14:02

Added 88346 : 669*2^678357-1 (204209 digits)

gd_barnes 2009-05-19 01:38

649*2^679239-1 is prime

MyDogBuster 2009-05-19 11:52

935*2^684668-1 is prime

mdettweiler 2009-05-19 19:05

From the 6-k minidrive on G8000:

315*2^846610-1 is prime

gd_barnes 2009-05-19 19:56

Congrats to both Karsten and Max on nice BIG primes from the 6k drive in the last few days! :smile:

gd_barnes 2009-05-20 02:21

783*2^680388-1 is prime

MyDogBuster 2009-05-20 12:18

999*2^685156-1 is prime

MyDogBuster 2009-05-21 00:31

873*2^685480-1 is prime

IronBits 2009-05-21 00:51

Added 88412 : 555*2^686694-1 (206719 digits)

IronBits 2009-05-21 08:43

Added 88417 : 429*2^686860-1 (206769 digits)

IronBits 2009-05-21 15:31

Added 88427 : 717*2^682046-1 (205320 digits)

IronBits 2009-05-22 23:53

Added 88442 : 609*2^683212-1 (205671 digits)

IronBits 2009-05-24 01:12

Added 88449 : 663*2^684374-1 (206020 digits)

IronBits 2009-05-24 13:34

Added 88465 : 497*2^688852-1 (207368 digits)

gd_barnes 2009-05-25 19:16

635*2^685706-1 is prime

gd_barnes 2009-05-27 17:30

777*2^686718-1 is prime

kar_bon 2009-05-28 05:44

found on G8000
327*2^869829-1 is prime!

no notification and not listed there yet (more than an hour ago!)

PS:
it's the last (!) entry in the latest complete resultfile
[url]http://nplb-gb1.no-ip.org/llrnet/results/results_20090528_0001_GB_nplb_8000.txt[/url]

this prime is also not listed in the allover primes for this port here
[url]http://nplb-gb1.no-ip.org/llrnet/primes_8000.txt[/url]

where is the issue?

gd_barnes 2009-05-28 05:55

Nice prime!

I see that the prime was found at 00:00:21 my time; 54 minutes ago. We'll give it until after 1 AM to see if the notification gets sent out and that it gets listed in the primes log since those are done once/hour. If not, then there is a bug and I'll have Max look into it.


Gary

gd_barnes 2009-05-28 06:13

[quote=kar_bon;175039]found on G8000
327*2^869829-1 is prime!

no notification and not listed there yet (more than an hour ago!)

PS:
it's the last (!) entry in the latest complete resultfile
[URL]http://nplb-gb1.no-ip.org/llrnet/results/results_20090528_0001_GB_nplb_8000.txt[/URL]

this prime is also not listed in the allover primes for this port here
[URL]http://nplb-gb1.no-ip.org/llrnet/primes_8000.txt[/URL]

where is the issue?[/quote]


Max, this does indeed seem to be a problem.

Prime 327*2^869829-1 was found on May 28th at 00:00:21 CDT (my time) but showed up in the May 27th results file as the last result. Apparently this caused it to not show up in the primes.log file and no prime notification was sent. It is now May 28th at 01:12 CDT so I've given it an hour to correct itself due to the strange timing of things but it did not do so.

Can you look into and correct the problem?


Thanks,
Gary

kar_bon 2009-05-28 06:29

if it is a script problem, David should also check his ports, too!

mdettweiler 2009-05-28 14:06

Hmm, that is very odd. Theoretically, though, no matter what the timestamp on the file, the DB should still import all k/n pairs within it. It should contain the entire contents of that file, including the prime.

I think I know why it didn't show up in the primes file for port 8000; I'll fix that and add it manually. Meanwhile, Dave, do you have any idea why the DB didn't send out a notification for it? Since it doesn't show up in the DB's prime list, it would appear that it didn't even make it into the DB. I presume the DB *is* still importing both the end-of-day results files and the intermediate ones, correct?

mdettweiler 2009-05-28 14:23

Okay, I figured out what's going on with my scripts that didn't cause this prime to be written to the prime log file. The scripts themselves are not at fault; instead, it is the timing of when they're run. Here's essentially how they work:

-The copy-off script is rather simple: every time it's run, it takes all the results files and moves to the web results folder. This has the effect of "emptying" the active results file for the next day.

-The status page generator script copies (not move) the results files for each server to their respective intermediate files in the web folder. It then runs through those intermediate files to tabulate daily totals by user, and search for primes. If a prime is found, it adds it to the prime log file.

I have the copy-off script set to run at 00:01 every day (CDT). The status page script runs at :0, :15:, :30, and :45 of every hour.

Unfortunately, we have a bit of a dilemma. If the copy-off script is run *before* the last status page generator run of the day, then the status page generator ends up skipping an entire 15 minutes of results. Thus, a 15 minute window during which primes would make it into the daily results files, but not into the prime log file.

Hence, I have it set to run the copy-off script one minute after the last status page run of the day. But we still have a problem (albeit a smaller one): any results found within that one minute between the two scripts will be missed by the status page script and not make it into the prime log file. This was the case with Karsten's G8000 prime.

Obviously, a gap of 1 minute is a lot less crucial than a 15 minute one. Nonetheless, though, as Karsten's prime just demonstrated, we can't afford to miss even a minute.

Unfortunately, crontab (the otherwise extremely powerful program used in Linux to run programs on a schedule) only allows me to control things by minutes, not seconds. I would rather not have both scripts run at the exact same minute, since that can lead to crazy file locking problems that could potentially botch an entire day's results. Thus, it seems that a gap of 1 minute is rather unavoidable.

One possibility for fixing this would be to simply integrate the copy-off function into the status page script. I must admit, however, I am not sure of a good way to implement that, and besides, the status page script is such a cobbled-together mess that I'm somewhat afraid to touch it. :smile:

Max :smile:

kar_bon 2009-05-28 15:06

[QUOTE=mdettweiler;175085]
Hence, I have it set to run the copy-off script one minute after the last status page run of the day. But we still have a problem (albeit a smaller one): any results found within that one minute between the two scripts will be missed by the status page script and not make it into the prime log file. This was the case with Karsten's G8000 prime.
[/QUOTE]

i understand it right:

the script only misses primes found in that special minute, but the pair-results in that minute will not be missed?

what about copying/moving the results every hour to a file and with this new file, all scripts will be run? so there will be no new results during that one minute!

BTW: that prime is not shown either at [url]http://nplb-gb1.no-ip.org/llrnet/[/url] nor at [url]http://www.noprimeleftbehind.net/index.php?content=prime_list[/url] !

gd_barnes 2009-05-28 16:26

Having to add the prime to primes.log manually is somewhat OK as a short-term fix. Not having it go to the database is not OK.

Please come up with a creative solution for this, i.e. something like:

1. Copy off results file to temp file.
2. Write some special code to parse through the file looking for any prime in the last minute.
3. If prime in last minute, add more additional special code to add the prime to the primes.log file, the notification is sent, and that the database gets updated with the prime.

This was the situation that I have referred to in the past that we have to test on new servers as they relate to updating the database. That is testing over a change over in dates or months or years. I did enough coding during the Y2K crises and otherwise related to the timing of schedulers to know that these types of situations will bite you if you don't test them ahead of time.

I understand what you mean by file locking problems. That can happen when 2 users try to update the same record online in an online entry system. Is Crontab completely inflexible in that way? Here is the way we did it on our scheduler at work: The execution of one job would be dependent on the execution of a prior job.

Here is what could be the source of the problem -OR- it is another problem: You have the script set to run at a hard-coded time of 1 minute after the hour. If I did that at my insurance co., they would kick it back to me on a code review in short order.

If you have a job (i.e. process or program) that is dependent on another one to run, you have to set it to run after that job is complete; not at one minute after you THINK it will complete. At work, we used a Jobtrac scheduler and we set one job as a successor to another. In our case here, what if there is a power blip or a computer problem or something else that occurs as the results are being copied off? What if it just decides to take 2 minutes to finish due to a huge volume of results or for some other reason?

What you need is a job (or process or program-based) dependency not a time-based one. The copy-off process needs to run immediately after the status page script has completed its midnight run.

Therefore, it looks like you have 2 problems that need to be fixed: The immediate one and a potential one that would occur if the status page script takes more than a minute to run. I can't say if changing it to a program-based dependency would fix the current issue but it does need to be considered.

Programmers spend 95% of their time coding for 5% of situations. This is an excellent example.

This will be especially important to test on those very small very fast tests on the new PRPnet server. It will be easy to regularly find 2 or more primes during that last minute for tests at n=~20K if a lot of clients are running the server.

One thing more to check: Please check that the result got in the database.


Thank you,
Gary

mdettweiler 2009-05-28 17:32

It would be quite easy to run both scripts in immediate succession by putting them both on the same crontab entry. *However*--we have a problem. One script runs once a day, the other runs once every 15 minutes. If I string them both together as one command, one of them will be running at the wrong frequency.

Hmm....I just got an idea. :smile: Maybe I can make crontab run just the status page script at 15-minute intervals, *but*, at the end of each day, *both* scripts would be run concurrently. That it, at 00:01, the status page is updated to reflect any changes in the last minute, and then the copy-off is performed immediately after. Yes, that will work, I'm sure of it. :smile:

Don't mind me, just thinking out loud. :wink:

As to the result being in the DB, though: I have no idea why it didn't make it in. The DB *should* be importing all results files, both intermediate and daily, so nothing should be missed. We'll have to wait for Dave to answer on that one.

BTW: email notifications are handled on the DB end, so that has nothing to do with my scripts. In this case, the problem appears to be because the results never got into the DB, for reasons unknown.

Max :smile:

Edit: Okay, I've put that modification in place. That should close the 1-minute gap in prime checking.
Edit2: Karsten's prime has also been retroactively added to the prime log file.

MyDogBuster 2009-05-28 19:04

When I was programming I ran into similar problems with end of file records. Some languages treat the last physical record (with data) as the end of file. Others treat the first $null record as the end of file. I know that the former would cause a problem with a do while loop because a do while won't execute if the while is already true. I have run into that situation with some of the scripts I've coded for my own use here. I always got around it by putting the read of the file as the first statement AFTER the do while statement so that the do while would always execute for the last record.

gd_barnes 2009-05-28 21:46

[quote=mdettweiler;175117]It would be quite easy to run both scripts in immediate succession by putting them both on the same crontab entry. *However*--we have a problem. One script runs once a day, the other runs once every 15 minutes. If I string them both together as one command, one of them will be running at the wrong frequency.

Hmm....I just got an idea. :smile: Maybe I can make crontab run just the status page script at 15-minute intervals, *but*, at the end of each day, *both* scripts would be run concurrently. That it, at 00:01, the status page is updated to reflect any changes in the last minute, and then the copy-off is performed immediately after. Yes, that will work, I'm sure of it. :smile:

Don't mind me, just thinking out loud. :wink:

As to the result being in the DB, though: I have no idea why it didn't make it in. The DB *should* be importing all results files, both intermediate and daily, so nothing should be missed. We'll have to wait for Dave to answer on that one.

BTW: email notifications are handled on the DB end, so that has nothing to do with my scripts. In this case, the problem appears to be because the results never got into the DB, for reasons unknown.

Max :smile:

Edit: Okay, I've put that modification in place. That should close the 1-minute gap in prime checking.
Edit2: Karsten's prime has also been retroactively added to the prime log file.[/quote]


Now you've got it! Here was our montra on my job: Never schedule job B to run at a specific time of day IF it is dependent on job A running first; even if job A is scheduled to run hours before job B. Job A could easily fail and it would create a mess if job B would run. Here is what we did if we wanted job B to run at a specific time but it was still dependent on job A:

Set a time dependency for it to run; 12 midnight in this case.
Set it to be dependent on job A completing successfully.

Both of those conditions had to be true in order for job B to run.

The way you're going to do it works too. Run job A every 15 mins. throughout the day but run both jobs A and B at midnight. I'm assuming by you doing that that if job A has a problem, job B will not run. That is the key.

Dude, your skimmin' again. lol I never said the result did not get in the database. I said we need to CHECK that it got in the database. As Karsten said, it is the PRIME that did not get in the database. Please check on the result. Thanks.


Gary

gd_barnes 2009-05-28 21:48

[quote=mdettweiler;175117]
Edit: Okay, I've put that modification in place. That should close the 1-minute gap in prime checking.
Edit2: Karsten's prime has also been retroactively added to the prime log file.[/quote]

Has the prime been added to the database? Be sure and check that the result is in the database too. Karsten needs to get credit for both.


Gary

kar_bon:
not yet in NPLB-database, only in GB-server primelist file!

vaughan 2009-05-28 23:47

465*2^690044-1 already in database.

mdettweiler 2009-05-29 03:22

[quote=gd_barnes;175152]Dude, your skimmin' again. lol I never said the result did not get in the database. I said we need to CHECK that it got in the database. As Karsten said, it is the PRIME that did not get in the database. Please check on the result. Thanks.[/quote]
[quote=gd_barnes;175153]Has the prime been added to the database? Be sure and check that the result is in the database too. Karsten needs to get credit for both.


Gary

kar_bon:
not yet in NPLB-database, only in GB-server primelist file![/quote]
Actually, I wasn't skimming this time around. :smile: The reason why I worded it like I did was because from what I understand, the DB does *not* utilize the prime logs generated by the individual servers in any way. Those are only for the benefit of human users. Instead, the DB just imports the results, and when it does that, it checks to see if the result is prime. If so, then it sets one of the fields, "is_prime", to 1, and the result is counted with the primes thereafter.

gd_barnes 2009-05-29 09:04

OK but that doesn't answer my questions:

Is the result yet in the database?
Is the prime yet in the database?

Karsten says the prime is not in the database.

Regardless, if either the prime or the result is not in the database, based on what you just said, why aren't they? If you're saying that it gets them from the result file, then both should be there.

kar_bon 2009-05-29 11:10

the prime is still not in here [url]http://www.noprimeleftbehind.net/index.php?content=prime_list[/url]

so i think the pair itself isn't there too!

perhaps more pairs missing?

please David or David check this:

take a resultfile (older ones too) and check if the [b]last[/b] pair listed (in that special one minute timeframe) is in the database or not!

the pair score for my account seems correct for that file for the day the prime was found, but i'm not sure. so perhaps only the last pair (-> the prime) is missing, perhaps other files are the same issue!

gd_barnes 2009-05-29 12:27

Max,

Please coordinate with AMDave on getting the missing result and prime loaded into the database.


Gary

mdettweiler 2009-05-29 15:55

From what I can tell, the result is *not* in the database. If it was, then then most likely the result would have been detected and flagged as prime without a problem.

Dave, can you provide some insight on this? I know that the DB imports both interim files and daily results files, which should mean that everything is imported (regardless of any 1-minute bug) unless either a) it's stopped pulling daily results files from G8000 or b) it's missing the last result in each file.

MyDogBuster 2009-05-30 06:50

969*2^689503-1 is prime

gd_barnes 2009-05-31 17:50

709*2^689023-1 is prime

MyDogBuster 2009-06-06 16:05

999*2^691895-1 is prime

gd_barnes 2009-06-06 17:25

645*2^691682-1 is prime

gd_barnes 2009-06-07 09:13

627*2^691932-1 is prime

MyDogBuster 2009-06-09 08:48

375*2^786387-1 is prime

371*2^898690-1 is prime

MyDogBuster 2009-06-09 13:18

945*2^692744-1 is prime

gd_barnes 2009-06-09 18:14

After an extremely long drought on the individual-k drive for me:

325*2^766545-1 is prime

...good day for that drive

gd_barnes 2009-06-10 10:11

The first one from the new 6k drive #2 on port 9000:

365*2^715676-1 is prime


A very excellent 30 hours for n>700K primes; all 4 of them on the individual-k drive!

Flatlander 2009-06-11 15:22

Added [URL="http://primes.utm.edu/primes/page.php?id=88821"]88821[/URL] : 355*2^719857-1 (216702 digits)

My third biggest ever. :smile:

MyDogBuster 2009-06-11 15:25

Nice Chris. Yeah

vaughan 2009-06-12 11:05

695*2^693588-1 is new prime.

gd_barnes 2009-06-16 02:47

435*2^695309-1 is prime

vaughan 2009-06-17 13:42

429*2^696361-1 is prime.

gd_barnes 2009-06-17 17:18

421*2^696385-1 is prime

kar_bon 2009-06-18 00:05

next from the first 6k minidrive:

345*2^894064-1 is prime!

vaughan 2009-06-18 10:31

699*2^694497-1 is prime.

kar_bon 2009-06-18 13:02

lucky day for me, the next from 6k minidrive:

333*2^893871-1 is prime

gd_barnes 2009-06-18 22:20

A sweet pair at such a high n-depth Karsten. :smile:

MyDogBuster 2009-06-19 19:02

875*2^695742-1 is prime


Nice pair Karsten. You've found a home on that mini-drive.

gd_barnes 2009-06-23 00:59

603*2^695447-1 is prime

MyDogBuster 2009-06-23 07:09

885*2^696823-1 is prime

Cruelty 2009-06-26 16:06

311*2^1581686-1 (476138 digits), i will release this k @ n=1.6M

kar_bon 2009-06-26 16:29

congratulations for NPLB's first prime >1M!

Svenie25 2009-06-26 19:13

That was fast:

325*2^809389-1 is prime!

MyDogBuster 2009-06-26 19:40

Nice one Sven.

Real nice one Cruelty.

gd_barnes 2009-06-26 23:36

[quote=Cruelty;178896]311*2^1581686-1 (476138 digits), i will release this k @ n=1.6M[/quote]
:george::george::george::george::george:


Sweet! Nearly n=600K larger than our previous largest prime. Congrats! :smile:

There will be more where that came from when we get k=300-400/n=1M-2M finished sieving within a few months.

gd_barnes 2009-06-26 23:38

[quote=Svenie25;178910]That was fast:

325*2^809389-1 is prime![/quote]

Blast, just my luck on that drive; stopping a little too soon. But you were due for one and it was a nice one. Way to go! :smile:

MyDogBuster 2009-06-28 05:17

377*2^850160-1 is prime

Svenie25 2009-07-01 18:38

Looks like k=325 is very productive:

[URL="http://primes.utm.edu/primes/page.php?id=89095"]325*2^842787-1 is prime![/URL]

P.S.: Why do I have an avater????

henryzz 2009-07-01 19:29

[quote=Svenie25;179505]Looks like k=325 is very productive:

[URL="http://primes.utm.edu/primes/page.php?id=89095"]325*2^842787-1 is prime![/URL]

P.S.: Why do I have an avater????[/quote]
the gerbils(R. I. P.) used to assign avatars randomly to people with no avatar
i think the snake has taken over their duties
whichever it is went a bit further a few days ago they changed the avatars of some of the old forum members as well

Svenie25 2009-07-01 20:06

[quote=henryzz;179516]the gerbils(R. I. P.) used to assign avatars randomly to people with no avatar
i think the snake has taken over their duties
whichever it is went a bit further a few days ago they changed the avatars of some of the old forum members as well[/quote]

No it is no problem. I only was a bit surpised. ;)

MyDogBuster 2009-07-12 15:24

371*2^993238-1 is prime

mdettweiler 2009-07-12 17:53

[quote=MyDogBuster;180707]371*2^993238-1 is prime[/quote]
Congratulations on a very big prime! :w00t:

kar_bon 2009-07-12 21:25

from 6k's 1st part:

321*2^942046-1 is prime!

mdettweiler 2009-07-12 21:45

[quote=kar_bon;180740]from 6k's 1st part:

321*2^942046-1 is prime![/quote]
Wow--two primes >900K in one day! :tu:

gd_barnes 2009-07-13 19:48

Great primes guys! We're moving up rapidly on 6th place in total score.

Svenie25 2009-07-13 20:10

[quote=gd_barnes;180857]Great primes guys! We're moving up rapidly on 6th place in total score.[/quote]

And by numbers we are good in advance of RPS.:smile:

kar_bon 2009-07-16 15:55

483*2^703479-1 is confirmed prime


All times are UTC. The time now is 09:06.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.