mersenneforum.org  

Go Back   mersenneforum.org > Fun Stuff > Lounge

Reply
 
Thread Tools
Old 2003-11-23, 16:39   #1
Old man PrimeNet
 
Old man PrimeNet's Avatar
 
Jan 2003
Altitude>12,500 MSL

11001012 Posts
Default Updated Server Stats Page

After a week of chasing down archived and misplaced server transaction logs, cleaning up and reorganizing them, I finally got around to updating the stats chart:

http://mersenne.org/ips/stats.html

What's interesting is the hockey stick bend upward starting late 2001. I have (tentatively) attributed this to new CPUs & George's corresponding Prime95 code improvements leveraging them. Any speculation or high-confidence info on what brought this new, steeper performance growth trend?
Old man PrimeNet is offline   Reply With Quote
Old 2003-11-23, 17:45   #2
GP2
 
GP2's Avatar
 
Sep 2003

2,579 Posts
Default

This effect also shows up in the plots of P90 CPU years /day (7-day-average) from old copies of summary.txt (aka status.shtml, aka the output of http://www.mersenne.org/primenet/ ):

http://opteron.mersenneforum.org/png/LLspeed.png


It might perhaps be attributed to the arrival in force of Pentium 4s:

http://opteron.mersenneforum.org/png/machines.png


More graphs linked to at:
http://opteron.mersenneforum.org/


PS,
There is some preliminary evidence from http://opteron.mersenneforum.org/png/LLspeed.png that we may now have entered a "second bend" of the hockey stick with an even higher slope.

Last fiddled with by GP2 on 2003-11-23 at 17:51
GP2 is offline   Reply With Quote
Old 2003-11-23, 17:49   #3
GP2
 
GP2's Avatar
 
Sep 2003

2,579 Posts
Default

See also the Gigaflops rate greatly exceeds trend predicted 2 1/2 years ago thread from the Data forum, where some speculative theories were discussed.
GP2 is offline   Reply With Quote
Old 2003-11-23, 18:21   #4
Prime Monster
 
Prime Monster's Avatar
 
Aug 2002

22×5×13 Posts
Default

I am not sure about this, but I would think the arrival of the DC fanatic on the scene has had something to do with this. Instead of running the client as a background application on a machine otherwise used for other purposes, the client becomes the main and only application. The machines are tailored to run GIMPS and nothing else. The fanatics also run their machines 24/7/365, in difference to the casual user.

PM
Prime Monster is offline   Reply With Quote
Old 2003-11-23, 18:27   #5
Joe O
 
Joe O's Avatar
 
Aug 2002

10158 Posts
Default Re: Updated Server Stats Page

Quote:
Originally posted by Old man PrimeNet
After a week of chasing down archived and misplaced server transaction logs, cleaning up and reorganizing them, I finally got around to updating the stats chart:

http://mersenne.org/ips/stats.html
Looks very nice! Thank you!

ps
Did you find any old summary.txt (aka status.shtml, aka the output of http://www.mersenne.org/primenet/ ) for GP2?
Joe O is offline   Reply With Quote
Old 2003-11-23, 21:23   #6
tha
 
tha's Avatar
 
Dec 2002

24·72 Posts
Default Re: Updated Server Stats Page

Quote:
Originally posted by Old man PrimeNet
After a week of chasing down archived and misplaced server transaction logs, cleaning up and reorganizing them, I finally got around to updating the stats chart:
Real nice to see the new graph, thank you!

Now that you have taken a turn at it, could you derive a graph from the data with all clients that log in, obtain assignments, but never have turned in any results eliminated? Or can you make the raw server data available to some selected users? (ehh, how many Mb's is it?) There are a few dataminers here that would enjoy delphing in it, don't you think GP?

I would like to check my conclusion that there have never been more than 16,000 clients active at any time.

YotN,

Henk.
tha is offline   Reply With Quote
Old 2003-11-23, 22:27   #7
Old man PrimeNet
 
Old man PrimeNet's Avatar
 
Jan 2003
Altitude>12,500 MSL

6516 Posts
Default

How would we define 'active at any time' if a computer may not contact the server for up to several months, but may in fact be running the entire period?

Last fiddled with by Old man PrimeNet on 2003-11-23 at 22:27
Old man PrimeNet is offline   Reply With Quote
Old 2003-11-23, 22:53   #8
tha
 
tha's Avatar
 
Dec 2002

78410 Posts
Default

Quote:
Originally posted by Old man PrimeNet
How would we define 'active at any time' if a computer may not contact the server for up to several months, but may in fact be running the entire period?
I made a graph myself based on the available data defining a client active from the first moment it turned in a result up to the last day it checked in a result. That is not excactly what I want, but close enough to be an indication.

With the server data available one would prefer this definition:

A client is assumed to have been active from the day it got an assignment up to the day it turns in that assignment. Overlapping assignments just counting as one contingeous period.

See my graphs at
http://home.planet.nl/~tha/primenetnumbers1.gif and
http://home.planet.nl/~tha/primenetnumbers2.gif

The low count is based on the file cleared.txt and the high count adds the data of status.txt to the first count.

YotN,

Henk Stokhorst
tha is offline   Reply With Quote
Old 2003-11-24, 00:36   #9
Old man PrimeNet
 
Old man PrimeNet's Avatar
 
Jan 2003
Altitude>12,500 MSL

101 Posts
Default

Using Henk's criteria, I get 44000+ 'live' CPUs queried directly from the server's SQL exponents assignment table. Exponents have about a dozen well-defined test states tracked as bit flags in an exponent state bit field, for example:

0x0200 exponent is assigned to a CPU
0x0400 factored composite
0x0800 LL composite
0x1000 prime
0x8000 marked for purge

PrimeNet's exponent state transition logic enforces consistency of the exponent states. Additional protections are applied through periodic, autonomous self-maintenance procedures - including the reclaimation of expired assignments.

So the SQL query, where a guaranteed-unique concatenation of the (case-sensitive in v4) userid and CPU names are counted distinctly across the exponents table where they are assigned and not completed for any reason, looks something like this:

select count(distinct(user_id + '^-/////-^' + machine_id))
from t_exponents_assigned
where state & 0x0200 = 0x0200
and state & 0x9C00 = 0

The summary.txt report shows the same number, which is even more conservative than Henk's criteria because after 60 days the server reclaims un-updated assignments as presumed lost. Sometimes this policy causes an unintentional (but routinely handled and credited) double-check condition when the 'lost' assignment suddenly checks in completed.

I'm not sure I understand how Henk arrives at his figures.
Old man PrimeNet is offline   Reply With Quote
Old 2003-11-24, 00:49   #10
pakaran
 
pakaran's Avatar
 
Aug 2002

F916 Posts
Default

Quote:
Originally posted by Old man PrimeNet
How would we define 'active at any time' if a computer may not contact the server for up to several months, but may in fact be running the entire period?
Machine has exponents out. In the case of 10M numbers, which are not unreserved, the machine should have contacted the server in the past 90 days.
pakaran is offline   Reply With Quote
Old 2003-11-24, 03:27   #11
GP2
 
GP2's Avatar
 
Sep 2003

2,579 Posts
Default

Quote:
Originally posted by Old man PrimeNet
Exponents have about a dozen well-defined test states tracked as bit flags in an exponent state bit field, for example:

0x0200 exponent is assigned to a CPU
0x0400 factored composite
0x0800 LL composite
0x1000 prime
0x8000 marked for purge
Is it possible to do a synchronization "lite" on a more regular basis?

In a few cases, people report results directly to George so the server doesn't know about already-factored or already-verified-LL-composite exponents and reassigns them (for instance 17363977 and 20092067 and 20099983).
GP2 is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Low weight stats page. jocelynl Riesel Prime Search 351 2020-06-14 10:44
TPS stats page Oddball Twin Prime Search 0 2011-10-29 18:34
odd entry on stats page mdettweiler Prime Sierpinski Project 3 2008-08-27 18:34
UPDATED: The current pre-sieved range reservation thread and stats page gribozavr Twin Prime Search 10 2007-01-19 21:06
website and stats updated wfgarnett3 PSearch 0 2004-09-09 03:15

All times are UTC. The time now is 02:33.

Mon Jul 13 02:33:04 UTC 2020 up 110 days, 6 mins, 0 users, load averages: 2.15, 2.04, 2.06

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.