Statistics and scoring - Page 8

IronBits · 2008-09-17, 09:01

I've sent an email to Phil to see what he can do.
Being that the nplb database is on the same physical disk as his databases, it should be a snap.
It would be nice to know what all needs to be in the database. How do the 'teams' work into it, assigning userIDs so that team affiliation can be handled etc.
Parsing the results.txt file and importing them into the database would be snap for him.
I assume once per day would be fine?

em99010pepe · 2008-09-17, 09:11

Update each 6 hours?

IronBits · 2008-09-17, 09:54

Well, let's give Phil sometime to wrap his head around things first.
Probably go for hourly once he/we have it all figured out and automated

IronBits · 2008-09-17, 20:53

Ok, the stats are displaying, no graphs yet, Bok thinks we should just convert the graphing part to ChartDirector seeing that I have a license for it.

I have the perl script to create the .csv files. (thanks to Anon)
Need to find out how to import them into the db (AES I hope)
I also created a llrnet and crus database, based off the nplb database structure.
I'm modifying the .php files now so that we can use just one interface to get at all 3 databases...
Once I get the importing of the data thing going, I can use llrnet and crus databases to 'practice' on, then, catch up the nplb database with all the files I have here that have not been imported, and then all those other servers operated by others that need to be imported.
Then the automation part will be tweaked so it's painless and the least time consuming.

more later.

em99010pepe · 2008-09-17, 20:58

Thank you IB.
Is it possible to score each pair? Instead of a ranking by number the ranking should be by score.

IronBits · 2008-09-17, 22:58

Let me get it all working first, then I'll start tweaking.
I'm not sure what 'score of a pair' means for example.
Once I have the data in there, we should be able to sort on any column when I'm finished.
We have multiple TYPE servers (nplb llrnet crus) and we have multiple ports within each TYPE, so not sure exactly how the stats layout will end up just yet.

em99010pepe · 2008-09-18, 20:45

Quote:

Originally Posted by IronBits

Let me get it all working first, then I'll start tweaking.
I'm not sure what 'score of a pair' means for example.
Once I have the data in there, we should be able to sort on any column when I'm finished.
We have multiple TYPE servers (nplb llrnet crus) and we have multiple ports within each TYPE, so not sure exactly how the stats layout will end up just yet.

As n increase in k*2^n-1 the candidates take more time to process so the ranking by total of number of candidates tested is unfair, the candidates do not have the same size.
On PSP and RS5 project they use a formula to calculate the score for each candidate, this way is more fair.

Carlos

IronBits · 2008-09-18, 23:46

How about using the last [time] field. If you do work on and old box and it takes 2 days to crunch 1 kn pair, then you should get more credit than someone with a computer that does it in 10 seconds ;)
Still not paying any attention to 'scores' yet.
Just getting the data into the database and displaying is my first task.
My gut feeling is by the time we get a nice stats system built up around it, we'll be over on BOINC doing the same projects...

gd_barnes · 2008-09-19, 02:02

Let's just stick with total results processed for now.

With David being in a big transition mode from Adam's set up to his, it would complicate things too much to attempt to score each k/n pair according to exponent.

We can work with him on that as an enhancement to the process in the next month or two.

Gary

2008-09-17, 20:58	#82
em99010pepe Sep 2004 2·5·283 Posts	Thank you IB. Is it possible to score each pair? Instead of a ranking by number the ranking should be by score. Last fiddled with by em99010pepe on 2008-09-17 at 20:59

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
ECPP - Scoring, or other primality tests (PFGW?)	f1pokerspeed	FactorDB	13	2012-07-02 09:04
Discussion about scoring results/primes	gd_barnes	No Prime Left Behind	33	2009-01-19 14:50
You know what they say about statistics ...	petrw1	PrimeNet	1	2007-10-08 13:29
321 Statistics	paulunderwood	3*2^n-1 Search	1	2005-02-25 21:41
Statistics	R.D. Silverman	NFSNET Discussion	1	2004-06-14 18:40

2008-09-17, 09:01	#78
IronBits I ♥ BOINC! Oct 2002 Glendale, AZ. (USA) 2131₈ Posts	I've sent an email to Phil to see what he can do. Being that the nplb database is on the same physical disk as his databases, it should be a snap. It would be nice to know what all needs to be in the database. How do the 'teams' work into it, assigning userIDs so that team affiliation can be handled etc. Parsing the results.txt file and importing them into the database would be snap for him. I assume once per day would be fine?

2008-09-17, 09:11	#79
em99010pepe Sep 2004 2·5·283 Posts	Update each 6 hours?

2008-09-17, 09:54	#80
IronBits I ♥ BOINC! Oct 2002 Glendale, AZ. (USA) 3·7·53 Posts	Well, let's give Phil sometime to wrap his head around things first. Probably go for hourly once he/we have it all figured out and automated

2008-09-17, 20:53	#81
IronBits I ♥ BOINC! Oct 2002 Glendale, AZ. (USA) 3×7×53 Posts	Ok, the stats are displaying, no graphs yet, Bok thinks we should just convert the graphing part to ChartDirector seeing that I have a license for it. I have the perl script to create the .csv files. (thanks to Anon) Need to find out how to import them into the db (AES I hope) I also created a llrnet and crus database, based off the nplb database structure. I'm modifying the .php files now so that we can use just one interface to get at all 3 databases... Once I get the importing of the data thing going, I can use llrnet and crus databases to 'practice' on, then, catch up the nplb database with all the files I have here that have not been imported, and then all those other servers operated by others that need to be imported. Then the automation part will be tweaked so it's painless and the least time consuming. more later.

2008-09-17, 22:58	#83
IronBits I ♥ BOINC! Oct 2002 Glendale, AZ. (USA) 3·7·53 Posts	Let me get it all working first, then I'll start tweaking. I'm not sure what 'score of a pair' means for example. Once I have the data in there, we should be able to sort on any column when I'm finished. We have multiple TYPE servers (nplb llrnet crus) and we have multiple ports within each TYPE, so not sure exactly how the stats layout will end up just yet.

2008-09-18, 23:46	#85
IronBits I ♥ BOINC! Oct 2002 Glendale, AZ. (USA) 3×7×53 Posts	How about using the last [time] field. If you do work on and old box and it takes 2 days to crunch 1 kn pair, then you should get more credit than someone with a computer that does it in 10 seconds ;) Still not paying any attention to 'scores' yet. Just getting the data into the database and displaying is my first task. My gut feeling is by the time we get a nice stats system built up around it, we'll be over on BOINC doing the same projects...

2008-09-19, 02:02	#86
gd_barnes May 2007 Kansas; USA 10100010011011₂ Posts	Let's just stick with total results processed for now. With David being in a big transition mode from Adam's set up to his, it would complicate things too much to attempt to score each k/n pair according to exponent. We can work with him on that as an enhancement to the process in the next month or two. Gary