GPU to 72 status... - Page 55

Dubslow · 2012-02-15, 23:25

Quote:

Originally Posted by James Heinrich

I'm battling valiantly to re-index the 33-million-record table of known factors. It's going poorly, unfortunately. I hope to have it back up and running properly within a day or so, but who knows. I didn't want to risk losing any data which is why I disabled submissions, and purposely took down the site for some time.

A few hours ago.

chalsall · 2012-02-15, 23:30

Quote:

Originally Posted by Dubslow

A few hours ago.

Ah... Thanks. I didn't see that.

Reindexing a 33 million row table can take some time....

James Heinrich · 2012-02-15, 23:55

Quote:

Originally Posted by chalsall

Ah... Thanks. I didn't see that.
Reindexing a 33 million row table can take some time....

You didn't see that cause you didn't ask (Dubslow did, in a PM).

Monkeying with the tables on my home machine / development server (Sandy-E, OCZ Vertex 3) works fine, albeit still slow (a few dozen minutes to complete). On my production server it's nigh impossible to work with that table anymore. Oh sure, selecting is fine, and inserting a few records at a time is no problem, but major operations take 5+ hours (let it run overnight, then find the ISP killed the process after ~5 hours cause it still hadn't finished).

So I'm taking a new approach: split it into 101 tables, one for each 10M range (plus one for >=1000M) and now it's a much more manageable ~300k-500k records per table. And except for a couple rare cases, it's no worse, in fact it's better off since it's querying a much more-specific smaller table.

If all goes well my site should be back up by the end of tonight...

James Heinrich · 2012-02-16, 00:22

Quote:

Originally Posted by James Heinrich

If all goes well my site should be back up by the end of tonight...

Apparently it went well.

It should be 99% functional now, the last 1% can regenerate while the site is running. Please let me know if anything's broken, cause it shouldn't be.

Dubslow · 2012-02-16, 02:57

Quote:

Originally Posted by James Heinrich

Monkeying with the tables on my home machine / development server (Sandy-E, OCZ Vertex 3) works fine, albeit still slow (a few dozen minutes to complete). On my production server it's nigh impossible to work with that table anymore. Oh sure, selecting is fine, and inserting a few records at a time is no problem, but major operations take 5+ hours (let it run overnight, then find the ISP killed the process after ~5 hours cause it still hadn't finished).

Get a better server? Or is the obvious solution one that doesn't work?

Dubslow · 2012-02-16, 03:52

chalsall, why has the LLTF reserved count dropped from >30K to <27K? I didn't see any major spike in the throughput graphs...

nucleon · 2012-02-16, 12:45

Quote:

Originally Posted by Dubslow

chalsall, why has the LLTF reserved count dropped from >30K to <27K? I didn't see any major spike in the throughput graphs...

Expired exponents perhaps?

-- Craig

chalsall · 2012-02-16, 13:18

Quote:

Originally Posted by Dubslow

chalsall, why has the LLTF reserved count dropped from >30K to <27K? I didn't see any major spike in the throughput graphs...

With our two big guns fighting it out in the DC range (hopefully temporarily), I was uncomfortable holding >30K assignments. So I had the system throw back to PrimeNet a few thousand which had already been TFed to 71.

kjaget · 2012-02-16, 15:35

Quote:

Originally Posted by Bdot

I like that a lot, big thank you!

My graph is quite spiky ... I could use a running average

Or, maybe add a column to the top table like "avg. GHz days per day" - for each work type and the total?

Or overlay some colored lines on top of the bars showing some sort of moving average? Something like https://chart.googleapis.com/chart?c...0,0,.35:.85,10 (first example I could find, but some imagination will get you to what I was thinking of).

chalsall · 2012-02-16, 15:56

Quote:

Originally Posted by kjaget

Or overlay some colored lines on top of the bars showing some sort of moving average?

OK. That is actually quite easy to do. Five minutes, in fact.

I'm only rendering a total running average, rather than a seperate line for each work type. I think the graphs would get too cluttered with five lines.

Bdot · 2012-02-16, 17:06

Quote:

Originally Posted by chalsall

OK. That is actually quite easy to do. Five minutes, in fact.

I'm only rendering a total running average, rather than a seperate line for each work type. I think the graphs would get too cluttered with five lines.

YES! That's perfectly what I had thought of ... Thanks!

EDIT: However, the line disagrees with what the "View Assignments" page says: "... you have done on average 224.105 GHz Days of work per day." But my avg. line seems to end at ~175.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Status	Primeinator	Operation Billion Digits	5	2011-12-06 02:35
62 bit status	1997rj7	Lone Mersenne Hunters	27	2008-09-29 13:52
OBD Status	Uncwilly	Operation Billion Digits	22	2005-10-25 14:05
1-2M LLR status	paulunderwood	3*2^n-1 Search	2	2005-03-13 17:03
Status of 26.0M - 26.5M	1997rj7	Lone Mersenne Hunters	25	2004-06-18 16:46

2012-02-16, 03:52	#600
Dubslow Basketry That Evening! "Bunslow the Bold" Jun 2011 40<A<43 -89<O<-88 3×29×83 Posts	chalsall, why has the LLTF reserved count dropped from >30K to <27K? I didn't see any major spike in the throughput graphs...