Server outrages - Page 34

mdettweiler · 2014-08-28, 05:34

Just noticed something weird in my PRPnet logs...it seems that noprimeleftbehind.net became "gradually" unreachable. At 5:28 this morning (server time), one of my clients tried to fetch new work, but just a couple hours later, at 7:40, it was able to return its last result. By 20:07, when it tried to fetch new work again (after finishing a fairly large PrimeGrid test), the server was fully unreachable.

Not that I could make a guess as to what this means for why things are down, but, it did seem noteworthy, for whatever it's worth.

gd_barnes · 2014-08-28, 07:18

I'm out of town for ~1.5 more weeks. Since Dave has the server machine now set up to automatically log on if there is a power blip, I could have a friend shut it down and turn it back on and it should log itself on. Then Max or Dave could restart the servers. I'll check back here in about 2 hours and again about this time tomorrow morning to see if there is any update as to what is going on.

AMDave · 2014-08-28, 20:20

right after I said it was ok, access to the server stopped.
It still has not been able to get a log file email out to me.
So either the router needs to be reset or the server is down.
In this circumstance it has mostly been the router.
I am unable to access the server to apply a response.
The best outcome would be to reset the router, wait 30 mins & check the web page, if still not available then restart the server as well.

In typical 'Murphy' fashion, the DR server is also down due to a PSU failure. I'll either replace it or migrate the websites & databases to another machine tomorrow.

mdettweiler · 2014-08-29, 21:08

Just a thought: if the router does turn out to be the issue, it might be time to look into getting a new one. We seem to be having router issues with increasing frequency lately, which may indicate it's "dying".

A halfway-decent wireless router can usually be found these days for $20-$25; a name brand pushes it up to the $35-$50 range, but usually no more than that for the features we need. Gary, let me know if you'd like me to do some quick shopping around for one online; I can also assist with configuring it appropriately after installation (the easiest thing to do would be to reconfigure it to use IP addresses consistent with the old router, rather than changing the static IPs on each machine).

gd_barnes · 2014-08-30, 09:23

I had a power outage and the machine was off. I had a friend go over and turn it on and it has internet access. Dave or Max, if you can start the servers, everything should be OK. Sorry about the problems.

I will look into another UPS in the near future. I need something more reliable than I had before.

mdettweiler · 2014-08-30, 19:32

Okay, I've restarted all the servers, namely: 1400, 1465, 1468, 1470, 2000, 9000, 12000, and 13000. Please let me know if I've forgotten any.

I also set the deadlines on all of them to 7 days until the old assignments are returned.

Incidentally, graphical access through VNC is now working perfectly, so Gary, when you get back you'll find the servers running exactly how they usually are. I noticed someone (Dave?) left us a little present on the desktop background - is that you, Dave?

(He looks jolly enough to fit the bill...)

Edit: Gary, I didn't restart any PRPnet clients, not knowing exactly which ones you'd want. Since VNC is working well now, you should be able to get full remote access yourself through the usual script (the 5900 version, not 5901).

AMDave · 2014-08-31, 06:16

No idea about desktop backgrounds on remote hosts as I only use the command line.

The DR server is up and running on alternate hardware until the server PSU is fixed or replaced.

AMDave · 2014-08-31, 07:27

@gary
It's probably not the UPS's fault if the power outage was long enough.
Don't forget to say thanks to your buddy from the rest of us.

AMDave · 2014-09-14, 20:19

Complete backup set offsite download completed for 2014-09-13. (4.7GB)

gd_barnes · 2014-09-14, 20:39

Quote:

Originally Posted by mdettweiler

Incidentally, graphical access through VNC is now working perfectly, so Gary, when you get back you'll find the servers running exactly how they usually are. I noticed someone (Dave?) left us a little present on the desktop background - is that you, Dave?

(He looks jolly enough to fit the bill...)

That's actually my buddy who turned on my machine. While I am gone he feeds my cat. He is a total ham, always pulling pranks like that while I'm gone. His favorite thing to do is move random stuff around my place. I almost always have a surprise when I get back. lol

AMDave · 2014-09-30, 10:23

Complete backup set offsite download completed for 2014-09-28. (4.8GB)

2014-08-30, 19:32	#369
mdettweiler A Sunny Moo Aug 2007 USA (GMT-5) 3×2,083 Posts	Okay, I've restarted all the servers, namely: 1400, 1465, 1468, 1470, 2000, 9000, 12000, and 13000. Please let me know if I've forgotten any. I also set the deadlines on all of them to 7 days until the old assignments are returned. Incidentally, graphical access through VNC is now working perfectly, so Gary, when you get back you'll find the servers running exactly how they usually are. I noticed someone (Dave?) left us a little present on the desktop background - is that you, Dave? (He looks jolly enough to fit the bill...) Edit: Gary, I didn't restart any PRPnet clients, not knowing exactly which ones you'd want. Since VNC is working well now, you should be able to get full remote access yourself through the usual script (the 5900 version, not 5901). Last fiddled with by mdettweiler on 2014-08-30 at 19:33

2014-08-31, 07:27	#371
AMDave Jan 2006 deep in a while-loop 2·7·47 Posts	@gary It's probably not the UPS's fault if the power outage was long enough. Don't forget to say thanks to your buddy from the rest of us. Last fiddled with by AMDave on 2014-08-31 at 07:28

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
What exactly is sent to the server?	paul0	NFS@Home	2	2015-03-12 23:00
Server bug -- new?	Christenson	Information & Answers	5	2011-07-12 21:44
Server Down?	Grant	Information & Answers	13	2008-11-24 19:37
New ECM-server available	andi314	Factoring	3	2003-08-31 11:22
New Server Hardware and price quotes, Funding the server	Angular	PrimeNet	32	2002-12-09 01:12

2014-08-28, 05:34	#364
mdettweiler A Sunny Moo Aug 2007 USA (GMT-5) 3·2,083 Posts	Just noticed something weird in my PRPnet logs...it seems that noprimeleftbehind.net became "gradually" unreachable. At 5:28 this morning (server time), one of my clients tried to fetch new work, but just a couple hours later, at 7:40, it was able to return its last result. By 20:07, when it tried to fetch new work again (after finishing a fairly large PrimeGrid test), the server was fully unreachable. Not that I could make a guess as to what this means for why things are down, but, it did seem noteworthy, for whatever it's worth.

2014-08-28, 07:18	#365
gd_barnes May 2007 Kansas; USA 2²×19×137 Posts	I'm out of town for ~1.5 more weeks. Since Dave has the server machine now set up to automatically log on if there is a power blip, I could have a friend shut it down and turn it back on and it should log itself on. Then Max or Dave could restart the servers. I'll check back here in about 2 hours and again about this time tomorrow morning to see if there is any update as to what is going on.

2014-08-28, 20:20	#366
AMDave Jan 2006 deep in a while-loop 2×7×47 Posts	right after I said it was ok, access to the server stopped. It still has not been able to get a log file email out to me. So either the router needs to be reset or the server is down. In this circumstance it has mostly been the router. I am unable to access the server to apply a response. The best outcome would be to reset the router, wait 30 mins & check the web page, if still not available then restart the server as well. In typical 'Murphy' fashion, the DR server is also down due to a PSU failure. I'll either replace it or migrate the websites & databases to another machine tomorrow.

2014-08-29, 21:08	#367
mdettweiler A Sunny Moo Aug 2007 USA (GMT-5) 3·2,083 Posts	Just a thought: if the router does turn out to be the issue, it might be time to look into getting a new one. We seem to be having router issues with increasing frequency lately, which may indicate it's "dying". A halfway-decent wireless router can usually be found these days for $20-$25; a name brand pushes it up to the $35-$50 range, but usually no more than that for the features we need. Gary, let me know if you'd like me to do some quick shopping around for one online; I can also assist with configuring it appropriately after installation (the easiest thing to do would be to reconfigure it to use IP addresses consistent with the old router, rather than changing the static IPs on each machine).

2014-08-30, 09:23	#368
gd_barnes May 2007 Kansas; USA 28AC₁₆ Posts	I had a power outage and the machine was off. I had a friend go over and turn it on and it has internet access. Dave or Max, if you can start the servers, everything should be OK. Sorry about the problems. I will look into another UPS in the near future. I need something more reliable than I had before.

2014-08-31, 06:16	#370
AMDave Jan 2006 deep in a while-loop 2×7×47 Posts	No idea about desktop backgrounds on remote hosts as I only use the command line. The DR server is up and running on alternate hardware until the server PSU is fixed or replaced.

2014-09-14, 20:19	#372
AMDave Jan 2006 deep in a while-loop 2·7·47 Posts	Complete backup set offsite download completed for 2014-09-13. (4.7GB)

2014-09-30, 10:23	#374
AMDave Jan 2006 deep in a while-loop 2·7·47 Posts	Complete backup set offsite download completed for 2014-09-28. (4.8GB)