Server outrages - Page 47

gd_barnes · 2017-12-01, 04:00

I sent a PM to Max asking for his help.

I looked at the router config on the new machine and everything looks fine to me. Obviously something needs to be changed somewhere.

AMDave · 2017-12-01, 12:28

when the connection is restored I need to do some DB maintenance to restore the stats.
The main table is busted due to HDD write corruption when the mobo hicupped

Here is the excerpt from the logfile that I get.

Code:

Completed local_port_status at Fri Dec  1 06:00:09 2017

DBD::mysql::st execute failed: Table './nplbstats/results' is marked as crashed and last (automatic?) repair failed at /home/nplb/scripts/refresh_database.pl line 476.
DBD::mysql::st execute failed: Table './nplbstats/results' is marked as crashed and last (automatic?) repair failed at /home/nplb/scripts/refresh_database.pl line 675.
DBD::mysql::st execute failed: Table './nplbstats/results' is marked as crashed and last (automatic?) repair failed at /home/nplb/scripts/refresh_database.pl line 805.
Starting refresh_database at Fri Dec  1 06:00:09 2017

mdettweiler · 2017-12-02, 01:56

Dave's guess was exactly right, it's a silly router issue: the port-forwards for the Internet-facing servers are bound to the MAC address of the Ethernet port on Jeepford's old motherboard. (We've been using a DHCP reservation instead of directly configuring Jeepford's static IP ever since we set up Gary's new router a year or two ago.)

I can fix this easily, but to do so I need access to the router's configuration page, which would be easy if not for the fact that (due to this issue) I don't have remote access to Gary's network.

So, I've PM'd him directions to download and run a handy-dandy little utility called "ngrok" which will bypass the router and create a direct tunnel to Jeepford, which I can use to get in and fix this.

gd_barnes · 2017-12-02, 07:27

OK I just got home. I will begin doing what Max requested. I will update this post if everything goes successfully.

Once Max has access to my "new" Jeepford machine I have no doubt that he will be able to fix the problem quickly.

Edit: Max, everything that you asked for in the PM has been done. Let me know if I need to do anything else.

mdettweiler · 2017-12-03, 04:58

All fixed!

The router configuration has been updated and everything is once again reachable from the Internet. I see that clients have already happily connected to the PRPnet servers and gotten some long-awaited tests.

Gary, I'll send you some directions (with screenshots!) for how to do this yourself in case it ever happens again. I'll also send them to Dave. The fewer maintenance tasks that "only one of us can do", the better.

gd_barnes · 2017-12-03, 09:00

Quote:

Originally Posted by mdettweiler

All fixed!

The router configuration has been updated and everything is once again reachable from the Internet. I see that clients have already happily connected to the PRPnet servers and gotten some long-awaited tests.

Gary, I'll send you some directions (with screenshots!) for how to do this yourself in case it ever happens again. I'll also send them to Dave. The fewer maintenance tasks that "only one of us can do", the better.

Oustanding! Thank you Max!

odicin · 2017-12-06, 07:41

@Dave: It seems that the NPLB port report for all 3 ports stuck at 2017-09-29.

Regards Odi

AMDave · 2017-12-07, 09:13

Hi Odi
/me waves
That's correct.
I have confirmed control of the stats server is restored, but it is a non-trivial task to restore the broken results table from the last backup before it broke, reprocess the result files up to the point where it broke & then process the data that has accumulated.
I work in a different city to where I live so I opted to defer it to this weekend when I can get a good run at it with my mind on the tasks.
However, your contributions are being recorded correctly and will be included in the stats when I restore the processes in the next day or two.

AMDave · 2017-12-12, 12:03

Apologies fro the stats blip.
http://stats.free-dc.org/stats.php?page=proj&proj=nplb
The hardware issue has been resolved and the corrupted database table has been rectified.
Move along. Nothing to see here.
https://www.youtube.com/watch?v=pdFl__NlOpA

AMDave · 2017-12-12, 13:18

NPLB stats database refresh rescheduled from every hour to 3-hourly to improve resource utilisation.

rebirther · 2017-12-12, 20:06

Some CRUS tables are also not updating and are empty.

2017-12-02, 01:56	#509
mdettweiler A Sunny Moo Aug 2007 USA (GMT-5) 1869₁₆ Posts	Dave's guess was exactly right, it's a silly router issue: the port-forwards for the Internet-facing servers are bound to the MAC address of the Ethernet port on Jeepford's old motherboard. (We've been using a DHCP reservation instead of directly configuring Jeepford's static IP ever since we set up Gary's new router a year or two ago.) I can fix this easily, but to do so I need access to the router's configuration page, which would be easy if not for the fact that (due to this issue) I don't have remote access to Gary's network. So, I've PM'd him directions to download and run a handy-dandy little utility called "ngrok" which will bypass the router and create a direct tunnel to Jeepford, which I can use to get in and fix this. Last fiddled with by mdettweiler on 2017-12-02 at 01:57

2017-12-02, 07:27	#510
gd_barnes "Gary" May 2007 Overland Park, KS 7²×241 Posts	OK I just got home. I will begin doing what Max requested. I will update this post if everything goes successfully. Once Max has access to my "new" Jeepford machine I have no doubt that he will be able to fix the problem quickly. Edit: Max, everything that you asked for in the PM has been done. Let me know if I need to do anything else. Last fiddled with by gd_barnes on 2017-12-02 at 08:29 Reason: edit

2017-12-06, 07:41	#513
odicin Sep 2011 Potsdam, Germany 10010010₂ Posts	@Dave: It seems that the NPLB port report for all 3 ports stuck at 2017-09-29. Regards Odi Last fiddled with by odicin on 2017-12-06 at 07:41

2017-12-12, 12:03	#515
AMDave Jan 2006 deep in a while-loop 2²·167 Posts	Apologies fro the stats blip. http://stats.free-dc.org/stats.php?page=proj&proj=nplb The hardware issue has been resolved and the corrupted database table has been rectified. Move along. Nothing to see here. https://www.youtube.com/watch?v=pdFl__NlOpA Last fiddled with by AMDave on 2017-12-12 at 12:04

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Gerbicz Error Checking - Originally: Would a "rack server" run the same as a desktop server	EdH	Hardware	16	2021-03-29 16:43
Use of a virtual private server (VPS) - normally a web server	drkirkby	Hardware	11	2021-03-15 09:11
is the server down	Unregistered	Information & Answers	1	2008-11-23 14:05
server down?	masser	Sierpinski/Riesel Base 5	2	2008-05-24 05:55
New Server Hardware and price quotes, Funding the server	Angular	PrimeNet	32	2002-12-09 01:12

2017-12-01, 04:00	#507
gd_barnes "Gary" May 2007 Overland Park, KS 11809₁₀ Posts	I sent a PM to Max asking for his help. I looked at the router config on the new machine and everything looks fine to me. Obviously something needs to be changed somewhere.

2017-12-03, 04:58	#511
mdettweiler A Sunny Moo Aug 2007 USA (GMT-5) 3·2,083 Posts	All fixed! The router configuration has been updated and everything is once again reachable from the Internet. I see that clients have already happily connected to the PRPnet servers and gotten some long-awaited tests. Gary, I'll send you some directions (with screenshots!) for how to do this yourself in case it ever happens again. I'll also send them to Dave. The fewer maintenance tasks that "only one of us can do", the better.

2017-12-07, 09:13	#514
AMDave Jan 2006 deep in a while-loop 1234₈ Posts	Hi Odi /me waves That's correct. I have confirmed control of the stats server is restored, but it is a non-trivial task to restore the broken results table from the last backup before it broke, reprocess the result files up to the point where it broke & then process the data that has accumulated. I work in a different city to where I live so I opted to defer it to this weekend when I can get a good run at it with my mind on the tasks. However, your contributions are being recorded correctly and will be included in the stats when I restore the processes in the next day or two.

2017-12-12, 13:18	#516
AMDave Jan 2006 deep in a while-loop 2²·167 Posts	NPLB stats database refresh rescheduled from every hour to 3-hourly to improve resource utilisation.

2017-12-12, 20:06	#517
rebirther Sep 2011 Germany 3,413 Posts	Some CRUS tables are also not updating and are empty.