mersenneforum.org Web server slow
 Register FAQ Search Today's Posts Mark Forums Read

 2005-04-20, 17:41 #1 HackMaster   Apr 2005 22 Posts Web server slow I noticed that your web server was acting very slow (slow: 3-10Kbps) for file downloads (the latest prime number and prime95 setup files). If you guys need any space to host files, or to offer a mirror, I can provide you with file and site mirrors. (price will probably be free if hosting credit is given) Last fiddled with by HackMaster on 2005-04-20 at 17:44
 2005-04-20, 19:13 #2 gribozavr     Mar 2005 Internet; Ukraine, Kiev 1100101112 Posts I can offer a mirror hosting too. All traffic is free for me from 16.00 UTC to 6.00 UTC. In a month or two I will be able to tell you if I could make it free during other time of day. Can you tell me how much traffic a month does meresenne.org have? My bandwidth: 64 Kbps. It would be good if you will provide me a domain name, something like ua.mersenne.org (I live in Ukraine!)
 2005-04-20, 23:11 #3 HackMaster   Apr 2005 410 Posts i have a dedicated Cable line doing 384Kbps. that is hooked up to a 30gb server, that i use for text transfers (like whole site backups). for file distributations, i have a OC-12 line. (hosting with a friend). For that, i have about 500 mb. and us.mersenne.org would be neat
2005-04-21, 04:53   #4
moo

Jul 2004
Nowhere

32916 Posts

Quote:
 Originally Posted by HackMaster i have a dedicated Cable line doing 384Kbps. that is hooked up to a 30gb server, that i use for text transfers (like whole site backups). for file distributations, i have a OC-12 line. (hosting with a friend). For that, i have about 500 mb. and us.mersenne.org would be neat
not fair ;) oc is so oc like lol "wishes for bw like that someday"

 2005-04-22, 04:45 #7 moo     Jul 2004 Nowhere 11001010012 Posts hack the problem is that the server regenerates the main page many many many times a day. also the web and database servers are located on the same server and on the hour it recomplies the entire database to generate stats. also its hosted in a datacenter but on a older duel p3 machine.
2005-04-22, 12:52   #9
gribozavr

Mar 2005
Internet; Ukraine, Kiev

40710 Posts

Quote:
 Originally Posted by Peter Nelson Although the prime95 software itself does not generate much traffic (however multiply this by about 50,000 machines) the other things on the server do. eg. web-based statistics, webserver for the project, ftp archive for software downloads etc.
As I pointed in my previous post, in the specified timeframe I don't care about the traffic.

Quote:
 Originally Posted by Peter Nelson Ideally a facility should be in a physically secure environment with UPS, fire detection and suppression, etc. The hardware should have redundant PSU, hot-swap/hot-spare RAID drives which will reduce problems due to the main causes of hardware failure. Ability to hardware reboot the server remotely when it crashes is also desirable and could be provided by eg an APC Masterswitch unit.
The servers (yes, there will be two) will stand at my home -- so any kind of hardware failture will be detected almost immediately. Software falitures are very improbable -- I use Linux with Apache as web server. Backups are already being regularly done.

Quote:
 Originally Posted by Peter Nelson The ftp server could be mirrored elsewhere, but to change the stats generation may require some backend work. It appears to be difficult to upgrade the existing server software in reasonable timescale (although some have tried moving towards v5).
I think that most traffic comes from the webserver and from the exponent lists. So we can mirror only them.

Quote:
 Originally Posted by Peter Nelson Moving/mirroring the ftp stuff will not solve this problem, but may be a good thing to do in any case.
I fully agree.

Quote:
 Originally Posted by Peter Nelson All of this is a world apart from hosting on a domestic DSL line, which is only appropriate for "wannabe" hosters. You don't see IBM or Microsoft hosting their site on DSL and there is a reason!
Though it is really an ADSL line, a whole home network will be using it in a week or less, so ISP was chosen very carefully.
(don't worry, I have upstream/downstream=64/64, so even if my people will be downloading files -- upstream busy, downstream will be free)

Quote:
 Originally Posted by Peter Nelson Although I like Ukraine as a country, I'm not convinced they have sufficient net infrastructure for this kind of thing. The exchange points at Amsterdam or London or Manchester (or somewhere directly linked into these) would be more sensible places to locate a European mirror site.
I can't understand, what's the difference between placing a server in Ukraine and in England: Internet is the same everywhere, 64k in Ukraine is the same as 64k in England. As I wrote above, if that ISP will not provide GOOD services, it will not be our ISP.

2005-04-22, 13:49   #10
HackMaster

Apr 2005

48 Posts

Quote:
 I can't understand, what's the difference between placing a server in Ukraine and in England: Internet is the same everywhere, 64k in Ukraine is the same as 64k in England. As I wrote above, if that ISP will not provide GOOD services, it will not be our ISP.
The internet is not a thing. Its a bit network. Your ISP must send its requests to the replying server. I will break it down for you for the way it happens for me to contact to the MIT server.
The connection must be sent to the server. It gets there by contacting the local Bellsouth main internet ring(which is a big loop of fiber opic line goin all around the usa. Its gonna find its way into the ring, go to the exit point that is closest to MIT, its gonna find its way to the MIT ISP, which will direct the request to the MIT HTTP server. Here is each step that the return communicaton takes to return.
Code:
 1  W92-RTR-1-W92SRV21.MIT.EDU (18.7.21.1)  0.508 ms  0.580 ms  0.257 ms
2  EXTERNAL-RTR-1-BACKBONE.MIT.EDU (18.168.0.18)  0.519 ms  0.443 ms  0.456 ms
3  ge-5-0-116.hsa2.Boston1.Level3.net (4.79.2.1)  0.415 ms  0.394 ms  0.372 ms
4  ae-1-56.mp2.Boston1.Level3.net (4.68.100.161)  0.643 ms  0.606 ms  0.694 ms
5  as-1-0.mp1.Miami1.Level3.net (64.159.0.1)  35.974 ms  35.170 ms as-0-0.mp2.Miami1.Level3.net (64.159.3.249)  35.046 ms
6  so-6-0-0.gar1.Miami1.Level3.net (4.68.112.42)  35.303 ms so-7-0-0.gar1.Miami1.Level3.net (4.68.112.46)  35.117 ms  35.076 ms
7  BELLSOUTH-TE.gar1.Level3.net (65.57.174.6)  43.291 ms BELL-SOUTH.gar1.Level3.net (65.57.174.2)  35.487 ms BELLSOUTH-TE.gar1.Level3.net (65.57.174.6)  39.413 ms
8  axr00mia-1-0-0.bellsouth.net (65.83.236.19)  35.307 ms axr00mia-0-0-0.bellsouth.net (65.83.236.17)  35.556 ms axr00mia-1-0-0.bellsouth.net (65.83.236.19)  35.350 ms
9  icx00jax-6-1-1.bellsouth.net (65.83.237.105)  43.322 ms  43.205 ms  43.006 ms
10  205.152.187.89 (205.152.187.89)  43.398 ms  43.135 ms  43.224 ms
Note, I am at school, so im directly connected, via T1, to the bellsouth link.
You may not have a good fiber line to me, for example. It does have to cross an ocean.
-----
One more note, I have the Cable line. Maximum download speed of 4Mbps and upload speeds of 384Kbps.

And i have been lucky. No computers failed.

I am only talking about mirroring your HTML files. That seem mostly static. Except for updates about new info found. nothing related to your other PrimeNet servers. only http://mersenne.org/, http://www.mersenne.org/prime**.txt, http://mersenne.org/gimps/p95v238.exe, and all the other OS versions.

ahh, whatever. i dont really care. I just would think that allowing your users to download the text files with the latest number, and the actual program with some speed. (For when you get /.ed) But I care not. I happened to find a copy of it on my file server from a previous install.

(i probably should note: "/." means to get slashdotted. Which means getting mentioned on http://slashdot.org and having millions of people visiting your site in minutes. see: http://www.thinkgeek.com/slashdotted/index.shtml

Last fiddled with by HackMaster on 2005-04-22 at 13:53

2005-04-22, 14:19   #11
gribozavr

Mar 2005
Internet; Ukraine, Kiev

11·37 Posts

Here's traceroute from my ISP's server to 205.152.187.89 (I can't traceroute from my computer because I haven't yet signed the contract with them):
Code:
 1  corporative (62.80.160.129)  1.104 ms  0.668 ms  0.613 ms
2  monthree (62.80.191.73)  2.464 ms  1.015 ms  0.792 ms
3  213.179.224.105 (213.179.224.105)  6.447 ms  3.339 ms  7.994 ms
4  195.5.5.254 (195.5.5.254)  7.813 ms  6.382 ms  3.449 ms
5  mgraz1-180-117.net.uta.at (212.152.180.117)  120.850 ms  117.249 ms  129.884 ms
6  c76vix2-g5-1.net.uta.at (212.152.192.98)  78.287 ms  74.622 ms  82.325 ms
7  212.73.202.137 (212.73.202.137)  81.665 ms  86.666 ms  97.814 ms
8  4.68.124.185 (4.68.124.185)  140.880 ms  133.339 ms  134.638 ms
9  as-1-0.bbr1.London2.Level3.net (212.187.128.61)  161.479 ms  162.096 ms  152.835 ms
10  as-0-0.bbr2.Washington1.Level3.net (4.68.128.102)  225.262 ms  219.843 ms  210.053 ms
11  as-1-0.mp1.Miami1.Level3.net (64.159.0.1)  200.294 ms as-0-0.mp2.Miami1.Level3.net (64.159.3.249)  210.021 ms  210.794 ms
12  so-7-0-0.gar1.Miami1.Level3.net (4.68.112.46)  255.528 ms  256.000 ms  262.219 ms
13  BELLSOUTH-TE.gar1.Level3.net (65.57.174.6)  283.751 ms  289.144 ms BELL-SOUTH.gar1.Level3.net (65.57.174.2)  179.695 ms
14  axr00mia-1-0-0.bellsouth.net (65.83.236.19)  294.233 ms axr00mia-0-0-0.bellsouth.net (65.83.236.17)  188.274 ms  179.702 ms
15  ixc00jax-6-0-1.bellsouth.net (65.83.237.93)  199.529 ms  187.728 ms  187.087 ms
16  205.152.187.89 (205.152.187.89)  303.421 ms *  267.958 ms
I think it's not bad -- only 6 more routers for crossing the ocean.

Quote:
 Originally Posted by HackMaster I am only talking about mirroring your HTML files. That seem mostly static. Except for updates about new info found. nothing related to your other PrimeNet servers. only http://mersenne.org/, http://www.mersenne.org/prime**.txt, http://mersenne.org/gimps/p95v238.exe, and all the other OS versions.
I meant that too.

 Similar Threads Thread Thread Starter Forum Replies Last Post Xyzzy Miscellaneous Math 62 2017-03-02 00:35 R.D. Silverman GMP-ECM 55 2011-10-16 17:28 petrw1 Hardware 13 2008-11-10 23:25 rudi_m Hardware 14 2005-10-11 03:31 Angular PrimeNet 32 2002-12-09 01:12

All times are UTC. The time now is 05:09.

Mon Oct 18 05:09:15 UTC 2021 up 86 days, 23:38, 0 users, load averages: 1.26, 1.09, 1.06