mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > PrimeNet

Reply
 
Thread Tools
Old 2009-11-16, 20:57   #1
Prime95
P90 years forever!
 
Prime95's Avatar
 
Aug 2002
Yeehaw, FL

2×5×23×31 Posts
Default New Server Plan

The GIMPS Board of Director's has approved purchasing a new server. But first we are looking for anyone with expertise in server hardware, server configuration, or database planning / disaster recovery to examine our plan and suggest improvements.

What follows is a brief outline of our plan to purchase a new server for database only - converting our existing server to web traffic only.


1. Priorities

a) Reasonable Cost, b) Data protection,
c) Reliability, d) Performance.
(Data protection also implies roomy capacity.)

2. Plan Summary

a) We will buy a powerful new database server having VM hosting capability and RAID6 as a DB-only tier, convert/upgrade our existing ISP-loaned server to a x64 web-only tier, convert/upgrade the old v4 RAID5 server as a x86 DB backup, add an external RAID5 array device as a third database/file backup store.

b) We presently own none of our servers. The old v4 server will be donated and become the first GIMPS asset, the purchased DB server the second, the external RAID5 the third asset.

3a. Proposed hardware

http://ecomm.dell.com/dellstore/bask...t@mersenne.org


3b. Proposed software

Windows Server 2008 Datacenter Edition x64 OS: $120
(for production DB server)

SQL Server 2008 x64 or x86: $240 x 3 CPUs = $720
(2x for production DB server, 1x for roll-forward backup DB server )

Windows Server 2008 Web Edition x64 or x86 OS: $19 x 2 servers = $38
(1x for DB server VM image, 1x for ISP-loaner)

Windows Server 2003 Std Ed x86: $40
(for roll-forward backup DB server)

Windows Remote Desktop Services User CAL: 5 x $6 = $30

Microsoft FrontPage 2003: 1 x $7


4. Disaster Plan

a) If ISP-loaned web server is reclaimed by the ISP or breaks, we load a VM web server into the DB server to handles the web tier traffic until we can purchase a replacement, or the ISP loans a suitable alternate server. In practice we should have the VM web server image preloaded on the DB server, but not running.

b) If our new primary DB server breaks, we get it fixed ASAP and we are down until it gets fixed.

c) The new primary DB server's SQL service will be brought offline for an hour or so every 3 months for an offline file snapshot to the external RAID5 array. These serve also as roll-forward starting points for the backup DB.

d) The new primary SQL DB server will regularly and automatically ship its logs to the external RAID5 array. The backup SQL DB server (donated v4 server) will reach over and roll-forward these logs to maintain a mostly-current second SQL DB.

e) If our primary SQL DB becomes damaged or lost, we have the backup SQL DB available to copy back onto the new SQL DB server, having lost only the transactions not yet shipped and rolled-forward in the backup DB.

f) If our backup SQL DB becomes damaged or lost, we have the snapshots and logs in the external RAID5 from which to reload the most recent DB snapshot and roll-forward to catch it up again.

g) If our external RAID5 DB file copies become damaged or lost, we produce a fresh offline snapshot and start the logs shipping onto it again.

h) Other data safety options - include shipping the SQL DB snapshots and logs using scripts or other tools to other remote storage and/or SQL server instances.
Prime95 is offline   Reply With Quote
Old 2009-11-16, 22:29   #2
sdbardwick
 
sdbardwick's Avatar
 
Aug 2002
North San Diego County

23·5·17 Posts
Default

Does the size of the data set render SSDs impractical?
Most DB systems are I/O bound rather than processor bound, so simply upgrading the storage subsystem can have a dramatic (in some cases miraculous) effect. I witnessed one case where reports that took 2.5 minutes on a short-stroked* 6 drive RAID 5 (Seagate 15K.5 SCSI) popped out in 3 seconds on a 4 SSD RAID01 (mirrored stripes), without any further opimization or any other hardware changes.
IIRC, the total hardware cost was around $2K (they could use MLC SSD's because operations resulted in few writes, but many reads); the look of astonishment on the client's face was priceless.

NB: I was only involved in hardware setup in that instance, so I didn't get a chance to see where in the process the time savings happened, or even see if there was some oddity in their data access patterns that SSDs especially benefited, nor do I know how much removing the parity calculation and writes affected the results (my gut says very little, as the report generation involved very few writes).



*Short-stroked: The HD were configured to only use the outer 1/2 of the platters to increase sustained data transfer rate and decrease access time.
sdbardwick is offline   Reply With Quote
Old 2009-11-16, 22:51   #3
Prime95
P90 years forever!
 
Prime95's Avatar
 
Aug 2002
Yeehaw, FL

2·5·23·31 Posts
Default

Quote:
Originally Posted by sdbardwick View Post
Does the size of the data set render SSDs impractical?
Most DB systems are I/O bound rather than processor bound.
My concern is SSDs are impractical from a cost point of view. We are a 501c3 charity that isn't exactly flush with extra cash.

I agree with your concern, which is why we're loading it up with 32GB of memory. Hopefully, this will keep a good percent of the DB in RAM.

The current server has a measly 2GB.
Prime95 is offline   Reply With Quote
Old 2009-11-16, 23:25   #4
Uncwilly
6809 > 6502
 
Uncwilly's Avatar
 
"""""""""""""""""""
Aug 2003
101×103 Posts

23×1,087 Posts
Default

I would also suggest that there be a physical seperation of the data back-ups. If Scott can send you a USB drive in the mail every month or so, that would ensure that if California slides off into the Pacifc that you can restart the system. And when you get a USB drive from him, you send him the old one with all of the latest developement files.
Cost ~$50 per annum.
Uncwilly is offline   Reply With Quote
Old 2009-11-17, 00:08   #5
axn
 
axn's Avatar
 
Jun 2003

2·13·181 Posts
Default

How many databases are there and how big are they? Depending on the db size, 32GB might be overkill.

Also, save $400 by dropping down one CPU grade

Are you locked in to SQL server or is an in-memory database (line Oracle TimesTen) an option?

Finally, please look into SQL Server mirroring for near realtime failover.
axn is offline   Reply With Quote
Old 2009-11-17, 01:16   #6
Prime95
P90 years forever!
 
Prime95's Avatar
 
Aug 2002
Yeehaw, FL

157328 Posts
Default

Quote:
Originally Posted by axn View Post
How many databases are there and how big are they? Depending on the db size, 32GB might be overkill.

Also, save $400 by dropping down one CPU grade

Are you locked in to SQL server or is an in-memory database (line Oracle TimesTen) an option?

Finally, please look into SQL Server mirroring for near realtime failover.
DB is currently 25GB.

We are locked into SQL server -- too much code would require a rewrite.
Prime95 is offline   Reply With Quote
Old 2009-11-17, 06:12   #7
S485122
 
S485122's Avatar
 
Sep 2006
Brussels, Belgium

2·787 Posts
Default

Quote:
Originally Posted by axn View Post
Also, save $400 by dropping down one CPU grade
The E5520 is indeed the CPU you want : it is more energy efficient and except for a few MHz has the same characteristics as the E5530 or the E5540.

Jacob
S485122 is offline   Reply With Quote
Old 2009-11-17, 06:30   #8
RMAC9.5
 
RMAC9.5's Avatar
 
Jun 2003

32×17 Posts
Default Ask some open source MySQL Developers for Input

The open source MySQL data base is free and has a really good reputation for really good performance. As far as I know, both SQL Server and MySQL use industry standard SQL commands for data input, data queries, etc. In other words, the existing GIMPS SQL code should be reusable or nearly reusable. Also, some of the data base geeks who develop and maintain the MySQL data base would probably help solve any problems that developed.

Using MySQL also gives you the flexibility to run Linux as the DB server's O/S (a $120 cost savings) and Linux/Apache for the web server (for an additional cost savings?).

Last fiddled with by RMAC9.5 on 2009-11-17 at 06:32
RMAC9.5 is offline   Reply With Quote
Old 2009-11-17, 08:59   #9
RMAC9.5
 
RMAC9.5's Avatar
 
Jun 2003

9916 Posts
Default What about building instead of buying?

Is Scott or whomever is physically closest to the current server willing to build the new server?
Here are some NewEgg example prices for the most expensive components:
Case - Cooler Master HAF 932 RC-932-KKN1-GP, full tower, 4 fans ATX $139.99
MB - Asus Z8NA-D6C, ATX, dual Xeon 5500 series CPU, DDR3 1333 $259.99
Power supply - Cooler Master UCP RS700-AAAAA3, 700 watt, 80+ silver $129.99
RAM - Super Talent W14RX12GH, 24 GB (6x4 GB) DDR3 1333, ECC Reg. $729.98
CPUs - 2 Intel Xeon E5520, 2.26 GHZ, LGA 1366, 80 watt, quad core $767.98
HDs - 4 Western Digital Caviar Green, 750 GB, SATA 3.0, 32 MB cache $239.96
Raid - Highpoint RocketRAID 2540x4, 4 port, SATA II, PCI-e x4 $ 99.99
Total cost @ 11/17/09 $2367.88 + shipping.

Note, no real attempt was made to maximize the savings. I picked quality
components and tried to make sure that they were compatible with each other.
RMAC9.5 is offline   Reply With Quote
Old 2009-11-17, 09:58   #10
Xyzzy
 
Xyzzy's Avatar
 
"Mike"
Aug 2002

7,699 Posts
Default

Offset the cost of the new server by auctioning off the old server.

"Own a piece of history!"
Xyzzy is offline   Reply With Quote
Old 2009-11-17, 14:56   #11
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

2×4,643 Posts
Default

Quote:
Originally Posted by RMAC9.5 View Post
The open source MySQL data base is free and has a really good reputation for really good performance. As far as I know, both SQL Server and MySQL use industry standard SQL commands for data input, data queries, etc. In other words, the existing GIMPS SQL code should be reusable or nearly reusable. Also, some of the data base geeks who develop and maintain the MySQL data base would probably help solve any problems that developed.
I agree with and would like support this argument / suggestion.

My cluster controller is a 1 GHz single core server with only 1 GB of RAM running LAMP (Linux / Apache / MySQL / Perl). While my "Exponents" table doesn't have the full dataset yet, it is 6 GB in size, with another 3 GB of indexes.

Recently it (much to my surprise) sustained over 1400 assignments / results a minute to my ~90 computer cluster for several hours. "Load" never went over 1....

Last fiddled with by chalsall on 2009-11-17 at 15:01 Reason: Added "single core"
chalsall is online now   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
My plan for RSA factoring distributed computing stathmk Open Projects 37 2019-12-08 04:36
A man, a plan, a cat, a ham, a yak, a yam, a hat, a canal--Panama! Xyzzy Math 5 2015-11-04 17:19
Intel offers processor overclocking protection plan Jeff Gilchrist Hardware 0 2012-01-23 01:54
v5 alpha and beta testing game plan Prime95 PrimeNet 77 2008-08-30 18:08
New Server Hardware and price quotes, Funding the server Angular PrimeNet 32 2002-12-09 01:12

All times are UTC. The time now is 01:07.

Tue Oct 20 01:07:37 UTC 2020 up 39 days, 22:18, 0 users, load averages: 2.13, 2.08, 2.15

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.