mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > PrimeNet > GPU to 72

Reply
 
Thread Tools
Old 2014-11-19, 04:31   #3158
kladner
 
kladner's Avatar
 
"Kieren"
Jul 2011
In My Own Galaxy!

9,923 Posts
Default

Just sayin': two factors since I got into the DC catch-up project.
kladner is offline   Reply With Quote
Old 2014-11-19, 14:13   #3159
Chuck
 
Chuck's Avatar
 
May 2011
Orange Park, FL

84510 Posts
Default

Is the procedure to send out DC work when needed to people selecting "Let GPU72 Decide" in effect?
Chuck is offline   Reply With Quote
Old 2014-11-19, 15:04   #3160
Mark Rose
 
Mark Rose's Avatar
 
"/X\(‘-‘)/X\"
Jan 2013
Ͳօɾօղէօ

532 Posts
Default

Quote:
Originally Posted by Chuck View Post
Is the procedure to send out DC work when needed to people selecting "Let GPU72 Decide" in effect?
It's probably not needed at the moment, given all the people manually working on DCTF. We still need work happening on TF.
Mark Rose is offline   Reply With Quote
Old 2014-11-19, 15:53   #3161
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

23·17·67 Posts
Default

Quote:
Originally Posted by Chuck View Post
Is the procedure to send out DC work when needed to people selecting "Let GPU72 Decide" in effect?
It isn't, but as Mark said, it's not needed.
chalsall is online now   Reply With Quote
Old 2014-11-19, 16:55   #3162
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

23·17·67 Posts
Default

Quote:
Originally Posted by Mark Rose View Post
The cg1.4xlarge is only available in us-east-1 and eu-west-1. Of those, only in one available zone in us-east-1 has the spot price been hovering around $0.135.
Mark: on a releative tangent... You have a lot more experience with EC2 than I; do you (or others) have any theory as to why there is such a huge discrepency in pricing between us-east-1d (currently ~$0.1342) and us-east-1c (~$2.10)? That's over 15 times!

I know there have been some studies on this; do you (or anyone) have any good references? (I'm just intriqued is all.)
chalsall is online now   Reply With Quote
Old 2014-11-19, 19:39   #3163
Primeinator
 
Primeinator's Avatar
 
"Kyle"
Feb 2005
Somewhere near M50..sshh!

2·3·149 Posts
Default

Quote:
Originally Posted by chalsall View Post
Yup. Just sign up to EC2, spin up an instance which can support NVideo CUDA (there are a bunch free ones; choose your faviorate distro) on a cg1.4xlarge instance type, install CUDA (and apply security updates, etc).

Next, create a new 1GB volume, and amoung other customizations change /etc/fstab to include a line which reads "/dev/sdf1 /home ext4 noauto,noatime 1 0", and then attach this to your instance (by default it will be "/dev/sdf"). Use "fdisk /dev/sdf" to create a single linux partition, and then "mkfs.ext4 /dev/sdf1".

Now, copy (with the archive flag) the existing "/home/ec2-user" directory to "/tmp/" Lastly "mount /home" should bring the newly created partition online. Move (or copy) the "/tmp/ec2-user" directory to "/home".

"shutdown -r now", log back into the instance, and execute "sudo mount /home". Make sure the new home partition mounts correctly.

If it does, then install all your desired mfaktc software in two seperate directories (including any submission / fetching spiders desired, and create the related cronjobs) and give it a go. Launch two mfaktc instances (the second with "-d 1"). You may also want to install an instance of mprime as well.

If everything's working the way you want then "Create Image" from the "Instances" tab. This will create a custom AMI which you'll boot from in the future (thus avoiding the need to install CUDA and the software each time.

Note that, importantly, the AMI file system is ***NOT*** preserved between instance creations; this is the reason for the extra volume created for "/home" -- mounted volume's are preserved.

Oh, and know that spot instances can go away at any time without notice. But, they're dirt cheap; I usually bid at $0.15 per hour, and often have one (or more) instances up for many days paying on average $0.135 an hour.

It's actually relatively easy to do.
Thanks! I am going to look into this.
Primeinator is offline   Reply With Quote
Old 2014-11-19, 20:28   #3164
Mark Rose
 
Mark Rose's Avatar
 
"/X\(‘-‘)/X\"
Jan 2013
Ͳօɾօղէօ

532 Posts
Default

Quote:
Originally Posted by chalsall View Post
Mark: on a releative tangent... You have a lot more experience with EC2 than I; do you (or others) have any theory as to why there is such a huge discrepency in pricing between us-east-1d (currently ~$0.1342) and us-east-1c (~$2.10)? That's over 15 times!

I know there have been some studies on this; do you (or anyone) have any good references? (I'm just intriqued is all.)
Amazon has never said specifically the algorithm behind the spot pricing. People who have looked more into it than I have come up with some speculations that make sense though.

Spot pricing is basically for unused reserved instances. People buy reserved instances for two reasons: one, if running most of the time, they save money; and two, they get first dibs on capacity, ahead of on-demand and spot. However, they don't have to be fully using their reserved instances. These unused instances can be sold on the spot market.

Amazon sets a floor on spot capacity, my guess is to cover the electrical cost of having the machine run. If there are sufficient spot requests to run all the spot capacity for an instance type, the highest bids win. Some people may set a higher than on-demand spot price to take advantage of low pricing most of the time, while also have a better chance to keep their instance running if capacity becomes constrained.

If all the reserved instances are in use, and the least-winning spot bid is at the on-demand price, on-demand capacity can be used to fulfill spot requests. The on-demand price for a cg1.4xlarge is currently $2.10 in us-east-1. In the one zone that has no spot capacity (probably no instances are reserved, because most people are using the g2.2xlarge instances), so the spot price is the on-demand price.

In the other two zones, one has a slightly higher bid price, likely because someone is willing to pay more to keep their spot instances in the same zone (with other spot instances or otherwise).

In eu-west-1 my guess is no one has unused reserved instances, so there is no spot capacity.
Mark Rose is offline   Reply With Quote
Old 2014-11-19, 23:13   #3165
TheMawn
 
TheMawn's Avatar
 
May 2013
East. Always East.

11×157 Posts
Default

So what exactly happened to that one-year buffer we had? I never really understood how we suddenly had a larger demand for DC's...
TheMawn is offline   Reply With Quote
Old 2014-11-19, 23:29   #3166
Mark Rose
 
Mark Rose's Avatar
 
"/X\(‘-‘)/X\"
Jan 2013
Ͳօɾօղէօ

532 Posts
Default

Quote:
Originally Posted by TheMawn View Post
So what exactly happened to that one-year buffer we had? I never really understood how we suddenly had a larger demand for DC's...
Basically, this thread: http://www.mersenneforum.org/showthread.php?t=19823

George changed it so that new users get DCLL instead of LL by default for various reasons. Instead of 50ish DC being requested per day, it jumped to 1000 per day. 90% of those will be recycled, so the rate will drop to 150ish per day, after 60 days (mid January).
Mark Rose is offline   Reply With Quote
Old 2014-11-20, 02:30   #3167
Uncwilly
6809 > 6502
 
Uncwilly's Avatar
 
"""""""""""""""""""
Aug 2003
101×103 Posts

837310 Posts
Default

Quote:
Originally Posted by chalsall View Post
Yup. Just sign up to EC2, spin up an instance which can support NVideo CUDA (there are a bunch free ones; choose your faviorate distro) on a cg1.4xlarge instance type, install CUDA (and apply security updates, etc).
If I could understand this (all), I would likely spend about $30 a month toward the 100M digit range.
Uncwilly is online now   Reply With Quote
Old 2014-11-20, 13:37   #3168
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

911210 Posts
Default

Quote:
Originally Posted by Uncwilly View Post
If I could understand this (all), I would likely spend about $30 a month toward the 100M digit range.
It really is quite easy. I'd suggest you sign up for EC2, and experiment with their "Free Teir" offer; gives you two "t1.micro" instances (one Linux and one Winblows) to experiement with for a year for free. Not powerful enough to do much LL'ing (and no GPU'ing), but a good way to get comfortable with the UI, creating and mounting volumes, etc.

If you're interested, I could probably figure out how to export my AMI (already configured with CUDA) for you to use.
chalsall is online now   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Status Primeinator Operation Billion Digits 5 2011-12-06 02:35
62 bit status 1997rj7 Lone Mersenne Hunters 27 2008-09-29 13:52
OBD Status Uncwilly Operation Billion Digits 22 2005-10-25 14:05
1-2M LLR status paulunderwood 3*2^n-1 Search 2 2005-03-13 17:03
Status of 26.0M - 26.5M 1997rj7 Lone Mersenne Hunters 25 2004-06-18 16:46

All times are UTC. The time now is 14:32.

Wed Aug 5 14:32:55 UTC 2020 up 19 days, 10:19, 1 user, load averages: 2.33, 1.83, 1.72

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.