Auto-add Computers?

ConstipatedNinj · 2015-11-30, 20:34

Howdy!

I work in HPC and I would really love to donate some extra cycles from our systems, but the setup for it seems a bit... involved. I'd rather not manually run the setup for each and every one of our ~4000 hosts to make sure it all reports correctly. Is there anyone who has successfully set up GIMPS as a PBS job who might be able to help me out?

I have a couple of ideas on how to do it automatically (largely through abuse of expect commands), but I wanted to know if there was a more elegant option.

Thanks for your time!

Xyzzy · 2015-11-30, 22:58

Please make sure you have permission first! (The electrical and cooling cost increase will not be trivial!)

ConstipatedNinj · 2015-12-01, 01:08

I do indeed! I already do something similar for folding@home.

In fact, it's generally appreciated when we submit a bunch of super-low-priority jobs, because it bumps up our cluster utilization percentages and gets our CIO more interested in putting down money for another cluster.

kladner · 2015-12-01, 05:47

Quote:

Originally Posted by ConstipatedNinj

I do indeed! I already do something similar for folding@home.

In fact, it's generally appreciated when we submit a bunch of super-low-priority jobs, because it bumps up our cluster utilization percentages and gets our CIO more interested in putting down money for another cluster.

ConstipatedNinj · 2015-12-01, 20:33

I know it's dumb, but boy, if the difference between say 83% utilization and 92% utilization is another 200 nodes to next year's cluster and the extra utilization is actually going to a good cause, I don't lose any sleep

But I take it that there's nobody who has done it in this format?

chalsall · 2015-12-01, 20:44

Quote:

Originally Posted by ConstipatedNinj

But I take it that there's nobody who has done it in this format?

Let's run a thought experiment...

If you have this much compute available then you will want to be identified.

Hmmmm....

ConstipatedNinj · 2015-12-01, 21:09

Quote:

Originally Posted by chalsall

Let's run a thought experiment...

If you have this much compute available then you will want to be identified.

Hmmmm....

I'm really sorry, but I don't think I quite understand what you're saying.

Are you saying that I'm making myself a target, are you saying that others wouldn't talk because they don't want to become a target, are you saying that anyone who would have done this would have talked about it before, or did you mean something entirely else?

blip · 2015-12-01, 21:33

Quote:

Originally Posted by ConstipatedNinj

Howdy!

I work in HPC and I would really love to donate some extra cycles from our systems, but the setup for it seems a bit... involved. I'd rather not manually run the setup for each and every one of our ~4000 hosts to make sure it all reports correctly. Is there anyone who has successfully set up GIMPS as a PBS job who might be able to help me out?

I have a couple of ideas on how to do it automatically (largely through abuse of expect commands), but I wanted to know if there was a more elegant option.

Thanks for your time!

The setup is quite simple and can be fully automated. What OS are you running on those hosts?

ConstipatedNinj · 2015-12-01, 21:48

Quote:

Originally Posted by blip

The setup is quite simple and can be fully automated. What OS are you running on those hosts?

I agree with your statement. After doing it manually once, I immediately had a few ideas of how to automate it. I was just reaching out because why reinvent the wheel.

The majority of our systems are RHEL, but we do have a wide variety of different flavors of linux for special use cases.

blip · 2015-12-01, 22:50

See this thread for init file and logging on linux flavours. I assume you have something like cfengine or puppet to distribute software and configs. prime.txt and local.txt are host-specific, but I do not know what would a minimum set-up here, or how to create a batch of IDs beforehand. Also, you would need to insert some system info (CPU freq, memory) there as well. Mprime generates some of this info on first start.

kladner · 2015-12-01, 22:57

Quote:

Originally Posted by ConstipatedNinj

I know it's dumb, but boy, if the difference between say 83% utilization and 92% utilization is another 200 nodes to next year's cluster and the extra utilization is actually going to a good cause, I don't lose any sleep

But I take it that there's nobody who has done it in this format?

I was only amused, not making fun. It's just the reference to budget battles that tickled me.

2015-11-30, 20:34	#1
ConstipatedNinj Nov 2015 9₁₆ Posts	Auto-add Computers? Howdy! I work in HPC and I would really love to donate some extra cycles from our systems, but the setup for it seems a bit... involved. I'd rather not manually run the setup for each and every one of our ~4000 hosts to make sure it all reports correctly. Is there anyone who has successfully set up GIMPS as a PBS job who might be able to help me out? I have a couple of ideas on how to do it automatically (largely through abuse of expect commands), but I wanted to know if there was a more elegant option. Thanks for your time!

2015-12-01, 22:50	#10
blip Jan 2014 222₈ Posts	See this thread for init file and logging on linux flavours. I assume you have something like cfengine or puppet to distribute software and configs. prime.txt and local.txt are host-specific, but I do not know what would a minimum set-up here, or how to create a batch of IDs beforehand. Also, you would need to insert some system info (CPU freq, memory) there as well. Mprime generates some of this info on first start. Last fiddled with by blip on 2015-12-01 at 22:54

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Auto-XYYXF tool	fivemack	NFS@Home	3	2016-07-06 04:01
auto off/on machines	wildrabbitt	Hardware	3	2016-05-14 16:31
Auto scroll and auto maximize worker windows ?	wyattwong	Software	3	2011-02-25 20:20
Spammer auto-ban system?	10metreh	Forum Feedback	6	2009-08-24 17:35
Auto updates from mprime	rgiltrap	Linux	1	2007-01-08 22:33

2015-11-30, 22:58	#2
Xyzzy Aug 2002 10000101101101₂ Posts	Please make sure you have permission first! (The electrical and cooling cost increase will not be trivial!)

2015-12-01, 01:08	#3
ConstipatedNinj Nov 2015 3² Posts	I do indeed! I already do something similar for folding@home. In fact, it's generally appreciated when we submit a bunch of super-low-priority jobs, because it bumps up our cluster utilization percentages and gets our CIO more interested in putting down money for another cluster.

2015-12-01, 20:33	#5
ConstipatedNinj Nov 2015 3² Posts	I know it's dumb, but boy, if the difference between say 83% utilization and 92% utilization is another 200 nodes to next year's cluster and the extra utilization is actually going to a good cause, I don't lose any sleep But I take it that there's nobody who has done it in this format?