mersenneforum.org > News 12 machines permanently sidelined: LL was better than PRP on storage space
 Register FAQ Search Today's Posts Mark Forums Read

 2021-08-21, 22:52 #1 ssybesma   "Steve Sybesma" May 2012 Brighton, CO USA 89 Posts 12 machines permanently sidelined: LL was better than PRP on storage space Unless you guys can come up with a way to limit the amount of storage PRP wants to eat up, I'm done with the GIMPS project as far as most of my machines. I have 20 machines and now 12 have been forced out. For a long time I was running Intel Compute Sticks (1GB RAM and 8GB storage) with a stripped down version of Peppermint OS and I had many completed LL tests doing it that way. It took about 4 months...and that was fine with me. Forcing PRP is the end of first-time testing for me...12 machines have to be taken offline permanently that can't do first-time tests. I didn't get into this project to do double-checks exclusively. Do you have any suggestion to limit what PRP uses to no more than 512MB of space? LL did not use that much storage space for its temp files. It was a fraction of what PRP uses. Last fiddled with by ssybesma on 2021-08-21 at 22:53
 2021-08-21, 23:32 #2 paulunderwood     Sep 2002 Database er0rr 34·53 Posts Have you thought about PXE booting SLAX Linux from one HDD? Last fiddled with by paulunderwood on 2021-08-21 at 23:37
2021-08-21, 23:48   #3
ssybesma

"Steve Sybesma"
May 2012
Brighton, CO USA

89 Posts
PXE booting

Quote:
 Originally Posted by paulunderwood Have you thought about PXE booting SLAX Linux from one HDD?
Ugh...I wouldn't even know how to begin doing that. You're saying one machine acts as a server for the smaller machines to run mprime on?

All I really need is a way to put a limitation on how much disk space the PRP checks consume.

If I can do that, I can do PRP checks with all my machines but they are still a little slower, but at least they won't freeze up my machines. A few months ago I figured out out to slim down Peppermint OS even more but it's not really enough to make PRP happy. It almost eats up everything you have, even if you make more space.

If I can put a hard limit on PRP disk space consumption to say 400MB, that would be ideal...that's all the temp files combined.

I think now that amount is way over 700MB and I've already removed 9 machines from the project so all the files are gone.

I still have 11 machines finishing up but those will all be forced onto PRP after they complete.

Last fiddled with by ssybesma on 2021-08-21 at 23:48

2021-08-22, 00:11   #4
paulunderwood

Sep 2002
Database er0rr

429310 Posts

Quote:
 Originally Posted by ssybesma Ugh...I wouldn't even know how to begin doing that. You're saying one machine acts as a server for the smaller machines to run mprime on?
Yes my first suggestion was a too drastic. Since you have Peppermint OS installed, why not set up a NFS to and from an HDD'd machine?

Last fiddled with by paulunderwood on 2021-08-22 at 00:19

 2021-08-22, 00:23 #5 Prime95 P90 years forever!     Aug 2002 Yeehaw, FL 23·3·5·67 Posts You can put "ProofPower=5" in prime.txt. This would limit disk usage to about 32*14MB = 448MB which will go up slowly as the first-test wavefront advances. You may also need to add "ProofPowerMult=1" Alternatively, if you have a reasonably sized network disk drive mounted, you can ask prime95 to store the temporary files on the network disk. I do this with several of my computers. Also: Tell prime95 to create fewer save files. Last fiddled with by Prime95 on 2021-08-22 at 00:25
2021-08-22, 00:27   #6
ssybesma

"Steve Sybesma"
May 2012
Brighton, CO USA

5916 Posts

Quote:
 Originally Posted by paulunderwood Yes my first suggestion was a too drastic. Since you have Peppermint OS installed, why not set up a NFS to and from an HDD'd machine?
OK, NFS being file sharing...that is setup. I can access files on any device from any another.

So how do I point mprime on each device to look at a folder on larger (more storage space) machine for its temp files?

That would certainly solve the problem.

Steve

Last fiddled with by ssybesma on 2021-08-22 at 00:27

 2021-08-22, 00:37 #7 paulunderwood     Sep 2002 Database er0rr 103058 Posts If the server is set up with something like /nfs_share/stick1, /nfs_share/stick2 etc then stick machine 1 accesses its share which contains all it needs for running mprime including the executable, Last fiddled with by paulunderwood on 2021-08-22 at 00:44
2021-08-22, 00:52   #9
ssybesma

"Steve Sybesma"
May 2012
Brighton, CO USA

89 Posts

Quote:
 Originally Posted by paulunderwood If the server is set up with something like /nfs_share/stick1, /nfs_share/stick2 etc then stick machine 1 accesses its share which contains all it needs for running mprime including the executable,

I get that part.
I haven't seen how to setup where mprime looks.
I assume that prime.txt or local.txt would hold the path to the individual destination folder where it will keep its files.
That seems like a VERY clean option you gave me and that way the PRP temp files can be as big as they want.
I assume not all of them are being accessed constantly at once but I have excellent network speed and not worried about the host machine's resources.

2021-08-22, 00:55   #10
kriesel

"TF79LL86GIMPS96gpu17"
Mar 2017
US midwest

686910 Posts

Quote:
 Originally Posted by ssybesma I get that part. I haven't seen how to setup where mprime looks.
./mprime -d
14
scroll through the choices, then at Advanced, say N don't skip

As a test I did this:
Code:
Your choice: 14

Consult readme.txt prior to changing any of these settings.

Temporary disk space limit in GB/worker (6.000000):
Upload bandwidth limit in Mbps (0.250000):
Upload large files time period start (00:00):
Upload large files time period end (24:00):
Skip advanced resource settings (Y): n
Optional directory to hold large temporary files: ./largetmp
Optional directory to hold archived proofs: ./archivedproofs
Daytime P-1/ECM stage 2 memory in GB (0.300000): 1
Nighttime P-1/ECM stage 2 memory in GB (0.300000): 1
Max emergency memory in GB/worker (1.000000):
Priority -- 1 is highly recommended, see readme.txt (1):
Certification work limit in % of CPU time (10):
Use hyperthreading for trial factoring (recommended) (Y):
Use hyperthreading for PRP, LL, P-1, ECM (not recommended) (N):

Accept the answers above? (Y): y
and afterward found in local.txt:
Code:
ProofResiduesDir=./largetmp
ProofArchiveDir=./archivedproofs
I did not find those Dir entries referenced in readme.txt or undoc.txt. Maybe I just missed them.
That's for splitting up the mprime storage space.
If you want it all on a file share, which would be simpler but maybe not quite the performance a split setup may offer, set up the share, cd to the share, as in a shell script, run from there, & don't set separate archive, temporary, or working directories in the mprime local.txt or prime.txt.

Last fiddled with by kriesel on 2021-08-22 at 01:07

2021-08-22, 00:59   #11
paulunderwood

Sep 2002
Database er0rr

10000110001012 Posts

Quote:
 Originally Posted by ssybesma I get that part. I haven't seen how to setup where mprime looks. I assume that prime.txt or local.txt would hold the path to the individual destination folder where it will keep its files. That seems like a VERY clean option you gave me and that way the PRP temp files can be as big as they want. I assume not all of them are being accessed constantly at once but I have excellent network speed and not worried about the host machine's resources.
The share becomes part of the local file system for the stick. With this extension, everything needed to run mprime -- ini, local,, GMP, temp files, proofs mprime -- are all stored on the share. From the client stick you just see another directory. -- set up to share from the server.; It is mounted by the client -- tested with the mount command and automated by an entry in the /etc/fstab.

Last fiddled with by paulunderwood on 2021-08-22 at 01:16

 Similar Threads Thread Thread Starter Forum Replies Last Post drkirkby Information & Answers 5 2021-02-12 08:41 hansl Computer Science & Computational Number Theory 23 2019-05-12 21:11 Arkadiusz Forum Feedback 19 2016-03-11 22:35 HellGauss Computer Science & Computational Number Theory 18 2015-11-16 14:21 moo Hardware 0 2005-11-23 03:16

All times are UTC. The time now is 13:26.

Tue Oct 4 13:26:37 UTC 2022 up 47 days, 10:55, 1 user, load averages: 1.30, 1.32, 1.27