mersenneforum.org Improved params files for CADO
 Register FAQ Search Today's Posts Mark Forums Read

 2022-04-19, 16:19 #89 VBCurtis     "Curtis" Feb 2005 Riverside, CA 41×131 Posts Hello! The params for C195 from the post your quoted are good for the first phase of the job, poly select. This phase is about 5% of the total time of the job. You can start that part immediately, if you wish. I'm in the middle of a midterm week at work, so I might need a day or two to get a complete draft of sieving params for C195 posted here. Before I do: If you have no experience with factoring software, you really should run some smaller jobs to see how the software runs, how much memory it takes (and how memory scales with job size), etc. A C120 and a C140 are good starter sizes. Do you understand how long a C195 will take an individual user? Do you have a 64GB-memory machine to run the filtering & matrix steps, or the time to learn how to use CADO for poly select and sieving but msieve for the filtering & matrix steps (msieve will fit on 32GB for this size of job)? I think the factoring as a service thing was designed for RSA-512 sized keys, which take a modern desktop something like 20-40 core-days to factor. A C193 is a whole lot tougher than that- over 100 times harder.
2022-04-19, 16:51   #90
charybdis

Apr 2020

79710 Posts

Quote:
 Originally Posted by VBCurtis Do you understand how long a C195 will take an individual user? Do you have a 64GB-memory machine to run the filtering & matrix steps, or the time to learn how to use CADO for poly select and sieving but msieve for the filtering & matrix steps (msieve will fit on 32GB for this size of job)? I think the factoring as a service thing was designed for RSA-512 sized keys, which take a modern desktop something like 20-40 core-days to factor. A C193 is a whole lot tougher than that- over 100 times harder.
The idea of FAAS is to do the whole thing in the cloud using msieve for the matrix, so access to suitable hardware won't be an issue in itself. The major obstacle is cost. In the original FAAS paper it cost $75 to factor a 512-bit key, so this c193 would set Thornado123 back thousands of dollars. IMO that's a lot to spend for a proof-of-concept that doesn't really advance the state of the art. Note that a 210-digit GNFS was done mainly in the cloud even before the FAAS paper came out.  2022-04-20, 06:16 #91 thornado123 Apr 2022 3 Posts Thanks @VBCurtis! Mhh sounds reasonable, I will start by factoring some smaller numbers to check my setup. If we are talking ~3K$ then it is okay with me. The big question is what a realistic time estimate would be? (if we use computing power in the a few thousands dollar) Best regards?
2022-04-20, 12:03   #92
charybdis

Apr 2020

797 Posts

Quote:
 Originally Posted by thornado123 The big question is what a realistic time estimate would be? (if we use computing power in the a few thousands dollar)
That depends on how many cores you're able to use at a time; I haven't used cloud computing myself so I'm not sure what a realistic number would be. But for a sense of scale, I'm currently running an SNFS job of a similar difficulty (actually probably slightly easier) using ~130 threads. I estimate the step that takes the most CPU-time, the sieving step, will take 20 days in total. Postprocessing adds another ~10% (more if you want to use MPI to do the matrix in a very short wall-clock time), you're doing GNFS which adds another ~5% for polynomial selection, your number is probably a bit harder than mine so let's add ~20% for that. That gets us to ~3600 CPU-days, and that's before considering whether the Amazon EC2 cores are slower than mine.

So you could run ~40 cores for ~100 days, but maybe that's too slow for you. To do 193-digit GNFS in a day or two you'll need thousands of cores for the sieving step, and then for linear algebra you'll need either a similar-sized MPI cluster - not sure if you can get hold of that via the cloud - or more likely a very powerful GPU; see the Msieve GPU linear algebra thread for details on that.

2022-04-20, 13:05   #93

Apr 2022

3 Posts

Quote:
 Originally Posted by charybdis That depends on how many cores you're able to use at a time; I haven't used cloud computing myself so I'm not sure what a realistic number would be. But for a sense of scale, I'm currently running an SNFS job of a similar difficulty (actually probably slightly easier) using ~130 threads. I estimate the step that takes the most CPU-time, the sieving step, will take 20 days in total. Postprocessing adds another ~10% (more if you want to use MPI to do the matrix in a very short wall-clock time), you're doing GNFS which adds another ~5% for polynomial selection, your number is probably a bit harder than mine so let's add ~20% for that. That gets us to ~3600 CPU-days, and that's before considering whether the Amazon EC2 cores are slower than mine. So you could run ~40 cores for ~100 days, but maybe that's too slow for you. To do 193-digit GNFS in a day or two you'll need thousands of cores for the sieving step, and then for linear algebra you'll need either a similar-sized MPI cluster - not sure if you can get hold of that via the cloud - or more likely a very powerful GPU; see the Msieve GPU linear algebra thread for details on that.
Mhh exciting! I don't need to do it in days 20-30 days would be fine by me. I will looking into the GPU thread though :)

I will do a test tonight on some smaller numbers and see how my setup preforms. Thanks for the answer!

2022-06-27, 23:22   #94
orever

Oct 2019

5 Posts

Quote:
 Originally Posted by thornado123 Mhh exciting! I don't need to do it in days 20-30 days would be fine by me. I will looking into the GPU thread though :) I will do a test tonight on some smaller numbers and see how my setup preforms. Thanks for the answer!
Have you tried to see if http://factordb.com/ has the number you want to factor?

Last fiddled with by Uncwilly on 2022-06-28 at 03:26 Reason: removed excessive blank lines.

2022-06-27, 23:26   #95
orever

Oct 2019

5 Posts

Quote:
 Originally Posted by thornado123 Mhh exciting! I don't need to do it in days 20-30 days would be fine by me. I will looking into the GPU thread though :) I will do a test tonight on some smaller numbers and see how my setup preforms. Thanks for the answer!

Is this another case of a secret number or can you say the number?

Maybe with ECM you can factor faster, or is it an RSA key?

 2022-08-10, 05:58 #96 bur     Aug 2020 79*6581e-4;3*2539e-3 3·193 Posts Have you ever posted a draft for C155? I thought so, but now I can't find it. Thanks. Last fiddled with by bur on 2022-08-10 at 06:00
 2022-08-10, 06:04 #97 kruoli     "Oliver" Sep 2017 Porta Westfalica, DE 108610 Posts Here is one.
 2022-08-10, 19:04 #98 VBCurtis     "Curtis" Feb 2005 Riverside, CA 10100111110112 Posts I return home Saturday, I ought to be able to post a faster one Sunday for C150 and C155. I was nearly done refining C100-C130 params when I left on this trip; C135-C155 I still have more data to take to see if my "improvements" are noise or actually faster. I'm trying harder this round to make parameters change steadily from file to file, which makes it easier to extend to 150-170 digits sizes with reasonable guesses.

 Similar Threads Thread Thread Starter Forum Replies Last Post Xyzzy Forum Feedback 3 2018-12-30 19:37 jasonp Operation Kibibit 5 2014-09-07 11:02 skan Information & Answers 1 2013-10-22 07:00 jasong GMP-ECM 11 2007-05-30 03:08 eepiccolo Lone Mersenne Hunters 3 2003-04-12 02:04

All times are UTC. The time now is 07:32.

Thu Aug 11 07:32:19 UTC 2022 up 35 days, 2:19, 2 users, load averages: 2.11, 1.74, 1.42