20210520, 15:23  #34 
"Curtis"
Feb 2005
Riverside, CA
1001100000000_{2} Posts 
As you go up in relations, you will go up in TD too.
I think if you do this for 190 vs 195 vs 200M rels you'll find out the interesting parts about how extra sieving > higher TD > smallerer matrix > possible saved time overall. If TD 110 fails to build a matrix, try 105? If you work from the top down, you won't need to try all the TDs for all the rels sizes the idea is to locate the largest TD that works for each relation set, as that "should" save the most time. I don't think you can run multiple copies of filtering at the same time unless you're really careful about specifying all the output file names to be different for each copy; else they'll trample each other. 
20210520, 16:19  #35 
"Curtis"
Feb 2005
Riverside, CA
2^{8}·19 Posts 

20210522, 06:50  #36 
Aug 2020
2^{2}·3·5^{2} Posts 
Unfortunately you were right about the simultaneous runs, I hardlinked the rels.dat file to different directories, as I thought it was only read from. But apparently the processes want write access to it, because they all quit at the first singleton removal with an error about writing access. I should build an HDD into that computer...
But if working down from TD=110 on 190,195,200 is sufficient, then it's not too many tests anyway. 
20210522, 12:25  #37  
Apr 2020
365_{10} Posts 
Quote:


20210523, 06:56  #38 
Aug 2020
454_{8} Posts 
Here are the results, no major gains, but if using more than 10 cores it will be worth to use 195/105 instead of 190/95. On my 10 core i9 the sieving would take 3:30 h longer with 2:40 h saved at LA, so already at 20 cores it would help a bit.
200M rels / TD=110 Code:
commencing 2way merge reduce to 15092846 relation sets and 14808858 unique ideals commencing full merge memory use: 682.9 MB found 21197 cycles, need 3146938 too few cycles, matrix probably cannot build Code:
matrix is 7010462 x 7010687 (2900.8 MB) with weight 774175808 (110.43/col) sparse part has weight 690320583 (98.47/col) [...] linear algebra completed 70075 of 7010687 dimensions (1.0%, ETA 11h36m) Code:
matrix is 7353588 x 7353812 (3046.7 MB) with weight 812669648 (110.51/col) sparse part has weight 725127644 (98.61/col) [...] linear algebra completed 73595 of 7353812 dimensions (1.0%, ETA 12h49m] Code:
commencing 2way merge reduce to 17035108 relation sets and 16791673 unique ideals commencing full merge memory use: 776.3 MB found 80952 cycles, need 3526279 too few cycles, matrix probably cannot build Code:
matrix is 8132721 x 8132946 (3102.7 MB) with weight 822289451 (101.11/col) sparse part has weight 732019314 (90.01/col) [...] linear algebra completed 81232 of 8132946 dimensions (1.0%, ETA 15h30m) 
20210527, 07:00  #39 
Aug 2020
300_{10} Posts 
The c159 is in progress, found 65 % of the relations. One thing I notice compared to the c163 is that the number of relations per q decreases strongly. Already at q ~ 29e6 it's only 35,000 rels per 10,000 range, whereas with the c163 it still was 35,000 rels at q ~ 66e6. The c159 will end up at q around 43e6.
So apparently that was a lucky polynomial with the c163. I am not sure if that changes anything regarding the parameters. 
20210529, 06:48  #40 
Aug 2020
2^{2}·3·5^{2} Posts 
The matrix was build at first try with 160,000,000 relations.
Final q sieved: 45300000 matrix is 5597069 x 5597293 (2017.8 MB) with weight 529305051 (94.56/col) sparse part has weight 472974971 (84.50/col) Is this as expected or does it make sense to see if fewer relations would work? TD was again the msieve default of 90, while your params.c160 aims for 145. To be honest, I forgot to adjust the msieve parameters... Last fiddled with by bur on 20210529 at 06:50 
20210529, 16:30  #41 
"Curtis"
Feb 2005
Riverside, CA
2^{8}×19 Posts 
5.5M matrix is still a bit on the small side. I bet 155M relations would work fine; if you don't mind spending the time to check, I'd appreciate it.
Note that CADO and msieve measure density in different ways; I subtract 50 from CADO density to get a rough msieve density, so your msieve default 90 isn't far from the density I guessed is best. Thanks for the stats report! Charybdis sent me a params trial and stats report on PM this week for a C165. These two reports provide ideas for a bit of tinkering with the settings. If you're going to do another 158167 sized job, let me know and I'll send you a new file to try out. If we're going to try to refine these settings, we will need one more data point: The poly score as reported by *msieve* (or by the optimal skew calculator at http://myfactors.mooo.com/). That's because poly scores can vary by 5% for a given size of input, and we should take that into account when comparing runs. 
20210529, 18:37  #42  
Apr 2020
5·73 Posts 
Quote:


20210610, 08:06  #43 
Aug 2020
2^{2}·3·5^{2} Posts 
I missed your reply, I'll run tests on the minimum number of relations after that strange C165 SNFS factorization finishes.
I entered the poly parameters into myfactor, but it came up with a different skew (3.3e6 instead of 2.6e6) than the one I used for the factorization and the scores were on the order of 10^12 instead of 10^7. I found this surprising, is the score calculated that differently or were the myfactor skews so bad? How can I calculate scores by using msieve? Regarding unique relations, I'll record those for the c159 tests. I don't have that data for the c164, I could rerun the matrix tests on it, should I just do it for the lowest number of relations that worked? 
20210610, 12:17  #44  
Jun 2012
3,079 Posts 
Quote:


Thread Tools  
Similar Threads  
Thread  Thread Starter  Forum  Replies  Last Post 
Some CADONFS Work At Around 175180 Decimal Digits  EdH  CADONFS  127  20201007 01:47 
Sigma parameter in ecm  storm5510  Information & Answers  4  20191130 21:32 
PrimeNet error 7: Invalid parameter  ksteczk  PrimeNet  6  20180326 15:11 
Parameter Underestimation  R.D. Silverman  Cunningham Tables  14  20100929 19:56 
ECM Work and Parameter Choices  R.D. Silverman  Cunningham Tables  11  20060306 18:46 