mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > YAFU

Reply
 
Thread Tools
Old 2012-07-27, 03:12   #67
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

3×29×83 Posts
Default

I've also had some small NFS jobs and some SIQS jobs use single threaded LA, while others have double threaded LA (with -threads 2).

For instance, I'm finishing up
Code:
4154843863990303329824450307542315625800528446005173610731460915373858442426082715954267037870986061
. Default nfs() as called by factor().
Code:
nfs: commencing algebraic side lattice sieving over range: 1160000 - 1180000
nfs: commencing algebraic side lattice sieving over range: 1140000 - 1160000
total yield: 381757, q=1180009 (0.00079 sec/rel) 
total yield: 390501, q=1160009 (0.00080 sec/rel)
...
commencing Lanczos iteration // not "commencing Lanczos iteration (2 threads)"
Dubslow is offline   Reply With Quote
Old 2012-07-27, 03:21   #68
Batalov
 
Batalov's Avatar
 
"Serge"
Mar 2008
Phi(4,2^7658614+1)/2

226178 Posts
Default

This is not a bug but a feature (of libmsieve, in fact). For very small jobs, parallelization will arguably incur more overhead than the time saved. The fine tuning of the cutoff value, though is another issue.
Batalov is offline   Reply With Quote
Old 2012-07-27, 03:51   #69
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

3×29×83 Posts
Default

Hmm... I hadn't noticed this before, that's why I brought it up.
Dubslow is offline   Reply With Quote
Old 2012-07-27, 18:05   #70
bsquared
 
bsquared's Avatar
 
"Ben"
Feb 2007

3·1,193 Posts
Default

Quote:
Originally Posted by bsquared View Post
Thanks. Looks like I need to raise the lower bound for siqs a smidge.
There's now a new bugfix version on sourceforge to address this issue (and the others related to gethostname and fclose). Somehow, the lower bound for siqs got set to 60 bits, which was way too low. I put it back to 115 bits, which is where it was in 1.31.
bsquared is offline   Reply With Quote
Old 2012-07-27, 18:08   #71
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

3×29×83 Posts
Default

Quote:
Originally Posted by bsquared View Post
There's now a new bugfix version on sourceforge to address this issue (and the others related to gethostname and fclose). Somehow, the lower bound for siqs got set to 60 bits, which was way too low. I put it back to 115 bits, which is where it was in 1.31.
So if it's too small for SIQS, just ECM it to death?
Dubslow is offline   Reply With Quote
Old 2012-07-27, 18:17   #72
bsquared
 
bsquared's Avatar
 
"Ben"
Feb 2007

357910 Posts
Default

Quote:
Originally Posted by Dubslow View Post
So if it's too small for SIQS, just ECM it to death?
No, below 115 bits it will use the tiny-mpqs routine.
bsquared is offline   Reply With Quote
Old 2012-07-30, 14:28   #73
swellman
 
swellman's Avatar
 
Jun 2012

2·1,621 Posts
Default

Quote:
Originally Posted by bsquared View Post
Yeah, there may be several megabytes of error 11's, but I don't think he needs to start from scratch.

swellman - let us know how it goes at the end.
The C150 factorization completed successfully, albeit with lots of errors.
swellman is offline   Reply With Quote
Old 2012-08-03, 05:44   #74
smh
 
smh's Avatar
 
"Sander"
Oct 2002
52.345322,5.52471

118910 Posts
Default

I frequently get the following error while using the -batchfile option
Code:
fopen error: Too many open files
couldn't open __tmpbatchfile for reading
In my last case the factor.log contains 274 successful factorizations.

I haven't counted other cases, but the factor.log was always around the same size, ~1,6 MB

This is with version 1.32
smh is offline   Reply With Quote
Old 2012-08-09, 08:15   #75
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

1C3516 Posts
Default

Code:
 1642 .n c69 = 107885441528430692626782312670553894975449688269454453262399368987322 = 2 * 3^2 * 7 * 17 * 61 * 542693 * 1103059 * 16733879020436308929733 * 82425948738382393997599092061 : No driver
Floating point exceptionu)...                                         
Floating point exceptionu)...                                         
WARNING: couldn't find factor in factor.log
Not very useful, and I doubt any logs are intact, but perhaps the bizarre output will point you to somewhere in the code...
Dubslow is offline   Reply With Quote
Old 2012-08-16, 07:43   #76
Kosmaj
 
Kosmaj's Avatar
 
Nov 2003

362210 Posts
Default

Hi smh

Try 1.32.1

Quote:
Originally Posted by smh View Post
I frequently get the following error while using the -batchfile option
Code:
fopen error: Too many open files
couldn't open __tmpbatchfile for reading
...
This is with version 1.32
Kosmaj is offline   Reply With Quote
Old 2012-09-16, 18:31   #77
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

3×29×83 Posts
Default



I'm trying my first SNFS.
Code:
cat nfs.job
n: 2260274989442597430324837567809598248216175664280098910872484517426279213920189887734212591070740298894552807438777800474054215249955552954875612404314502283
m: 604963733022224170044057949441
deg: 6
skew: 0.239633
type: snfs
Y0: -114554768608639305064203361
Y1: 1
c0: -1
c6: 5281
rlim: 3309400
alim: 3309400
lpbr: 27
lpba: 27
mfbr: 52
mfba: 52
rlambda: 2.5
alambda: 2.5
I started sieving with YAFU before realizing that it chose the wrong siever; I fixed that with -siever, and then let it run over night. That worked fine (I manually chose -r) but instead of the 9M minrels I expected for a 27-bit job, YAFU chose 44M. Anyways, I let it sieve overnight, since I had no plans to wake up and start the filtering. When I did wake up, there were ~20M rels, at which point I paused the sieving and started the stuff below. I did -nc, and it solved the matrix before barfing that it couldn't open the dependency file. I looked and didn't see one myself either. I also tried -nc3, -ncr, and then -nc2 again to see if that would help, but I got the same result each time.
Code:
bill@Gravemind:~/yafu∰∂ ./yafu "nfs($(cat num))" -nc -threads 8 -R
//yafu header

>> nfs: checking for job file - number in job file matches input
nfs: checking for data file
nfs: commencing NFS restart
nfs: user specified post processing only, skipping search for last special-q
nfs: commencing gnfs on c157:
nfs: continuing with sieving - could not determine last special q; using default startq
nfs: commencing msieve filtering

commencing relation filtering
estimated available RAM is 12019.3 MB
commencing duplicate removal, pass 1
read 10M relations
read 20M relations
found 2768855 hash collisions in 20732859 relations
added 631974 free relations
commencing duplicate removal, pass 2
found 2411447 duplicates and 18953386 unique relations
memory use: 98.6 MB
reading ideals above 720000
commencing singleton removal, initial pass
memory use: 344.5 MB
reading all ideals from disk
memory use: 535.2 MB
keeping 13180092 ideals with weight <= 200, target excess is 130118
...
commencing in-memory singleton removal
begin with 7820136 relations and 4836922 unique ideals
reduce to 7820124 relations and 4828622 ideals in 2 passes
max relations containing the same ideal: 117
relations with 0 large ideals: 4834
relations with 1 large ideals: 12390
relations with 2 large ideals: 140146
relations with 3 large ideals: 701960
relations with 4 large ideals: 1779378
relations with 5 large ideals: 2403338
relations with 6 large ideals: 1767340
relations with 7+ large ideals: 1010738
commencing 2-way merge
reduce to 7814582 relation sets and 4823080 unique ideals
commencing full merge
memory use: 433.6 MB
found 3662687 cycles, need 1069280
weight of 1069280 cycles is about 59809102 (55.93/cycle)
distribution of cycle lengths:
1 relations: 28369
2 relations: 121318
3 relations: 139390
4 relations: 172321
5 relations: 185201
6 relations: 181786
7 relations: 166585
8 relations: 71339
9 relations: 2941
10+ relations: 30
heaviest cycle: 10 relations
commencing cycle optimization
start with 5158756 relations
pruned 286274 relations
memory use: 170.9 MB
distribution of cycle lengths:
1 relations: 28369
2 relations: 133498
3 relations: 158931
4 relations: 199515
5 relations: 204404
6 relations: 176021
7 relations: 125660
8 relations: 41452
9 relations: 1418
10+ relations: 12
heaviest cycle: 10 relations
RelProcTime: 655
nfs: commencing msieve linear algebra

commencing linear algebra
read 1069280 cycles
cycles contain 2727286 unique relations
read 2727286 relations
using 20 quadratic characters above 134210414
building initial matrix
memory use: 347.8 MB
read 1069280 cycles
matrix is 1062222 x 1069280 (253.8 MB) with weight 78634309 (73.54/col)
sparse part has weight 54761416 (51.21/col)
filtering completed in 3 passes
matrix is 1010906 x 1011097 (243.3 MB) with weight 75287769 (74.46/col)
sparse part has weight 52664954 (52.09/col)
matrix starts at (0, 0)
matrix is 1010906 x 1011097 (243.3 MB) with weight 75287769 (74.46/col)
sparse part has weight 52664954 (52.09/col)
saving the first 48 matrix rows for later
matrix includes 64 packed rows
matrix is 1010858 x 1011097 (232.1 MB) with weight 56427786 (55.81/col)
sparse part has weight 50738978 (50.18/col)
using block size 65536 for processor cache size 8192 kB
dump interval = 2000
commencing Lanczos iteration (8 threads)
memory use: 232.6 MB
linear algebra at 0.1%, ETA 0h22m1011097 dimensions (0.1%, ETA 0h22m)    
checkpointing every 2430000 dimensions97 dimensions (0.2%, ETA 0h24m)    
linear algebra completed 1010734 of 1011097 dimensions (100.0%, ETA 0h 0m)    
lanczos halted after 15986 iterations (dim = 1010762)
lanczos error: only trivial dependencies found
BLanczosTime: 1831
nfs: commencing msieve sqrt

commencing square root phase
reading relations for dependency 1
error: read_cycles can't open dependency file
bill@Gravemind:~/yafu∰∂ ./yafu "nfs($(cat num))" -nc3 -threads 8 -R
//yafu header


>> nfs: checking for job file - number in job file matches input
nfs: checking for data file
nfs: commencing NFS restart
nfs: continuing with sieving - could not determine last special q; using default startq
nfs: commencing msieve sqrt

commencing square root phase
reading relations for dependency 1
error: read_cycles can't open dependency file
bill@Gravemind:~/yafu∰∂ ls
aliqueit.log  bckup        ecm.conf      ggnfs  nfs.dat.cyc  nfs.log    README     rels3.dat  rels7.dat    siqs.dat    tunerels.out   yafu.ini
ali    CHANGES      ecm.progress  ggnfs.log                       msieve   nfs.dat.mat  num        rels0.dat  rels4.dat  rsals        SNFS        xtra           yafu-linux64
aliqueit_ecm_temp.log    docfile.txt    gnfs-runs_excel2007.xlsx       nfs.fb      rels1.dat  rels5.dat  script.py   yafu
aliqueit.ini    ecm          fdb1          gnfs-runs_excel2007.xlsx_1.ods  nfs.dat  nfs.job      polys.dat  rels2.dat  rels6.dat  session.log  tune.job    yafu-1.32.zip
// no nfs.dep file
bill@Gravemind:~/yafu∰∂ ./yafu "nfs($(cat num))" -ncr -threads 8 -R
//yafu header


>> nfs: checking for job file - number in job file matches input
nfs: checking for data file
nfs: commencing NFS restart
nfs: user specified post processing only, skipping search for last special-q
nfs: continuing with sieving - could not determine last special q; using default startq
nfs: commencing msieve linear algebra

commencing linear algebra
matrix starts at (0, 0)
matrix is 1010906 x 1011097 (243.3 MB) with weight 75287769 (74.46/col)
sparse part has weight 52664954 (52.09/col)
saving the first 48 matrix rows for later
matrix includes 64 packed rows
matrix is 1010858 x 1011097 (232.1 MB) with weight 56427786 (55.81/col)
sparse part has weight 50738978 (50.18/col)
using block size 65536 for processor cache size 8192 kB
dump interval = 2000
commencing Lanczos iteration (8 threads)
memory use: 232.6 MB
error: cannot open matrix checkpoint file
bill@Gravemind:~/yafu∰∂ ls
498680.elf             aliqueit.log  bckup        ecm.conf      ggnfs                           kibibit  nfs.dat.cyc  nfs.log    README     rels3.dat  rels7.dat    siqs.dat    tunerels.out   yafu.ini
ali                    aliquot.sh    CHANGES      ecm.progress  ggnfs.log                       msieve   nfs.dat.mat  num        rels0.dat  rels4.dat  rsals        SNFS        xtra           yafu-linux64
aliqueit_ecm_temp.log  AllSeq.txt    docfile.txt  factor.log    gnfs-runs_excel2007.xlsx        new      nfs.fb       pl         rels1.dat  rels5.dat  script.py    spidey.log  yafu
aliqueit.ini           badrels.txt   ecm          fdb1          gnfs-runs_excel2007.xlsx_1.ods  nfs.dat  nfs.job      polys.dat  rels2.dat  rels6.dat  session.log  tune.job    yafu-1.32.zip
bill@Gravemind:~/yafu∰∂ ./yafu "nfs($(cat num))" -nc2 -threads 8 -R
//yafu header


>> nfs: checking for job file - number in job file matches input
nfs: checking for data file
nfs: commencing NFS restart
nfs: user specified post processing only, skipping search for last special-q
nfs: continuing with sieving - could not determine last special q; using default startq
nfs: commencing msieve linear algebra

commencing linear algebra
read 1011097 cycles
cycles contain 2656951 unique relations
read 2656951 relations
using 20 quadratic characters above 134210414
building initial matrix
memory use: 338.4 MB
read 1011097 cycles
matrix is 1010906 x 1011097 (243.3 MB) with weight 75287769 (74.46/col)
sparse part has weight 52664954 (52.09/col)
filtering completed in 1 passes
matrix is 1010906 x 1011097 (243.3 MB) with weight 75287769 (74.46/col)
sparse part has weight 52664954 (52.09/col)
matrix starts at (0, 0)
matrix is 1010906 x 1011097 (243.3 MB) with weight 75287769 (74.46/col)
sparse part has weight 52664954 (52.09/col)
saving the first 48 matrix rows for later
matrix includes 64 packed rows
matrix is 1010858 x 1011097 (232.1 MB) with weight 56427786 (55.81/col)
sparse part has weight 50738978 (50.18/col)
using block size 65536 for processor cache size 8192 kB
dump interval = 2000
commencing Lanczos iteration (8 threads)
memory use: 232.6 MB
linear algebra at 0.1%, ETA 0h22m1011097 dimensions (0.1%, ETA 0h22m)    
checkpointing every 2430000 dimensions97 dimensions (0.2%, ETA 0h24m)    
linear algebra completed 1010581 of 1011097 dimensions (99.9%, ETA 0h 0m)    
lanczos halted after 15984 iterations (dim = 1010762)
lanczos error: only trivial dependencies found
BLanczosTime: 1896
nfs: commencing msieve sqrt

commencing square root phase
reading relations for dependency 1
error: read_cycles can't open dependency file
Should I try something like
Code:
cp nfs.* msieve.*; ./msieve -nc2 -nc3 blah
?
Dubslow is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Running YAFU via Aliqueit doesn't find yafu.ini EdH YAFU 8 2018-03-14 17:22
Where to report bugs Matt Software 1 2007-02-20 19:13
Possible Prime95 bugs JuanTutors Software 9 2006-09-24 21:22
RMA 1.7 beta bugs TTn 15k Search 2 2004-11-24 22:11
RMA 1.6 fixes LLR bugs! TTn 15k Search 16 2004-06-16 01:22

All times are UTC. The time now is 06:59.


Wed Dec 1 06:59:19 UTC 2021 up 131 days, 1:28, 1 user, load averages: 1.17, 1.41, 1.34

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.