mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > CADO-NFS

Reply
 
Thread Tools
Old 2018-05-23, 09:08   #265
Gimarel
 
Apr 2010

24·32 Posts
Default

Quote:
Originally Posted by henryzz View Post
It is worth noting that unlike the ggnfs siever cado can sieve below the fb bound.
I think you mean, that cado can sieve with fb entries above the currently sieved special-q.
IMO that's slower overall, at least for small composites like c145. That's the reason I limited the fb.
Gimarel is offline   Reply With Quote
Old 2018-05-26, 23:23   #266
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

5·347 Posts
Default Error?

Code:
Info:Linear Algebra: Starting
Warning:Command: Process with PID 23973 finished with return code 255
Error:Linear Algebra: Program run on server failed with exit code 255
Error:Linear Algebra: Command line was: /home/wombatman/cado-nfs-2.3.0/build/BenMeekins-PC/linalg/bwc/bwc.pl :complete 'thr=8' 'nullspace=left' 'matrix=/tmp/cado.ui87i89u/c165.sparse.bin' 'wdir=/tmp/cado.ui87i89u/c165.bwc' 'cpubinding=/home/wombatman/cado-nfs-2.3.0/parameters/misc/cpubinding.conf' 'cantor_threshold=2048' 2> /tmp/cado.ui87i89u/c165.bwc.stderr.3
b'Missing parameters: m and/or n at linalg/bwc/bwc.pl line 360.\n
Any ideas what this is? Sieving and merging completed without issue. This error occurs immediately upon the start of linear algebra.
wombatman is offline   Reply With Quote
Old 2018-05-27, 02:16   #267
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

6C716 Posts
Default

Since I can't edit the previous post, the solution was to add the appropriate parameter line to the new c165 params file (and in this case, to the snapshot as well). That's my bad. The lines I added were the following, copied from pre-existing c165 params file:

Code:
###########################################################################
# Linear algebra
###########################################################################

tasks.linalg.bwc.interval = 1000
tasks.linalg.bwc.interleaving = 0
tasks.linalg.m = 64
tasks.linalg.n = 64

###########################################################################
# Characters
###########################################################################

tasks.linalg.characters.nchar = 50
wombatman is offline   Reply With Quote
Old 2018-07-02, 01:43   #268
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

110110001112 Posts
Default CADO-NFS on RPis

I've been playing with using RPis as a mini-cluster with CADO-NFS. I'm running into what I think is a memory issue. The short version is this: the RPis can do polynomial selection workunits up to at least C17x (I think C177 is the highest I've done). However, they cannot handle sieving workunits above C117 (C119 and above led to the error detailed below), giving the following error repeatedly:

Code:
Error:Lattice Sieving: Program run on localhost failed with exit code -9
Error:Lattice Sieving: Stderr output follows (stored in file /tmp/cado.znzw_dvb/c120.upload/c120_sieving_196000-197000#2.2w0rleb9.stderr0):
b'madvise failed: Invalid argument\n'

I know I can take this to the CADO-NFS programmers, but I figured I would check here first in case there's a simple solution. This is on an RPi Model 3B+(1GB RAM).
wombatman is offline   Reply With Quote
Old 2018-07-02, 05:13   #269
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

41×109 Posts
Default

If you're using 2.3.0, the C120 params file uses I = 14 for no good reason. C115 file uses I = 12. If you're using the git 3.0.0, then params.c120 uses I = 12 and I dunno why you're getting crashes.

I=12 should fit comfortably in 1GB.
VBCurtis is offline   Reply With Quote
Old 2018-07-02, 05:45   #270
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

5×347 Posts
Default

It's the 2.3.0 version. Thanks!
wombatman is offline   Reply With Quote
Old 2018-07-02, 08:03   #271
VictordeHolland
 
VictordeHolland's Avatar
 
"Victor de Hollander"
Aug 2011
the Netherlands

2×587 Posts
Default

Quote:
Originally Posted by wombatman View Post
I know I can take this to the CADO-NFS programmers, but I figured I would check here first in case there's a simple solution. This is on an RPi Model 3B+(1GB RAM).
Could you time RSA-100 to compare the RPi 3B+ with my (ancient) Odroid-U2 ARM board?

CADO-NFS 3.0-dev timings for RSA-100 on Odroid-U2:
http://mersenneforum.org/showpost.ph...&postcount=129


RSA-100 with Msieve-lasieve4-python script on Odroid-U2 in:
http://mersenneforum.org/showthread.php?t=23471
VictordeHolland is offline   Reply With Quote
Old 2018-07-02, 19:21   #272
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

6C716 Posts
Default

Sure. Started it just now with default parameters, 4 threads.
wombatman is offline   Reply With Quote
Old 2018-07-03, 02:35   #273
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

5×347 Posts
Default

Code:
Info:Square Root: finished
Info:Square Root: Factors: 37975227936943673922808872755445627854565536638199 40094690950920881030683735292761468389214899724061
Info:Square Root: Total cpu/real time for sqrt: 441/124.699
Info:Polynomial Selection (size optimized): Aggregate statistics:
Info:Polynomial Selection (size optimized): potential collisions: 2890.72
Info:Polynomial Selection (size optimized): raw lognorm (nr/min/av/max/std): 2920/32.780/37.719/38.560/0.695
Info:Polynomial Selection (size optimized): optimized lognorm (nr/min/av/max/std): 2920/32.780/36.417/38.550/0.985
Info:Polynomial Selection (size optimized): Total time: 403.24
Info:Polynomial Selection (root optimized): Aggregate statistics:
Info:Polynomial Selection (root optimized): Total time: 510.88
Info:Polynomial Selection (root optimized): Rootsieve time: 507.48
Info:Generate Factor Base: Total cpu/real time for makefb: 8.42/2.29804
Info:Generate Free Relations: Total cpu/real time for freerel: 245.18/62.0037
Info:Lattice Sieving: Aggregate statistics:
Info:Lattice Sieving: Total number of relations: 2689258
Info:Lattice Sieving: Average J: 1023.74 for 88142 special-q, max bucket fill: 0.707584
Info:Lattice Sieving: Total CPU time: 40586.2s
Info:Filtering - Duplicate Removal, splitting pass: Total cpu/real time for dup1: 24.95/68.3106
Info:Filtering - Duplicate Removal, splitting pass: Aggregate statistics:
Info:Filtering - Duplicate Removal, splitting pass: CPU time for dup1: 67.6s
Info:Filtering - Duplicate Removal, removal pass: Total cpu/real time for dup2: 108.2/94.0727
Info:Filtering - Singleton removal: Total cpu/real time for purge: 117.94/84.1812
Info:Filtering - Merging: Total cpu/real time for merge: 386.29/355.652
Info:Filtering - Merging: Total cpu/real time for replay: 35.57/37.4631
Info:Linear Algebra: Total cpu/real time for bwc: 18146.5/0.00117993
Info:Linear Algebra: Aggregate statistics:
Info:Linear Algebra: Krylov: WCT time 2941.91
Info:Linear Algebra: Lingen CPU time 303.06, WCT time 84.66
Info:Linear Algebra: Mksol: WCT time 1477.02
Info:Quadratic Characters: Total cpu/real time for characters: 19.53/9.2079
Info:Square Root: Total cpu/real time for sqrt: 441/124.699
Info:HTTP server: Shutting down HTTP server
Info:Complete Factorization: Total cpu/elapsed time for entire factorization: 61033.9/16947.3
Info:root: Cleaning up computation data in /tmp/cado.1xpfmivz
37975227936943673922808872755445627854565536638199 40094690950920881030683735292761468389214899724061
***Note that everything except for the linear algebra was done on 2 threads.

Polyselect: 23 minutes, 42 seconds
Sieving: 40586.2 seconds (~5.5 hours real time)
Filtering: 639 secs (~10 minutes)
Linear Algebra: 2941.91+84.66+1477.02 = 4503.59 seconds (~1.25 hours) ***4 threads here
Sqrt: 125 seconds
Total (CPU/Real): 61033.9/16947.3 seconds
wombatman is offline   Reply With Quote
Old 2018-07-03, 10:38   #274
VictordeHolland
 
VictordeHolland's Avatar
 
"Victor de Hollander"
Aug 2011
the Netherlands

22268 Posts
Default

Quote:
Originally Posted by wombatman View Post
***Note that everything except for the linear algebra was done on 2 threads.

Polyselect: 23 minutes, 42 seconds
Sieving: 40586.2 seconds (~5.5 hours real time)
Filtering: 639 secs (~10 minutes)
Linear Algebra: 2941.91+84.66+1477.02 = 4503.59 seconds (~1.25 hours) ***4 threads here
Sqrt: 125 seconds
Total (CPU/Real): 61033.9/16947.3 seconds
Cool, thx!
I'm a bit surprised that it is not faster than the quad-A9 in the ODROID-U2?! Even after taking into account the clockspeed difference (1700 MHz for the U2 vs. 1400MHz of the RP3B+)
Were you using the CADO 3.0-dev latest git version?
VictordeHolland is offline   Reply With Quote
Old 2018-07-03, 14:11   #275
wombatman
I moo ablest echo power!
 
wombatman's Avatar
 
May 2013

33078 Posts
Default

No, this was with the CADO-2.3.0 release. I haven't compiled the latest version.
wombatman is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
CADO-NFS on windows jux CADO-NFS 22 2019-11-12 12:08
CADO help henryzz CADO-NFS 4 2017-11-20 15:14
CADO and WinBlows akruppa Programming 22 2015-12-31 08:37
CADO-NFS skan Information & Answers 1 2013-10-22 07:00
CADO R.D. Silverman Factoring 4 2008-11-06 12:35

All times are UTC. The time now is 14:44.

Wed Nov 25 14:44:40 UTC 2020 up 76 days, 11:55, 3 users, load averages: 0.87, 1.30, 1.36

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.