Yafu - Page 68

bchaffin · 2011-07-01, 21:42

Is there any way to disable the screen output of the polyfind step? Initially it was pretty awesome to watch the torrent of output when running 12 threads in parallel, but eventually the novelty wore off and I realized that half a thread is being spent just running the xterm and writing to disk. It's coming from inside libmsieve, though, so I don't know if there's any easy way to turn it off.

BTW, Ben, fantastic work on the recent versions. My aliquot workers took about 5 weeks to go through all the c104's in open sequences, using mostly SIQS and some GNFS at the end. With the addition of the minimum relations check, the multi-threaded polyfind, and the recent SIQS improvements, they are now about 60% through the c105's in just over a week. Without actually measuring anything, it feels like 2-3x improvement in throughput. Great stuff.

bsquared · 2011-07-01, 22:14

Quote:

Originally Posted by bchaffin

Is there any way to disable the screen output of the polyfind step? Initially it was pretty awesome to watch the torrent of output when running 12 threads in parallel, but eventually the novelty wore off and I realized that half a thread is being spent just running the xterm and writing to disk. It's coming from inside libmsieve, though, so I don't know if there's any easy way to turn it off.

I've wondered that myself - I'm guessing that eventually jrk/jason will disable all of the output. Presumably when the (still relatively new) uber fast poly select code gains enough maturity. Maybe if one of them is reading this thread they could comment.

Quote:

Originally Posted by bchaffin

BTW, Ben, fantastic work on the recent versions. My aliquot workers took about 5 weeks to go through all the c104's in open sequences, using mostly SIQS and some GNFS at the end. With the addition of the minimum relations check, the multi-threaded polyfind, and the recent SIQS improvements, they are now about 60% through the c105's in just over a week. Without actually measuring anything, it feels like 2-3x improvement in throughput. Great stuff.

jasonp · 2011-07-01, 23:25

The debug output always happens; you can redirect to /dev/null if it's really bothersome :)

Honestly the current code is not well suited for very high-throughput use, and making it work better on RSA768-size numbers is taking up all my time.

BudgieJane · 2011-07-03, 08:36

Talking of screen output, I'm using YAFU in Windows and redirecting output to a file. I'd like to see a switch that replaces the multiple backspaces (that appear in the output to enable the next line to overwrite the previous one on the screen) with a single newline. Is that possible, please?

Jane

Karl M Johnson · 2011-07-03, 14:05

Quote:

Originally Posted by jasonp

The debug output always happens; you can redirect to /dev/null if it's really bothersome :)

"> NUL" for windows users.

BudgieJane · 2011-07-03, 15:31

Quote:

Originally Posted by Karl M Johnson

"> NUL" for windows users.

I don't want to throw the output away, as I parse the redirected output file to obtain the factors; this seems easier than trying to get them from factor.txt. I also like to browse the output file to give me an idea how a factorization is proceeding.

bsquared · 2011-07-04, 01:44

The factor log has a regular format that I think would be just as easy to parse as redirected output. What parsing language are you using?

BudgieJane · 2011-07-04, 06:40

Quote:

Originally Posted by bsquared

The factor log has a regular format that I think would be just as easy to parse as redirected output. What parsing language are you using?

APL

BudgieJane · 2011-07-04, 14:00

Actually, I've just done what I should have done ages ago: read the help text!

It seems the -of flag is exactly what I need, returning the parenthesized input and the factors separated by slashes, which is much easier to parse than the debug output.

As I mentioned earlier, the debug output is handy for seeing how yafu is getting on.

bsquared · 2011-07-04, 14:09

Quote:

Originally Posted by BudgieJane

Actually, I've just done what I should have done ages ago: read the help text!

It seems the -of flag is exactly what I need, returning the parenthesized input and the factors separated by slashes, which is much easier to parse than the debug output.

As I mentioned earlier, the debug output is handy for seeing how yafu is getting on.

Ok, great. You have WraithX to thank for that - he implemented that and a few other switches a while back.

10metreh · 2011-07-04, 14:41

It's probably not a major issue, but what causes this?

Code:

elapsed time of 378.0667 seconds exceeds 409 second deadline; poly select done

2011-07-03, 08:36	#741
BudgieJane "Jane Sullivan" Jan 2011 Beckenham, UK 104₁₆ Posts	Talking of screen output, I'm using YAFU in Windows and redirecting output to a file. I'd like to see a switch that replaces the multiple backspaces (that appear in the output to enable the next line to overwrite the previous one on the screen) with a single newline. Is that possible, please? Jane Last fiddled with by BudgieJane on 2011-07-03 at 08:37 Reason: added parentheses to make things clearer

2011-07-04, 14:41	#748
10metreh Nov 2008 2·3³·43 Posts	It's probably not a major issue, but what causes this? Code: elapsed time of 378.0667 seconds exceeds 409 second deadline; poly select done

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Running YAFU via Aliqueit doesn't find yafu.ini	EdH	YAFU	8	2018-03-14 17:22
YAFU-1.34	bsquared	YAFU	119	2015-11-05 16:24
Yafu bug.	storflyt32	YAFU	2	2015-06-29 05:19
yafu-1.33	bsquared	YAFU	12	2012-11-08 04:12
yafu-1.32.1	bsquared	YAFU	21	2012-09-04 19:44

2011-07-01, 21:42	#738
bchaffin Sep 2010 Portland, OR 2²·3·31 Posts	Is there any way to disable the screen output of the polyfind step? Initially it was pretty awesome to watch the torrent of output when running 12 threads in parallel, but eventually the novelty wore off and I realized that half a thread is being spent just running the xterm and writing to disk. It's coming from inside libmsieve, though, so I don't know if there's any easy way to turn it off. BTW, Ben, fantastic work on the recent versions. My aliquot workers took about 5 weeks to go through all the c104's in open sequences, using mostly SIQS and some GNFS at the end. With the addition of the minimum relations check, the multi-threaded polyfind, and the recent SIQS improvements, they are now about 60% through the c105's in just over a week. Without actually measuring anything, it feels like 2-3x improvement in throughput. Great stuff.

2011-07-01, 23:25	#740
jasonp Tribal Bullet Oct 2004 3·1,181 Posts	The debug output always happens; you can redirect to /dev/null if it's really bothersome :) Honestly the current code is not well suited for very high-throughput use, and making it work better on RSA768-size numbers is taking up all my time.

2011-07-04, 01:44	#744
bsquared "Ben" Feb 2007 DC2₁₆ Posts	The factor log has a regular format that I think would be just as easy to parse as redirected output. What parsing language are you using?

2011-07-04, 14:00	#746
BudgieJane "Jane Sullivan" Jan 2011 Beckenham, UK 404₈ Posts	Actually, I've just done what I should have done ages ago: read the help text! It seems the -of flag is exactly what I need, returning the parenthesized input and the factors separated by slashes, which is much easier to parse than the debug output. As I mentioned earlier, the debug output is handy for seeing how yafu is getting on.