Automatic fetch of Trial Factoring work for GPU mfakt* - Page 4

bcp19 · 2012-08-19, 13:15

You seem to be going a little complicated here, what about a program that was like the submission spider, set to run every X hours and just checked the size of the worktodo.txt file? I always refill my worktodo on mfakt* when it drops below 1K (cause I try to check it daily but sometimes every other day), but if I had an automatic thing like this I could have it check to see if it was below say 200 bytes (approx 7 assignments) and if so, then grab 1-10 more (depending on the time between program runs) and append worktodo.

chalsall · 2012-08-19, 17:04

Quote:

Originally Posted by bcp19

You seem to be going a little complicated here, what about a program that was like the submission spider, set to run every X hours and just checked the size of the worktodo.txt file?

Yeah... I can get a bit obsessive about solving problems... However, I have figured out a cross-platform solution. The same Perl program works under both Linux and Windows, and it is designed such that it can be a fetching spider, a submission spider and a mfakt* slave driver (or any combination of same) all at the same time.

I want to run through a few more error-recovery tests on my own systems, but I'll soon need a couple of beta testers for each OS type. If anyone is interested in giving this a try, please PM me with a machine name (or machine names) to associate with the fetching spider -- this is needed for the "shared secret" technique.

Any number of instances can be associated with each machine, so if you (for example) run four instances of mfaktc on one machine, only one machine association is needed -- each instance will appear separately on GPU72, much like the threads/CPUs for Prime95/mprime.

LaurV · 2012-09-29, 05:05

Any news?

Bdot · 2012-10-02, 12:10

Quote:

Originally Posted by chalsall

Yeah... I can get a bit obsessive about solving problems... However, I have figured out a cross-platform solution. The same Perl program works under both Linux and Windows, and it is designed such that it can be a fetching spider, a submission spider and a mfakt* slave driver (or any combination of same) all at the same time.

I want to run through a few more error-recovery tests on my own systems, but I'll soon need a couple of beta testers for each OS type. If anyone is interested in giving this a try, please PM me with a machine name (or machine names) to associate with the fetching spider -- this is needed for the "shared secret" technique.

Any number of instances can be associated with each machine, so if you (for example) run four instances of mfaktc on one machine, only one machine association is needed -- each instance will appear separately on GPU72, much like the threads/CPUs for Prime95/mprime.

I stumbled over this thread just now ... sorry for being quite late.

How about two additional hooks in mfakt*: one after it read a worktodo entry (or at least tried to ...), and one after it wrote a results entry.

This could be something like two ini-variables that define something being started by mfakt* in those two cases, for example:

FETCH_COMMAND=perl spider.pl fetch w1.txt
SUBMIT_COMMAND=perl spider.pl submit res.txt

Of course, mfakt* could automatically append the names of the worktodo and results files for the current instance.

I guess this could have simplified your spider, but now that you've finished it already ...

Anyway, to add hooks like that is not difficult, and might turn out useful once the "temporary duct tape" is removed (i.e. you tell me how to fetch stuff programmatically ;-).

Anyway, I also use your submit spider (after adding proxy support), and have not (yet) tried to move it into my C(++) code. It's so much easier in perl ...

Hmm, maybe I could check out how prime95 is doing the communication and "learn" from that ..

swl551 · 2012-10-03, 01:16

I'm willing to transpose it to a .NET console app as I was already planning this integration for my mfaktXapp.

I'll use his Perl code as the blueprint for its conversion to c#

Since this domain is Chalsall's I have no objection to turning over the source code to him when I'm done. I'll maintain it until I'm fired, die or you find a better solution.

Let me know.

LaurV · 2012-10-03, 02:03

Quote:

Originally Posted by Bdot

I guess this could have simplified your spider, but now that you've finished it already ...

Finish? Where? I may be missed the announcement, and am still waiting for it. And I don't understand why is so difficult, just provide a mechanism (http link? like factorDB?) to get an assignment from the gpu72 server, and let us worry about putting that in a fork or in a graphic interface... We just need to be able to tell to the server form time to time "give me something to do" and "this is my result". When WE desire, and in a SAFE way (like my assignments should me MINE not YOURS). Excluding crawling to the assignment page by hand, with mouse clicks and typing.

LaurV · 2012-10-03, 02:10

Quote:

Originally Posted by kladner

Until Adobe puts out a 'nix version of Photoshop I'm locked into Windows. I can't afford a Mac of similar power to my PC.

Still, I have plenty of frustrations with Windows going way back.

Is there any mac of a similar power to a (generic) PC?

LaurV, everyday frustrated by Windows and women. We can't live with them. We can't live without them...

swl551 · 2013-03-26, 01:32

Quote:

Originally Posted by LaurV

Any news?

Yes. For windows you must call the Kernel32.dll GenerateConsoleCtrlEvent

First you have to AttachConsole
Second GenerateConsoleCtrlEvent

Windows 8 seriously mucked up this interaction. (see my code comments on what broke with Windows 8.)

Exact code from MISFITs' SendCtrlCode project. For windows you could launch SendCtrlCode.exe from Perl and pass in the PID. It may not be how you wanted to solve the problem, but it works.

I hope it helps with any future projects.

kladner · 2013-03-26, 02:49

Quote:

Originally Posted by LaurV

Is there any mac of a similar power to a (generic) PC?

LaurV, everyday frustrated by Windows and women. We can't live with them. We can't live without them...

Long after the question.....does this come close to similarity?
http://www.macmall.com/p/Apple-Mac-P...59~pdp.hgcjafi

kracker · 2013-03-26, 05:02

Quote:

Originally Posted by kladner

Long after the question.....does this come close to similarity?
http://www.macmall.com/p/Apple-Mac-P...59~pdp.hgcjafi

The Xeon E5645 is only $574.99 at newegg... the whole server/computer is $3,627.99... wow looks like something is really expensive there or.... Usual high mac-like prices.

Also, it is technically *not* 12 core, it is 6 core with HT.

kladner · 2013-03-26, 11:47

Quote:

Originally Posted by kracker

The Xeon E5645 is only $574.99 at newegg... the whole server/computer is $3,627.99... wow looks like something is really expensive there or.... Usual high mac-like prices.

Also, it is technically *not* 12 core, it is 6 core with HT.

Look again.

Quote:

2.4GHz 12-Core (2x 6-Core) Intel Xeon

Quote:

The single-processor Mac Pro offers four slots that support up to 32GB of DDR3 ECC SDRAM, while the dual-processor Mac Pro offers eight slots that support up to 64GB.

Quote:

Up to 24 virtual cores.The Intel Xeon processors support Hyper-Threading, which allows two threads to run simultaneously on each core. So, for example, a 12-core Mac Pro presents 24 virtual cores that are recognized by OS X.

And yes. It is a Mac and costs accordingly.

2012-10-03, 01:16	#38
swl551 Aug 2012 New Hampshire 1450₈ Posts	I'm willing to port the perl code to a .NET console app. I'm willing to transpose it to a .NET console app as I was already planning this integration for my mfaktXapp. I'll use his Perl code as the blueprint for its conversion to c# Since this domain is Chalsall's I have no objection to turning over the source code to him when I'm done. I'll maintain it until I'm fired, die or you find a better solution. Let me know.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Automatic submit results + fetch assignments for mfaktc?	DuskFalls	GPU Computing	5	2017-12-02 00:34
Simple Script to get Trial Factoring Work	jfamestad	PrimeNet	3	2016-11-06 20:32
Why trial factoring work chopped into chunks?	lidocorc	PrimeNet	4	2008-11-06 18:48
How does the trial factoring work with 15K*2^n-1	jocelynl	15k Search	0	2003-07-11 14:23
How does trial-factoring work?	ThomRuley	Software	5	2003-05-30 20:34

2012-08-19, 13:15	#34
bcp19 Oct 2011 1247₈ Posts	You seem to be going a little complicated here, what about a program that was like the submission spider, set to run every X hours and just checked the size of the worktodo.txt file? I always refill my worktodo on mfakt* when it drops below 1K (cause I try to check it daily but sometimes every other day), but if I had an automatic thing like this I could have it check to see if it was below say 200 bytes (approx 7 assignments) and if so, then grab 1-10 more (depending on the time between program runs) and append worktodo.

2012-09-29, 05:05	#36
LaurV Romulan Interpreter Jun 2011 Thailand 2·5·31² Posts	Any news?