Misfit and worktodo.add with mfaktc - Page 2

Thecmaster · 2019-04-08, 11:05

Ok. Thanx. Maybe if I add delay it will work batter. Don't know. I'll add and check in later.

LaurV · 2019-04-08, 13:00

This works as it is supposed to. No bugs here. Keep calm and run TF...

Misfit does not use .add file at all, and why should he?

The .add file is used by mfaktc, same way as p95, where the idea was borrowed from. When you need to add work, you must avoid editing worktodo.txt file by yourself. This is because the program itself is editing the worktodo.txt to keep track of the work it does, i.e. lines are deleted when assignments are done. For example, if assignments A, B, C are in the file, and you edit it to add assignment D, then your editor makes a copy of it in RAM, which contain A, B, and C, then you add the line D, but meantime, because you type so slow,

the assignment A is finished and the program will delete the line A from the file (but not from your editor, as it has no idea that somebody is editing the file). Now, the file on disk has B and C, but the file in your editor has A, B, C, D. Therefore, if you save the file now, after adding the line D, the new worktodo file will contain A, B, C, D, and the effect is that you added not only the assignment D, but also A (which will be done two times, wasting resources, as the assignment was done already).

To avoid this, the worktodo.add was introduced with the idea that you can put there the work you need to add, eventually in a separate folder to play with it how long you want, then copy it in the folder where the program is, and next time when the worktodo.txt is edited by the program, the worktodo.add will be added to it, and deleted. Simple and safe.

Misfit has no idea about it, and it does not touch, nor edit, nor use in any way, this file. But... BUT... a good program like Misfit will check if the .add file exists, and if so, it will not add work to worktodo.txt, and let mfaktc to "integrate" first the work in the .add file, which has higher priority. Otherwise, if misfit will continue add work, with higher priority, it may be that .add is never added. Mind that misfit checks hourly (settable from the config) to add the work, but worktodo.txt is edited by the program every time a TF assignment is finished, which can be every second, or once per day, depending of your exponent and bitlevel - some assignments are very fast, some take ages...

So, if you have a problem with .add file, the problem is with mfaktc, and not misfit. Misfit will wait for mfaktc to "digest" the .add file, before adding new work.

Here on this side of the pool, we check by eyes how long till the mfaktc assignment will finish, and if we consider that we have enough time, we edit it directly. Otherwise if like 5 minutes or less left, we wait first to finish the assignment. So we never need to use the .add file. But we are aware of its existence and behavior. Usually, for the bitlevels we work, the assignments take hours, so no issue. You would really need the .add file when your assignments take seconds, or 2-3 minutes each, and you would not have time to edit the worktodo.txt

On the other hand, if you have misifit, why don't you add the new work directly to the misfit worktodo file? (which is updated hourly or so, and moreover you can "pause automation" to be on the safe side).

Thecmaster · 2019-04-08, 15:11

Quote:

Originally Posted by LaurV

This works as it is supposed to. No bugs here. Keep calm and run TF...

Misfit does not use .add file at all, and why should he?

Probably wrong.
1, it is misfits that makes the worktodo.add. more about that later.
2. I didn't say it was a bug. I wanted help with settings to make it work as it should. I figured I had missed something when researching the problem, testing and digging in the forum about it.

Quote:

The .add file is used by mfaktc, same way as p95, where the idea was borrowed from. When you need to add work, you must avoid editing worktodo.txt file by yourself. This is because the program itself is editing the worktodo.txt to keep track of the work it does, i.e. lines are deleted when assignments are done. For example, if assignments A, B, C are in the file, and you edit it to add assignment D, then your editor makes a copy of it in RAM, which contain A, B, and C, then you add the line D, but meantime, because you type so slow,

the assignment A is finished and the program will delete the line A from the file (but not from your editor, as it has no idea that somebody is editing the file). Now, the file on disk has B and C, but the file in your editor has A, B, C, D. Therefore, if you save the file now, after adding the line D, the new worktodo file will contain A, B, C, D, and the effect is that you added not only the assignment D, but also A (which will be done two times, wasting resources, as the assignment was done already).

Yeah. But i did that manually before i started to use misfit. I started to use misfit because i'm away from home days to a week and i don't want mfaktc to ever run out of work. I wanted it automatic for later this summer when i'm away for a few week without being home.

Quote:

To avoid this, the worktodo.add was introduced with the idea that you can put there the work you need to add, eventually in a separate folder to play with it how long you want, then copy it in the folder where the program is, and next time when the worktodo.txt is edited by the program, the worktodo.add will be added to it, and deleted. Simple and safe.

Misfit has no idea about it, and it does not touch, nor edit, nor use in any way, this file. But... BUT... a good program like Misfit will check if the .add file exists, and if so, it will not add work to worktodo.txt, and let mfaktc to "integrate" first the work in the .add file, which has higher priority. Otherwise, if misfit will continue add work, with higher priority, it may be that .add is never added. Mind that misfit checks hourly (settable from the config) to add the work, but worktodo.txt is edited by the program every time a TF assignment is finished, which can be every second, or once per day, depending of your exponent and bitlevel - some assignments are very fast, some take ages...

This isn't totaly true though. Misfit is the program that makes the .add file. And the default settings for misfit is to use the worktodo.add to assign work to mFaktx. otherwise i wouldn't got this question or problem.

https://gyazo.com/72272dd92d1516d22981058b376f433a

Quote:

So, if you have a problem with .add file, the problem is with mfaktc, and not misfit. Misfit will wait for mfaktc to "digest" the .add file, before adding new work.

It is probably not wrong with either BUT you are also wrong that it's not Misfit. You got here and wrote stuf that's not right.

Quote:

Here on this side of the pool, we check by eyes how long till the mfaktc assignment will finish, and if we consider that we have enough time, we edit it directly. Otherwise if like 5 minutes or less left, we wait first to finish the assignment. So we never need to use the .add file. But we are aware of its existence and behavior. Usually, for the bitlevels we work, the assignments take hours, so no issue. You would really need the .add file when your assignments take seconds, or 2-3 minutes each, and you would not have time to edit the worktodo.txt

On the other hand, if you have misifit, why don't you add the new work directly to the misfit worktodo file? (which is updated hourly or so, and moreover you can "pause automation" to be on the safe side).

I want misfit to make everything when i'm not able to. If i'm away for long time. I don't want to be standing without work.

Then we have your attitude. I don't like it. You wrote stuff here like i was stupid or that I wanted to complain., I just want help. And I have done my research before so I know that my question is legit and probably noone have had the same problem. You are just behaving like an asshole in my opinion. sry but how you wrote it is not nice.

LaurV · 2019-04-08, 16:24

I am using Misfit for years, since the very day Scott sent me the source code, and have never seen worktodo.add on my folders... But well, you may be using a different or newer version, or different settings... In that case, I can't help, sorry. You may drop a PM to Scott.

About my attitude, well, you can cry for you mama or deal with it...

Thecmaster · 2019-04-08, 16:43

Quote:

Originally Posted by LaurV

I am using Misfit for years, since the very day Scott sent me the source code, and have never seen worktodo.add on my folders... But well, you may be using a different or newer version, or different settings... In that case, I can't help, sorry. You may drop a PM to Scott.

About my attitude, well, you can cry for you mama or deal with it...

As I wrote. I don't think it's a bug. And I didn't complain about any of the programs.

I have dealt with your attitude. No need to cry to mama for me when you are the baby.

chalsall · 2019-04-08, 18:12

Quote:

Originally Posted by Thecmaster

As I wrote. I don't think it's a bug. And I didn't complain about any of the programs.

Don't worry about LaurV. The

emoji is almost his trade-mark...

What you have described is happening suggests this is in fact not a bug, like you said. I like to call it "making friends" with code; understanding how it all works, and interoperates.

LaurV is also, I believe, incorrect about the worktodo.add file.

This was introduced by both Scott and Oliver at the suggestion of several seasoned programmers here, to avoid what is known as a "race condition". The issue is that unlike LL'ing, DC'ing and P-1'ing, one cannot predict when mfaktX will find a factor, and so it is never safe for another program to modify the worktodo.txt file.

99.99999% of the time everything is fine, and I do it manually all the time. But that 0.00001% of the time is a problem. It's sometimes referred to as the "once a year" bug, which programmers hate!

Chuck · 2019-04-08, 20:49

Quote:

Originally Posted by Thecmaster

Hi. I'm using misfit to fetch work from GPU72. I have a problem where misfit puts work in worktodo.add and then it stays there. And next time misfit wants to add work or it wants to drain MISFITworktodo.txt it complains that worktodo.add have work in it already.

The thing that's bothers me is that it's not constant. Someone it works and if I move the work from .add to .txt and then delete .add it will work at least once. All way from fetch to .txt and then deleting .add.

Have anyone had the same problem or is there something I can check to make it work constant. Do I need to go through .add or is there any option to let misfit add work to .txt directly?

And if anyone can explain more in detail how it is supposed to work I might find what I have done wrong. And what is triggering the work in .add to get moved in to .txt? Is that misfit or mfaktc?
/Thecmaster

Do you have your MISFIT work management parameters set to drain the WorkToDo file appropriately? I have used MISFIT for years and and never used the .add feature.

I have mine set as follows:

Drain MISFITworkToDo when total GHzDs drops below 1500
Total GHzDs to assigh-out during drain 700

And my work fetch parameters are set to

Check MISFITworkToDo every (hours) 1
Fetch when MISFITworkToDo GHzDs drops below 1500

petrw1 · 2019-04-08, 20:57

Quote:

Originally Posted by Chuck

I have used MISFIT for years and and never used the .add feature.

I have mine set as follows:

. . .

Ditto for me.

Thecmaster · 2019-04-08, 23:29

Quote:

Originally Posted by Chuck

Do you have your MISFIT work management parameters set to drain the WorkToDo file appropriately? I have used MISFIT for years and and never used the .add feature.

I have mine set as follows:

Drain MISFITworkToDo when total GHzDs drops below 1500
Total GHzDs to assigh-out during drain 700

And my work fetch parameters are set to

Check MISFITworkToDo every (hours) 1
Fetch when MISFITworkToDo GHzDs drops below 1500

It can have something to do with my settings for how to drain. And how often it will check misfit worktodo file. And how long time the assigned task took. I was at the time doing some 75 bit level. And had werry low settings on misfit when to drain and so. And while worktodo.add is in the folder misfit will not see those GHz days. And probably tried to drain a few times before worktodo.add was added to worktodo. And probably it was me and only me that made a problem for my self
Without realising it. Probably I was the one that got to the PC while misfit was waiting for mfaktc to add the .add to .txt I though it was something wrong and put my fingers in the game and giggled it all up.

I have adjusted the numbers and I have done some 74 bit level and it seems to be working as it should. Misfits assigns work, the .add gets consumed and misfit fetch work from gpu72 in to MISFITworktodo file.

I will let it run and see if it works add it should and it is like I think me that made the mishap.

I might put in your numbers in misfit and run that.

Thanx for all help. It is with your help and advise I realised it was probably all me that made the bug. And this have been a week with some learning. Not just what's in this thread.

/Arvid

Chuck · 2019-04-09, 00:30

I didn't give my fetch parameter in the previous post.

GHzDs to fetch 1000

And I Let GPU72 decide

I don't know why you would use the .add feature unless you had some specific tests you wanted to manually put in the MISFITWorkToDo file.

Thecmaster · 2019-04-13, 13:44

FYI

It seems to work fine now. I haven't got the same problem again after adjusting numbers when to assign work, drain and fetch. I didn't put in the delay line in mFaktc.ini. worktodo.add works add it should to.

I did some adjustments yesterday just. I went from fetching 15 assignments to fetch 1500Ghz days. And drain 700 when below 300.

That way it will fetch and assign reasonable amount what ever bitlevel I'm doing.

Right now I do 74-75 in 92M range.

Thanx for all help. Your information (even if it wasn't exalt the solution) it helped me find a setting that worked and didn't give me the conflict I got.

2019-04-08, 13:00	#13
LaurV Romulan Interpreter Jun 2011 Thailand 7²·197 Posts	This works as it is supposed to. No bugs here. Keep calm and run TF... Misfit does not use .add file at all, and why should he? The .add file is used by mfaktc, same way as p95, where the idea was borrowed from. When you need to add work, you must avoid editing worktodo.txt file by yourself. This is because the program itself is editing the worktodo.txt to keep track of the work it does, i.e. lines are deleted when assignments are done. For example, if assignments A, B, C are in the file, and you edit it to add assignment D, then your editor makes a copy of it in RAM, which contain A, B, and C, then you add the line D, but meantime, because you type so slow, the assignment A is finished and the program will delete the line A from the file (but not from your editor, as it has no idea that somebody is editing the file). Now, the file on disk has B and C, but the file in your editor has A, B, C, D. Therefore, if you save the file now, after adding the line D, the new worktodo file will contain A, B, C, D, and the effect is that you added not only the assignment D, but also A (which will be done two times, wasting resources, as the assignment was done already). To avoid this, the worktodo.add was introduced with the idea that you can put there the work you need to add, eventually in a separate folder to play with it how long you want, then copy it in the folder where the program is, and next time when the worktodo.txt is edited by the program, the worktodo.add will be added to it, and deleted. Simple and safe. Misfit has no idea about it, and it does not touch, nor edit, nor use in any way, this file. But... BUT... a good program like Misfit will check if the .add file exists, and if so, it will not add work to worktodo.txt, and let mfaktc to "integrate" first the work in the .add file, which has higher priority. Otherwise, if misfit will continue add work, with higher priority, it may be that .add is never added. Mind that misfit checks hourly (settable from the config) to add the work, but worktodo.txt is edited by the program every time a TF assignment is finished, which can be every second, or once per day, depending of your exponent and bitlevel - some assignments are very fast, some take ages... So, if you have a problem with .add file, the problem is with mfaktc, and not misfit. Misfit will wait for mfaktc to "digest" the .add file, before adding new work. Here on this side of the pool, we check by eyes how long till the mfaktc assignment will finish, and if we consider that we have enough time, we edit it directly. Otherwise if like 5 minutes or less left, we wait first to finish the assignment. So we never need to use the .add file. But we are aware of its existence and behavior. Usually, for the bitlevels we work, the assignments take hours, so no issue. You would really need the .add file when your assignments take seconds, or 2-3 minutes each, and you would not have time to edit the worktodo.txt On the other hand, if you have misifit, why don't you add the new work directly to the misfit worktodo file? (which is updated hourly or so, and moreover you can "pause automation" to be on the safe side). Last fiddled with by LaurV on 2019-04-08 at 13:10 Reason: spacing

2019-04-08, 16:24	#15
LaurV Romulan Interpreter Jun 2011 Thailand 7²×197 Posts	I am using Misfit for years, since the very day Scott sent me the source code, and have never seen worktodo.add on my folders... But well, you may be using a different or newer version, or different settings... In that case, I can't help, sorry. You may drop a PM to Scott. About my attitude, well, you can cry for you mama or deal with it... Last fiddled with by LaurV on 2019-04-08 at 16:25

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
MFAKTC worktodo.txt permissions keep changing back	Rodrigo	GPU Computing	16	2017-12-23 15:04
mfaktc on Linux and misfit on Windows	bgbeuning	GPU Computing	3	2016-01-25 05:20
Help with Misfit	TheMawn	MISFIT	18	2015-06-21 22:00
MISFIT 2.9	swl551	MISFIT	44	2014-12-15 12:46
MISFIT for MFAKTx	swl551	MISFIT	186	2014-02-05 23:27

2019-04-08, 11:05	#12
Thecmaster "Arvid Björklin" Apr 2016 Pitea, Sweden 1000110₂ Posts	Ok. Thanx. Maybe if I add delay it will work batter. Don't know. I'll add and check in later.

2019-04-09, 00:30	#21
Chuck May 2011 Orange Park, FL 3·5·59 Posts	I didn't give my fetch parameter in the previous post. GHzDs to fetch 1000 And I Let GPU72 decide I don't know why you would use the .add feature unless you had some specific tests you wanted to manually put in the MISFITWorkToDo file.

2019-04-13, 13:44	#22
Thecmaster "Arvid Björklin" Apr 2016 Pitea, Sweden 2×5×7 Posts	FYI It seems to work fine now. I haven't got the same problem again after adjusting numbers when to assign work, drain and fetch. I didn't put in the delay line in mFaktc.ini. worktodo.add works add it should to. I did some adjustments yesterday just. I went from fetching 15 assignments to fetch 1500Ghz days. And drain 700 when below 300. That way it will fetch and assign reasonable amount what ever bitlevel I'm doing. Right now I do 74-75 in 92M range. Thanx for all help. Your information (even if it wasn't exalt the solution) it helped me find a setting that worked and didn't give me the conflict I got.