Status Report for mprime backup files
 

I wrote a [URL="https://github.com/sethtroisi/prime95/pull/1/files"]medium sized change[/URL] that prints the status of all backup files in a directory.
I personally found this very useful for continuing to P-1 higher levels (especially as I tried to coordinate this across multiple computers) and for ECM work that I was moving around.

Using this worktodo.txt stopped at the points indicated you can see the output.
[CODE]
[Worker #1]
#Pminus1=N/A,1,2,13007,-1,20000000,0
# Stopped at ~7% stage 1 (stage 0, squaring small primes)
#Pminus1=N/A,1,2,12011,-1,20000000,0
# Stopped at ~71% stage 1
#Pminus1=N/A,1,2,13009,-1,30000,300000000
# Stopped at ~9% stage 2
#Pminus1=N/A,1,2,13217,-1,200000,0
# Finished stage 1, stage 2

#ECM2=1,2,13033,-1,1000000,0,7
# Stopped at ~33% stage 1
#ECM2=1,2,13037,-1,10000,100000000,7
# Stopped at ~27% stage 2 (curve 2)
#PRP=1,2,500009,-1
# Stopped at ~3.3%

#TEST=500029,40,1
# Stopped at ~9%

#PRP=4847,2,3321063,1
# Seventeen or bust like number stopped at ~10.8%
#PRP=6,10,71299,7
# Near Repunit prime stopped at 89%
[/CODE]

[CODE]
Status of files in 'testing'.
Backup e0013033 | ECM | Curve 1 | Stage 1 (33.2%).
Backup e0013033.bu | ECM | Curve 1 | Stage 1 (33.2%).
Backup e0013037 | ECM | Curve 2 | Stage 2 (27.9%).
Backup e0013037.bu | ECM | Curve 2 | Stage 2 (27.9%).
Backup m0012011 | P-1 | Stage 1 (71.9%) B1 @ 14376553.
Backup m0012011.bu | P-1 | Stage 1 (71.9%) B1 @ 14376553.
Backup m0013007 | P-1 | Stage 1 (8.4%) B1 <2436719.
Backup m0013007.bu | P-1 | Stage 1 (8.4%) B1 <2436719.
Backup m0013009 | P-1 | B1=30000 complete, Stage 2 (9.9%).
Backup m0013009.bu | P-1 | B1=30000 complete, Stage 2 (9.9%).
Backup m0013217 | P-1 | B1=200000,B2=20000000,E=12 complete.
Backup m0013217.bu | P-1 | B1=200000,B2=20000000,E=12 complete.
Backup p0500009 | PRP | Iteration 16631/500009 [3.33%].
Backup p0500009.bu | PRP | Iteration 16631/500009 [3.33%].
Backup p0500029 | LL | Iteration 45144/500029 [9.03%].
Backup p0500029.bu | LL | Iteration 45144/500029 [9.03%].
Backup p4847_3321063 | PRP | Iteration 360034/3321063 [10.84%].
Backup p4847_3321063.bu | PRP | Iteration 360034/3321063 [10.84%].
Backup p6_71299_7 | PRP | Iteration 212862/71299 [89.87%].
Backup p6_71299_7.bu | PRP | Iteration 212862/71299 [89.87%].
[/CODE]

Would this be useful to you?
What other output would be useful?
error counts? file modification date? file size? indication that newer backup file supersedes this file? indication that file is in worktodo?

George suggested I get some feedback about what would be useful for other people and what output formatting is good before they considers it. So feedback would be much appreciated.

[QUOTE=SethTro;540022]file modification date? file size? indication that newer backup file supersedes this file? indication that file is in worktodo?[/QUOTE]

These three looks useful. These would allow to clean up redundant files.

Also, files in stage 2 (P-1 or ECM) should show B2 as well.

I'm working on TWOK and have a bunch of P-1 save files laying around that I want to run the new fast stage 2 code on.

I rewrote my code as a [URL="https://github.com/sethtroisi/prime95/blob/py_status_report/prime95_status.py"]standalone python file[/URL] [URL="https://raw.githubusercontent.com/sethtroisi/prime95/py_status_report/prime95_status.py"](raw)[/URL] because C is terrible and it takes a quarter the code to write this in Python.

[CODE]
$ ./prime95_status.py
Found 9 backup files in '.'
e0013033 | ECM | Curve 1 | Stage 1 (34.6%)
e0013033.bu | ECM | Curve 1 | Stage 1 (2.4%)
e0013037 | ECM | Curve 2 | Stage 2 (35.4%)
m0012011 | P-1 | Stage 1 (71.6%) B1 @ 14327561
m0013007 | P-1 | Stage 1 (7.7%) B1 <2215679
m0013009 | P-1 | B1=30000 complete, Stage 2 (10.5%)
m0013217 | P-1 | B1=200000 ,B2=20000000 ,E=12 complete
p0500009 | PRP | Iteration 107730/500009 [21.55%]
p0500029 | LL | Iteration 42453/500029 [8.49%]
[/CODE]

30.8 introduces a new P-1 file format (probably ECM too) so I can't parse those files till the source code is released (or George gives me a sneak peak of the new pm1_save file format)

I added a few new features today
[LIST=1][*]JSON output of the raw data I process[*]Test data generator[*]Verified support for 30.3[/LIST]