I think I originally got this from fivemack.

It is a linux perl script (assumes you have cat, for instance). The first argument should be the poly file. The subsequent arguments are data file names. It will output the msieve.fb, worktodo.ini, and msieve.dat files. All that's left to do is the command "msieve -t 4 -nc" and off you go.

p.s. remove the .txt file extension.

[quote=Joshua2;202492]I think this is all the rest. 18 download files total? did i miss one maybe? alq4788.2509_70M4.71.tar.bz2?[/quote]
You're missing two of Andi47's ranges: 20M-21M and 70M-71M.
This should be all the links for those:
[URL]http://www.sendspace.com/file/p567yi[/URL]
[URL]http://www.sendspace.com/file/4fbeo9[/URL]
[URL]http://www.sendspace.com/file/qwe6k2[/URL]
[quote=Joshua2;202494]i installed coreutils to get wget and wc and stuff, so I need someone to write me a script using some of those linux things or windows script to put everything in one file for msieve. I don't want to have to rename each file to end with dat as well. also i'm planning on using the 1.43 x64 build of msieve, good?
i put up all the md5s[/quote]
Hm...I'm sure there's a better way out there somewhere, but here's one I just figured out. It just uses one Windows command, type. I tested it on a few small text files and it works as intended. First, create a subdirectory where the msieve.dat will be put (temporarily at least). For this example, that will be called "all". Then open a command prompt to the folder with all of the relations in it (and no other files; rearrange as necessary to make it so). Then run "type * > all\msieve.dat". It will probably take quite a while, depending on your hard drive speed, as it must rewrite all of the data into one file. Once it finishes, you can move msieve.dat to your msieve folder.
You can:
1. do this one time, once you get all relations files gathered, or
2. do it now and then use my previous batch file as you get the last of the files, or
3. do it now, and then use "type * >> all\msieve.dat" (note the ">>" makes it append instead of overwrite) while only having the new relations files in the current directory.

(/me goes and reads the posts above mine first...) The "cat" command is basically identical to type, except that with *, type doesn't exclude the output file, so it'll double print it all (hence having the output file in another folder). The script might be a bit difficult to use due to needing to get all the data file names into it...

I had downloaded two of those three, just not [url]http://www.sendspace.com/file/4fbeo9[/url], are you sure I need to redownload those other two, like somehow I extracted them to the wrong spot? I grabbed that one though. I counted 19 files but only downloaded 18 so now I have downloaded 19.

[quote=Joshua2;202500]I had downloaded two of those three, just not [URL]http://www.sendspace.com/file/4fbeo9[/URL], are you sure I need to redownload those other two, like somehow I extracted them to the wrong spot? I grabbed that one though. I counted 19 files but only downloaded 18 so now I have downloaded 19.[/quote]
Well, they didn't seem to be in your listing of line counts. Perhaps you can still get those two without redownloading them (where did you download and extract them to? Maybe you can just grab them from there).
By the way, the 4 files you listed the line counts for separately/earlier weren't in the big list of line counts you posted (and so, most likely, not in the same folder as the rest). Make sure you don't accidentally leave them out when combining the files. :smile:

i catted everything together:
cat: 4788_2509.dat: input file is output file
and then put it in with msieve:
error: polynomial is missing or corrupt

[quote=Joshua2;202504]i catted everything together:
cat: 4788_2509.dat: input file is output file
and then put it in with msieve:
error: polynomial is missing or corrupt[/quote]
Do you have the files jrk posted in msieve's folder? (especially msieve.fb as posted, which is a slightly different format from the .poly posted in the first post for sieving)
[quote=jrk;201659]DJason's msieve is easy enough to use, you should not have any difficulty learning it. Basically all you'd need to do is to download and keep track of the relation files produced here, untar/zip/whatever and combine them all into a [B]msieve.dat[/B] file,

make a [B]worktodo.ini[/B] file containing:
[code]
N 8519618226197093878278613851429334276607578086560582046132272468491047228903383713809367142607155237315475444625223025926760239272565192820910356755196796601078683
[/code]a [B]msieve.fb[/B] file containing the poly in msieve format:
[code]
N 8519618226197093878278613851429334276607578086560582046132272468491047228903383713809367142607155237315475444625223025926760239272565192820910356755196796601078683
SKEW 82092126.77
A0 -4506332652721281857439312883465578850580235
A1 1546557538158535979212952557252545273
A2 -493361789599381258970904335
A3 -1674326900805118095209
A4 -406958861894
A5 22800
R0 -51819960992313118269272571928496
R1 813459549425076319
[/code]and run:
msieve -v -nc -t 4
(for 4 threads)[/quote]You can try running msieve now to check that everything's working, but don't expect to get past the filtering. There aren't enough relations.

i did have those files jrk posted in there they look like those as well. and i ran that command still no dice. and i'm hopping that cat error is alright? my file is almost 6 gigs
edit i deleted it and im redoing it with the windows commands and I'm pretty certain all the proper files for sure this time.
[code]
1260506 1260506 133139467 41_42A
1253862 1253862 132460990 42_43A
1258725 1258725 133022781 43_44A
1249981 1249981 132155337 44_45A
1260568 1260568 133294715 45_46A
1258456 1258456 133122510 46_47A
4963398 4963398 525700227 4788.2509.050-054
2436113 2436113 258177809 4788.2509.054-056.dat
4797408 4797408 508715467 4788.2509.056-060.dat
1182918 1182918 125496371 4788.2509.060-061
5817400 5817400 617476880 4788.2509.061-066
1146395 1146395 121728725 4788.2509.066-067
1245036 1245036 131730216 47_48A
1240658 1240658 131288269 48_49A
1258442 1258442 133216974 49_50A
124098 124098 13267959 alq4788.2509_19M9.19M95.out
119325 119325 12756484 alq4788.2509_19M95.20.out
113713 113713 11878203 alq4788.2509_20.20M1.out
229919 229919 24019972 alq4788.2509_20.21b.out
346452 346452 36202695 alq4788.2509_20.21c.out
340094 340094 35544438 alq4788.2509_20.21d.out
229871 229875 24012800 alq4788.2509_20M0.20M2.tar
116158 116158 12131437 alq4788.2509_20M1.20M2.out
227519 227519 24175175 alq4788.2509_70.71a.out
222767 222767 23667254 alq4788.2509_70.71b.out
335863 335863 35683311 alq4788.2509_70.71c.out
335863 335863 35683311 alq4788.2509_70.71c.out.dat
336738 336738 35785213 alq4788.2509_70.71d.out
336738 336738 35785213 alq4788.2509_70.71d.out.dat
143234 143234 14989038 gnfs_22000000-22125000-alg.dat
142512 142512 14913513 gnfs_22125000-22250000-alg.dat
144327 144327 15100513 gnfs_22250000-22375000-alg.dat
144396 144396 15110244 gnfs_22375000-22500000-alg.dat
149424 149424 15647083 gnfs_22500000-22625000-alg.dat
146992 146992 15389321 gnfs_22625000-22750000-alg.dat
145498 145498 15230038 gnfs_22750000-22875000-alg.dat
147197 147197 15410992 gnfs_22875000-23000000-alg.dat
146202 146202 15310151 gnfs_23000000-23125000-alg.dat
145465 145465 15230424 gnfs_23125000-23250000-alg.dat
149951 149951 15706441 gnfs_23250000-23375000-alg.dat
149974 149974 15708755 gnfs_23375000-23500000-alg.dat
147110 147110 15409077 gnfs_23500000-23625000-alg.dat
149789 149789 15689910 gnfs_23625000-23750000-alg.dat
149999 149999 15714375 gnfs_23750000-23875000-alg.dat
147494 147494 15452328 gnfs_23875000-24000000-alg.dat
149951 149951 15709680 gnfs_24000000-24125000-alg.dat
149278 149278 15641465 gnfs_24125000-24250000-alg.dat
146938 146938 15402241 gnfs_24250000-24375000-alg.dat
148257 148257 15533819 gnfs_24375000-24500000-alg.dat
147779 147779 15490967 gnfs_24500000-24625000-alg.dat
149365 149365 15657471 gnfs_24625000-24750000-alg.dat
148181 148181 15536110 gnfs_24750000-24875000-alg.dat
150057 150057 15737329 gnfs_24875000-25000000-alg.dat
151064 151064 15840617 gnfs_25000000-25125000-alg.dat
146886 146886 15395400 gnfs_25125000-25250000-alg.dat
145652 145652 15270115 gnfs_25250000-25375000-alg.dat
148109 148109 15534828 gnfs_25375000-25500000-alg.dat
149446 149446 15674643 gnfs_25500000-25625000-alg.dat
149282 149282 15660700 gnfs_25625000-25750000-alg.dat
152277 152277 15978785 gnfs_25750000-25875000-alg.dat
146901 146901 15410893 gnfs_25875000-26000000-alg.dat
302442 302442 31729842 gnfs_26000000-26250000-alg.dat
305414 305414 32047823 gnfs_26250000-26500000-alg.dat
298422 298422 31322243 gnfs_26500000-26750000-alg.dat
303349 303349 31843929 gnfs_26750000-27000000-alg.dat
301610 301610 31663458 gnfs_27000000-27250000-alg.dat
304507 304507 31974561 gnfs_27250000-27500000-alg.dat
301704 301704 31681672 gnfs_27500000-27750000-alg.dat
302370 302370 31758961 gnfs_27750000-28000000-alg.dat
300276 300276 31541894 gnfs_28000000-28250000-alg.dat
299266 299266 31439943 gnfs_28250000-28500000-alg.dat
303480 303480 31887297 gnfs_28500000-28750000-alg.dat
304645 304645 32017186 gnfs_28750000-29000000-alg.dat
298335 298335 31355225 gnfs_29000000-29250000-alg.dat
301922 301922 31729271 gnfs_29250000-29500000-alg.dat
300981 300981 31638854 gnfs_29500000-29750000-alg.dat
310022 310022 32596196 gnfs_29750000-30000000-alg.dat
619843 619843 65183336 gnfs_30000000-30500000-alg.dat
613640 613640 64547193 gnfs_30500000-31000000-alg.dat
607995 607995 63964734 gnfs_31000000-31500000-alg.dat
612604 612604 64472412 gnfs_31500000-32000000-alg.dat
611848 611848 64395479 gnfs_32000000-32500000-alg.dat
612148 612148 64440296 gnfs_32500000-33000000-alg.dat
625924 625924 65917065 gnfs_33000000-33500000-alg.dat
615823 615823 64864619 gnfs_33500000-34000000-alg.dat
620250 620250 65339209 gnfs_34000000-34500000-alg.dat
622741 622741 65617526 gnfs_34500000-35000000-alg.dat
616841 616841 65007334 gnfs_35000000-35500000-alg.dat
616155 616155 64943744 gnfs_35500000-36000000-alg.dat
614377 614377 64784352 gnfs_36000000-36500000-alg.dat
616576 616576 65016794 gnfs_36500000-37000000-alg.dat
622816 622816 65684355 gnfs_37000000-37500000-alg.dat
618905 618905 65288946 gnfs_37500000-38000000-alg.dat
317652 317652 33512338 gnfs_38000000-38250000-alg.dat
308746 308746 32581023 gnfs_38250000-38500000-alg.dat
312209 312209 32945915 gnfs_38500000-38750000-alg.dat
311259 311259 32844324 gnfs_38750000-39000000-alg.dat
313330 313330 33068822 gnfs_39000000-39250000-alg.dat
314445 314445 33192834 gnfs_39250000-39500000-alg.dat
313972 313972 33144327 gnfs_39500000-39750000-alg.dat
308251 308251 32541931 gnfs_39750000-40000000-alg.dat
1149732 1149732 160541364 s4788_i2509_21_22M
58130798 58130802 6178876096 total
[/code]

[quote=Mini-Geek;202503]Well, they didn't seem to be in your listing of line counts. Perhaps you can still get those two without redownloading them (where did you download and extract them to? Maybe you can just grab them from there).[/quote]
I just noticed that 70-71's c and d files were posted in the earlier batch of line counts. That seems to be [URL]http://www.sendspace.com/file/qwe6k2[/URL], so it's just [URL]http://www.sendspace.com/file/p567yi[/URL] (20.2-21 and 70-70.4M) and [URL]http://www.sendspace.com/file/4fbeo9[/URL] (20-20.2M) that I haven't seen you post the line counts for yet.

So, you have a directory whose contents are

msieve.fb
worktodo.ini
msieve.dat

run k:\wherever\you\installed\it\msieve.exe -v -nc -t 4 and say what error message you get

check that there's a carriage-return at the end of msieve.fb

[quote=Joshua2;202507]and i'm hopping that cat error is alright? my file is almost 6 gigs[/quote]
The cat error looks perfectly fine. That means that it (unlike Windoze's type) was smart enough to ignore the file you were writing to.

Edit: This was before I read fivemack's post...he's right, it's just the lack of a new blank line at the end of the msieve.fb file. Oddly, with the 4 extra lines, it doesn't matter if there's a blank line at the end. Weird.[quote=Joshua2;202507]i did have those files jrk posted in there they look like those as well. and i ran that command still no dice.[/quote]
I downloaded jrk's msieve.fb and tried it out and got the same error, so I compared it to one I knew worked, and decided to try adding the last 4 lines. (I used the numbers from the other job, which was a c144 GNFS, so I hope they don't cause any ill side effects here...) It got past that part now for me (and choked on the msieve.dat as expected, since I didn't have one).
Try this for msieve.fb instead:
[code]N 8519618226197093878278613851429334276607578086560582046132272468491047228903383713809367142607155237315475444625223025926760239272565192820910356755196796601078683
SKEW 82092126.77
A0 -4506332652721281857439312883465578850580235
A1 1546557538158535979212952557252545273
A2 -493361789599381258970904335
A3 -1674326900805118095209
A4 -406958861894
A5 22800
R0 -51819960992313118269272571928496
R1 813459549425076319
FAMAX 12500000
FRMAX 12500000
SALPMAX 134217728
SRLPMAX 134217728
[/code](the last 4 lines are new)

so it was missing carriage return. I edited my previous post to have all the latest wc lines 58130798. how many relations we need? if I filter once will it have to refilter stage 1 again or i need to wait?
[code]
commencing relation filtering
estimated available RAM is 8191.2 MB
commencing duplicate removal, pass 1
error -1 reading relation 33017179
error -15 reading relation 34376408
error -15 reading relation 34713146
found 10990849 hash collisions in 58130793 relations
added 122614 free relations
commencing duplicate removal, pass 2
found 10570473 duplicates and 47682934 unique relations
memory use: 330.4 MB
reading ideals above 70975488
commencing singleton removal, initial pass
[/code]
should I stop it or will it save its work?