[QUOTE=bdodson;130384]Good thing, there's no ftp
(only sftp); automated ftp seems unlikely. -Bruce[/QUOTE]Perhaps it's a local LeHigh situation, but automated sftp (or scp, which is essentially the same thing) is very easy to set up. I use it in a number of situations, mostly cronjobs which transfer gigabytes of files (PostgreSQL dumps mostly) to and from Harvard every week.

Let me know if you would like more details of how to set up scripted sftp transfers.


Paul

[QUOTE=xilman;130538]Perhaps it's a local LeHigh situation, but automated sftp (or scp, which is essentially the same thing) is very easy to set up. I use it in a number of situations, mostly cronjobs which transfer gigabytes of files (PostgreSQL dumps mostly) to and from Harvard every week.

Let me know if you would like more details of how to set up scripted sftp transfers.

Paul[/QUOTE]

Sounds good; I'm not sure what Greg has in mind, data-wise (we
haven't gotten that far yet). On the 3+512 exchanges, there was
also a problem on Tom's side; the annon ftp wasn't accepting
sftp connections; or at least, I wasn't able to get one. Actually,
even if/when the new cluster gets ftp disabled, there's an old mail
server ...

I'm also interested in getting msieve assistance --- I ought to be
able to improve matters by removing duplicates, at least. If/when
I'm running complete sieving jobs (rather than partial ranges) I could
perhaps prepare a matrix to send off (as we used to do with Lehigh
factorizations finished on the MSR cluster for older nfs's, back in the
day); or perhaps the linux/quads here could be used? -Bruce

You've got enough resources there that I'd have thought you'd just run the msieve stage yourself. msieve is embarrassingly easy to run:

* put your number, unadorned, into a file worktodo.ini
* put 'N number' into a file msieve.dat, followed by the concatenation of all the relations
* write an msieve.fb file of the form
[code]
N number
A6 9
A0 1
R1 -1
R0 35917545547686059365808220080151141317043
[/code]
* do 'msieve -v -nc1 2500000,2500000' to do the filtering, 'msieve -v -t4 -nc2' to do the linear algebra on four threads, 'msieve -v -nc3' to do the square roots, 'msieve -v -t4 -ncr' to restart the linear algebra if your computer crashed. Count on maybe 15MB of memory use per million relations in the linear algebra stage, and maybe 20MB in the other two - the 225Mrel job for 6+383 just barely failed to fit on a 4G machine for those two stages, so I just ran nc1 on an 8G machine, copied the directory to a reliable 4G machine that I could leave for a week, ran nc2, copied the directory back to the 8G machine and ran nc3.

[QUOTE=fivemack;130548]
* do 'msieve -v -nc1 2500000,2500000' to do the filtering[/QUOTE]
Note that the latest version has much improved automatic sizing of filtering bounds, so that '-nc1' without numerical arguments should do the same job with much less memory

[QUOTE=fivemack;130548]msieve is embarrassingly easy to run:
[/QUOTE]Ditto on the "embarrassing" part. It has made factoring easier, and made me dumber, because I've fallen out of the habit of thinking about how some of the parameters affect the process. (This is really my fault, and not Jason's, but msieve is a crutch -- a well-made one..)

I'm not done with my current range, but I think I should get a new one on the books before fivemack takes off (assuming he won't be updating these pages while basking in the sun...)

Reserving 100-105

- ben.

I'm not fleeing the country until Saturday 12 April - I was just hoping that I could get results from a one-week processing job before I left on a jetplane. So you may want a bigger reservation ...

I [i]have[/i] posted to mersenneforum from a youth hostel in Serbia, but I don't have the ability to log into my compute farm from outside my house.

Sorry, got dates mixed up.

I don't want to monopolize the ranges (in the hopes that many others will see there are fertile q left and reserve them...). If all goes well I should be nearly done with what I have before you leave, so I can grab a new reservation then.

[quote=bsquared;130743]I'm not done with my current range, but I think I should get a new one on the books before fivemack takes off (assuming he won't be updating these pages while basking in the sun...)

Reserving 100-105

- ben.[/quote]

I'm on track to have this range done by saturday, so I'll go ahead and extend the reservation to 115. That will keep me busy for another couple weeks.

40-41M finished and currently uploading.

Running two instances of 15e slows down the core 2 duo too much, so I will wait with reserving the next range until I have finished 41-42M.

41-42M is finished, I will upload the file today or tomorrow.

reserving 42-43M