Archived data files...

Xyzzy · 2004-01-15, 22:29

Sometime today, our Opteron server will begin archiving the cleared and status text files from PrimeNet... You will be able to access them here:

http://opteron.mersenneforum.org/primenet/

Now is the time to let me know if the naming convention and compression method is acceptable... I've chosen to use gzipped tar files because they are readable by both Windows and Linux machines... (In Windows I think you will have to use WinZip or something like that!)

Thanks for any suggestions!

PrimeCruncher · 2004-01-19, 22:19

Hmmm...

yymmdd-hh.tar.gz

Naming convention is fine with me. Most Windoze users prefer ZIP but gzipped tar is fine with me because I use PowerArchiver, which, IMO, rocks and is the best compression software there is.

I see the file contains status and cleared. May I request that summary.txt be included also?

The connection seems a bit slow. I feel like I'm using dial-up! Six to seven Kbps; is this a limitation of the bandwith available to the Opteron server or are lots of people flooding it with requests?

Xyzzy · 2004-01-20, 02:22

Where can I find summary.txt?

The connection is slow because it is shared between a pile of computers and there are usually quite a few people logged in doing stuff... The download will be slow, but it will complete eventually...

The entire connection can only handle 40KB/s up...

nfortino · 2004-01-20, 02:36

Quote:

Originally posted by Xyzzy
Where can I find summary.txt?

http://www.mersenne.org/primenet/summary.txt

PrimeCruncher · 2004-01-20, 03:04

Quote:

Originally posted by Xyzzy
The connection is slow because it is shared between a pile of computers and there are usually quite a few people logged in doing stuff... The download will be slow, but it will complete eventually...

The entire connection can only handle 40KB/s up...

Unfortunate. Does anyone around here have computers on 24/7 with huge hard drives hooked up to really fast connections (i.e. cable/DSL/T1, etc) so we could mirror the files and have alternate sites to download from? This also ensures that if the Opteron goes down we don't lose those files.

Xyzzy · 2004-01-20, 04:06

I figure in the future if someone needs a pile of them I can just cut them a CD and mail it to them...

If you only need a few then the download should be fine...

Xyzzy · 2004-01-20, 05:03

I've added in the summary.txt file...

After some additional thought, we'll use bzip2 to compress these...

Code:

-rw-r--r--    1 root     root      2987946 Jan 19 23:51 bz2-example
-rw-r--r--    1 root     root      4101939 Jan 19 23:50 gz-example
-rw-r--r--    1 root     root     15564800 Jan 19 23:51 original
-rw-r--r--    1 root     root      4102053 Jan 19 23:52 zip-example

Using bzip2 will save us a lot of room...

If you run Windows, there are free bzip2 programs available... Here is one example:

http://gnuwin32.sourceforge.net/packages/bzip2.htm

PrimeCruncher · 2004-01-20, 19:47

Once again, I daresay PowerArchiver rules cuz it supports bzip2 compression as well.

Xyzzy · 2004-01-20, 21:00

Quote:

Originally posted by PrimeCruncher
Once again, I daresay PowerArchiver rules cuz it supports bzip2 compression as well.

Too bad it isn't free...

Xyzzy · 2004-01-20, 21:59

BTW, the compression tests were done at maximum compression for each type...

PrimeCruncher · 2004-01-20, 23:57

Quote:

Originally posted by Xyzzy
Too bad it isn't free...

The unregistered version has a nag screen with a max of four seconds. I tolerated that for quite a while before I finally got sick of it.

2004-01-15, 22:29	#1
Xyzzy "Mike" Aug 2002 7946₁₀ Posts	Archived data files... Sometime today, our Opteron server will begin archiving the cleared and status text files from PrimeNet... You will be able to access them here: http://opteron.mersenneforum.org/primenet/ Now is the time to let me know if the naming convention and compression method is acceptable... I've chosen to use gzipped tar files because they are readable by both Windows and Linux machines... (In Windows I think you will have to use WinZip or something like that!) Thanks for any suggestions!

2004-01-20, 05:03	#7
Xyzzy "Mike" Aug 2002 2×29×137 Posts	I've added in the summary.txt file... After some additional thought, we'll use bzip2 to compress these... Code: -rw-r--r-- 1 root root 2987946 Jan 19 23:51 bz2-example -rw-r--r-- 1 root root 4101939 Jan 19 23:50 gz-example -rw-r--r-- 1 root root 15564800 Jan 19 23:51 original -rw-r--r-- 1 root root 4102053 Jan 19 23:52 zip-example Using bzip2 will save us a lot of room... If you run Windows, there are free bzip2 programs available... Here is one example: http://gnuwin32.sourceforge.net/packages/bzip2.htm

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Searching data from npg files ( Primegrid)	pepi37	Linux	5	2016-06-29 11:11
Primenet exponent status distribution archived data	James Heinrich	Data	2	2012-02-01 21:14
older files archived?	tom11784	Lone Mersenne Hunters	0	2004-05-24 12:02
Do you have old stored versions of data files?	GP2	Data	0	2003-11-04 20:13
A brief description of data files	GP2	Data	1	2003-10-13 14:31

2004-01-19, 22:19	#2
PrimeCruncher Sep 2003 Borg HQ, Delta Quadrant 2BE₁₆ Posts	Hmmm... yymmdd-hh.tar.gz Naming convention is fine with me. Most Windoze users prefer ZIP but gzipped tar is fine with me because I use PowerArchiver, which, IMO, rocks and is the best compression software there is. I see the file contains status and cleared. May I request that summary.txt be included also? The connection seems a bit slow. I feel like I'm using dial-up! Six to seven Kbps; is this a limitation of the bandwith available to the Opteron server or are lots of people flooding it with requests?

2004-01-20, 02:22	#3
Xyzzy "Mike" Aug 2002 2·29·137 Posts	Where can I find summary.txt? The connection is slow because it is shared between a pile of computers and there are usually quite a few people logged in doing stuff... The download will be slow, but it will complete eventually... The entire connection can only handle 40KB/s up...

2004-01-20, 04:06	#6
Xyzzy "Mike" Aug 2002 2·29·137 Posts	I figure in the future if someone needs a pile of them I can just cut them a CD and mail it to them... If you only need a few then the download should be fine...

2004-01-20, 19:47	#8
PrimeCruncher Sep 2003 Borg HQ, Delta Quadrant 2BE₁₆ Posts	Once again, I daresay PowerArchiver rules cuz it supports bzip2 compression as well.

2004-01-20, 21:59	#10
Xyzzy "Mike" Aug 2002 17412₈ Posts	BTW, the compression tests were done at maximum compression for each type...