mersenneforum.org  

Go Back   mersenneforum.org > Other Stuff > Wikis > mersennewiki

Reply
 
Thread Tools
Old 2012-06-09, 19:11   #1
Xyzzy
 
Xyzzy's Avatar
 
"Mike"
Aug 2002

2·32·5·83 Posts
Default Big downloads?

For quite a while we maintained this page:

http://www.mersennewiki.org/index.ph...ersenne_primes

But, having a lot of people (or maybe one repeatedly?) downloading 47.txt really used up our bandwidth allowance, so we put a block on the downloads.

We are curious how we could fix this.

Perhaps a big torrent (around 252MiB uncompressed) with all of the numbers?
Perhaps a bunch of little torrents?
Perhaps a free download service, like Dropbox? (We figure there is some sort of limit, though.)

We think if just ordinary (curious) people downloaded the files the bandwidth would be reasonable, but it has been a problem in the past when a new prime is announced or when someone decides to deplete our bandwith allowance.

Suggestions?

(FWIW, we are willing to seed a torrent or multiple torrents but we would need several other people to have the download speed be reasonable and to provide redundancy.)

Thanks!

Xyzzy is offline   Reply With Quote
Old 2012-06-09, 19:16   #2
Batalov
 
Batalov's Avatar
 
"Serge"
Mar 2008
Phi(3,3^1118781+1)/3

11·19·43 Posts
Default

I think it would be best to replace it with (the code and) executables that could be downloaded and will produce this number on the people's computer. It could be even improved with being able to do it in any given base. (Maybe some Babylonian followers would want to see the M47 in base 60. And they can!)

P.S. You can also simply edit those links into e.g. http://prime.isthe.com/chongo/tech/m...9/prime-c.html
(and all others are in http://www.isthe.com/chongo/tech/mat.../mersenne.html )

Last fiddled with by Batalov on 2012-06-09 at 19:24
Batalov is offline   Reply With Quote
Old 2012-06-09, 19:44   #3
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

8,861 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
Suggestions?
The server GPU72.com is on has a monthly transmission allotment of 2 TB a month.

I would be happy to set up a virtual host (say, "files.mersennewiki.org") on the server and give you (Mike) FTP access to the root of that server. You would simply have to set up a DNS entry for the domain pointing to an IP I would give you, upload the files, and change the links.

Let me know (via PM) if you're interested in this solution.
chalsall is offline   Reply With Quote
Old 2012-06-09, 20:01   #4
Xyzzy
 
Xyzzy's Avatar
 
"Mike"
Aug 2002

2·32·5·83 Posts
Default

PM sent.
Xyzzy is offline   Reply With Quote
Old 2012-06-09, 21:09   #5
Batalov
 
Batalov's Avatar
 
"Serge"
Mar 2008
Phi(3,3^1118781+1)/3

11×19×43 Posts
Default

At the very least they should be (g)zipped?
Also, the webserver can be instructed to serve "47.txt" as a stream from "unzip -p 47.zip". (But then again, this will defeat the attempt to save traffic.)

What's wrong with using Noll's links? (just curious)
It's not like someone owns the M47 or its decimal representation. And he is already dealing with the hassle of serving these files. This is a Wiki page, right?

Would you like to host the human genome sequence? I wouldn't; I'd give a link to UCSC or NCBI.
Batalov is offline   Reply With Quote
Old 2012-06-09, 21:30   #6
Xyzzy
 
Xyzzy's Avatar
 
"Mike"
Aug 2002

2·32·5·83 Posts
Default

Problem solved. Chalsall is awesome. That is all.



click here
Xyzzy is offline   Reply With Quote
Old 2012-06-09, 21:33   #7
Xyzzy
 
Xyzzy's Avatar
 
"Mike"
Aug 2002

2·32·5·83 Posts
Default

Quote:
What's wrong with using Noll's links? (just curious)
It's not like someone owns the M47 or its decimal representation. And he is already dealing with the hassle of serving these files. This is a Wiki page, right?
We think we didn't know about his links when we started and it seemed easier to keep things the way they were, or something. A lot of what we do involves very little thinking.

Xyzzy is offline   Reply With Quote
Old 2012-06-09, 22:15   #8
Dubslow
Basketry That Evening!
 
Dubslow's Avatar
 
"Bunslow the Bold"
Jun 2011
40<A<43 -89<O<-88

1C3516 Posts
Default

[ASIDE]
Someone should remove the asterisk from M41, and change "between the 40th () and the 47th () on" to "between the 41th () and the 47th () on".

[/ASIDE]
Dubslow is offline   Reply With Quote
Old 2012-06-09, 22:16   #9
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

8,861 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
Problem solved.
Very kind Mike. But this was easy to do, and I've got bandwidth to burn.

Quote:
Originally Posted by Batalov
At the very least they should be (g)zipped.
Good point.

Three lines in the .htaccess file, and one run of "find", and the server will now send the data in GZIP format if the browser says it can handle it.
chalsall is offline   Reply With Quote
Old 2012-06-10, 00:26   #10
jasonp
Tribal Bullet
 
jasonp's Avatar
 
Oct 2004

351610 Posts
Default

Um, the incident Mike is talking about involved some joker in Europe downloading the files tens of thousands of times from a list of constantly updated proxied IPs. chalsall, this sounds like it's putting you in harm's way...
jasonp is offline   Reply With Quote
Old 2012-06-10, 01:19   #11
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

212358 Posts
Default

Quote:
Originally Posted by jasonp View Post
chalsall, this sounds like it's putting you in harm's way...
Appreciate the warning.

I've put on an hourly quota.
chalsall is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
http://www.nfsnet.org/downloads/nfsnet-04145-powerpc-MacOSX.tgz Death NFSNET Discussion 15 2004-06-22 07:35

All times are UTC. The time now is 09:40.

Thu Apr 9 09:40:26 UTC 2020 up 15 days, 7:13, 1 user, load averages: 1.69, 1.55, 1.35

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.