New server discussion

magnav0x · 2005-12-02, 21:26

My only idea is that the server pspnet.no-ip.org on port 12984? I did a scan on the host and the port appears open, so what else could the issue be, other than the host not accepting incomming connections. Suppose I could jet on over to the UK and kick the server or something.

Edit by LTD: Sorry this entry should have not been splited but i don't know how to move it back

ltd · 2005-12-02, 21:42

I have allready mailed Footmaster to look at the server.
Sorry but there is nothing else i can do about it.

Lars

Edit by LTD: Sorry this entry should have not been splited but i don't know how to move it back

ltd · 2005-12-07, 06:52

Thats the small problem. The IP is not static so the redirect must go against the domain name if that is possible.

Our next problem are the linux machines that run for magnav0x and need the fixed IP entry cause of problems with domain name resolution in some of the linux clients.

Then we have to decide how we procede.
There are three possible ways.
1. We go back to the old server at footmaster if he is willing to continue to run it. Advantage:It is a machine with static IP and there is no problem with changing the client configuration.
Diadvantage: Machine is known to have some stability problems.
2. We continue to run with my server.
Advantage: I have everything in my hands what makes it easier to insert new ranges if needed or to remove sieved out k/n pairs within a day. It also gives me a better chance to come up with automated stats updates in the future as file handling will be easier.
Disadvantage: It cost me an extra 10Euro per month for the connection. ( Thats not really a problem as i am willing to pay that)
The server has to prove that it is stable.
The server has not a static IP
3. We move to the server offered by magnav0x.

OK let the discussion start.

Lars

Citrix · 2005-12-07, 07:07

Ill leave the decision up to you. I will transfer the .org account to your account in a day or two. (check email), so no more IP issues.

May be the linux computer's problems can be fixed?

What ever you think is best, is ok with me.

Citrix

drakkar67 · 2005-12-07, 07:21

voting for trying the 2nd choice

drakkar

Mystwalker · 2005-12-07, 10:53

Maybe hosting it on a virtual server would be another possibility.

- the price is < 10 Euros meanwhile
- static IP address is available
- "direct" (except physical, of course) access as well
- system ressources would be lower than for the other three options, but I'm not sure whether a high performance is needed

I've seen that you can test a virtual server for 3 days without any hassle...

ltd · 2005-12-07, 18:46

The link Mystwalker has posted is very interesting.
I don't know why i ignored that provider when i looked for a server.
There virtual server should be able to even hold the complete database
if we don't build the stats every hour.
I will check there server next week when i am on holiday and also ask them
if the expected load from the stats runs is OK from there side for a virtual server.

I had this discussion earlier with other providers and got the answer that they would not allow that load on a virtual server but i think the machines offered at this provider should allow the load when we do only a handfull of statsruns a day. ( Start with one and maybe end with a run every 6 hours)

I will keep you informed.

Lars

Mystwalker · 2005-12-08, 10:47

Maybe it is possible to tweak the DB to lessen the stats creation effort?

- optimize queries
- applying indexes (if not already done, of course)
- aggregate data that doesn't change anymore, so that is does not have to be computed every time

ltd · 2005-12-08, 16:22

Quote:

Originally Posted by Mystwalker

Maybe it is possible to tweak the DB to lessen the stats creation effort?

- optimize queries
- applying indexes (if not already done, of course)
- aggregate data that doesn't change anymore, so that is does not have to be computed every time

Here an answer to your suggestion.

There is allways space for optimized queries but i have no good ideas at the moment.

Indexes are set up as far as it makes sence with the RAM installation i have on my machine. But there are some queries that can not use an index due to some restrictions of mysql.

I have already aggregated data as far as it was easy possible. For example stats for users/teams are created within a second.
Importing new results is also done within "no time".
The most time is spend to create stats tables like "distribution of untested values".
These tables are made out of several queries with nice things like "group by"/ "min"/ "max"/"sum"/... in different combinations. I do not know other ways to get these informations without a significant danger to have inconsistent data in the display or without a significant slowdown of the data import.

To give an impression of the amount of data which has to be handled.
The complete database has a size of 264MB at the moment.

Lars

Citrix · 2005-12-08, 19:26

The .org account is pointing to ltd's server, now.

@magnav0x, I suggest you run a local LLRnet for your linux computers, since you have a computer with a static IP that you could use as a server. I think that should solve all the problems at present.

Citrix

Citrix · 2005-12-08, 20:23

Can we make the basic database public? That way people can study it and come up with new ideas etc. Are there any problems anyone can see?

Well the size is an issue, 264 MB. But we could make a smaller demo DB say upto 2 Million only. Or something like that.

What do you all think?

Citrix

2005-12-02, 21:26	#1
magnav0x Oct 2005 2²×5 Posts	New server discussion My only idea is that the server pspnet.no-ip.org on port 12984? I did a scan on the host and the port appears open, so what else could the issue be, other than the host not accepting incomming connections. Suppose I could jet on over to the UK and kick the server or something. Edit by LTD: Sorry this entry should have not been splited but i don't know how to move it back Last fiddled with by ltd on 2005-12-14 at 21:59

2005-12-02, 21:42	#2
ltd Apr 2003 772₁₀ Posts	I have allready mailed Footmaster to look at the server. Sorry but there is nothing else i can do about it. Lars Edit by LTD: Sorry this entry should have not been splited but i don't know how to move it back Last fiddled with by ltd on 2005-12-14 at 21:59

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
new server setup discussion	mdettweiler	No Prime Left Behind	15	2009-09-08 09:42
NPLB LLRnet server discussion	em99010pepe	No Prime Left Behind	229	2008-04-30 19:13
CRUS LLRnet server discussion	em99010pepe	Conjectures 'R Us	181	2008-02-04 19:51
P-1 discussion	AntonVrba	Prime Cullen Prime	5	2007-04-04 04:59
New Server Hardware and price quotes, Funding the server	Angular	PrimeNet	32	2002-12-09 01:12

2005-12-07, 06:52	#3
ltd Apr 2003 2²×193 Posts	Thats the small problem. The IP is not static so the redirect must go against the domain name if that is possible. Our next problem are the linux machines that run for magnav0x and need the fixed IP entry cause of problems with domain name resolution in some of the linux clients. Then we have to decide how we procede. There are three possible ways. 1. We go back to the old server at footmaster if he is willing to continue to run it. Advantage:It is a machine with static IP and there is no problem with changing the client configuration. Diadvantage: Machine is known to have some stability problems. 2. We continue to run with my server. Advantage: I have everything in my hands what makes it easier to insert new ranges if needed or to remove sieved out k/n pairs within a day. It also gives me a better chance to come up with automated stats updates in the future as file handling will be easier. Disadvantage: It cost me an extra 10Euro per month for the connection. ( Thats not really a problem as i am willing to pay that) The server has to prove that it is stable. The server has not a static IP 3. We move to the server offered by magnav0x. OK let the discussion start. Lars

2005-12-07, 07:07	#4
Citrix Jun 2003 2×7×113 Posts	Ill leave the decision up to you. I will transfer the .org account to your account in a day or two. (check email), so no more IP issues. May be the linux computer's problems can be fixed? What ever you think is best, is ok with me. Citrix

2005-12-07, 07:21	#5
drakkar67 Feb 2003 Istanbul 2²×13 Posts	voting for trying the 2nd choice drakkar

2005-12-07, 10:53	#6
Mystwalker Jul 2004 Potsdam, Germany 3·277 Posts	Maybe hosting it on a virtual server would be another possibility. - the price is < 10 Euros meanwhile - static IP address is available - "direct" (except physical, of course) access as well - system ressources would be lower than for the other three options, but I'm not sure whether a high performance is needed I've seen that you can test a virtual server for 3 days without any hassle...

2005-12-07, 18:46	#7
ltd Apr 2003 2²·193 Posts	The link Mystwalker has posted is very interesting. I don't know why i ignored that provider when i looked for a server. There virtual server should be able to even hold the complete database if we don't build the stats every hour. I will check there server next week when i am on holiday and also ask them if the expected load from the stats runs is OK from there side for a virtual server. I had this discussion earlier with other providers and got the answer that they would not allow that load on a virtual server but i think the machines offered at this provider should allow the load when we do only a handfull of statsruns a day. ( Start with one and maybe end with a run every 6 hours) I will keep you informed. Lars

2005-12-08, 10:47	#8
Mystwalker Jul 2004 Potsdam, Germany 3·277 Posts	Maybe it is possible to tweak the DB to lessen the stats creation effort? - optimize queries - applying indexes (if not already done, of course) - aggregate data that doesn't change anymore, so that is does not have to be computed every time

2005-12-08, 19:26	#10
Citrix Jun 2003 2×7×113 Posts	The .org account is pointing to ltd's server, now. @magnav0x, I suggest you run a local LLRnet for your linux computers, since you have a computer with a static IP that you could use as a server. I think that should solve all the problems at present. Citrix

2005-12-08, 20:23	#11
Citrix Jun 2003 2·7·113 Posts	Can we make the basic database public? That way people can study it and come up with new ideas etc. Are there any problems anyone can see? Well the size is an issue, 264 MB. But we could make a smaller demo DB say upto 2 Million only. Or something like that. What do you all think? Citrix