New server discussion
 

My only idea is that the server pspnet.no-ip.org on port 12984? I did a scan on the host and the port appears open, so what else could the issue be, other than the host not accepting incomming connections. Suppose I could jet on over to the UK and kick the server or something.


Edit by LTD: Sorry this entry should have not been splited but i don't know how to move it back

I have allready mailed Footmaster to look at the server.
Sorry but there is nothing else i can do about it.

Lars

Edit by LTD: Sorry this entry should have not been splited but i don't know how to move it back

Thats the small problem. The IP is not static so the redirect must go against the domain name if that is possible.

Our next problem are the linux machines that run for magnav0x and need the fixed IP entry cause of problems with domain name resolution in some of the linux clients.

Then we have to decide how we procede.
There are three possible ways.
1. We go back to the old server at footmaster if he is willing to continue to run it. Advantage:It is a machine with static IP and there is no problem with changing the client configuration.
Diadvantage: Machine is known to have some stability problems.
2. We continue to run with my server.
Advantage: I have everything in my hands what makes it easier to insert new ranges if needed or to remove sieved out k/n pairs within a day. It also gives me a better chance to come up with automated stats updates in the future as file handling will be easier.
Disadvantage: It cost me an extra 10Euro per month for the connection. ( Thats not really a problem as i am willing to pay that)
The server has to prove that it is stable.
The server has not a static IP
3. We move to the server offered by magnav0x.

OK let the discussion start.

Lars

Ill leave the decision up to you. I will transfer the .org account to your account in a day or two. (check email), so no more IP issues.

May be the linux computer's problems can be fixed?


What ever you think is best, is ok with me.

Citrix

voting for trying the 2nd choice

drakkar

Maybe hosting it on a virtual server would be another possibility.

- the price is < 10 Euros meanwhile
- static IP address is available
- "direct" (except physical, of course) access as well
- system ressources would be lower than for the other three options, but I'm not sure whether a high performance is needed

I've seen that you can [url=https://www.server4you.de/de/v/vservertest.html]test[/url] a virtual server for 3 days without any hassle...

The link Mystwalker has posted is very interesting.
I don't know why i ignored that provider when i looked for a server.
There virtual server should be able to even hold the complete database
if we don't build the stats every hour.
I will check there server next week when i am on holiday and also ask them
if the expected load from the stats runs is OK from there side for a virtual server.

I had this discussion earlier with other providers and got the answer that they would not allow that load on a virtual server but i think the machines offered at this provider should allow the load when we do only a handfull of statsruns a day. ( Start with one and maybe end with a run every 6 hours)

I will keep you informed.

Lars

Maybe it is possible to tweak the DB to lessen the stats creation effort?

- optimize queries
- applying indexes (if not already done, of course)
- aggregate data that doesn't change anymore, so that is does not have to be computed every time

[QUOTE=Mystwalker]Maybe it is possible to tweak the DB to lessen the stats creation effort?

- optimize queries
- applying indexes (if not already done, of course)
- aggregate data that doesn't change anymore, so that is does not have to be computed every time[/QUOTE]
Here an answer to your suggestion.

There is allways space for optimized queries but i have no good ideas at the moment.

Indexes are set up as far as it makes sence with the RAM installation i have on my machine. But there are some queries that can not use an index due to some restrictions of mysql.

I have already aggregated data as far as it was easy possible. For example stats for users/teams are created within a second.
Importing new results is also done within "no time".
The most time is spend to create stats tables like "distribution of untested values".
These tables are made out of several queries with nice things like "group by"/ "min"/ "max"/"sum"/... in different combinations. I do not know other ways to get these informations without a significant danger to have inconsistent data in the display or without a significant slowdown of the data import.

To give an impression of the amount of data which has to be handled.
The complete database has a size of 264MB at the moment.

Lars

The .org account is pointing to ltd's server, now.

@magnav0x, I suggest you run a local LLRnet for your linux computers, since you have a computer with a static IP that you could use as a server. I think that should solve all the problems at present.

Citrix

Can we make the basic database public? That way people can study it and come up with new ideas etc. Are there any problems anyone can see?


Well the size is an issue, 264 MB. But we could make a smaller demo DB say upto 2 Million only. Or something like that.

What do you all think?

Citrix