Output text in data format?
 

Hi,

I have a feature request. Some of you may have already seen this since I stupidly posted it in the wrong place :redface:

While I'm at it, I'll try to clarify a bit of what I meant since it wasn't understood very well.

In certain places on mersenne.org, when acquiring data, there is an option "print a simple text report." See the attachment. The query is limited to 50,000 lines, I would imagine because of the load it might place on the server.

With the server getting its upgrade, I was thinking it might be possible for this limit to be raised, but having 50,000 lines of text displayed in a browser is a bit cumbersome, and if the limit were extended to something like 250,000, it would only become worse.

On the other hand, I was thinking if there was an option to have the results uploaded to a report.txt, it might be feasible to have a very large amount of data quickly gathered into a format that's ready to be processed.

Is this clearer?

[QUOTE=TheMawn;380742]... having 50,000 lines of text displayed in a browser is a bit cumbersome, and if the limit were extended to something like 250,000, it would only become worse.[/QUOTE]IIRC the HTTP [url=http://tools.ietf.org/html/rfc2183]Content-Disposition[/url] header tells the browser the appropriate method of display/play/download.

[QUOTE=TheMawn;380742]Hi,

I have a feature request. Some of you may have already seen this since I stupidly posted it in the wrong place :redface:

While I'm at it, I'll try to clarify a bit of what I meant since it wasn't understood very well.

In certain places on mersenne.org, when acquiring data, there is an option "print a simple text report." See the attachment. The query is limited to 50,000 lines, I would imagine because of the load it might place on the server.

With the server getting its upgrade, I was thinking it might be possible for this limit to be raised, but having 50,000 lines of text displayed in a browser is a bit cumbersome, and if the limit were extended to something like 250,000, it would only become worse.

On the other hand, I was thinking if there was an option to have the results uploaded to a report.txt, it might be feasible to have a very large amount of data quickly gathered into a format that's ready to be processed.

Is this clearer?[/QUOTE]

I hadn't looked at that section in regards to performance. The new server seems to generate the data in a somewhat reasonable time, given the amount of content it spits out. It's a little CPU heavy during the query so that's probably a good candidate for some optimization down the road.

As far as getting the "print" button to generate a simmple text/plain output instead of formatted inside the page, that's a design question... it wouldn't make the query run any faster though so unless that could be addressed to handle larger sets of data, I don't know...

If not for increased performance, then maybe for convenience?

I can't imagine anyone ever queries 50,000 lines of text just to look at them in the web page. I usually copy it all into a results.txt anyway and then open Excel to process the data. I don't know how many people do that.

[QUOTE=TheMawn;380764]50,000 lines of text[/QUOTE]

Seems a touch demanding?

[QUOTE]I usually copy it all into a results.txt anyway and then open Excel to process the data. I don't know how many people do that.[/QUOTE]

I imagine you are really thinking of a [B]worktodo.txt[/B], though if that were true why wasn't the Exclude currently assigned exponents button checked?

Well, yes, the idea is to make a worktodo.txt. I was just making that picture to show what I was talking about. Normally yes assigned work would be excluded, but I fail to see how that is in any way relevant to my suggestion.

Anyway, if you want to persist, I can show you a completely different example. See the attachment.

If I wanted to access the data from this page instead, for whatever purposes, the query is limited to 1,000 exponents and it generates a big clunky web page. If mersenne.org just let me download a report.txt instead of displaying everything, it could save me a step.

[QUOTE=TheMawn;380816]See the attachment.

If I wanted to access the data from this page instead, for whatever purposes, the query is limited to 1,000 exponents[/QUOTE]

I don't see any attachment but I don't imagine that would be especially useful anyhow.
Perhaps if I had injected an emoticon my purpose for comment might be been clearer!
I don't for any moment imagine that you would take a shortcut to results.
I note that today results pages from mersenne.org are now offering 3000 lines instead of 1000 formerly, so perhaps more liberal limits to your particular kind of search might also get a rise.
I would think that limits are imposed to prevent server wastage.
I have been guilty of submitting a request where, by finger problem, the upper limit had one too many digits than intended, thus incurring a curtailed response.

I just don't get why nobody is understanding what my request is.

Instead of a giant page full of lines of text, how about the page lets me download a raw .txt file instead?

This was the page I was looking at previously. Again the data there isn't particularly useful to anyone as it is, being very messy. If I was going to process it for any reason, I would copy it all, paste it into a .txt file and then open it in excel and use some clever delimitation options to try to make it more readable.


Again it's limited to 1,000 exponents and if I wanted to look at 10,000 exponents, I would have to f*ck around with this nine more times.


If I have not yet made myself clear then I won't bother trying to explain it any more. And if I have, I would like to know if it would be a lot of work.

Hint: GPU72.com has the option to download worktodo.txt as a file instead of as a great big pile of crap on the page that needs to be manually copied and pasted.

[QUOTE=TheMawn;381200]download a raw .txt file instead?[/QUOTE]

Well that would be a design change isn't it. And that is what you seek. I do get that.

[QUOTE=TheMawn;381200]I just don't get why nobody is understanding what my request is.

Instead of a giant page full of lines of text, how about the page lets me download a raw .txt file instead?[/QUOTE]

I "get" what you are saying, trying to create a worktodo.txt file for mfaktc can be a pain. I end up highlighting the stuff on the web page then copy'n'paste to a text file using edit and then search and replace...

Bit of a fag, but doable.

Even nicer would be an option to directly build the worktodo ie you are asked for

start,number of exponents, end bit