Output text in data format?

[snme2pm1]

Originally Posted by Gordon

I "get" what you are saying, trying to create a worktodo.txt file for mfaktc can be a pain. I end up highlighting the stuff on the web page then copy'n'paste to a text file using edit and then search and replace...

Bit of a fag, but doable.

My comprehension stops short of understanding what "bit of a fag" might mean.
My first guess is that might be some admission of difficulty.
I do not concede any difficulty editing mersenne.org/report_factoring_effort material for worktodo purposes.
Perhaps it is the the tool for the purpose that matters.
I tend to use TextPad.

[Uncwilly]

Originally Posted by TheMawn

I can't imagine anyone ever queries 50,000 lines of text just to look at them in the web page. I usually copy it all into a results.txt anyway and then open Excel to process the data. I don't know how many people do that.

I used to do it by hand, until I found that Excel can grab the table all by itself. I set my spreadsheet up to grab 2 longish tables (4500-8000 rows) and then work from there. I have attached a picture for where to find it in the old menu system.


[edit]BTW, you will want to uncheck text-only when you pass the URL to excel. And with the new server, it all takes me ~10 seconds once the spreadsheet is open, before making it all automated and copying everything by hand and sorting it out, it took about 3 minutes each time.[/edit]
[edit2]http://bit.ly/XHJdW4[/edit]

[LaurV]

If you grab your expos and drop them to mersenne.ca, it can create a worktodo list for you. I however use programmer's notepad 2, to which I made a small macro with search and replace to get rid of the p-1 data.

[James Heinrich]

Originally Posted by TheMawn

I just don't get why nobody is understanding what my request is.
Instead of a giant page full of lines of text, how about the page lets me download a raw .txt file instead?

I understand your request, but I hadn't seen this thread until now. Now that I know where/what change you're looking for I should be able to do something about it.

[James Heinrich]

You should now have a download option. Let me know if it's not working as intended.
You can in theory choose the download option for either text or HTML output, but presumably you would usually want the text version.

I also increased the max-rows from 50k to 100k (for text, HTML output remains limited 10k)

If you want another checkbox to generate worktodo directly from that report let me know what you want it to look like, should be trivial to add.

[kracker]

Originally Posted by James Heinrich

You should now have a download option. Let me know if it's not working as intended.
You can in theory choose the download option for either text or HTML output, but presumably you would usually want the text version.

I also increased the max-rows from 50k to 100k (for text, HTML output remains limited 10k)

If you want another checkbox to generate worktodo directly from that report let me know what you want it to look like, should be trivial to add.

I'm not pushing it.... but is it possible for a option to remove all P-1/ECM data from it?(pure TF data)

[James Heinrich]

Originally Posted by kracker

I'm not pushing it.... but is it possible for a option to remove all P-1/ECM data from it?(pure TF data)

Do you mean remove the last 2 columns of the report (B1/B2), or remove exponents from the list that have had P-1/ECM done?

edit: if you meant remove B1/B2 columns... done
If you meant something else, please explain further.

[kracker]

Originally Posted by James Heinrich

Do you mean remove the last 2 columns of the report (B1/B2), or remove exponents from the list that have had P-1/ECM done?

edit: if you meant remove B1/B2 columns... done
If you meant something else, please explain further.

Exactly what I was thinking, Thank you!!

[James Heinrich]

No problem. If someone uses this report to generate worktodo for TF please let me know what you would like the output to be like. Specifically the target TF level -- should it be set to current+1, a fixed number, or a placeholder like "xx" so you can search-replace with whatever you want?

[Mark Rose]

I say just use curl and awk ;D

[LaurV]

Filling it with "from 1 to 10000" returns nothing. However, the "2 to 10000" returns the right list... (default when picked from the menu on the left, the box is filled with "1").

Now, if we are at it, (I mean you, James ), can we have a "limited" number of rows for the "work done" report? I mean, beside of "exponent range" boxes, just a "show last 100 results" box, where I can edit the 100, same as it is done for top producer lists?

I don't know if it makes too much sense from the server's point of view, here it depends how the query is organized, maybe it needs to search all the DB to get the last results, so it may *not* be less work for the server, but certainly would be less data to transfer, because we are usually interested only in the results form the last day, week, whatever, so if I feel "100" in the box and check the "don't show futile Tf work done" box, then I will only get 100 lines instead of 15k lines, i.e. transfer 10k instead of 1.5 megs, and yet have all the report I need.

Currently, the report gives us thousands of lines we don't need, and it is very slow if you check the boxen that exclude the "lot of text generation" (as TF results), because the DB is still searched for ages for very old LL results to fill in all those thousands of lines. It's worth thinking about. Most of us won't need to see the very old reports (and transfer hundreds of kilobytes of them) after every submission...