mersenneforum.org

mersenneforum.org (https://www.mersenneforum.org/index.php)
-   Aliquot Sequences (https://www.mersenneforum.org/forumdisplay.php?f=90)
-   -   Reserved for MF - Sequence 4788 (https://www.mersenneforum.org/showthread.php?t=11615)

bur 2021-09-16 14:42

Thanks, to find the number of uniques I just did a [C]wc -l[/C] on the lines not starting with #, does that yield the correct result? Is there a faster way, does remdup output the number somewhere?

EdH 2021-09-16 15:00

[QUOTE=bur;587972]Thanks, to find the number of uniques I just did a [C]wc -l[/C] on the lines not starting with #, does that yield the correct result? Is there a faster way, does remdup output the number somewhere?[/QUOTE]I can't answer the first part, but remdups4 outputs counts to the terminal as it runs.

bur 2021-09-16 15:56

You're right, even with a summary. I must have been blind. Thanks again and sorry for the off-topic.

ryanp 2021-09-16 17:09

I typically run [C]remdups4[/C] after gathering new relations files, though I haven't been keeping track of the % dups.

Currently at 1B uniques as of this morning.

ryanp 2021-09-20 01:41

Latest run is going:

[CODE]Sun Sep 19 16:01:22 2021 commencing relation filtering
Sun Sep 19 16:01:22 2021 setting target matrix density to 120.0
Sun Sep 19 16:01:22 2021 estimated available RAM is 192016.8 MB
Sun Sep 19 16:01:22 2021 commencing duplicate removal, pass 1
Sun Sep 19 19:12:14 2021 found 498163917 hash collisions in 1834320482 relations
Sun Sep 19 19:12:45 2021 commencing duplicate removal, pass 2
Sun Sep 19 19:36:34 2021 found 107391008 duplicates and 1726929474 unique relations
Sun Sep 19 19:36:34 2021 memory use: 16280.0 MB
Sun Sep 19 19:36:35 2021 reading ideals above 1259929600
Sun Sep 19 19:36:35 2021 commencing singleton removal, initial pass[/CODE]

We'll see what happens by morning. Not sure if I quite have enough unique's yet, but it's getting there!

bur 2021-09-20 09:43

Good to know.

[QUOTE]found 107391008 duplicates and 1726929474 unique relations[/QUOTE]Why is the duplicate percentage so low, is that after an inital removal already?

ryanp 2021-09-20 14:16

[QUOTE=bur;588215]Good to know.

Why is the duplicate percentage so low, is that after an inital removal already?[/QUOTE]

I had been running remdups up until now, but the relations file is taking up too much disk space at this point, so now I'm just appending new rel's and handing the file right to msieve.

ryanp 2021-09-21 00:06

The msieve run with 1.72B uniques succeeded, but generated a 169M x 169M matrix. Trying again now, with 1.9B uniques.

charybdis 2021-09-21 00:19

What Q value have you sieved up to, and what is the overall duplication rate like? I'd be interested to know how well my estimates from test-sieving have held up.

Batalov 2021-09-21 01:08

1 Attachment(s)
[QUOTE=ryanp;588270]The msieve run with 1.72B uniques succeeded, but generated a 169M x 169M matrix. Trying again now, with 1.9B uniques.[/QUOTE]
That's the famous cusp (of convergence)

bur 2021-09-21 17:27

[QUOTE]That's the famous cusp (of convergence)[/QUOTE]
Interesting, is it valid for most sizes of numbers? That'd be quite helpful.


All times are UTC. The time now is 21:18.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.