mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > Factoring

Reply
 
Thread Tools
Old 2014-08-23, 14:24   #89
R.D. Silverman
 
R.D. Silverman's Avatar
 
Nov 2003

11101001001002 Posts
Default

Quote:
Originally Posted by alpertron View Post
The previous values are for all Mersenne numbers with exponents less than 232. I think it is better to filter to the range 1M to 10M (so we can perform the PRP test on the cofactor). In this way the statistics from http://www.mersenne.ca/manyfactors.p...n=4&fac_max=10 are:

Code:
10 prime factors known for 1 Mersenne number
9 prime factors known for 1 Mersenne number
8 prime factors known for 5 Mersenne numbers
7 prime factors known for 16 Mersenne numbers -> 0.003 % 
6 prime factors known for 114 Mersenne numbers -> 0.019 %
5 prime factors known for 682 Mersenne numbers -> 0.116 %
4 prime factors known for 4,337 Mersenne numbers -> 0.740 %
You are making a basic faulty assumption throughout your entire
discussion.

Consider the range of exponents that you are considering.
Let us say for the moment that it is [2, 50M]. Do you understand
that by Erdos-Kac, the number of expected factors varies WIDELY
over that range???


Furthermore, the data arises from factoring efforts that vary widely
across that range as well. You need to find ALL factors less than
N^alpha for a FIXED alpha as N varies from 2^2-1 to 2^~50M-1.

Over that range the SIZE of the composites changes from 1 digit to
~35 MILLION digits.
R.D. Silverman is offline   Reply With Quote
Old 2014-08-23, 14:32   #90
alpertron
 
alpertron's Avatar
 
Aug 2002
Buenos Aires, Argentina

2·683 Posts
Default

Quote:
Originally Posted by R.D. Silverman View Post
You are making a basic faulty assumption throughout your entire
discussion.

Consider the range of exponents that you are considering.
Let us say for the moment that it is [2, 50M]. Do you understand
that by Erdos-Kac, the number of expected factors varies WIDELY
over that range???


Furthermore, the data arises from factoring efforts that vary widely
across that range as well. You need to find ALL factors less than
N^alpha for a FIXED alpha as N varies from 2^2-1 to 2^~50M-1.
It is impossible to find "ALL factors less than N^alpha for a FIXED alpha as N varies from 2^2-1 to 2^~50M-1" as you said because of the different sizes of the numbers we are considering. As that cannot be done (so the current theory does not help in this problem), I'm using the current statistics and the number of prime factors appears to follow a geometric distribution. That means that it is better to start with Mersenne numbers that already have a large number of prime factors, because the probability to find a new prime factor does not depend on the number of prime factors already found.
Quote:
Over that range the SIZE of the composites changes from 1 digit to
~35 MILLION digits.
It is not 35 million, but 15 million.

Last fiddled with by alpertron on 2014-08-23 at 14:43
alpertron is offline   Reply With Quote
Old 2014-08-23, 14:47   #91
R.D. Silverman
 
R.D. Silverman's Avatar
 
Nov 2003

22×5×373 Posts
Default

Quote:
Originally Posted by alpertron View Post
It is impossible to find "ALL factors less than N^alpha for a FIXED alpha as N varies from 2^2-1 to 2^~50M-1" as you said because of the different sizes of the numbers we are considering.
Of course it is impossible. But until you have such data, trying to
draw conclusions from your data is erroneous.

Quote:

As that cannot be done (so the current theory does not help in this problem), I'm using the current statistics and the number of prime factors appears to follow a geometric distribution.
Which shows that your data is wrong/incomplete. re: Erdos-Kac
R.D. Silverman is offline   Reply With Quote
Old 2014-08-23, 14:51   #92
alpertron
 
alpertron's Avatar
 
Aug 2002
Buenos Aires, Argentina

2·683 Posts
Default

What is the expected distribution of prime factors if we knew all prime factors below a certain constant bound B, instead of N^alpha?
alpertron is offline   Reply With Quote
Old 2014-08-23, 17:47   #93
pdazzl
 
Apr 2014

7716 Posts
Default

Quote:
Originally Posted by alpertron View Post
I think it is better to filter to the range 1M to 10M (so we can perform the PRP test on the cofactor). In this way the statistics from http://www.mersenne.ca/manyfactors.p...n=4&fac_max=10 are:
I think that I am in agreement with you, the 1M to 10M/20M range may be the ideal breadth range to scan.

The crux of this problem comes back to current hardware limitations. Let's say 2^56 is a reasonable TF range to breadth scan exponents. A good question posed could be "Given a TF range of 2^56, what range of exponents will you find the highest density of exponents with discovered factors of 10 or more".

Another thing to consider is a prime factor can only divide one Mersenne number; thus as the exponents get bigger, the starting point of prime factors gets bigger (2p-1) and the density of primes gets smaller as primes get bigger one could infer that bigger exponents(over 1B) would need a higher TF range to reach the same density of discovered factors in an exponent range.

All the over 1B exponents with at least 8 known prime factors were discovered by me in the last couple weeks, there were no 1B+ exponents with at least 8 known prime factors just a few weeks ago. I have yet to bump an over 1B exponent up to 9 known prime factors.

Last fiddled with by pdazzl on 2014-08-23 at 17:49
pdazzl is offline   Reply With Quote
Old 2014-08-23, 18:10   #94
R.D. Silverman
 
R.D. Silverman's Avatar
 
Nov 2003

746010 Posts
Default

Quote:
Originally Posted by alpertron View Post
What is the expected distribution of prime factors if we knew all prime factors below a certain constant bound B, instead of N^alpha?
Define 'distribution'.

Do you want the counting function (Erdos-Kac) , or do you want the density function for factor sizes (Dickman's function)????
R.D. Silverman is offline   Reply With Quote
Old 2014-08-23, 19:23   #95
wblipp
 
wblipp's Avatar
 
"William"
May 2003
New Haven

93E16 Posts
Default

Quote:
Originally Posted by R.D. Silverman View Post
This is correct. I do not know which would be more successful. I strongly suspect (based on some experience with similar things) that a breadth-first search will succeed with less expected work. I have not crunched through the numbers
I did crunch some numbers, but mostly learned that I need crunch a different set of numbers.

For various levels of "n" digits, I calculated the probability a number has 11 factors less than n digits. Then I calculated the ECM effort to clear that many candidates to n digits. "n" = 30 digits turned out to be the most efficient. This took much more time than running this one number to 45 digits (the median of finding the next factor).

But it's a stupid approach. The vast majority of the time is spent completing ECM to high levels for candidates that have few factors of small size. It's a waste of time because those numbers are very unlikely to have enough large factors to reach the total count of 11. I'm confident that some process of dropping those candidates with few factors at low levels will be much more effective.

A tip to others - don't forget that you cannot find 10^9 candidates with exponents near 10^7.
wblipp is offline   Reply With Quote
Old 2014-08-23, 22:00   #96
alpertron
 
alpertron's Avatar
 
Aug 2002
Buenos Aires, Argentina

2×683 Posts
Default

Quote:
Originally Posted by R.D. Silverman View Post
Define 'distribution'.

Do you want the counting function (Erdos-Kac) , or do you want the density function for factor sizes (Dickman's function)????
I want to know the expected numbers in last table I presented to you:

Code:
10 prime factors known for 1 Mersenne number
9 prime factors known for 1 Mersenne number
8 prime factors known for 5 Mersenne numbers
7 prime factors known for 16 Mersenne numbers -> 0.003 % 
6 prime factors known for 114 Mersenne numbers -> 0.019 %
5 prime factors known for 682 Mersenne numbers -> 0.116 %
4 prime factors known for 4,337 Mersenne numbers -> 0.740 %
for the range of exponents 1M to 10M for the following factor bounds: 1025, 1030 and 1035. You will need to replace the numbers 1, 1, 5, 16, 114, 682 and 4337 by the expected values.

Last fiddled with by alpertron on 2014-08-23 at 22:01
alpertron is offline   Reply With Quote
Old 2014-08-24, 04:32   #97
wblipp
 
wblipp's Avatar
 
"William"
May 2003
New Haven

2·7·132 Posts
Default

Quote:
Originally Posted by alpertron View Post
I want to know the expected numbers ... for the range of exponents 1M to 10M for the following factor bounds: 1025, 1030 and 1035.
Here's what I did for exponent 107 and factor bound 1030.

We know there are not any factors below 107. Beyond this we expect the number of factors to be typical. We know that the expected number of factors between 10^7 and 10^30 is ln(30/7) = 1.455. We expect the number of factors to be distributed Poisson. The probability of 11 or more in a Poisson random variable with this mean is 4.94 * 10-8.

I'm not sure about the way I handled the small factor issue. For larger factors, I've previously looked at data that shows these estimates are reasonable in spite of the 2kn+1 issue. I guess I should look at a bunch of exponents near 10^7 and see how many factors show up between below10^10. My approach says it should be ln(10/7) = 0.357.
wblipp is offline   Reply With Quote
Old 2014-08-24, 05:28   #98
pdazzl
 
Apr 2014

7×17 Posts
Default

Quote:
Originally Posted by wblipp View Post
Here's what I did for exponent 107 and factor bound 1030.

We know there are not any factors below 107. Beyond this we expect the number of factors to be typical. We know that the expected number of factors between 10^7 and 10^30 is ln(30/7) = 1.455. We expect the number of factors to be distributed Poisson. The probability of 11 or more in a Poisson random variable with this mean is 4.94 * 10-8.

I'm not sure about the way I handled the small factor issue. For larger factors, I've previously looked at data that shows these estimates are reasonable in spite of the 2kn+1 issue. I guess I should look at a bunch of exponents near 10^7 and see how many factors show up between below10^10. My approach says it should be ln(10/7) = 0.357.

The 10th prime of the 7M # was 18 digits. So the probability that this scenario was possible would be based off ln(18/7)? Then probability multiplied by the number of primes between 1M and 10M?
pdazzl is offline   Reply With Quote
Old 2014-08-24, 15:53   #99
pdazzl
 
Apr 2014

11910 Posts
Default

I think that's the question we're looking for an anwer on...just how rare are these upper numbers that we've so far found in terms of probability. Is it a blue lobster, or an albino lobster? :)

http://www.thefeaturedcreature.com/2...-lobsters.html
pdazzl is offline   Reply With Quote
Reply



Similar Threads
Thread Thread Starter Forum Replies Last Post
New P+1 record factor akruppa Factoring 5 2007-11-01 16:47
Greg Childers finds Record P+1 Factor wblipp ElevenSmooth 9 2005-12-27 20:18
Record ECM factor found philmoore Factoring 10 2005-02-27 09:38
ECM Server for Record Size Factors at 8195 wblipp ElevenSmooth 1 2003-11-25 15:47
Record ECM factor found by Prime95 philmoore Lounge 0 2003-06-24 20:41

All times are UTC. The time now is 14:54.


Mon Aug 2 14:54:01 UTC 2021 up 10 days, 9:23, 0 users, load averages: 2.95, 3.24, 3.57

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.