Mlucas v19 available - Page 4

tdulcet · 2020-05-20, 12:40

I wrote a script to download, setup, build and run Mlucas on Linux. It supports x86 Intel and AMD and ARM CPUs: https://github.com/tdulcet/Distribut...Scripts#mlucas

If the required dependencies (Make and the GNU C compiler) are already installed, it should work on any Linux distribution. Otherwise, it will install the required dependencies on Ubuntu and Debian/Raspbian. Pull requests are welcome!

By creating a Makefile and using Make's jobs (-j) feature with one job for each CPU thread, this script will build Mlucas significantly faster than if you manually ran the gcc commands in the Mlucas README. For example, if your CPU has four CPU threads, it will build approximately four times faster. This script follows the recommended instructions on the Mlucas README for each architecture and CPU, which should provide the best performance for most users. It also saves the Makefile so users can easily change the gcc parameters and rerun make.

There is a log of the script running on Travis CI here. Note that there are over 20,000 lines of output, most of which are warnings from gcc. There are also separate scripts to download, setup and run Prime95 and CUDALucas on Linux.

ewmayer · 2020-05-21, 19:02

@tdulcet - thanks for this! Yes, parallel-buildability is the one clear advantage automake has over my beloved command-line mode.

I think a good way to proceed is to let other Mlucas-building GIMPSers try your script out, if feedback is positive I'll be happy to add a link to it, along with suitable text and credit-to-you, on the README page. Sound good?

tdulcet · 2020-05-22, 02:00

@ewmayer Sounds great. Thanks! Feedback is always welcome.

ewmayer · 2020-06-07, 20:40

Quote:

Originally Posted by tdulcet

@ewmayer Sounds great. Thanks! Feedback is always welcome.

FYI, I added a note re. your script under "News" at the Mlucas readme page - hopefully that will encourage a few more people to try it out and provide feedback.

bayanne · 2020-07-05, 11:05

Curiosity has got the better of me.
Will the new ARM cpu being designed to run Mac OS11 be able to run Mlucas, or is it far too early to know ...

Thanks

ewmayer · 2020-07-05, 23:35

Quote:

Originally Posted by bayanne

Curiosity has got the better of me.
Will the new ARM cpu being designed to run Mac OS11 be able to run Mlucas, or is it far too early to know ...

Thanks

I intend to port my ARM inline-asm routines to the forthcoming "Apple cores", yes.

ewmayer · 2020-07-08, 23:36

Couple significant announcements, of the I-have-good-news-and-bad-news variety.

o First, the bad: I have found and fixed a pair of critical bugs affecting FFT lengths of form 3*2^k. This means current GIMPS double-checks at FFT length 3M (3072K) and recently-reached-by-the-GIMPS-first-time-test-wavefront 6M (6144K). The bug is specific to 256-bit SIMD builds, meaning x86 avx and avx2-targeting builds. Assuming a multithreaded build, only FFT radix sets of form 192,[powers of 2] are affected, but radix-192 is the most common leading radix appearing in the runtime-based mlucas.cfg tuning file for GIMPS-relevant FFT lengths of the above form, in my experience. ARM builds are not affected, but I rebuilt those binaries as a matter of course, to make sure my bugfix didn't inadvertently break anything there.

o Now the good news: Thanks to Loïc Le Loarer, we have a vastly improved version of the primenet.py assignment-management script for users to try out. This uses Primenet v5 API calls to do cool stuff like register one's computer and monitor progress of one's various runs across multiple devices, as shown in the attachment below.

Check out the Mlucas readme page for details and updated links!

kriesel · 2020-07-09, 03:41

Quote:

Originally Posted by ewmayer

I have found and fixed a pair of critical bugs affecting FFT lengths of form 3*2^k. This means current GIMPS double-checks at FFT length 3M (3072K) and recently-reached-by-the-GIMPS-first-time-test-wavefront 6M (6144K). The bug is specific to 256-bit SIMD builds, meaning x86 avx and avx2-targeting builds. Assuming a multithreaded build, only FFT radix sets of form 192,[powers of 2] are affected, but radix-192 is the most common leading radix appearing in the runtime-based mlucas.cfg tuning file for GIMPS-relevant FFT lengths of the above form, in my experience. ARM builds are not affected, but I rebuilt those binaries as a matter of course, to make sure my bugfix didn't inadvertently break anything there.

This raises some questions.
100Mdigit exponents use 18M ffts.
For example, complex FFT radices 36 16 16 32 32
which is 3² 2^k.
Are they affected too? Have they been checked for whether they're affected?
How many versions back do the relevant bugs go?
But it would not affect SSE2 builds, correct?

ewmayer · 2020-07-09, 05:29

Quote:

Originally Posted by kriesel

This raises some questions.
100Mdigit exponents use 18M ffts.
For example, complex FFT radices 36 16 16 32 32
which is 3² 2^k.
Are they affected too? Have they been checked for whether they're affected?
How many versions back do the relevant bugs go?
But it would not affect SSE2 builds, correct?

The patch-related notes on the readme detail all this - your example is FFT length 9*2^k, not the 3*2^k possibly affected by the bug. The bug is actually quite easy to look for based on certain key params in the carry-related sourcefiles, now that I know to double-check those prior to release.

Bug is only related to new code introduced in v19, and if your run at whatever FFT length and radices doesn't crash for expos < 98% the max permitted for the given FFT length (look for the p[ = ...]/pmax_rec on startup, it's unaffected by the bug.

henryzz · 2020-07-09, 11:59

Are any exponents potentially affected tested and double checked with mlucas?

tdulcet · 2020-07-09, 14:10

Quote:

Originally Posted by ewmayer

Thanks to Loïc Le Loarer, we have a vastly improved version of the primenet.py assignment-management script for users to try out.

Thank you Loïc Le Loarer for creating this new PrimeNet script! I just updated my Install Script for Linux to use it. It will automatically set most of the --register options with the computers system info.

Quote:

Originally Posted by ewmayer

I have found and fixed a pair of critical bugs affecting FFT lengths of form 3*2^k.

@ewmayer I tried to download the new source tarballs, but I am getting the old MD5 checksums and not what is listed on the Mlucas README. I was going to update my scripts with the new checksums.

2020-05-20, 12:40	#34
tdulcet "Teal Dulcet" Jun 2018 1C₁₆ Posts	Install Script for Linux I wrote a script to download, setup, build and run Mlucas on Linux. It supports x86 Intel and AMD and ARM CPUs: https://github.com/tdulcet/Distribut...Scripts#mlucas If the required dependencies (Make and the GNU C compiler) are already installed, it should work on any Linux distribution. Otherwise, it will install the required dependencies on Ubuntu and Debian/Raspbian. Pull requests are welcome! By creating a Makefile and using Make's jobs (-j) feature with one job for each CPU thread, this script will build Mlucas significantly faster than if you manually ran the gcc commands in the Mlucas README. For example, if your CPU has four CPU threads, it will build approximately four times faster. This script follows the recommended instructions on the Mlucas README for each architecture and CPU, which should provide the best performance for most users. It also saves the Makefile so users can easily change the gcc parameters and rerun make. There is a log of the script running on Travis CI here. Note that there are over 20,000 lines of output, most of which are warnings from gcc. There are also separate scripts to download, setup and run Prime95 and CUDALucas on Linux.

2020-07-08, 23:36	#40
ewmayer ∂²ω=0 Sep 2002 República de California 2³×1,453 Posts	Couple significant announcements, of the I-have-good-news-and-bad-news variety. o First, the bad: I have found and fixed a pair of critical bugs affecting FFT lengths of form 3*2^k. This means current GIMPS double-checks at FFT length 3M (3072K) and recently-reached-by-the-GIMPS-first-time-test-wavefront 6M (6144K). The bug is specific to 256-bit SIMD builds, meaning x86 avx and avx2-targeting builds. Assuming a multithreaded build, only FFT radix sets of form 192,[powers of 2] are affected, but radix-192 is the most common leading radix appearing in the runtime-based mlucas.cfg tuning file for GIMPS-relevant FFT lengths of the above form, in my experience. ARM builds are not affected, but I rebuilt those binaries as a matter of course, to make sure my bugfix didn't inadvertently break anything there. o Now the good news: Thanks to Loïc Le Loarer, we have a vastly improved version of the primenet.py assignment-management script for users to try out. This uses Primenet v5 API calls to do cool stuff like register one's computer and monitor progress of one's various runs across multiple devices, as shown in the attachment below. Check out the Mlucas readme page for details and updated links! Attached Thumbnails

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Mlucas v18 available	ewmayer	Mlucas	48	2019-11-28 02:53
Mlucas version 17	ewmayer	Mlucas	3	2017-06-17 11:18
MLucas on IBM Mainframe	Lorenzo	Mlucas	52	2016-03-13 08:45
Mlucas on Sparc -	Unregistered	Mlucas	0	2009-10-27 20:35
mlucas on sun	delta_t	Mlucas	14	2007-10-04 05:45

2020-05-21, 19:02	#35
ewmayer ∂²ω=0 Sep 2002 República de California 2³·1,453 Posts	@tdulcet - thanks for this! Yes, parallel-buildability is the one clear advantage automake has over my beloved command-line mode. I think a good way to proceed is to let other Mlucas-building GIMPSers try your script out, if feedback is positive I'll be happy to add a link to it, along with suitable text and credit-to-you, on the README page. Sound good?

2020-05-22, 02:00	#36
tdulcet "Teal Dulcet" Jun 2018 2²×7 Posts	@ewmayer Sounds great. Thanks! Feedback is always welcome.

2020-07-05, 11:05	#38
bayanne "Tony Gott" Aug 2002 Yell, Shetland, UK 3·107 Posts	Curiosity has got the better of me. Will the new ARM cpu being designed to run Mac OS11 be able to run Mlucas, or is it far too early to know ... Thanks

2020-07-09, 11:59	#43
henryzz Just call me Henry "David" Sep 2007 Cambridge (GMT/BST) 3×1,951 Posts	Are any exponents potentially affected tested and double checked with mlucas?