error: cannot locate relation

cardmaker · 2017-03-22, 11:34

Mon Mar 20 18:34:54 2017 Found 57047148 relations, 100.0% of the estimated minimum (57029236).
Mon Mar 20 18:34:54 2017 -> ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc1
Mon Mar 20 18:34:57 2017
Mon Mar 20 18:34:57 2017
Mon Mar 20 18:34:57 2017 Msieve v. 1.52 (SVN Nicht versioniertes Verzeichnis)
Mon Mar 20 18:34:57 2017 random seeds: 2c9fb8c6 7cd3e086
Mon Mar 20 18:34:57 2017 factoring ...................edited by me .....................(154 digits)
Mon Mar 20 18:34:58 2017 no P-1/P+1/ECM available, skipping
Mon Mar 20 18:34:58 2017 commencing number field sieve (154-digit input)
Mon Mar 20 18:34:59 2017 R0: -2174355777841529198328326414512
Mon Mar 20 18:34:59 2017 R1: 88895928538698403
Mon Mar 20 18:34:59 2017 A0: 116018582650438596594949373039092456755
Mon Mar 20 18:34:59 2017 A1: -7245692906973895032403217429627
Mon Mar 20 18:34:59 2017 A2: -11620312480264375825430343
Mon Mar 20 18:34:59 2017 A3: -31729392293279897
Mon Mar 20 18:34:59 2017 A4: -76118983948
Mon Mar 20 18:34:59 2017 A5: 180
Mon Mar 20 18:34:59 2017 skew 14859258.20, size 4.609e-15, alpha -6.125, combined = 2.729e-12 rroots = 3
Mon Mar 20 18:34:59 2017
Mon Mar 20 18:34:59 2017 commencing relation filtering
Mon Mar 20 18:34:59 2017 estimated available RAM is 5968.3 MB
Mon Mar 20 18:34:59 2017 commencing duplicate removal, pass 1
Mon Mar 20 18:55:01 2017 found 11457021 hash collisions in 57047147 relations
Mon Mar 20 18:55:42 2017 added 121867 free relations
Mon Mar 20 18:55:42 2017 commencing duplicate removal, pass 2
Mon Mar 20 19:04:29 2017 found 11267809 duplicates and 45901205 unique relations
Mon Mar 20 19:04:29 2017 memory use: 330.4 MB
Mon Mar 20 19:04:29 2017 reading ideals above 49741824
Mon Mar 20 19:04:29 2017 commencing singleton removal, initial pass
Mon Mar 20 19:12:17 2017 memory use: 753.0 MB
Mon Mar 20 19:12:17 2017 reading all ideals from disk
Mon Mar 20 19:16:04 2017 memory use: 741.7 MB
Mon Mar 20 19:16:08 2017 commencing in-memory singleton removal
Mon Mar 20 19:16:11 2017 begin with 45901205 relations and 39665804 unique ideals
Mon Mar 20 19:16:42 2017 reduce to 26021466 relations and 17379282 ideals in 16 passes
Mon Mar 20 19:16:42 2017 max relations containing the same ideal: 30
Mon Mar 20 19:16:44 2017 reading ideals above 720000
Mon Mar 20 19:16:44 2017 commencing singleton removal, initial pass
Mon Mar 20 19:22:15 2017 memory use: 689.0 MB
Mon Mar 20 19:22:15 2017 reading all ideals from disk
Mon Mar 20 19:24:34 2017 memory use: 924.4 MB
Mon Mar 20 19:24:41 2017 keeping 23195245 ideals with weight <= 200, target excess is 145607
Mon Mar 20 19:24:47 2017 commencing in-memory singleton removal
Mon Mar 20 19:24:52 2017 begin with 26021483 relations and 23195245 unique ideals
Mon Mar 20 19:25:47 2017 reduce to 25911751 relations and 23085394 ideals in 10 passes
Mon Mar 20 19:25:47 2017 max relations containing the same ideal: 200
Mon Mar 20 19:26:11 2017 removing 2697553 relations and 2297553 ideals in 400000 cliques
Mon Mar 20 19:26:12 2017 commencing in-memory singleton removal
Mon Mar 20 19:26:15 2017 begin with 23214198 relations and 23085394 unique ideals
Mon Mar 20 19:26:53 2017 reduce to 23006488 relations and 20576073 ideals in 10 passes
Mon Mar 20 19:26:53 2017 max relations containing the same ideal: 192
Mon Mar 20 19:27:14 2017 removing 2033898 relations and 1633898 ideals in 400000 cliques
Mon Mar 20 19:27:15 2017 commencing in-memory singleton removal
Mon Mar 20 19:27:18 2017 begin with 20972590 relations and 20576073 unique ideals
Mon Mar 20 19:27:43 2017 reduce to 20837176 relations and 18804383 ideals in 7 passes
Mon Mar 20 19:27:43 2017 max relations containing the same ideal: 181
Mon Mar 20 19:27:59 2017 removing 1831353 relations and 1431353 ideals in 400000 cliques
Mon Mar 20 19:28:00 2017 commencing in-memory singleton removal
Mon Mar 20 19:28:02 2017 begin with 19005823 relations and 18804383 unique ideals
Mon Mar 20 19:28:25 2017 reduce to 18885239 relations and 17250344 ideals in 8 passes
Mon Mar 20 19:28:25 2017 max relations containing the same ideal: 170
Mon Mar 20 19:28:40 2017 removing 1724255 relations and 1324255 ideals in 400000 cliques
Mon Mar 20 19:28:41 2017 commencing in-memory singleton removal
Mon Mar 20 19:28:43 2017 begin with 17160984 relations and 17250344 unique ideals
Mon Mar 20 19:29:05 2017 reduce to 17045000 relations and 15807950 ideals in 8 passes
Mon Mar 20 19:29:05 2017 max relations containing the same ideal: 159
Mon Mar 20 19:29:18 2017 removing 1657229 relations and 1257229 ideals in 400000 cliques
Mon Mar 20 19:29:19 2017 commencing in-memory singleton removal
Mon Mar 20 19:29:21 2017 begin with 15387771 relations and 15807950 unique ideals
Mon Mar 20 19:29:37 2017 reduce to 15271815 relations and 14432392 ideals in 7 passes
Mon Mar 20 19:29:37 2017 max relations containing the same ideal: 148
Mon Mar 20 19:29:49 2017 removing 1613736 relations and 1213736 ideals in 400000 cliques
Mon Mar 20 19:29:49 2017 commencing in-memory singleton removal
Mon Mar 20 19:29:51 2017 begin with 13658079 relations and 14432392 unique ideals
Mon Mar 20 19:30:08 2017 reduce to 13536798 relations and 13094703 ideals in 8 passes
Mon Mar 20 19:30:08 2017 max relations containing the same ideal: 135
Mon Mar 20 19:30:19 2017 removing 1167442 relations and 894252 ideals in 273190 cliques
Mon Mar 20 19:30:20 2017 commencing in-memory singleton removal
Mon Mar 20 19:30:21 2017 begin with 12369356 relations and 13094703 unique ideals
Mon Mar 20 19:30:34 2017 reduce to 12301349 relations and 12131242 ideals in 7 passes
Mon Mar 20 19:30:34 2017 max relations containing the same ideal: 124
Mon Mar 20 19:30:45 2017 relations with 0 large ideals: 475
Mon Mar 20 19:30:45 2017 relations with 1 large ideals: 584
Mon Mar 20 19:30:45 2017 relations with 2 large ideals: 9431
Mon Mar 20 19:30:45 2017 relations with 3 large ideals: 91478
Mon Mar 20 19:30:45 2017 relations with 4 large ideals: 474777
Mon Mar 20 19:30:45 2017 relations with 5 large ideals: 1474779
Mon Mar 20 19:30:45 2017 relations with 6 large ideals: 2849215
Mon Mar 20 19:30:45 2017 relations with 7+ large ideals: 7400610
Mon Mar 20 19:30:45 2017 commencing 2-way merge
Mon Mar 20 19:30:58 2017 reduce to 7911093 relation sets and 7740986 unique ideals
Mon Mar 20 19:30:58 2017 commencing full merge
Mon Mar 20 19:34:12 2017 memory use: 932.1 MB
Mon Mar 20 19:34:13 2017 found 4263310 cycles, need 4239186
Mon Mar 20 19:34:15 2017 weight of 4239186 cycles is about 296784562 (70.01/cycle)
Mon Mar 20 19:34:15 2017 distribution of cycle lengths:
Mon Mar 20 19:34:15 2017 1 relations: 483922
Mon Mar 20 19:34:15 2017 2 relations: 529017
Mon Mar 20 19:34:15 2017 3 relations: 542195
Mon Mar 20 19:34:15 2017 4 relations: 503094
Mon Mar 20 19:34:15 2017 5 relations: 460585
Mon Mar 20 19:34:15 2017 6 relations: 400615
Mon Mar 20 19:34:15 2017 7 relations: 341429
Mon Mar 20 19:34:15 2017 8 relations: 277175
Mon Mar 20 19:34:15 2017 9 relations: 214897
Mon Mar 20 19:34:15 2017 10+ relations: 486257
Mon Mar 20 19:34:15 2017 heaviest cycle: 19 relations
Mon Mar 20 19:34:17 2017 commencing cycle optimization
Mon Mar 20 19:34:27 2017 start with 22098355 relations
Mon Mar 20 19:35:15 2017 pruned 547871 relations
Mon Mar 20 19:35:15 2017 memory use: 736.6 MB
Mon Mar 20 19:35:15 2017 distribution of cycle lengths:
Mon Mar 20 19:35:15 2017 1 relations: 483922
Mon Mar 20 19:35:15 2017 2 relations: 540850
Mon Mar 20 19:35:15 2017 3 relations: 562059
Mon Mar 20 19:35:15 2017 4 relations: 515896
Mon Mar 20 19:35:15 2017 5 relations: 472478
Mon Mar 20 19:35:15 2017 6 relations: 406495
Mon Mar 20 19:35:15 2017 7 relations: 344209
Mon Mar 20 19:35:15 2017 8 relations: 273936
Mon Mar 20 19:35:15 2017 9 relations: 209208
Mon Mar 20 19:35:15 2017 10+ relations: 430133
Mon Mar 20 19:35:15 2017 heaviest cycle: 18 relations
Mon Mar 20 19:35:28 2017 RelProcTime: 3629
Mon Mar 20 19:35:28 2017 elapsed time 01:00:31
Mon Mar 20 19:35:31 2017 LatSieveTime: 27802.8
Mon Mar 20 19:35:31 2017 -> Running matrix solving step ...
Mon Mar 20 19:35:31 2017 -> ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc2
Mon Mar 20 19:35:31 2017
Mon Mar 20 19:35:31 2017
Mon Mar 20 19:35:31 2017 Msieve v. 1.52 (SVN Nicht versioniertes Verzeichnis)
Mon Mar 20 19:35:31 2017 random seeds: 96480443 6c11f15c
Mon Mar 20 19:35:31 2017 factoring ...................edited by me ..................... (154 digits)
Mon Mar 20 19:35:32 2017 no P-1/P+1/ECM available, skipping
Mon Mar 20 19:35:32 2017 commencing number field sieve (154-digit input)
Mon Mar 20 19:35:32 2017 R0: -2174355777841529198328326414512
Mon Mar 20 19:35:32 2017 R1: 88895928538698403
Mon Mar 20 19:35:32 2017 A0: 116018582650438596594949373039092456755
Mon Mar 20 19:35:32 2017 A1: -7245692906973895032403217429627
Mon Mar 20 19:35:32 2017 A2: -11620312480264375825430343
Mon Mar 20 19:35:32 2017 A3: -31729392293279897
Mon Mar 20 19:35:32 2017 A4: -76118983948
Mon Mar 20 19:35:32 2017 A5: 180
Mon Mar 20 19:35:32 2017 skew 14859258.20, size 4.609e-15, alpha -6.125, combined = 2.729e-12 rroots = 3
Mon Mar 20 19:35:32 2017
Mon Mar 20 19:35:32 2017 commencing linear algebra
Mon Mar 20 19:35:33 2017 read 4239186 cycles
Mon Mar 20 19:35:41 2017 cycles contain 12183053 unique relations
Mon Mar 20 19:39:31 2017 read 12183053 relations
Mon Mar 20 19:39:56 2017 using 20 quadratic characters above 536870792
Mon Mar 20 19:41:05 2017 building initial matrix
Mon Mar 20 19:44:35 2017 memory use: 1658.7 MB
Mon Mar 20 19:44:39 2017 read 4239186 cycles
Mon Mar 20 19:44:40 2017 matrix is 4239008 x 4239186 (1271.7 MB) with weight 399187390 (94.17/col)
Mon Mar 20 19:44:40 2017 sparse part has weight 286741728 (67.64/col)
Mon Mar 20 19:45:42 2017 filtering completed in 2 passes
Mon Mar 20 19:45:44 2017 matrix is 4238253 x 4238431 (1271.7 MB) with weight 399163506 (94.18/col)
Mon Mar 20 19:45:44 2017 sparse part has weight 286737154 (67.65/col)
Mon Mar 20 19:46:09 2017 matrix starts at (0, 0)
Mon Mar 20 19:46:10 2017 matrix is 4238253 x 4238431 (1271.7 MB) with weight 399163506 (94.18/col)
Mon Mar 20 19:46:10 2017 sparse part has weight 286737154 (67.65/col)
Mon Mar 20 19:46:10 2017 saving the first 48 matrix rows for later
Mon Mar 20 19:46:11 2017 matrix includes 64 packed rows
Mon Mar 20 19:46:12 2017 matrix is 4238205 x 4238431 (1231.3 MB) with weight 317198593 (74.84/col)
Mon Mar 20 19:46:12 2017 sparse part has weight 280395773 (66.16/col)
Mon Mar 20 19:46:12 2017 using block size 8192 and superblock size 1474560 for processor cache size 15360 kB
Mon Mar 20 19:46:29 2017 commencing Lanczos iteration (2 threads)
Mon Mar 20 19:46:29 2017 memory use: 994.3 MB
Mon Mar 20 19:47:35 2017 linear algebra at 0.0%, ETA 49h21m
Mon Mar 20 19:47:52 2017 checkpointing every 100000 dimensions
Wed Mar 22 03:54:17 2017 -> factmsieve.py (v0.83)
Wed Mar 22 03:54:17 2017 -> This is client 1 of 1
Wed Mar 22 03:54:17 2017 -> Running on 2 Cores with 1 hyper-thread per Core
Wed Mar 22 03:54:17 2017 -> Working with NAME = /root/ggnfs/example
Wed Mar 22 03:54:17 2017 -> Selected lattice siever: gnfs-lasieve4I14e
Wed Mar 22 03:54:17 2017 -> No parameter change detected, resuming...
Wed Mar 22 03:54:17 2017 -> Running setup ...
Wed Mar 22 03:54:17 2017 -> Estimated minimum relations needed: 5.70292e+07
Wed Mar 22 03:54:17 2017 -> cleaning up before a restart
Wed Mar 22 03:54:19 2017 -> Running lattice siever ...
Wed Mar 22 03:54:19 2017 -> entering sieving loop
Wed Mar 22 03:54:19 2017 -> Running matrix solving step ...
Wed Mar 22 03:54:19 2017 -> ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc2
Wed Mar 22 03:54:21 2017
Wed Mar 22 03:54:21 2017
Wed Mar 22 03:54:21 2017 Msieve v. 1.52 (SVN Nicht versioniertes Verzeichnis)
Wed Mar 22 03:54:21 2017 random seeds: b0d42aa2 6fe8d1dd
Wed Mar 22 03:54:21 2017 factoring...................edited by me ..................... (154 digits)
Wed Mar 22 03:54:22 2017 no P-1/P+1/ECM available, skipping
Wed Mar 22 03:54:23 2017 commencing number field sieve (154-digit input)
Wed Mar 22 03:54:24 2017 R0: -2174355777841529198328326414512
Wed Mar 22 03:54:24 2017 R1: 88895928538698403
Wed Mar 22 03:54:24 2017 A0: 116018582650438596594949373039092456755
Wed Mar 22 03:54:24 2017 A1: -7245692906973895032403217429627
Wed Mar 22 03:54:24 2017 A2: -11620312480264375825430343
Wed Mar 22 03:54:24 2017 A3: -31729392293279897
Wed Mar 22 03:54:24 2017 A4: -76118983948
Wed Mar 22 03:54:24 2017 A5: 180
Wed Mar 22 03:54:24 2017 skew 14859258.20, size 4.609e-15, alpha -6.125, combined = 2.729e-12 rroots = 3
Wed Mar 22 03:54:24 2017
Wed Mar 22 03:54:24 2017 commencing linear algebra
Wed Mar 22 03:55:57 2017 read 4238431 cycles
Wed Mar 22 03:56:04 2017 cycles contain 12183021 unique relations
Wed Mar 22 03:56:04 2017 read 0 relations
Wed Mar 22 03:56:04 2017 error: cannot locate relation 57047147

hello, i got this error , whats sould i doo?

fivemack · 2017-03-22, 12:04

I find that errors of that kind often mean that I've run out of disc space and some intermediate files have been corrupted; at worst you may have to redo the linear algebra.

cardmaker · 2017-03-22, 13:55

Hello, disk space is enough i have more space, how i redo algebra?

chris2be8 · 2017-03-22, 16:44

First, make a backup of everything in the directory and save it somewhere else. So if you get stuck you can restore from the backup and try again.

Did the system crash during the linear algebra? If so that could cause problems that need to be fixed by running msieve manually.

To restart the linear algebra try:
./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -ncr

If that works run:
./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc3

If that fails you could re-run the linear algebra with:
./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc

If you get stuck run "ls -l" in the dir and post the output. That will help us work out what to do.

But don't forget to make a backup first!

Chris

PS, are you running it as root? I've always run it as a normal user account, although that should not stop it from working.

cardmaker · 2017-03-22, 18:02

Many thanks for your replay.

at the first cmd like you said this error come.

root@vmi94057:~/ggnfs/msieve# ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -ncr
error: column too large; corrupt file?
root@vmi94057:~/ggnfs/msieve#

Dubslow · 2017-03-22, 19:13

Please post the output of ls -l, and PLEASE use the [code] tag for when you copy and paste terminal output.

Code:

like this

cardmaker · 2017-03-22, 20:11

here is the output:

Code:

root@vmi94057:~# cd ggnfs
root@vmi94057:~/ggnfs# ls -l
total 462968
drwxr-xr-x 2 root root      4096 Dec 17 13:11 bin
-rw-r--r-- 1 root root      5777 Mar 22 19:06 example.dat
-rw-r--r-- 1 root root 169541096 Mar 22 02:15 example.dat.bak.chk
-rw-r--r-- 1 root root 169541096 Mar 22 03:07 example.dat.chk
-rw-r--r-- 1 root root 103155256 Mar 20 19:45 example.dat.cyc
-rw-r--r-- 1 root root         0 Mar 22 19:06 example.dat.lp
-rw-r--r-- 1 root root         0 Mar 22 19:06 example.dat.mat
-rw-r--r-- 1 root root      3949 Dec 17 14:14 example.dat.T0.p
-rw-r--r-- 1 root root     11280 Dec 17 14:47 example.dat.T1.p
-rw-r--r-- 1 root root       452 Mar 22 15:02 example.fb
-rw-r--r-- 1 root root       155 Mar 22 15:02 example.ini
-rw-r--r-- 1 root root       154 Dec 17 13:16 example.ini.T0
-rw-r--r-- 1 root root       154 Dec 17 13:16 example.ini.T1
-rw-r--r-- 1 root root  12855624 Jan 14 16:36 example.job.T0.afb.0
-rw-r--r-- 1 root root  12855624 Jan 14 16:36 example.job.T1.afb.0
-rw-r--r-- 1 root root         5 Dec 17 14:50 example.lcf
-rw-r--r-- 1 root root    292459 Mar 22 19:07 example.log
-rw-r--r-- 1 root root     25293 Dec 17 14:50 example.log.T0
-rw-r--r-- 1 root root     21827 Dec 17 14:50 example.log.T1
-rw-r--r-- 1 root root   2787840 Dec 17 14:50 example.msp.T0
-rw-r--r-- 1 root root   2830484 Dec 17 14:50 example.msp.T1
-rwxrwxrwx 1 root root       157 Dec 16 12:21 example.n
-rw-r--r-- 1 root root       462 Dec 17 14:50 example.poly
-rwxrwxrwx 1 root root     74986 Oct  9 17:38 factmsieve.84.py
-rwxrwxrwx 1 root root         0 Jun 13  2016 factMsieve.pl
drwxr-xr-x 7 root root      4096 Dec 17 12:58 msieve
root@vmi94057:~/ggnfs#

chris2be8 · 2017-03-23, 16:50

Bad news, example.dat is only 5777 bytes. That should contain all the relations found by sieving. Without them you can't hope to complete the run.

All you can do now is start all over again by deleting all the files named example.* except example.n and example.poly, then re-running factmsieve.py (or factMsieve.pl).

This assume you don't have a copy of example.dat anywhere else.

Chris

Stargate38 · 2017-03-23, 22:10

What number are you trying to factor? All I know is the size (154 digits), and there are a lot of C154s out there.

VBCurtis · 2017-03-23, 22:46

Quote:

Originally Posted by Stargate38

What number are you trying to factor? All I know is the size (154 digits), and there are a lot of C154s out there.

What difference does it make? OP edited it out, and the specific number has nothing to do with the resolution of his problem.

kar_bon · 2017-03-24, 09:25

1. Look at "example.dat.bak.chk" and "example.dat.chk", perhaps they are ok.
Make a copy of the directory and rename perhaphs "example.dat.chk" to "example.dat" and restart with "-nc1".

2. Check, if the entry

Code:

SAVEPAIRS = True

is set in your factmsieve.py (almost at top). This will save a zipped file of the *.dat to "spairs.save.gz" so next time you got a copy of it.

2017-03-22, 11:34	#1
cardmaker Jun 2016 11₁₆ Posts	error: cannot locate relation Mon Mar 20 18:34:54 2017 Found 57047148 relations, 100.0% of the estimated minimum (57029236). Mon Mar 20 18:34:54 2017 -> ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc1 Mon Mar 20 18:34:57 2017 Mon Mar 20 18:34:57 2017 Mon Mar 20 18:34:57 2017 Msieve v. 1.52 (SVN Nicht versioniertes Verzeichnis) Mon Mar 20 18:34:57 2017 random seeds: 2c9fb8c6 7cd3e086 Mon Mar 20 18:34:57 2017 factoring ...................edited by me .....................(154 digits) Mon Mar 20 18:34:58 2017 no P-1/P+1/ECM available, skipping Mon Mar 20 18:34:58 2017 commencing number field sieve (154-digit input) Mon Mar 20 18:34:59 2017 R0: -2174355777841529198328326414512 Mon Mar 20 18:34:59 2017 R1: 88895928538698403 Mon Mar 20 18:34:59 2017 A0: 116018582650438596594949373039092456755 Mon Mar 20 18:34:59 2017 A1: -7245692906973895032403217429627 Mon Mar 20 18:34:59 2017 A2: -11620312480264375825430343 Mon Mar 20 18:34:59 2017 A3: -31729392293279897 Mon Mar 20 18:34:59 2017 A4: -76118983948 Mon Mar 20 18:34:59 2017 A5: 180 Mon Mar 20 18:34:59 2017 skew 14859258.20, size 4.609e-15, alpha -6.125, combined = 2.729e-12 rroots = 3 Mon Mar 20 18:34:59 2017 Mon Mar 20 18:34:59 2017 commencing relation filtering Mon Mar 20 18:34:59 2017 estimated available RAM is 5968.3 MB Mon Mar 20 18:34:59 2017 commencing duplicate removal, pass 1 Mon Mar 20 18:55:01 2017 found 11457021 hash collisions in 57047147 relations Mon Mar 20 18:55:42 2017 added 121867 free relations Mon Mar 20 18:55:42 2017 commencing duplicate removal, pass 2 Mon Mar 20 19:04:29 2017 found 11267809 duplicates and 45901205 unique relations Mon Mar 20 19:04:29 2017 memory use: 330.4 MB Mon Mar 20 19:04:29 2017 reading ideals above 49741824 Mon Mar 20 19:04:29 2017 commencing singleton removal, initial pass Mon Mar 20 19:12:17 2017 memory use: 753.0 MB Mon Mar 20 19:12:17 2017 reading all ideals from disk Mon Mar 20 19:16:04 2017 memory use: 741.7 MB Mon Mar 20 19:16:08 2017 commencing in-memory singleton removal Mon Mar 20 19:16:11 2017 begin with 45901205 relations and 39665804 unique ideals Mon Mar 20 19:16:42 2017 reduce to 26021466 relations and 17379282 ideals in 16 passes Mon Mar 20 19:16:42 2017 max relations containing the same ideal: 30 Mon Mar 20 19:16:44 2017 reading ideals above 720000 Mon Mar 20 19:16:44 2017 commencing singleton removal, initial pass Mon Mar 20 19:22:15 2017 memory use: 689.0 MB Mon Mar 20 19:22:15 2017 reading all ideals from disk Mon Mar 20 19:24:34 2017 memory use: 924.4 MB Mon Mar 20 19:24:41 2017 keeping 23195245 ideals with weight <= 200, target excess is 145607 Mon Mar 20 19:24:47 2017 commencing in-memory singleton removal Mon Mar 20 19:24:52 2017 begin with 26021483 relations and 23195245 unique ideals Mon Mar 20 19:25:47 2017 reduce to 25911751 relations and 23085394 ideals in 10 passes Mon Mar 20 19:25:47 2017 max relations containing the same ideal: 200 Mon Mar 20 19:26:11 2017 removing 2697553 relations and 2297553 ideals in 400000 cliques Mon Mar 20 19:26:12 2017 commencing in-memory singleton removal Mon Mar 20 19:26:15 2017 begin with 23214198 relations and 23085394 unique ideals Mon Mar 20 19:26:53 2017 reduce to 23006488 relations and 20576073 ideals in 10 passes Mon Mar 20 19:26:53 2017 max relations containing the same ideal: 192 Mon Mar 20 19:27:14 2017 removing 2033898 relations and 1633898 ideals in 400000 cliques Mon Mar 20 19:27:15 2017 commencing in-memory singleton removal Mon Mar 20 19:27:18 2017 begin with 20972590 relations and 20576073 unique ideals Mon Mar 20 19:27:43 2017 reduce to 20837176 relations and 18804383 ideals in 7 passes Mon Mar 20 19:27:43 2017 max relations containing the same ideal: 181 Mon Mar 20 19:27:59 2017 removing 1831353 relations and 1431353 ideals in 400000 cliques Mon Mar 20 19:28:00 2017 commencing in-memory singleton removal Mon Mar 20 19:28:02 2017 begin with 19005823 relations and 18804383 unique ideals Mon Mar 20 19:28:25 2017 reduce to 18885239 relations and 17250344 ideals in 8 passes Mon Mar 20 19:28:25 2017 max relations containing the same ideal: 170 Mon Mar 20 19:28:40 2017 removing 1724255 relations and 1324255 ideals in 400000 cliques Mon Mar 20 19:28:41 2017 commencing in-memory singleton removal Mon Mar 20 19:28:43 2017 begin with 17160984 relations and 17250344 unique ideals Mon Mar 20 19:29:05 2017 reduce to 17045000 relations and 15807950 ideals in 8 passes Mon Mar 20 19:29:05 2017 max relations containing the same ideal: 159 Mon Mar 20 19:29:18 2017 removing 1657229 relations and 1257229 ideals in 400000 cliques Mon Mar 20 19:29:19 2017 commencing in-memory singleton removal Mon Mar 20 19:29:21 2017 begin with 15387771 relations and 15807950 unique ideals Mon Mar 20 19:29:37 2017 reduce to 15271815 relations and 14432392 ideals in 7 passes Mon Mar 20 19:29:37 2017 max relations containing the same ideal: 148 Mon Mar 20 19:29:49 2017 removing 1613736 relations and 1213736 ideals in 400000 cliques Mon Mar 20 19:29:49 2017 commencing in-memory singleton removal Mon Mar 20 19:29:51 2017 begin with 13658079 relations and 14432392 unique ideals Mon Mar 20 19:30:08 2017 reduce to 13536798 relations and 13094703 ideals in 8 passes Mon Mar 20 19:30:08 2017 max relations containing the same ideal: 135 Mon Mar 20 19:30:19 2017 removing 1167442 relations and 894252 ideals in 273190 cliques Mon Mar 20 19:30:20 2017 commencing in-memory singleton removal Mon Mar 20 19:30:21 2017 begin with 12369356 relations and 13094703 unique ideals Mon Mar 20 19:30:34 2017 reduce to 12301349 relations and 12131242 ideals in 7 passes Mon Mar 20 19:30:34 2017 max relations containing the same ideal: 124 Mon Mar 20 19:30:45 2017 relations with 0 large ideals: 475 Mon Mar 20 19:30:45 2017 relations with 1 large ideals: 584 Mon Mar 20 19:30:45 2017 relations with 2 large ideals: 9431 Mon Mar 20 19:30:45 2017 relations with 3 large ideals: 91478 Mon Mar 20 19:30:45 2017 relations with 4 large ideals: 474777 Mon Mar 20 19:30:45 2017 relations with 5 large ideals: 1474779 Mon Mar 20 19:30:45 2017 relations with 6 large ideals: 2849215 Mon Mar 20 19:30:45 2017 relations with 7+ large ideals: 7400610 Mon Mar 20 19:30:45 2017 commencing 2-way merge Mon Mar 20 19:30:58 2017 reduce to 7911093 relation sets and 7740986 unique ideals Mon Mar 20 19:30:58 2017 commencing full merge Mon Mar 20 19:34:12 2017 memory use: 932.1 MB Mon Mar 20 19:34:13 2017 found 4263310 cycles, need 4239186 Mon Mar 20 19:34:15 2017 weight of 4239186 cycles is about 296784562 (70.01/cycle) Mon Mar 20 19:34:15 2017 distribution of cycle lengths: Mon Mar 20 19:34:15 2017 1 relations: 483922 Mon Mar 20 19:34:15 2017 2 relations: 529017 Mon Mar 20 19:34:15 2017 3 relations: 542195 Mon Mar 20 19:34:15 2017 4 relations: 503094 Mon Mar 20 19:34:15 2017 5 relations: 460585 Mon Mar 20 19:34:15 2017 6 relations: 400615 Mon Mar 20 19:34:15 2017 7 relations: 341429 Mon Mar 20 19:34:15 2017 8 relations: 277175 Mon Mar 20 19:34:15 2017 9 relations: 214897 Mon Mar 20 19:34:15 2017 10+ relations: 486257 Mon Mar 20 19:34:15 2017 heaviest cycle: 19 relations Mon Mar 20 19:34:17 2017 commencing cycle optimization Mon Mar 20 19:34:27 2017 start with 22098355 relations Mon Mar 20 19:35:15 2017 pruned 547871 relations Mon Mar 20 19:35:15 2017 memory use: 736.6 MB Mon Mar 20 19:35:15 2017 distribution of cycle lengths: Mon Mar 20 19:35:15 2017 1 relations: 483922 Mon Mar 20 19:35:15 2017 2 relations: 540850 Mon Mar 20 19:35:15 2017 3 relations: 562059 Mon Mar 20 19:35:15 2017 4 relations: 515896 Mon Mar 20 19:35:15 2017 5 relations: 472478 Mon Mar 20 19:35:15 2017 6 relations: 406495 Mon Mar 20 19:35:15 2017 7 relations: 344209 Mon Mar 20 19:35:15 2017 8 relations: 273936 Mon Mar 20 19:35:15 2017 9 relations: 209208 Mon Mar 20 19:35:15 2017 10+ relations: 430133 Mon Mar 20 19:35:15 2017 heaviest cycle: 18 relations Mon Mar 20 19:35:28 2017 RelProcTime: 3629 Mon Mar 20 19:35:28 2017 elapsed time 01:00:31 Mon Mar 20 19:35:31 2017 LatSieveTime: 27802.8 Mon Mar 20 19:35:31 2017 -> Running matrix solving step ... Mon Mar 20 19:35:31 2017 -> ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc2 Mon Mar 20 19:35:31 2017 Mon Mar 20 19:35:31 2017 Mon Mar 20 19:35:31 2017 Msieve v. 1.52 (SVN Nicht versioniertes Verzeichnis) Mon Mar 20 19:35:31 2017 random seeds: 96480443 6c11f15c Mon Mar 20 19:35:31 2017 factoring ...................edited by me ..................... (154 digits) Mon Mar 20 19:35:32 2017 no P-1/P+1/ECM available, skipping Mon Mar 20 19:35:32 2017 commencing number field sieve (154-digit input) Mon Mar 20 19:35:32 2017 R0: -2174355777841529198328326414512 Mon Mar 20 19:35:32 2017 R1: 88895928538698403 Mon Mar 20 19:35:32 2017 A0: 116018582650438596594949373039092456755 Mon Mar 20 19:35:32 2017 A1: -7245692906973895032403217429627 Mon Mar 20 19:35:32 2017 A2: -11620312480264375825430343 Mon Mar 20 19:35:32 2017 A3: -31729392293279897 Mon Mar 20 19:35:32 2017 A4: -76118983948 Mon Mar 20 19:35:32 2017 A5: 180 Mon Mar 20 19:35:32 2017 skew 14859258.20, size 4.609e-15, alpha -6.125, combined = 2.729e-12 rroots = 3 Mon Mar 20 19:35:32 2017 Mon Mar 20 19:35:32 2017 commencing linear algebra Mon Mar 20 19:35:33 2017 read 4239186 cycles Mon Mar 20 19:35:41 2017 cycles contain 12183053 unique relations Mon Mar 20 19:39:31 2017 read 12183053 relations Mon Mar 20 19:39:56 2017 using 20 quadratic characters above 536870792 Mon Mar 20 19:41:05 2017 building initial matrix Mon Mar 20 19:44:35 2017 memory use: 1658.7 MB Mon Mar 20 19:44:39 2017 read 4239186 cycles Mon Mar 20 19:44:40 2017 matrix is 4239008 x 4239186 (1271.7 MB) with weight 399187390 (94.17/col) Mon Mar 20 19:44:40 2017 sparse part has weight 286741728 (67.64/col) Mon Mar 20 19:45:42 2017 filtering completed in 2 passes Mon Mar 20 19:45:44 2017 matrix is 4238253 x 4238431 (1271.7 MB) with weight 399163506 (94.18/col) Mon Mar 20 19:45:44 2017 sparse part has weight 286737154 (67.65/col) Mon Mar 20 19:46:09 2017 matrix starts at (0, 0) Mon Mar 20 19:46:10 2017 matrix is 4238253 x 4238431 (1271.7 MB) with weight 399163506 (94.18/col) Mon Mar 20 19:46:10 2017 sparse part has weight 286737154 (67.65/col) Mon Mar 20 19:46:10 2017 saving the first 48 matrix rows for later Mon Mar 20 19:46:11 2017 matrix includes 64 packed rows Mon Mar 20 19:46:12 2017 matrix is 4238205 x 4238431 (1231.3 MB) with weight 317198593 (74.84/col) Mon Mar 20 19:46:12 2017 sparse part has weight 280395773 (66.16/col) Mon Mar 20 19:46:12 2017 using block size 8192 and superblock size 1474560 for processor cache size 15360 kB Mon Mar 20 19:46:29 2017 commencing Lanczos iteration (2 threads) Mon Mar 20 19:46:29 2017 memory use: 994.3 MB Mon Mar 20 19:47:35 2017 linear algebra at 0.0%, ETA 49h21m Mon Mar 20 19:47:52 2017 checkpointing every 100000 dimensions Wed Mar 22 03:54:17 2017 -> factmsieve.py (v0.83) Wed Mar 22 03:54:17 2017 -> This is client 1 of 1 Wed Mar 22 03:54:17 2017 -> Running on 2 Cores with 1 hyper-thread per Core Wed Mar 22 03:54:17 2017 -> Working with NAME = /root/ggnfs/example Wed Mar 22 03:54:17 2017 -> Selected lattice siever: gnfs-lasieve4I14e Wed Mar 22 03:54:17 2017 -> No parameter change detected, resuming... Wed Mar 22 03:54:17 2017 -> Running setup ... Wed Mar 22 03:54:17 2017 -> Estimated minimum relations needed: 5.70292e+07 Wed Mar 22 03:54:17 2017 -> cleaning up before a restart Wed Mar 22 03:54:19 2017 -> Running lattice siever ... Wed Mar 22 03:54:19 2017 -> entering sieving loop Wed Mar 22 03:54:19 2017 -> Running matrix solving step ... Wed Mar 22 03:54:19 2017 -> ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc2 Wed Mar 22 03:54:21 2017 Wed Mar 22 03:54:21 2017 Wed Mar 22 03:54:21 2017 Msieve v. 1.52 (SVN Nicht versioniertes Verzeichnis) Wed Mar 22 03:54:21 2017 random seeds: b0d42aa2 6fe8d1dd Wed Mar 22 03:54:21 2017 factoring...................edited by me ..................... (154 digits) Wed Mar 22 03:54:22 2017 no P-1/P+1/ECM available, skipping Wed Mar 22 03:54:23 2017 commencing number field sieve (154-digit input) Wed Mar 22 03:54:24 2017 R0: -2174355777841529198328326414512 Wed Mar 22 03:54:24 2017 R1: 88895928538698403 Wed Mar 22 03:54:24 2017 A0: 116018582650438596594949373039092456755 Wed Mar 22 03:54:24 2017 A1: -7245692906973895032403217429627 Wed Mar 22 03:54:24 2017 A2: -11620312480264375825430343 Wed Mar 22 03:54:24 2017 A3: -31729392293279897 Wed Mar 22 03:54:24 2017 A4: -76118983948 Wed Mar 22 03:54:24 2017 A5: 180 Wed Mar 22 03:54:24 2017 skew 14859258.20, size 4.609e-15, alpha -6.125, combined = 2.729e-12 rroots = 3 Wed Mar 22 03:54:24 2017 Wed Mar 22 03:54:24 2017 commencing linear algebra Wed Mar 22 03:55:57 2017 read 4238431 cycles Wed Mar 22 03:56:04 2017 cycles contain 12183021 unique relations Wed Mar 22 03:56:04 2017 read 0 relations Wed Mar 22 03:56:04 2017 error: cannot locate relation 57047147 hello, i got this error , whats sould i doo? Last fiddled with by cardmaker on 2017-03-22 at 11:36

2017-03-22, 19:13	#6
Dubslow Basketry That Evening! "Bunslow the Bold" Jun 2011 40<A<43 -89<O<-88 3·29·83 Posts	Please post the output of ls -l, and PLEASE use the [code] tag for when you copy and paste terminal output. Code: like this

2017-03-24, 09:25	#11
kar_bon Mar 2006 Germany 2,999 Posts	1. Look at "example.dat.bak.chk" and "example.dat.chk", perhaps they are ok. Make a copy of the directory and rename perhaphs "example.dat.chk" to "example.dat" and restart with "-nc1". 2. Check, if the entry Code: SAVEPAIRS = True is set in your factmsieve.py (almost at top). This will save a zipped file of the *.dat to "spairs.save.gz" so next time you got a copy of it.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Yafu: relation packing	LaurV	YAFU	6	2017-08-06 08:33
The relation of time taken for NFS and CPU/Hardware	didgogns	Factoring	2	2017-06-11 18:04
Error reading relation	jux	YAFU	24	2016-02-13 10:43
I don't understand these relation counts	fivemack	Msieve	4	2012-10-29 11:26
msieve C157 sqrt error: relation xxxx corrupt	tgrdy	Msieve	6	2010-08-20 21:51

2017-03-22, 12:04	#2
fivemack (loop (#_fork)) Feb 2006 Cambridge, England 2×7×461 Posts	I find that errors of that kind often mean that I've run out of disc space and some intermediate files have been corrupted; at worst you may have to redo the linear algebra.

2017-03-22, 13:55	#3
cardmaker Jun 2016 17 Posts	Hello, disk space is enough i have more space, how i redo algebra?

2017-03-22, 16:44	#4
chris2be8 Sep 2009 100101111010₂ Posts	First, make a backup of everything in the directory and save it somewhere else. So if you get stuck you can restore from the backup and try again. Did the system crash during the linear algebra? If so that could cause problems that need to be fixed by running msieve manually. To restart the linear algebra try: ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -ncr If that works run: ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc3 If that fails you could re-run the linear algebra with: ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -nc If you get stuck run "ls -l" in the dir and post the output. That will help us work out what to do. But don't forget to make a backup first! Chris PS, are you running it as root? I've always run it as a normal user account, although that should not stop it from working.

2017-03-22, 18:02	#5
cardmaker Jun 2016 21₈ Posts	Many thanks for your replay. at the first cmd like you said this error come. root@vmi94057:~/ggnfs/msieve# ./msieve -s /root/ggnfs/example.dat -l /root/ggnfs/example.log -i /root/ggnfs/example.ini -nf /root/ggnfs/example.fb -t 2 -ncr error: column too large; corrupt file? root@vmi94057:~/ggnfs/msieve#

2017-03-23, 16:50	#8
chris2be8 Sep 2009 2×1,213 Posts	Bad news, example.dat is only 5777 bytes. That should contain all the relations found by sieving. Without them you can't hope to complete the run. All you can do now is start all over again by deleting all the files named example.* except example.n and example.poly, then re-running factmsieve.py (or factMsieve.pl). This assume you don't have a copy of example.dat anywhere else. Chris

2017-03-23, 22:10	#9
Stargate38 "Daniel Jackson" May 2011 14285714285714285714 3·251 Posts	What number are you trying to factor? All I know is the size (154 digits), and there are a lot of C154s out there.