mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > Software

Reply
 
Thread Tools
Old 2004-02-19, 03:52   #1
HiddenWarrior
 
HiddenWarrior's Avatar
 
Jun 2003
Russia, Novosibirsk

2×107 Posts
Default FILE vs. MDB

I came to idea that it will be great if Prime95 will store all processing data (content of p* and q* files) not in files but in database (Microsoft Access for example .mdb). There are some positive reasons for that:
1. No data loss. For example, when working with file, some data in it can be lost due to bad disk fragmentation. Some time ago I have to redo 5 million iterations of LLT on 33M exponent coz p* file got some errors when was written... There are no such problem with databases.
2. Sometimes it is faster to read/write from/to database than from file.

Comments?
HiddenWarrior is offline   Reply With Quote
Old 2004-02-19, 04:38   #2
dsouza123
 
dsouza123's Avatar
 
Sep 2002

66210 Posts
Default

Databases have the same problems.

Databases are saved as files unless they only exist in memory, if it is just in memory then a power outage would wipe it out.
It could be a fast write to memory with a delayed write to disk.

When databases crash they also lose information.

The speed of writing to a database that is stored on disk is dependent on
the efficiency of the disk writing code and other things, so writing a single
file should be faster if the disk writing code is efficient because the database
has to get the information, format it, write to disk and update other information in the database.

Maybe the p and q files should be written twice, ( one copy may be good ).
Or written slower or verified. Maybe if it were written in numbered packets
(like tcp) the size of a disk cluster, they could be found and resequenced easier if lost.
Each packet would have the exponent, iteration, packet number and chunk of data.

Disk fragmentation doesn't cause a file to be corrupt, it just makes it hard or impossible to put it back together if deleted.

Usually a disk has lost clusters or some other file system problem if it is losing parts of a file.

There is a possibility of bugs in the routine to write or read the p and q files,
but is unlikely because many people use them without problems.
Unless it is a very subtle bug that can only surface with very rare conditions.
dsouza123 is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
P-1 File Name Bug NBtarheel_33 Software 2 2010-06-06 08:29
WorkToDo File storm5510 Software 9 2009-08-18 00:18
Dat File? Xentar Sierpinski/Riesel Base 5 10 2008-06-23 02:09
Sieve dat file em99010pepe Sierpinski/Riesel Base 5 13 2006-12-05 01:50
How to change Pxxxx.001 file to Pxxxx file? edorajh Software 3 2003-12-31 12:30

All times are UTC. The time now is 12:08.

Fri Apr 23 12:08:44 UTC 2021 up 15 days, 6:49, 0 users, load averages: 1.66, 1.83, 1.79

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.