Script for split file

[pepi37]

I need script that will "ask" me number of workers and then split input file equally into worktodo.txt file ( and if possible add "Worker line") ( in this case 3 workers)

example

input.txt
PRP=1,2,3
PRP=1,2,4
PRP=1,2,5


output

[Worker #1]
PRP=1,2,3
[Worker #2]
PRP=1,2,4
[Worker #3]
PRP=1,2,5

Thanks

[paulunderwood]

Originally Posted by pepi37

I need script that will "ask" me number of workers and then split input file equally into worktodo.txt file ( and if possible add "Worker line") ( in this case 3 workers)

Windows or Linux? What is your preferred (scripting) language?

[kruoli]

In bash:

if [ $# -ne 3 ];
then
  echo 'Usage: bash splitter.sh [in file] [out file] [number of workers]';
  exit -1;
fi;
if ls "$1."* 1> /dev/null 2>&1;
then
  echo 'Temporary files could not be created.';
  exit -2;
fi;
range=$(seq 1 $3);
if [ $? -ne 0 ];
then
  echo 'The worker count was not numerical.';
  exit -3;
fi;

for w in $range;
do
  echo "[Worker #$w]" >> "$1.tmp";
done;
cat "$1" >> "$1.tmp";
split -n r/$3 "$1.tmp" "$1.s";
cat "$1.s"* > "$2";
rm "$1."*;

[pepi37]

Originally Posted by paulunderwood

Windows or Linux? What is your preferred (scripting) language?

Whatever I can run under Linux 😀
Language, everyone you like it. I will adopt
Thanks

[Uncwilly]

What about this tool? https://www.mersenne.ca/balance.php

[pepi37]

Originally Posted by Uncwilly

What about this tool? https://www.mersenne.ca/balance.php

At first sight look perfect!

[pepi37]

Originally Posted by Uncwilly

What about this tool? https://www.mersenne.ca/balance.php

But doesnot work on PRP tests...

[pepi37]

Originally Posted by kruoli

In bash:

if [ $# -ne 3 ];
then
  echo 'Usage: bash splitter.sh [in file] [out file] [number of workers]';
  exit -1;
fi;
if ls "$1."* 1> /dev/null 2>&1;
then
  echo 'Temporary files could not be created.';
  exit -2;
fi;
range=$(seq 1 $3);
if [ $? -ne 0 ];
then
  echo 'The worker count was not numerical.';
  exit -3;
fi;

for w in $range;
do
  echo "[Worker #$w]" >> "$1.tmp";
done;
cat "$1" >> "$1.tmp";
split -n r/$3 "$1.tmp" "$1.s";
cat "$1.s"* > "$2";
rm "$1."*;

Work perfect.
Now I will see can I adopt it to Win
Thanks!

[Uncwilly]

Originally Posted by pepi37

But doesnot work on PRP tests...

I just tried it with some made up PRP lines and it recognized them, sorted them, and attempted to balance them.

[Batalov]

bash

N=3
for i in `seq 1 $N`; do 
  echo '[Worker #'$i']'; awk 'a++%'$N'=='$i'-1' input.txt
done > output.txt

[paulunderwood]

Here is a perl script. usage: perl myscript.pl input_file worker_count > output_file

open(fh,"<",$ARGV[0]);
$count=0;
while(<fh>){$count++;}
close(fh);

open(fh,"<",$ARGV[0]);
$per_worker=int($count/$ARGV[1]);
$extras=$count%$ARGV[1];
$worker_blurb="[Worker \#";
$worker=0;
while(<fh>){
        $line=$_;
        $count++;
        if($count>$per_worker){
                $count=0;
                print("\n");
                $worker++;
                print($worker_blurb.$worker."]\n");
                if($extras==0){$per_worker--;}
                $extras--;
        }
        print($line);
}
close(fh);