Colab question - Page 7

chalsall · 2020-04-16, 15:33

Quote:

Originally Posted by kladner

It came up with a P4, which seems to run at about 0.4 of the T4 speed.

Yeah. One of the tricks we've figured out is if you get a P4 or a K80, go to the Runtime menu and choose "Factory Reset". Then "Connect" again, and rerun your Notebook. After a few itterations you should get a P100 or a T4 -- worth the effort!

kladner · 2020-04-16, 15:59

Quote:

Originally Posted by chalsall

Yeah. One of the tricks we've figured out is if you get a P4 or a K80, go to the Runtime menu and choose "Factory Reset". Then "Connect" again, and rerun your Notebook. After a few itterations you should get a P100 or a T4 -- worth the effort!

Thanks! That got me a P100. Looks like it runs at about 0.65 of a T4.

UPDATE: After 8.5 hours, the CPU is up to 77% of Stage 1 of its first P-1 run. ~~Two cores of an i7-6700K do both stages in 3-3.5 hours.~~ In the past I have found information on the CPU running the notebook, but now I can't track it down. It seems hard to believe that even a single core would take that long on Stage 1.
EDIT: EEK! I have to retract my statement about 6700K run times (@ 4.3 GHz, 32 GiB DDR4-3000). Total brain fart. I'm seeing S1 ~5 hours, and S2 a bit over 6 hours.
Found the CPU type in Primenet account summary, and of course on the CPUs page. Currently:
Intel Xeon E3-1230 v6 @ 3.50GHz GPU72_TF Linux64,Prime95,v29.8,build 6 2020-04-17 01:04
OK. In broad terms, if some parity is assumed between CPUs, doubling the 6700K S1 timing says a single core might take ~10 hours. The single 3.5 GHz Xeon core is not going to match that. It is at 83% at 9h 52m.

OK. After a few Factory resets I got a T4 again. (The resets were after I poked the wrong thing and disconnected the notebook.) However, the CPU started a new P-1. The one that was running is in the GPU72 Assignments, showing ~82% Stage one. Is there some way to recover this job?

Dang! T4s are bloody fast! Does a 'what makes sense' assignment (99.7M) in 32 min where the best my 1060 can do is about 3 times that. I know that is lower rank and older hardware, but Sheesh!

kladner · 2020-04-17, 16:41

I must be missing something. I now have two partial P-1 S1 assignments, and the current run started another. I've looked through the thread but haven't found anything relevant for searching "resume." Sorry for being needy.

chalsall · 2020-04-17, 16:50

Quote:

Originally Posted by kladner

I must be missing something. I now have two partial P-1 S1 assignments, and the current run started another. I've looked through the thread but haven't found anything relevant for searching "resume." Sorry for being needy.

No problem. And I don't think this behavior has been clearly laid out...

The P-1 assignment code has a longer timeout period between reissuing work. Forty (40#) minutes between the last check-in (CKPoint file or Estimated completion) and when it will be reissued to another Instance. I can probably shorten this now that the code (finally) looks sane (read: no edge-cases (that I know of)).

You *will* get this assignment back, with the checkpoint file to continue from. So at most ten minutes of work will have been lost (average five, of course).

P.S. Oh, also... I don't yet have the system un-reserving abandoned assignments without work done yet. Maybe over the weekend I can implement that -- not a bug, it just means a few assignments may collect in your account while being processed.

kladner · 2020-04-17, 17:06

That is a relief! Thanks Chris. I currently have 3 at 10%, 19%, and 98%. Meanwhile it is working on a 4th. It's good to know it will return to those. I'm still just running 1 notebook, but I've been thinking about getting another Google account to try running another.

One other thing: In Tools>Settings>Miscellaneous what do the setting for Power, Corgi mode, and Kitty mode do? Are they applicable to our work?

chalsall · 2020-04-17, 17:25

Quote:

Originally Posted by kladner

One other thing: In Tools>Settings>Miscellaneous what do the setting for Power, Corgi mode, and Kitty mode do? Are they applicable to our work?

Not at all applicable to our work. But very amusing to try... Googlers have a great sense of humor! I particularily like Kitty mode!

kladner · 2020-04-17, 17:54

LOL! I'll give it a try on the next restart. Thanks again.

Later: No restart was needed. Try turning them on together.

chalsall · 2020-04-17, 20:38

So, I plan to start producing training videos, to teach kids how to do various geeky things.

I'm just getting started, and uploaded my very first YouTube video just now. This is using some really neat Open Source desktop capture software I've found --
Open Broadcaster Software. Still making friends with it, but wow! Seem very capable.

My first video is an experiment; mostly just a proof-of-concept. The audio is effectively non-existent. It's picking up my office fan and my typing (I forgot to speak during the recording). But the video shows the Factory Reset trick, as well as how I use my Reverse SSH Tunnels to get Bash shell access to and telemetry from the running sessions.

https://youtu.be/IAXEpRvUEkc

kladner · 2020-04-17, 23:27

I think cultivating and encouraging geeky kids is a fantastic idea! They may be really glad for the support, too.

kladner · 2020-04-18, 02:58

Quote:

I've been thinking about getting another Google account to try running another.

oops. Misconception, I think. After more study I just started another notebook with my key on it. Both are P100s at the moment. I haven't lucked into a T4 for a while. I don't know how you manage to snag 7. I did go paid BTW. Not running mfaktc locally won't pay for it, but the machine will get cooler and quieter.

So far, the second instance has not showed up in GPU72 or Primenet.

chalsall · 2020-04-18, 03:20

Quote:

Originally Posted by kladner

oops. Misconception, I think. After more study I just started another notebook with my key on it. Both are P100s at the moment. I haven't lucked into a T4 for a while. I don't know how you manage to snag 7. I did go paid BTW. Not running mfaktc locally won't pay for it, but the machine will get cooler and quieter. So far, the second instance has not showed up in GPU72 or Primenet.

I see in my Admin report that you are running two instances, both with the same name. If you want to differentiate between them, just create a new Instance Key (or more).

So you know, all your TF results show up on Primenet under the GPU72_TF "virtual machine". If you create a new key, a new machine will appear on Primenet for your P-1 submissions.

Lastly, Chuck is also using the paid tier, and he's reported he's only ever seen P100s (he regularly runs four at a time). This surprises me a bit, since I'm on the free tier (paid isn't available except in the USA) and quite regularly get T4s.

2020-04-17, 17:06	#71
kladner "Kieren" Jul 2011 In My Own Galaxy! 2·3·1,693 Posts	That is a relief! Thanks Chris. I currently have 3 at 10%, 19%, and 98%. Meanwhile it is working on a 4th. It's good to know it will return to those. I'm still just running 1 notebook, but I've been thinking about getting another Google account to try running another. One other thing: In Tools>Settings>Miscellaneous what do the setting for Power, Corgi mode, and Kitty mode do? Are they applicable to our work? Last fiddled with by kladner on 2020-04-17 at 17:19 Reason: another question: corgi? kitty?

2020-04-17, 17:54	#73
kladner "Kieren" Jul 2011 In My Own Galaxy! 2·3·1,693 Posts	LOL! I'll give it a try on the next restart. Thanks again. Later: No restart was needed. Try turning them on together. Last fiddled with by kladner on 2020-04-17 at 23:16

2020-04-17, 20:38	#74
chalsall If I May "Chris Halsall" Sep 2002 Barbados 2×5×7×139 Posts	Becoming a YouTube Star! (Or maybe just a Nerd...) So, I plan to start producing training videos, to teach kids how to do various geeky things. I'm just getting started, and uploaded my very first YouTube video just now. This is using some really neat Open Source desktop capture software I've found -- Open Broadcaster Software. Still making friends with it, but wow! Seem very capable. My first video is an experiment; mostly just a proof-of-concept. The audio is effectively non-existent. It's picking up my office fan and my typing (I forgot to speak during the recording). But the video shows the Factory Reset trick, as well as how I use my Reverse SSH Tunnels to get Bash shell access to and telemetry from the running sessions. https://youtu.be/IAXEpRvUEkc

2020-04-17, 16:41	#69
kladner "Kieren" Jul 2011 In My Own Galaxy! 10158₁₀ Posts	I must be missing something. I now have two partial P-1 S1 assignments, and the current run started another. I've looked through the thread but haven't found anything relevant for searching "resume." Sorry for being needy.

2020-04-17, 23:27	#75
kladner "Kieren" Jul 2011 In My Own Galaxy! 2·3·1,693 Posts	I think cultivating and encouraging geeky kids is a fantastic idea! They may be really glad for the support, too.