mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > Hardware > GPU Computing

Reply
 
Thread Tools
Old 2016-03-25, 10:53   #1
Brain
 
Brain's Avatar
 
Dec 2009
Peine, Germany

331 Posts
Default Titan's Best Choice

I'd like to exchange experiences with the (classic) Nvidia GTX Titan (GK110): Hardware settings only.
I'm trying to get an overview of the best stable setting for running CUDALucas, mainly for the memory clock. When I started running my first Titan there were incorrect residues with 3000 MHz mem clock. Now I'm running on 2600 MHz and it's fine. DP enabled, of course.
I like to step up the clock a bit more but I'd like to benefit from your experiences:

What is your stable Titan (X/Z) setting?
Mine:
Code:
2x Classic Nvidia GTX Titan (GK110)
Memory Clock:  2600 MHz
Power Target:  100% --> levels out to
Chip Clock D0: 823 MHz @87°C (air)
Chip Clock D1: 836 MHz @84°C (air)
If we also want to share sw settings like "Threads" that's okay for me. I haven't noticed any big performance differences when running CL 2.05.1 on Windows 10 64bit.

Happy Easter, Sebastian
Brain is offline   Reply With Quote
Old 2016-03-25, 15:13   #2
airsquirrels
 
airsquirrels's Avatar
 
"David"
Jul 2015
Ohio

11×47 Posts
Default

I've always been really surprised when people here post about needing to make all these down clocking mods to get stability on their Titans. Mine are all running stock clocks

I have:

5 Titans on water (~40-50*C) - very stable always matching residues
3 Titan blacks on water - (50* C) - very stable always matching residues

2 Titan Zs (EVGA SC) on air (75-85* temps) - one mismatch out of hundreds of tests, running both cores with separate instances of CUDALucas.

I had three more normal Titans on Air that ran without issue and produced matching residues, however two of them exploded the MOSFETs or inductors on the power phase that supplies the memory, so no more regular Titans on Air doing LL. They seem to be fine on TF work as it thrashes a lot less memory.
airsquirrels is offline   Reply With Quote
Old 2016-03-25, 17:50   #3
ATH
Einyen
 
ATH's Avatar
 
Dec 2003
Denmark

2×1,439 Posts
Default

My Titan Black is overclocked by the manufacturer:
http://www.evga.com/Products/Specs/G...4-911e445a6b9f
GPU Base clock: 967 Mhz Boost: 1072 Mhz

vs Base: 889Mhz Boost: 980 Mhz for the base Titan Black settings:
http://www.geforce.com/hardware/desk...specifications

I'm not sure about the memory clock, the EVGA link says "7000Mhz Effective" which sounds like a load of ....
GPU-Z says the memory is only running 1750Mhz. It is very stable not a bad test yet and I have done a lot of double checking with it, but I have not tried to overclock the memory. It is strange that the geforce.com link does not mention the base memory clock it just says 7.0 Gbps which is a transfer rate and not a clock.
ATH is offline   Reply With Quote
Old 2016-05-31, 11:24   #4
diep
 
diep's Avatar
 
Sep 2006
The Netherlands

677 Posts
Default

Yo, is old thread, yet i wonder.

the gddr5 produces CRC outputs - so you can check amount of memory errors roughly by checking the number of CRC problems the gpu's show - do you check those?

I wonder about that 50C with watercooling a little.

Because nowadays cpu's/gpu's should eat a lot less power if you manage to cool them to room temperature. So if you manage to watercool it to 20C, it'll run a lot colder. Might produce less errors then.

Now i'm not watercooling GPU's, i am watercooling lots of cpu's though. With a single eheim pump and in parallel then 4 waterblocks and 4 radiators (one radiator after each heatsink).

the heatsinks in this case are simplistic things from 3 dollar.

this type:

http://www.ebay.com/itm/Aluminium-Wa...gAAOSw1DtXKZyl

I designed in CAD a simplistico plastic thing to mount each 3 dollar waterblock onto motherboard. advantage of the ABS plastic i printed it in is it bends a little so acts like spring pushing very well waterblock onto cpu even though that waterblock is of course junk thing :)

Over here i use eheim pumps - pushes through a lot of water and those pumps really pump through the amount of water they say they pump - instead of those pumps that on paper do much more than in reality.

I use a 15 euro aquarium to hold demineralized water.

Aquarium ==> eheim pump ==> splitters to parallel lines ==> heatsink ==> radiator (8x8CM) ==> Aquarium

So after each heatsink is cheapskate radiator and then waterflow back to aquarium.

Please note each 8x8CM radiator also picked up cheap from ebay i have a low RPM fan onto (don't try this at home), to reduce noise levels as i sit 1.5 meters away from all this - which is the limiting cooling factor.

Radiator like this with G1/4 inch opening can remove 100+ watt hands down roughly - yet with low RPM fan it doesn't get that.

In my experience the sort of fans you buy is crucial. 8x8 CM fans deliver quite a lot of air pressure against low noise - and you need quite some air pressure to cool those radiators well. The sort of bearing the fan then has is crucial for the noise it produces.

Even with this foobar setup i have - cheapskate everywhere - light waterblocks and simplistico radiators of just 8x8CM - there is no way to heat up much above room temperature.

The cooling works of course quadratic better with higher temperature differences.

Challenge for a gpu is bit tougher of course there as mentionned gpu's eat a lot more juice.

Yet did you try to watercool it in such a manner that you get the GPU to room temperature?

Most those expensive kits you can buy are mainly having same opening G1/4 for the waterflow like i have over here. So my fubar setup here then isn't that much worse. With 1/4 inch opening it doesn't matter then how good your pump is if the entire 300+ watt gets watercooled through a single 1/4 inch opening of radiator.
diep is offline   Reply With Quote
Old 2016-05-31, 15:02   #5
tServo
 
tServo's Avatar
 
"Marv"
May 2009
near the Tannhäuser Gate

22×53 Posts
Default

Quote:
Originally Posted by Brain View Post
I'd like to exchange experiences with the (classic) Nvidia GTX Titan (GK110): Hardware settings only.
IMHO, the key to running these boards if using air-cooling is the back plate that cools the memory chips on the back of the board. If you are using water cooling, you may be cooling the board so much that the back plate is not needed. However, I noticed that Evga's Titan Hydro copper boards ( which were factory over clocked ) not only were water cooled but also had a backplate.
I run some Fermi boards in summer and I can do that without destroying the boards by manually cranking the fans between 70 -> 95 percent ( they are in the basement so noise is not an issue ). With my Titans, I have noticed that cranking the fans allows the boards to run faster because they are not performance capped by heat issues.
Just my 2 cents. YMMV.
tServo is offline   Reply With Quote
Old 2016-05-31, 15:43   #6
diep
 
diep's Avatar
 
Sep 2006
The Netherlands

677 Posts
Default

Quote:
Originally Posted by tServo View Post
IMHO, the key to running these boards if using air-cooling is the back plate that cools the memory chips on the back of the board. If you are using water cooling, you may be cooling the board so much that the back plate is not needed. However, I noticed that Evga's Titan Hydro copper boards ( which were factory over clocked ) not only were water cooled but also had a backplate.
I run some Fermi boards in summer and I can do that without destroying the boards by manually cranking the fans between 70 -> 95 percent ( they are in the basement so noise is not an issue ). With my Titans, I have noticed that cranking the fans allows the boards to run faster because they are not performance capped by heat issues.
Just my 2 cents. YMMV.
In factory where they produce the GPU's, that probably is TSMC, the gpu's produced in the middle in general clock way higher without problems than the gpu's at the outside.

So if you are lucky and have 1 from the center then that will have less heat issues.

Also some months later on usually there is process improvements - mostly software related. Typically newer batches of tesla's for example eat less power.

There can be many reasons therefore why one or another suffers more or less from heat related issues - yet one thing is for sure - running mfaktc hits nearby the worst case path of those GPU's - maxing out its power usage and therefore heat.

If you would however manage to cool it to nearby 20C, then power usage of the GPU will drop another 10% or so compared to what it burns when it is 50C.

So real good watercooling might be worth investigating IMHO

Last fiddled with by diep on 2016-05-31 at 15:44
diep is offline   Reply With Quote
Old 2016-05-31, 22:18   #7
henryzz
Just call me Henry
 
henryzz's Avatar
 
"David"
Sep 2007
Cambridge (GMT)

22·1,423 Posts
Default

With water cooling is the cooling based upon room temperature or is there some sort of refrigeration going on?
henryzz is offline   Reply With Quote
Old 2016-06-01, 06:05   #8
LaurV
Romulan Interpreter
 
LaurV's Avatar
 
Jun 2011
Thailand

5×11×157 Posts
Default

Subscribing to what tServo says. Also, you may need some small fans around in the box. The aeration for cases designed for air cooling is not good for water cooling. When I switched to water cooling, in the beginning, I had heat issues with other components in the box. I mean, I had everything on water, mobo, memories, cpu, gpu, so the air in the box wasn't moving much. When you have a huge air-cooler for the CPU, that is "accidentally" cooling many other small things in your box, because it is moving a lot of air around. Things which don't really "need" cooling, like small ICs or mosfets there, so they don't have heatsinks, but when you move to water, they start getting hot. First trick was to turn the case with the back side, up. Hot air going up between the cards, and getting out on top. Then installing small/quiet fans in the case here and there...

Also, be careful with aluminum parts, they have a lot of galvanic effects with other things normally used in a cooling installation, which are usually copper, nickel, steel, etc. Don't mix metals, if you go aluminum, then use everything from it! (radiators including).
LaurV is offline   Reply With Quote
Old 2016-06-01, 13:06   #9
tServo
 
tServo's Avatar
 
"Marv"
May 2009
near the Tannhäuser Gate

22×53 Posts
Default

Quote:
Originally Posted by henryzz View Post
With water cooling is the cooling based upon room temperature or is there some sort of refrigeration going on?
99% of the time, it's room temperature. I have occasionally seen some phase change cooling devices but the companies rarely last. Too expensive to purchase and run.

I believe Asetek has offered some tec ( peltier ) assisted devices in the past. They were placed between the cpu or gnu and the heat-exchange plate of the water cooler.
tServo is offline   Reply With Quote
Old 2016-06-01, 22:54   #10
TObject
 
TObject's Avatar
 
Feb 2012

34·5 Posts
Default

Quote:
Originally Posted by henryzz View Post
With water cooling is the cooling based upon room temperature or is there some sort of refrigeration going on?
Once you go below room temperature you have to take into account condensation that enters the picture.
TObject is offline   Reply With Quote
Old 2016-06-02, 00:05   #11
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

23·17·67 Posts
Default

Quote:
Originally Posted by TObject View Post
Once you go below room temperature you have to take into account condensation that enters the picture.
Or, more specifically, the dew point.

Here in Bimshire our rum and ice and coconut water drinks sweat water as condensation.

So do our servers, if not properly managed....
chalsall is online now   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Titan Black ATH Hardware 15 2017-05-27 22:38
Nvidia announces Titan Xp card ixfd64 GPU Computing 10 2017-05-17 15:19
Nvidia announces Titan X ixfd64 GPU Computing 20 2015-04-28 00:27
Geforce GTX Titan 6GB ATH GPU Computing 295 2013-05-12 21:35
2x AMD 7990 or 2x Nvidia Titan ?? Manpowre GPU Computing 27 2013-05-12 10:00

All times are UTC. The time now is 02:00.

Wed Aug 5 02:00:03 UTC 2020 up 18 days, 21:46, 1 user, load averages: 2.32, 1.87, 1.61

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.