Giant squids and colossal squids can have axons as long as 12 meters each and are among the longest single cells in the world.

[Worklog] The Beast Slayer
#91
It would seem environmentally dubious to constantly run clean water down the drain.

I always found the challenge to running multiple GPUs under Linux wasn't the fan control or overclocking, and more just getting them all working nicely in a single X session in order to control them at all!

You're probably already aware of coolbits, here are example settings commands for nvidia-settings:

Enable PowerMizer (Prefer Maximum Performance):
nvidia-settings -a '[gpu:0]/GPUPowerMizerMode=1'

Gain manual fan control:
nvidia-settings -a '[gpu:0]/GPUFanControlState=1'

Set GPU fan to 70%:
nvidia-settings -a '[fan:0]/GPUTargetFanSpeed=70'

Set GPU Clock offset +120Mhz:
nvidia-settings -a '[gpu:0]/GPUGraphicsClockOffset[3]=120'

Set GPU Memory offset +100Mhz:
nvidia-settings -a '[gpu:0]/GPUMemoryTransferRateOffset[3]=100'


Here are the same settings in the correct format for your .nvidia-settings-rc on a multi-gpu system:

[gpu:0]/GPUPowerMizerMode=1
[gpu:1]/GPUPowerMizerMode=1
[gpu:2]...etc

[gpu:0]/GPUFanControlState=1
[gpu:1]/GPUFanControlState=1
[gpu:2]...etc

[fan:0]/GPUTargetFanSpeed=70
[fan:1]/GPUTargetFanSpeed=70
[fan:2]

[gpu:0]/GPUGraphicsClockOffset[3]=120
[gpu:1]/GPUGraphicsClockOffset[3]=120
[gpu:2]...etc

[gpu:0]/GPUMemoryTransferRateOffset[3]=100
[gpu:1]/GPUMemoryTransferRateOffset[3]=100
[gpu:2]...etc


Hope this helps
[Image: sigimage.php?u=652873&t=212997&b=twilight2]
Reply
Likes:
#92
(2017-03-27, 11:13:52 PM)BestPony Wrote: It would seem environmentally dubious to constantly run clean water down the drain.

True. Mind you, it's desalinated water that a significant portion of the country refuses to drink (I'm still alive, so I'm pretty sure there's nothing wrong with it).

Thankfully I don't need to worry about using those commands. Can easily do them in the nVidia X Server GUI. I didn't really have any major issues getting the GPUs working together. F@H didn't automatically detect the GPUs, so I had to manually add the slots. It was sufficient to add them with the automatic GPU index. That is, set to -1. From there, I had to manually set the OpenCL and CUDA indexes by experimenting to see which numbers were the right ones. Took no more than two minutes per system.
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes:
#93
Times might have changed since I last messed with overclocking under Linux, but you might find that the nVidia X Server GUI doesn't retain the fan and OC settings after reboot. That's what the commands/config file were for.
[Image: sigimage.php?u=652873&t=212997&b=twilight2]
Reply
Likes:
#94
I believe you're right about that. I think I only need to set the State and Speed commands in that order for each GPU. At least, if I only want to control the fans. For overclocking, I'll just add the relevant lines whenever I'm ready.

What I'm not sure about is how to actually make the script and set it to start automatically each time I boot. I'm guessing I need the Linux equivalent of a .bat file to put those commands in first.
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes:
#95
Hiigs, if you become a historical geniuis some day, will you remember me? ;D

Knew you wouldn't give up though! Nobody ever gives up when they have the passion to make great things.
Reply
Likes:
#96
I've got some Linux foo but I'm sure there are people more knowledgeable than I who can do this a better way:

1. Edit your /home/<your username>/.nvidia-settings-rc file with the desired attributes I specified above

2. I found that after a reboot this file may get overwritten and you'll lose your changes. Test it, and if that happens you can make the file read-only (even to the root account) via
Code:
sudo chattr +i /home/<your username>/.nvidia-settings-rc


3. To make sure the file is applied after reboot, put the following in your crontab
Code:
@reboot sh -c '/usr/bin/nvidia-settings --load-config-only'


Let me know how you get on
[Image: sigimage.php?u=652873&t=212997&b=twilight2]
Reply
Likes:
#97
Small update:

[Image: LLez7Ev.jpg]

To help with fixing the cable jungle, I've cut out a length of cable trunking, then cut two sets of holes for the PCI-e cables to plug into the video cards, and another hole in the center where the cables come together. Additional trunking will be made to hide more cables, and guide them to where they need to go. When the chillbox casing is built, the trunking will be aligned properly and secured.

Speaking of the chillbox, as I would need a decent amount of insulation, I've doubled up on the standoffs, so there's a larger gap between the motherboards and the acrylic.

I'm also tempted to swap the hard drives out for some M2 drives, just so I can get rid of some additional cables. A couple of 30 or 60 gig M2 drives would probably cost about 60 to 80 dollars currently. I don't think it's worth it though. These systems don't access the hard drives that frequently, and they're not set to save their data at regular enough intervals to cause any major interruptions. Besides, that cash can go towards more cards!
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes: Ruthalas
#98
Not enough updates around here. Certainly not enough significant ones. Here's the best I've got though...

[Image: y8xykALh.jpg]

Did a little more cable management. The vertical cable trunking is actually two pieces back to back and secured with super glue. The alignment is a little off, but if I do finally finish the rest of the system within the next decade, the alignment will be sorted when they get anchored to the case I plan to make. At the moment, all the trunking is supported by the cables themselves. They can be adjusted to an extent by wiggling the cables around a bit. Still got a lot of cable management to do, but the trunking does a very good job at handling most of it.

I should probably do a bit of dusting as well...
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes:
#99
.......have you tried mining?
[Image: sigimage.php?FAHUser=Talifan9&FAHTeam=21...luttershy1]



Reply
Likes:
I could easily do that, but I'm not running this for monetary gain.
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes:
(2017-06-24, 05:09:27 AM)hiigaran Wrote: I could easily do that, but I'm not running this for monetary gain.

my point being that it could lead to more cards for folding Pinkiecrazy
[Image: sigimage.php?FAHUser=Talifan9&FAHTeam=21...luttershy1]



Reply
Likes:
I don't think I can draw much more power from my room...
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes:
Any further thoughts on the cool-box?
[Image: sigimage.php?w=2943722&p=81403693&u=6423...&b=pinkie1]
[Image: sigimage.php?e=ruthalas&b=pinkie1]
Reply
Likes:
Currently looking at testing x1 risers first. The success or failure of those tests will determine how I will proceed. Got my eye on ones selling for about $5.50. Would be $88 in total if I were to get one per slot, but for now, I'll just grab two, then test them by running two on risers, and two in slots to compare the x16 performance to the x1 performance. As per some recommendations, I made sure the version numbers printed on their PCBs were a 6 or above, and that they took PCI-e power cables. Apparently SATA power connections have burned out on some systems. Got just enough cables for both PSUs to run everything without requiring adapters, but there will be a HEAP of cables as a result of this.

Assuming it does work, I will need to build a mounting that can support 16 cards. Will need to research or come up with designs.

At this point, I might even need to consider incorporating the PSUs into the chilling section. If I do this, I might as well get M2 drives as well, or else the hard drives will look odd hanging out by themselves.
[Image: sigimage.php?FAHUser=hiigaran&FAHTeam=21...hangeling1]
Reply
Likes:
Are you going to have it going by the end of the year?
IRC channel Yay for brony@home (irc.canternet.org #foldingismagic)
http://derpy.me/gLbV2

[Image: sigimage.php?u=605723&t=212997&b=twilight3]

Reply
Likes:




SOON