Hardware for Deep Learning

Нашел сегодня, повешу, чтобы не потерялось.

https://timdettmers.wordpress.com/2014/08/14/which-gpu-for-deep-learning/

TL;DR advice

• Best (affordable) GPU: GTX 980


• Most cost effective GPUs: GTX 580 3GB and GTX 980


• I work with data sets > 250GB: GTX Titan eBay


• I have no money: GTX 580 3GB eBay


• I do Kaggle: GTX 980 or GTX 580 1.5GB/3GB


• I am a researcher: 1-4x GTX 980


• I am a researcher with data sets > 250GB: 1-4x GTX Titan


• I never used deep learning before: GTX 580 3GB


• I want to build a GPU cluster: This is really complicated, I will write some advice about this soon, but you can get some ideas here


• I started deep learning and I am serious about it: Start with one GTX 580 3GB and buy more GTX 580s as you feel the need for them; save money for Volta GPUs in 2016 Q2/Q3

https://timdettmers.wordpress.com/2015/03/09/deep-learning-hardware-guide/

Conclusion / TL;DR

• GPU: GTX 580 (no money); GTX 980 (best performance); GTX Titan (if you need memory)


• CPU: Two threads per GPU; full 40 PCIe lanes and correct PCIe spec (same as your motherboard); > 2GHz; cache does not matter;


• RAM: Use asynchronous mini-batch allocation; clock rate and timings do not matter; buy at least as much CPU RAM as you have GPU RAM;


• Hard drive/SSD: Use asynchronous batch-file reads and compress your data if you have image or sound data; a hard drive will be fine unless you work with 32 bit floating point data sets with large input dimensions


• PSU: Add up watts of GPUs + CPU + (100-300) for required power; get high efficiency rating if you use large conv nets; make sure it has enough PCIe connectors (6+8pins) and watts for your (future) GPUs


• Cooling: Set coolflags bit in your config if you run a single GPU; otherwise flashing BIOs for increased fan speeds is easiest and cheapest; use water cooling for multiple GPUs and/or when you need to keep down the noise (you work with other people in the same room)


• Motherboard: Get PCIe 3.0 and as many slots as you need for your (future) GPUs (one GPU takes two slots; max 4 GPUs per system)


• Monitors: If you want to upgrade your system to be more productive, it might make more sense to buy an additional monitor rather than upgrading your GPU