Recently, Frank published a series of blog posts on GPU resource management. I invited Frank to the show to explain why GPU resource management is different than CPU and memory management in vSphere. Frank goes over all the intricate details, and as always, dives deep into the various constructs involved. I highly recommend reading the articles which are part of the following series, and make sure to also check the tool Frank developed, as this helps visualizing the challenges you may face today, or potentially in the future!
- https://frankdenneman.ai/ai-infrastructure/
- https://frankdenneman.ai/understanding-ai-memory/
- https://frankdenneman.ai/tools/
You can listen to the episode on Spotify (bit.ly/4th0Jhs), Apple (bit.ly/47wcGHH), or via the below embedded player, and I also posted it on Youtube with video!