Using containers for HPC workloads (but avoiding Docker)
C1 | Mon 21 Jan | 2:10 p.m.–2:20 p.m.
Hello there! I am an IT professional specialising in GNU/Linux and Open Source. I also have a Law degree, but computers are my true passion. I have approximate knowledge of many things. I am a science enthusiast and an aspiring polyglot (in both human and computer lingos). I use Oxford commas and indent my code with spaces 😄. When I take a break from being a geek, I enjoy discovering the world and other cultures, particularly if there's food, wine, or beer involved.
Containers are the old hot thing. But their adoption in all realms of IT is far from widespread. Most containers we see in the wild today are created to host daemon-type processes and scale them massively, but traditional HPC workloads are different and so HPC shops continue to have some aversion to them. In this short talk I will discuss some of the challenges that Docker introduces when it comes to using containers in a multi-tenant HPC cluster, and what are some of the possible solutions. We will also explore the relationship between containers and reproducibility in Computational Science. Linux Australia: http://mirror.linux.org.au/pub/linux.conf.au/2019/c1/Monday/Using_containers_for_HPC_workloads_but_avoiding_Docker.webm YouTube: https://www.youtube.com/watch?v=TG_Phv4ppF0