Hackathon 8

The goal was to explore Kubernetes and understand how it could be used to manage and scale HPC-style workloads.

What was done

We built a Kubernetes cluster with Redis, worker pods and monitoring, then moved to a VM-based setup. Ran a multi-container FastQC workflow and created a Python frontend for job submission.

What was learnt

We gained hands-on experience with Kubernetes orchestration, including Pods, Deployments, Services and StatefulSets, and explored scaling with HPA and KEDA. Learned how Kubernetes could help coordinate and scale containerised HPC workloads.