Running Large Language Models on Vlaams Super Computer (VSC)
Project Context
This site is a practical guide for deploying, managing, and analyzing large language models (LLMs) using the Vlaams Supercomputer (VSC).
This project was completed as part of my internship, under the guidance of Prof. Dr. Dirk Valkenborg and Jimmy Schepers.
Their support and mentorship were instrumental in bringing this work to fruition.
What You’ll Find Here
- Project Overview:
Understand the goals and scope of this project. - HPC & LLM Basics:
Learn foundational concepts about high-performance computing and how to run LLMs. - Environment Setup:
Step-by-step instructions for setting up your VSC environment, downloading models, and managing dependencies. - Running Jobs:
How to launch SLURM jobs, organize scripts, and capture logs/output. - Best Practices:
Proven tips for efficient, reproducible, and scalable research on HPC.
About VSC
The Vlaams SuperComputer (VSC) provides powerful computing resources for research and innovation in Flanders.
Learn more: VSC User Portal
Acknowledgments
I sincerely thank Prof. Dr. Dirk Valkenborg and Jimmy Schepers for their exceptional mentorship throughout this project.