This project contains a collection of independent, executable scripts that showcase most of the available functionalities in PyTorch Lightning, each covering a new feature or technique. It's organized to help you smoothly progress from basic to advanced PyTorch Lightning concepts.
Project Directory
- Basic: 🏗 Foundational Lightning concepts like creating modules, validation and testing, checkpointing, early stopping, pretrained models, debugging, and inference.
- Intermediate: 🚀 More specialized topics like accelerated hardware, modularization, scaling techniques, deployment, and profiling.
- Advanced: 🔍 Deep dives into running with config files, modifying trainers, manual optimization, advanced checkpointing, IPUs, and HPUs.
Overview
Each sub-directory is designed to help users become familiar with a specific set of PyTorch Lightning functionalities and best practices. Whether you're just starting out or are an advanced user seeking to refine your techniques, the project provides structured guidance and practical examples.
Features
- Compact, Executable Scripts: 📦 Each script is designed to be concise, demonstrating how individual features, functions, or classes operate, making learning targeted and efficient.
- CPU-Friendly: 🖥 Most scripts are optimized to run on standard CPUs, minimizing the need for specialized hardware.
- Quick Iteration: ⏲ Each script executes in under a minute, enabling rapid testing, learning, and iteration.
- Official Documentation Links: 📚 Every script is accompanied by relevant references to official Lightning documentation, helping you deepen your understanding.
- Independent Execution: 🏃♂️ The scripts are modular, allowing you to explore features individually without needing to execute the entire project.
- Comprehensive Coverage: 🌐 From basic modules and validation to advanced manual optimization and hardware-specific integrations, this guide ensures broad exposure to the various functionalities PyTorch Lightning offers.
- Step-by-Step Structure: 🛠 Organized progressively, it enables users to gradually advance from foundational knowledge to more sophisticated techniques.
Getting Started
To get started with this project, clone the repository and follow the instructions below.
Installation
- Clone the repository:
git clone <https://github.com/ishandutta0098/zero-to-lightning.git>- Navigate to the project directory:
cd zero-to-lightning- Create the conda environment:
# Create the conda environment
conda env create -f conda.yml
# Activate the environment
conda activate lit-envUsage
You can run any script by passing it's path directly as shown below.
python <path_to_script>
# Example
python src/basic/level_01_lightning_module/lightning_module.pyMost of the scripts run directly. For one script we use the LightningCLI.
To run the script src/advanced/level_14_run_with_config_file/run_with_yaml.py follow the below steps 👇