Tutorials

Model Training

• LLM Pretraining & Evaluation

Model Behaviour-Level Simulation

• Random Bitflip on CLM
• Bitflip-Aware LoRA Fine-Tuning
• Bitflip-Aware LoRA Fine-Tuning with FSDP2 (Llama-3-70B)
• Optical Neural Networks on RoBERTa
• Scaling Optical Transformers to Causal Language Models
• Spiking Neural Networks on RoBERTa
• Processing-in-Memory on RoBERTa
• Processing-in-Memory on Vision Transformer
• Mase-Triton