Pytorch Fsdp Articles

Page 1 of 1 (3 articles)

6/11/2024 • EN

A technical guide on fine-tuning the Llama 3 LLM using PyTorch FSDP and Q-Lora on Amazon SageMaker for efficient training.

Amazon Sagemaker Fine Tuning Llama 3 Pytorch Fsdp Q Lora

4/22/2024 • EN

A technical guide on fine-tuning the Llama 3 70B model using PyTorch FSDP and Q-Lora for efficient training on limited GPU hardware.

Fine Tuning large language models Llama 3 Pytorch Fsdp Q Lora

5/2/2023 • EN

A technical tutorial on fine-tuning a 20B+ parameter LLM using PyTorch FSDP and Hugging Face on Amazon SageMaker's multi-GPU infrastructure.

Amazon Sagemaker Hugging Face large language models Model Fine Tuning Pytorch Fsdp

Select Language