In this new video, I demo the newly launched Amazon SageMaker Training Compiler, a feature of SageMaker that can accelerate the training of deep learning (DL) models by up to 50% through more efficient use of GPU instances.
Starting from a couple of sample notebooks based on Hugging Face models (BERT and GPT-2), I train both vanilla and compiled jobs, and I compare their performance.
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos ⭐️⭐️⭐️
Code: github.com/aws/amazon-sagemaker-examples/tree/master/sagemaker-training-compiler/huggingface
More Hugging Face on SageMaker notebooks: github.com/huggingface/notebooks/tree/master/sagemaker
New to Transformers? Check out the Hugging Face course at huggingface.co/course
- AWS re:Invent 2021 - A first look at SageMaker Training Compiler ( Download)
- AWS re:Invent 2021 - {New Launch} Introducing Amazon SageMaker Training Compiler ( Download)
- Speeding up deep learning training with SageMaker Training Compiler ( Download)
- AWS re:Invent 2021 - Use SageMaker to develop ML models faster, featuring Qualtrics ( Download)
- AWS re:Invent 2021 - {New Launch} Amazon SageMaker serverless inference (Preview) ( Download)
- AWS re:Invent 2021 - Train ML models at scale with Amazon SageMaker, featuring Aurora ( Download)
- AWS Summit SF 2022 - Train ML models at scale with Amazon SageMaker Training (AIM207) ( Download)
- AWS re:Invent 2022 - Train ML models at scale with Amazon SageMaker, featuring AI21 Labs (AIM301) ( Download)
- AWS re:Invent 2021 - Serverless Inference on SageMaker! FOR REAL! ( Download)
- AWS re:Invent 2020: Accelerating autonomous vehicle solutions with SageMaker, featuring Lyft ( Download)
- SageMaker Edge - Compilation demo | Amazon Web Services ( Download)
- AWS reInvent 2021 Recap - Brooke Jamieson ( Download)
- AWS re:Invent 2021: AWS On Air ft. Amazon SageMaker Studio Lab | AWS Events ( Download)
- SageMaker Edge - Packaging a model demo | Amazon Web Services ( Download)
- AWS re:Invent 2021 - Vanguard: Personalization at scale with Amazon SageMaker ( Download)
