MPT-30B Open-Source LLM from MosaicML!

Hey everyone! This video dives into MosaicML's new MPT-30B open-source large language model... with a commercial license!! The video opens with a quick demo of how to test the model from the HuggingFace Spaces + MosaicML Inference API demo and then dives into the details in the release blog post from MosaicML! What an exciting time to be in AI!!

MPT-30B-Chat Spaces demo: https://huggingface.co/spaces/mosaicml/mpt-30b-chat

Release blog post from MosaicML: https://www.mosaicml.com/blog/mpt-30b

AliBi attention paper (Train Short, Test Long): https://arxiv.org/abs/2108.12409

Chapters
0:00 Intro and Demo
4:00 MPT-30B Blog Post!!
9:00 MPT-30B Family
13:45 My Favorite Part of the Blog Post
15:50 Inference and Training Cloud
19:28 Thank you for watching!

Comments

Popular posts from this blog

Video From YouTube

GPT Researcher: Deploy POWERFUL Autonomous AI Agents

Building AI Ready Codebase Indexing With CocoIndex