Building an Open Assistant API
From sentdex · · 41 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Working with one of the Open Assistant models, a 12B parameter Pythia model (https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5)
Github: https://github.com/Sentdex/OpenAssistant_API_Pythia_12B
Neural Networks from Scratch book: https://nnfs.io Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://discord.gg/sentdex Reddit: https://www.reddit.com/r/sentdex/ Support the content: https://pythonprogramming.net/support-donate/ Twitter: https://twitter.com/sentdex Instagram: https://instagram.com/sentdex Facebook: https://www.facebook.com/pythonprogramming.net/ Twitch: https://www.twitch.tv/sentdex
Video Contents:
00:00 - Basics of using OpenAssistant Pythia 12B locally 16:37 - Creating an OpenAssistant API 22:22 - Interfacing with our new OpenAssistant API 31:32 - Handling for long contexts