Open Assistant Inference Backend Development (Hands-On Coding)
#ai #huggingface #coding
Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...
Original repo is here: https://github.com/huggingface/text-generation-inference
OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)
Check out https://www.wandb.courses/ for free MLOps courses!
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
21:05
ykilcher
9 months agoOpenAssistant RELEASED! The world's best open-source Chat AI!
8 -
16:52
ykilcher
9 months agoOpenAssistant First Models are here! (Open-Source ChatGPT)
8 -
2:04
HowToLinux
6 months ago6_What is open source software?
20 -
7:29
JAM Solutions
3 years agoCoding Interactive Brokers API in Python Part 2
38 -
8:08
benjamintech
11 months agoHarnessing the Power of OpenAI's API: A Hands-on Tutorial
1 -
0:25
DEVIL
5 months agoFuture-Proof Your Coding Skills: Must-Learn Programming Languages for 2024
9 -
1:08
Emmanuel Akinyemi
9 months agoIntroduction video: Mastering Algorithms (DSA) , Creating with React.js & Python, and Tech Talks!
20 -
10:42
boyzone87
3 years ago5 Coding Concepts Testing You On Data Science Interviews in 2021 (Facebook, Twitch, Postmates)
100 -
0:22
Online Code School
2 months agoJavaScript's Communicator - Coding Riddles #codingproblems
4 -
8:57
Son of a Tech
10 months agoHive vs. OpenAI: Which Offers Better Privacy for AI Model Training? - 259
5