Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
nicolay-r 
posted an update 14 days ago
Post
348
📢 For those who interested in adopting streaming with bare minimum dependencies and setting up a GenAI powered demo in Web, this post might be relevant. Streaming support is inevitable for running local or remote models. Delighted to share the first part of the tutorial.

🎬 https://youtu.be/XgByPLLsiCI

From which you will learn how to:
☑️ Use pure JS for fetching streaming from the specific provider (Replicate)
☑️ Use pure JS with custom proxy streaming provider (FastAPI)

✨ TLDR: We review POST-based approaches for fetching data readers and adopting data parsers.
Using FastAPI as a proxy, we explain how to take control over transferred data.

Resources:
💻 JS: https://gist.github.com/nicolay-r/86fc212086c0955d541244253ec0564b
💻 JS+FastAPI: https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59

This tutorial is super helpful for anyone looking to set up GenAI streaming with minimal dependencies. From my own experience, using a setup like this really simplifies managing data streams and integrating local models. If you want to explore similar tools or get additional support, I’ve found it useful to contact drift https://drift.pissedconsumer.com/customer-service.html for guidance and tips.