impressive efficiency
seriously speaking, am I the only one who noticed that this model is one of the best little ones?
in my opinion it is a model with impressive efficiency, congratulations I hope you want to continue developing it.
Thank you I built it for a customer with specific needs. usually I post the most efficient ones with complete Open Source instructions in the Intelligent Estate community. you can find some others that really push the limits there. How are you using it if you don't mind me asking? platform/use case rag tool use. honestly I forgot the specifics about why I made this guy I know it was for RAG and GPT4ALL in an estate agent.
for efficiency I've found Spaetzle, blacsheep and I'm about to post a great few great new Quants.
Hello, it's a pleasure . I’m just a tech enthusiast with a mini PC powered by an Intel GPU Arc and 32GB of shared ddr5 ram. I used your model with Ollama and an OpenWebUI frontend.
I tested several models with questions on logic, mathematics, physics, text comprehension, and creativity, and your model surprisingly outperformed others with twice the instruction parameters. Moreover, it is very fast, which pleasantly surprised me.
Thank you for your recommendations; I'll try to explore more of your work! :-)
I started building and optimizing for use on a Mini-PC specifically the sub 200$ N300 units so I could get a few out to people wanting local AI.
I moved to using them over Rasperry Pis some time ago, besides having to sanitize windows it really is great and we work with unique open/closed source datasets for importance matrix quantization and tests to verify efficiency. I'm glad someone out there is finding them useful. it's good to hear and I'm sure you'll find at least some of the Intelligent Estate models handy.
Feel free to join it's open to all (you can get access top some private models and other projects. basically it's the template for anyone to use for setting up AI RAG agents for clients) so if you wanted to start a business installing RAG systems for other business you just have to use GPT4ALL and a Mini PC and you can make bank. I'm trying to create a network for "Founders" but that's a long story.