text: dialogue.ğŸ“„ï¸� Hugging Face HubThe Hugging Face Hub is a platform with over 120k models, 20k datasets, and 50k demo apps (Spaces), all open source and publicly available, in an online platform where people can easily collaborate and build ML together.ğŸ“„ï¸� Hugging Face Local PipelinesHugging Face models can be run locally through the HuggingFacePipeline class.ğŸ“„ï¸� Huggingface TextGen InferenceText Generation Inference is a Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power LLMs api-inference widgets.ğŸ“„ï¸� JSONFormerJSONFormer is a library that wraps local HuggingFace pipeline models for structured decoding of a subset of the JSON Schema.ğŸ“„ï¸� KoboldAI APIKoboldAI is a "a browser-based front-end for AI-assisted writing with multiple local & remote AI models...". It has a public and local API that is able to be used in langchain.ğŸ“„ï¸� Llama-cppllama-cpp is a Python binding for llama.cpp.ğŸ“„ï¸� Caching integrationsThis notebook covers how to cache results of individual LLM calls.ğŸ“„ï¸� ManifestThis notebook goes over how to use Manifest and LangChain.ğŸ“„ï¸� ModalThe Modal cloud platform provides convenient, on-demand access to serverless cloud compute from Python scripts on your local computer.ğŸ“„ï¸� MosaicMLMosaicML offers a managed inference service. You can either use a variety of open source models, or deploy your own.ğŸ“„ï¸� NLP CloudThe NLP Cloud serves high performance