text: with LangChain.OpenLLM is an open platform for operating large language models (LLMs) in
  production. It enables developers to easily run inference with any open-source
  LLMs, deploy to the cloud or on-premises, and build powerful AI apps.Installation and Setupâ€‹Install the OpenLLM package via PyPI:pip install openllmLLMâ€‹OpenLLM supports a wide range of open-source LLMs as well as serving users' own
  fine-tuned LLMs. Use openllm model command to see all available models that
  are pre-optimized for OpenLLM.Wrappersâ€‹There is a OpenLLM Wrapper which supports loading LLM in-process or accessing a
  remote OpenLLM server:from langchain.llms import OpenLLMWrapper for OpenLLM serverâ€‹This wrapper supports connecting to an OpenLLM server via HTTP or gRPC. The
  OpenLLM server can run either locally or on the cloud.To try it out locally, start an OpenLLM server:openllm start flan-t5Wrapper usage:from langchain.llms import OpenLLMllm = OpenLLM(server_url='http://localhost:3000')llm("What is the difference between a duck and a goose? And why there are so many Goose in Canada?")Wrapper for Local Inferenceâ€‹You can also use the OpenLLM wrapper to load LLM in current Python process for
  running inference.from langchain.llms import OpenLLMllm = OpenLLM(model_name="dolly-v2", model_id='databricks/dolly-v2-7b')llm("What is the difference between a duck and a goose? And why there are so many Goose in Canada?")Usageâ€‹For a more detailed walkthrough of the OpenLLM Wrapper, see the