langchain_nvidia_ai_endpoints.chat_models.ChatNVIDIA¶
class langchain_nvidia_ai_endpoints.chat_models.ChatNVIDIA[source]¶
Bases: _NVIDIAClient, SimpleChatModel
NVIDIA chat model.
Example
from langchain_nvidia_ai_endpoints import ChatNVIDIA
model = ChatNVIDIA(model="llama2_13b")
response = model.invoke("Hello")
Create a new model by parsing and validating input data from keyword arguments.
Raises ValidationError if the input data cannot be parsed to form a valid model.
param cache: Optional[bool] = None¶
Whether to cache the response.
param callback_manager: Optional[BaseCallbackManager] = None¶
Callback manager to add to the run trace.
param callbacks: Callbacks = None¶
Callbacks to add to the run trace.
param client: NVEModel = <class 'langchain_nvidia_ai_endpoints._common.NVEModel'>¶
param max_tokens: int = 1024¶
Constraints
minimum = 32
maximum = 1024
param metadata: Optional[Dict[str, Any]] = None¶
Metadata to add to the run trace.
param model: str [Required]¶
Name of the model to invoke
param tags: Optional[List[str]] = None¶
Tags to add to the run trace.
param temperature: float = 0.2¶
Constraints
exclusiveMinimum = 0.0
maximum = 1.0
param top_p: float = 0.7¶
Constraints
minimum = 0.0
maximum = 1.0
param verbose: bool [Optional]¶
Whether to print out response text.