langchain_community.llms.titan_takeoff_pro.TitanTakeoffPro¶
class langchain_community.llms.titan_takeoff_pro.TitanTakeoffPro[source]¶
Bases: LLM
Create a new model by parsing and validating input data from keyword arguments.
Raises ValidationError if the input data cannot be parsed to form a valid model.
param base_url: Optional[str] = 'http://localhost:3000'¶
Specifies the baseURL to use for the Titan Takeoff Pro API.
Default = http://localhost:3000.
param cache: Optional[bool] = None¶
param callback_manager: Optional[BaseCallbackManager] = None¶
param callbacks: Callbacks = None¶
param max_new_tokens: Optional[int] = None¶
Maximum tokens generated.
param metadata: Optional[Dict[str, Any]] = None¶
Metadata to add to the run trace.
param min_new_tokens: Optional[int] = None¶
Minimum tokens generated.
param no_repeat_ngram_size: Optional[int] = None¶
Prevent repetitions of ngrams of this size. Default = 0 (turned off).
param regex_string: Optional[str] = None¶
A regex string for constrained generation.
param repetition_penalty: Optional[float] = None¶
Penalise the generation of tokens that have been generated before.
Set to > 1 to penalize.
param sampling_temperature: Optional[float] = None¶
Sample with randomness. Bigger temperatures are associated with
more randomness and ‘creativity’.
param sampling_topk: Optional[int] = None¶
Sample predictions from the top K most probable candidates.
param sampling_topp: Optional[float] = None¶
Sample from predictions whose cumulative probability exceeds this value.
param streaming: bool = False¶
Whether to stream the output. Default = False.
param tags: Optional[List[str]] = None¶