ex: https://example.my-lakefs.com
repo – [optional, default = ‘’] target repository
ref – [optional, default = ‘main’] target ref (branch name,
tag, or commit ID)
path – [optional, default = ‘’] target path
lazy_load() → Iterator[Document]¶
A lazy loader for Documents.
load() → List[Document][source]¶
Load data into Document objects.
load_and_split(text_splitter: Optional[TextSplitter] = None) → List[Document]¶
Load Documents and split into chunks. Chunks are returned as Documents.
Parameters
text_splitter – TextSplitter instance to use for splitting documents.
Defaults to RecursiveCharacterTextSplitter.
Returns
List of Documents.
set_path(path: str) → None[source]¶
set_ref(ref: str) → None[source]¶
set_repo(repo: str) → None[source]¶