Spaces:
Runtime error
Runtime error
File size: 2,424 Bytes
0558aa4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 |
NVIDIA NeMo Framework Developer Docs
====================================
NVIDIA NeMo Framework is an end-to-end, cloud-native framework designed to build, customize, and deploy generative AI models anywhere.
`NVIDIA NeMo Framework <https://github.com/NVIDIA/NeMo>`_ supports large-scale training features, including:
- Mixed Precision Training
- Parallelism
- Distributed Optimizer
- Fully Sharded Data Parallel (FSDP)
- Flash Attention
- Activation Recomputation
- Positional Embeddings and Positional Interpolation
- Post-Training Quantization (PTQ) and Quantization Aware Training (QAT) with `TensorRT Model Optimizer <https://github.com/NVIDIA/TensorRT-Model-Optimizer>`_
- Knowledge Distillation-based training with `TensorRT Model Optimizer <https://github.com/NVIDIA/TensorRT-Model-Optimizer>`_
- Sequence Packing
`NVIDIA NeMo Framework <https://github.com/NVIDIA/NeMo>`_ has separate collections for:
* :doc:`Large Language Models (LLMs) <nlp/nemo_megatron/intro>`
* :doc:`Automatic Speech Recognition (ASR) <asr/intro>`
* :doc:`Text-to-Speech (TTS) <tts/intro>`
Each collection consists of prebuilt modules that include everything needed to train on your data.
Every module can easily be customized, extended, and composed to create new generative AI
model architectures.
For quick guides and tutorials, see the "Getting started" section below.
.. toctree::
:maxdepth: 2
:caption: Getting Started
:name: starthere
:titlesonly:
starthere/intro
starthere/fundamentals
starthere/tutorials
For more information, browse the developer docs for your area of interest in the contents section below or on the left sidebar.
.. toctree::
:maxdepth: 1
:caption: Key Optimizations
:name: Key Optimizations
features/mixed_precision
features/parallelisms
features/moe
features/optimizations/index
.. toctree::
:maxdepth: 1
:caption: Model Checkpoints
:name: Checkpoints
checkpoints/intro
.. toctree::
:maxdepth: 2
:caption: Evaluation
:name: evaluation
:titlesonly:
evaluation/evaluation-doc
evaluation/evaluation-adapters
.. toctree::
:maxdepth: 1
:caption: APIs
:name: APIs
:titlesonly:
apis
.. toctree::
:maxdepth: 1
:caption: Collections
:name: Collections
:titlesonly:
collections
.. toctree::
:maxdepth: 1
:caption: Speech AI Tools
:name: Speech AI Tools
:titlesonly:
tools/intro
|