Optimum documentation

🤗 Optimum Furiosa

Overview

🤗 Optimum Installation Quick tour Notebooks

Conceptual guides

Quantization

Habana

Intel

AWS Trainium/Inferentia

Furiosa

🤗 Optimum Furiosa Installation

How-To Guides

Reference

ONNX Runtime

Exporters

Torch FX

BetterTransformer

LLM quantization

Utilities

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.13.1).

Join the Model Database community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

🤗 Optimum Furiosa

🤗 Optimum Furiosa is the interface between the 🤗 Transformers library and Furiosa NPUs Furiosa Warboy. It provides a set of tools enabling easy model loading and inference for different downstream tasks.

How-to guides

Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use 🤗 Optimum Furiosa to solve real-world problems.

Reference

Technical descriptions of how the classes and methods of 🤗 Optimum Furiosa work.

←🤗 Optimum Neuron Installation→