Welcome to Azarrot’s documentation!

Azarrot is an OpenAI compatible LLM inference server, focusing on OpenVINO™ and IPEX-LLM usage.

The name azarrot is combined from azalea and parrot.

Note

This project is under active development.

Contents

• Quickstart
  • Prerequisites
  • Install
  • Start to use

Indices and tables

• Index

• Module Index

• Search Page