Installation

This guide describes how to install AIBrix manifests in different platforms.

Currently, AIBrix installation does rely on other cloud specific features. It’s fully compatible with vanilla Kubernetes.

Install AIBrix on Cloud Kubernetes Clusters

Attention

AIBrix will install Envoy Gateway and KubeRay in your environment. If you already have these components installed, you can use corresponding manifest to skip them.

Stable Version

# Install component dependencies
kubectl apply -f https://github.com/aibrix/aibrix/releases/download/v0.2.1/aibrix-dependency-v0.2.1.yaml

# Install aibrix components
kubectl apply -f https://github.com/aibrix/aibrix/releases/download/v0.2.1/aibrix-core-v0.2.1.yaml

Nightly Version

# clone the latest repo
git clone https://github.com/aibrix/aibrix.git
cd aibrix

# Install component dependencies
kubectl create -k config/dependency
kubectl create -k config/default

Install AIBrix in testing Environments

Getting Started

• Lambda Cloud
• Mac for Desktop

Install Individual AIBrix Components

Autoscaler

kubectl apply -k config/standalone/autoscaler-controller/

Distributed Inference

kubectl apply -k config/standalone/distributed-inference-controller/

Model Adapter(Lora)

kubectl apply -k config/standalone/model-adapter-controller