#Install Alauda AI Generative

Alauda AI Generative is a cloud-native component built on KServe for serving generative AI models. As an extension of the Alauda AI ecosystem, it specifically optimizes for Large Language Models (LLMs), offering essential features such as inference orchestration, streaming responses, and resource-based auto-scaling for generative workloads.

---

#Prerequisites

Before installing Alauda AI Generative, you need to ensure the following dependencies are installed:

#Required Dependencies

#Optional Dependencies

#Installation Notes

1. Required Dependencies: All three required dependencies must be installed before installing Alauda AI Generative.
2. GIE Integration: If you want to use GIE, you can enable it during the installation process by selecting the "Integrated GIE" option in the Alauda AI Generative UI.
3. Alauda AI Integration: If you don't need KServe Predictive AI functionality and only want to use LLM Generative AI, you can disable the "Integrated With Alauda AI" option during installation.

#Downloading Cluster Plugin

#Uploading the Cluster Plugin

For more information on uploading the cluster plugin, please refer to Uploading Cluster Plugins

#Installing Alauda AI Generative

1. Go to the Administrator -> Marketplace -> Cluster Plugin page, switch to the target cluster, and then deploy the Alauda AI Generative Cluster plugin.

2. In the deployment form, configure the following parameters as needed:

#Envoy Gateway Configuration

#Envoy AI Gateway Configuration

#KServe Gateway Configuration

#GIE(gateway-api-inference-extension) Configuration

#Alauda AI Integration

3. Click Install to begin the installation process.

4. Verify result. You can see the status of "Installed" in the UI.

#Upgrading Alauda AI Generative

1. Upload the new version for package of Alauda AI Generative plugin to ACP.
2. Go to the Administrator -> Clusters -> Target Cluster -> Functional Components page, then click the Upgrade button, and you will see the Alauda AI Generative can be upgraded.