Use Google Gemini with DataRobot¶
Access this AI accelerator on GitHub
DataRobot allows you to leverage LLMs proposed by hyperscalers via the Custom Model Workshop.
This AI Accelerator demonstrates how to implement a Streamlit application based on the Google Gemini LLM and host it on the DataRobot platform. The user of this AI Accelerator is expected to be familiar with the custom model deployment process and custom metrics creation in DataRobot as well as with Google Vertex AI.
This accelerator requires the service account for the Vertex AI project. The following steps outline the accelerator workflow.
-
Create credentials with a GCP service account (base64 encoded).
-
Optional. Deploy a guard model from the DataRobot global models.
-
Deploy a text model (Gemini Pro).
-
Deploy a multimodal model (Gemini Pro Vision).
-
Create custom metrics for both deployments (text and multimodal).
-
Deploy a Streamlit app to DataRobot.