Skip to content


VertexAI LLM implementation running the async API clients for Gemini.

  • Gemini API:

    To use the VertexAILLM is necessary to have configured the Google Cloud authentication using one of these methods:

    • Setting GOOGLE_CLOUD_CREDENTIALS environment variable
    • Using gcloud auth application-default login command
    • Using vertexai.init function from the google-cloud-aiplatform library


  • model: the model name to use for the LLM e.g. "gemini-1.0-pro". Supported models.

  • _aclient: the GenerativeModel to use for the Vertex AI Gemini API. It is meant to be used internally. Set in the load method.