Unable to use ChatGoogleGenerativeAI with Gemini with proxy endpoint

[ferrygun]

I am getting this error with Gemini API and proxy endpoint as per my company endpoint:

object GenerateContentResponse can't be used in 'await' expression

This the code, how can make this works?

from langchain_google_genai import ChatGoogleGenerativeAI

llm = ChatGoogleGenerativeAI(
        model="gemini-1.5-pro",
            client_options={
                "api_endpoint": <Proxy_Endpoint>",
            },
            google_api_key="<api_key>", 
            transport="rest")

[kevinkupski]

Did you try to use rest_asyncio for the transport parameter? That worked for me. I guess the asyncio implementation is required when using the model with the asyncio functions (e.g. astream).