Langchain openai image input Dec 9, 2024 · Then install langchain-openai and set environment variables AZURE_OPENAI_API_KEY and AZURE_OPENAI_ENDPOINT: Image input: import base64 import Mar 8, 2024 · Based on the information provided, it seems that the AzureChatOpenAI class from the langchain_openai library is primarily designed for chat models and does not directly support image generation tasks like the Dall-e-3 model in Azure OpenAI. . LangChain supports multimodal data as input to chat models: Following provider-specific formats; Adhering to a cross-provider standard; Below, we demonstrate the cross-provider standard. ChatXAI. We will also demonstrate how to use few-shot prompting in this context to improve performance. Any parameters that are valid to be passed to the openai. param api_wrapper: DallEAPIWrapper [Required] ¶ param args_schema: Optional [TypeBaseModel] = None ¶ This method takes a schema as input which specifies the names, types, and descriptions of the desired output attributes. config (Optional[RunnableConfig]) – A config to use when input (LanguageModelInput) – The input to the Runnable. from_messages ( messages = [ SystemMessage (content = 'Describe the following image very briefly. As of the v0. whewphfefouorgbjbdvljtgeefvgsouspqmyffwwdicscjhedsqlrybzzqljatmuomkxdohyyeqdrjpi