Skip to content

[BC Idea]: Add Support for Vision-Enabled AI Models in Business Central #3633

@DmitryKatson

Description

@DmitryKatson
Contributor

BC Idea Link

https://experience.dynamics.com/ideas/idea/?ideaid=1c68ff7a-e328-f011-9d47-7c1e52f90348

Description

Description

We need to implement support for vision-enabled AI models in Business Central through the Azure OpenAI service. This would allow users to send images along with text prompts to AI models and receive detailed responses about the image content.

Why is this needed?

Vision capabilities will enable numerous valuable business scenarios:

  • Product image analysis for catalog management
  • Document and receipt processing with contextual understanding
  • Quality control through image analysis
  • etc.

This builds upon existing text-based Azure OpenAI capabilities, creating a more versatile AI integration that can work with both textual and visual data.

Requirements

  • Allow sending images to AI models via multiple methods: URLs, direct uploads, Media fields, MediaSets, etc.
  • Support detail level settings for image analysis (auto, low, high)
  • Handle multiple images in a single request (up to 10 images per request as per Azure's limitations)
  • Proper error handling for unsupported file types
  • Documentation and examples for integration

Reference

Implementation should follow the official Microsoft documentation for GPT with vision:
Azure AI Services: Use vision-enabled chat models

I will provide the implementation for this BC Idea

  • I will provide the implementation for this BC Idea
    Internal work item: AB#578341

Activity

JesperSchulz

JesperSchulz commented on May 8, 2025

@JesperSchulz
Contributor

@DmitryKatson, we will be discussing these plans Wednesday next week! Please stay tuned, while I'm working on getting your plans approved 🥳

JesperSchulz

JesperSchulz commented on May 14, 2025

@JesperSchulz
Contributor

Approved 🚀 However, the feature must of course go through our DSB process just as our CAPI service must be updated to support these capabilities. But as such, we're excited to move forward with this idea!
Let's talk when we meet 🥳

DmitryKatson

DmitryKatson commented on May 14, 2025

@DmitryKatson
ContributorAuthor

🥳 Great! Let me know if anything else is required. The PR is there, and it's "just" a wrapper around the official OpenAI vision API... so nothing should stop you ;)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    ApprovedThe issue is approvedBCIdeaIssue related to a BCIdeaIntegrationGitHub request for Integration areaLinkedIssue is linked to a Azure Boards work item

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Participants

      @JesperSchulz@DmitryKatson

      Issue actions

        [BC Idea]: Add Support for Vision-Enabled AI Models in Business Central · Issue #3633 · microsoft/BCApps