Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[UI] - Make AI Image Block Production-ready #26505

Closed
6 tasks done
Tracked by #26495
oidacra opened this issue Oct 24, 2023 · 4 comments · Fixed by #27183 or #27294
Closed
6 tasks done
Tracked by #26495

[UI] - Make AI Image Block Production-ready #26505

oidacra opened this issue Oct 24, 2023 · 4 comments · Fixed by #27183 or #27294

Comments

@oidacra
Copy link
Member

oidacra commented Oct 24, 2023

Parent Issue

#26495

User Story

As a user of the Block Editor, I want to generate an image using the new AI Image Prompt Extension so that I can seamlessly incorporate AI-generated visuals into my content.

Endpoint: /api/v1/ai/image/generate

Acceptance Criteria

  • The Block Editor should have an "AI Image " command in the list
  • The AI should generate an image based on the provided prompt.
  • The AI should generate an image using the content already in the Block Editor.
  • Users should be able to insert the AI-generated image into their content as Image Node.
  • Error handling of the AI endpoints are not in the scope of this task.

dotCMS Version

master

Proposed Objective

User Experience

Proposed Priority

Priority 2 - Important

External Links... Slack Conversations, Support Tickets, Figma Designs, etc.

Command Menu
Screenshot 2023-10-24 at 3 41 35 PM

Modal with the options

Generate it by a prompt
Screenshot 2023-10-24 at 3 41 44 PM

Generate using the content with additional details.
Screenshot 2023-10-24 at 3 41 59 PM

Create a Image Node
Screenshot 2023-10-24 at 3 42 06 PM

Handle error
Screenshot 2023-10-24 at 3 42 53 PM

Assumptions & Initiation Needs

  • Assuming the AI Image Prompt Extension has the necessary APIs and SDKs for integration.
  • Users have a basic understanding of the Block Editor functionalities.

Quality Assurance Notes & Workarounds

  • Ensure that the AI suggestions do not interfere with the normal functioning of the Block Editor.
  • Test the AI Image Prompt Extension on various prompts to ensure diverse and relevant image outputs.
  • Ensure the generated image can be easily inserted and edited within the Block Editor.

Tasks

  1. QA : Not Needed Team : Falcon Type : Task dotCMS : AI
    oidacra
  2. dotCMS : AI
  3. Team : Falcon Type : Task dotCMS : AI
  4. Team : Falcon Type : Defect Type : Task dotCMS : AI
  5. Team : Falcon Type : Defect dotCMS : AI
  6. Merged QA : Not Needed Team : Falcon dotCMS : AI
    hmoreras
@hmoreras
Copy link
Contributor

hmoreras commented Jan 4, 2024

QA notes:

  1. Add the package com.barchart.udt in the Exported Packages button in the plugin portlet.
  2. Install the last version of the AI plugin.
  3. Add the token key in the apps configuration portlet.
  4. Create a content that has a block editor on it, or use one that already have it like BLOG.
  5. In the Editor type /ai, select the AI Image.
  6. In the modal there are two options, create an image from a prompt or create an image based on the content of the editor, test both scenarios.
  7. when hit the button generate a loading block will show in the editor.
  8. Once the response is done an image will show with a context menu.
  9. All functions of the context menu should work.

Use the images in the description as reference.

@dsilvam
Copy link
Contributor

dsilvam commented Jan 8, 2024

Needs work. Failing case:

When you add multiple consecutive images generated by AI, they are able to render properly (from a page) but when editing the contentlet only one of those images is shown.

@dsilvam
Copy link
Contributor

dsilvam commented Jan 9, 2024

Passed Internal QA: AI Image block working as expected. Case describe in the last comment got fixed.

@dsilvam dsilvam removed their assignment Jan 9, 2024
@dsilvam dsilvam closed this as completed Jan 9, 2024
@josemejias11
Copy link

Approved: Tested on master_1894351, Docker, macOS 13.0, FF v121.0.1
Screenshot 2024-01-23 at 10 21 47 AM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment