Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow using images as input with gpt-4 vision #286

Merged
merged 55 commits into from
Feb 9, 2024
Merged

Allow using images as input with gpt-4 vision #286

merged 55 commits into from
Feb 9, 2024

Commits on Feb 9, 2024

  1. rebase origin/main

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    b5da133 View commit details
    Browse the repository at this point in the history

  2. add image_url to ChatCraftHumanMessage, update onSendClick to send th… 

    …e image
    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    c146714 View commit details
    Browse the repository at this point in the history

  3. Update store format to use Base64 data

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    fd4d5df View commit details
    Browse the repository at this point in the history

  4. rename image_url to image and remove debug log

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a009a66 View commit details
    Browse the repository at this point in the history

  5. remove deprecated interface and rename content to textAndImage

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    8791b35 View commit details
    Browse the repository at this point in the history

  6. rename image_url to image

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    5b73645 View commit details
    Browse the repository at this point in the history

  7. fix cutoff test

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    40340d5 View commit details
    Browse the repository at this point in the history

  8. fix type mismatch by using ChatCompletionContentPart

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    ff7de7f View commit details
    Browse the repository at this point in the history

  9. add supportsImages to ChatCraftModel and set max_tokens for gpt-4-vis… 

    …ion-preview model
    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    0cace53 View commit details
    Browse the repository at this point in the history

  10. add clip icon to upload files

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    0c4d571 View commit details
    Browse the repository at this point in the history

  11. now click icon support upload images

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    22fda70 View commit details
    Browse the repository at this point in the history

  12. preview image only cap height, so can preview full

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    c41c148 View commit details
    Browse the repository at this point in the history

  13. reset input, user can attach same files if they want

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3373039 View commit details
    Browse the repository at this point in the history

  14. update model when user select images

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    6121261 View commit details
    Browse the repository at this point in the history

  15. try openai lasted version

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    855ce84 View commit details
    Browse the repository at this point in the history

  16. db store images

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    7d2fdbb View commit details
    Browse the repository at this point in the history

  17. rebase on latest main

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    95903f6 View commit details
    Browse the repository at this point in the history

  18. move close X circle to top-right corner

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    af2fcc0 View commit details
    Browse the repository at this point in the history

  19. bugfix, should also clear input images after send transcript

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    aca69c9 View commit details
    Browse the repository at this point in the history

  20. click small image shows larger in the middle

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3ff2898 View commit details
    Browse the repository at this point in the history

  21. better look of small image's close button

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a7e3db4 View commit details
    Browse the repository at this point in the history

  22. Images in messages width 100%

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a429d58 View commit details
    Browse the repository at this point in the history

  23. re-focus the prompt

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    2378dac View commit details
    Browse the repository at this point in the history

  24. past image file to attach

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a611c05 View commit details
    Browse the repository at this point in the history

  25. use chakra-ui Image component

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    427ca59 View commit details
    Browse the repository at this point in the history

  26. rebase on main

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    874d9d7 View commit details
    Browse the repository at this point in the history

  27. refactor with ImageModal component

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    63cd21a View commit details
    Browse the repository at this point in the history

  28. remove unused variable in the comment

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    9f7eb0b View commit details
    Browse the repository at this point in the history

  29. set image optional in ChatCraftMessageTable

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    5101e66 View commit details
    Browse the repository at this point in the history

  30. rename Clip everywhere to Attach

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    af0d8f6 View commit details
    Browse the repository at this point in the history

  31. rename textAndImage to content

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    8ec864f View commit details
    Browse the repository at this point in the history

  32. optimize: remove this.image check as not undefined; shorthand assign … 

    …text
    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    bd3b179 View commit details
    Browse the repository at this point in the history

  33. catch processing images' error and show the popup

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    87e3147 View commit details
    Browse the repository at this point in the history

  34. Support adding more than 1 image at a time in the file picker

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    cc975e2 View commit details
    Browse the repository at this point in the history

  35. add an index number to the top left corner of each image

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    8050611 View commit details
    Browse the repository at this point in the history

  36. fix number outline shape oval to round, add margin

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    bad9188 View commit details
    Browse the repository at this point in the history

  37. fix broken pnpm-lock

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    1a3f24f View commit details
    Browse the repository at this point in the history

  38. only image also get response

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    ae80a97 View commit details
    Browse the repository at this point in the history

  39. Re-focus after closing the full image

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3cc95c7 View commit details
    Browse the repository at this point in the history

  40. update comment about cutoff bug

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    d870c8c View commit details
    Browse the repository at this point in the history

  41. rebase on main

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    eb817cf View commit details
    Browse the repository at this point in the history

  42. use new menu component, no long space after message

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    11a9e18 View commit details
    Browse the repository at this point in the history

  43. image in modal enlarge

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3e795b4 View commit details
    Browse the repository at this point in the history

  44. support continue use non vision model when history has images

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    8c1d624 View commit details
    Browse the repository at this point in the history

  45. Not being able to send empty messages

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    725f5cf View commit details
    Browse the repository at this point in the history

  46. Fix image styling when using gpt4-vision (#419) 

    * Fix image styling when using gpt4-vision

* Allow better scaling of images
    @Amnish04 @mingming-ma
    Amnish04 authored and mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    de8b5fb View commit details
    Browse the repository at this point in the history

  47. remove the unused import

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    7f1109c View commit details
    Browse the repository at this point in the history

  48. fix share chat image missing

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    0e8d50d View commit details
    Browse the repository at this point in the history

  49. refact useEffect dependencies

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    68830a6 View commit details
    Browse the repository at this point in the history

  50. rename Attach to AttachFileButton

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    6f725f5 View commit details
    Browse the repository at this point in the history

  51. rename image to imageUrls

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    1a592b6 View commit details
    Browse the repository at this point in the history

  52. fix typo

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    1f023ea View commit details
    Browse the repository at this point in the history

  53. use maxHeight for responsive modal

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    11ebc37 View commit details
    Browse the repository at this point in the history

  54. refactor code

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3a27281 View commit details
    Browse the repository at this point in the history

  55. update dependencies

    @mingming-ma
    mingming-ma committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    f679e4e View commit details
    Browse the repository at this point in the history