FEATURE: GPT4o support and better auditing

[SamSaffron]

• Introduce new support for GPT4o (automation / bot / summary / helper)
• Properly account for token counts on OpenAI models
• Track feature that was used when generating AI completions

[nattsw]

@SamSaffron looks like legit failures -

1) DiscourseAi::AiBot::Tools::SearchSettings#process can return more many settings with no descriptions if there are lots of hits
     Failure/Error: { name: strategy.display_name, value: strategy.model }
     
     NoMethodError:
       undefined method `display_name' for nil:NilClass
     # ./plugins/discourse-ai/lib/summarization/models/custom_llm.rb:8:in `display_name'

[SamSaffron]

Yep, will fix we have a flake

…

On Tue, 14 May 2024 at 12:09 PM, Natalie Tay ***@***.***> wrote: @SamSaffron <https://github.com/SamSaffron> looks like legit failures - 1) DiscourseAi::AiBot::Tools::SearchSettings#process can return more many settings with no descriptions if there are lots of hits Failure/Error: { name: strategy.display_name, value: strategy.model } NoMethodError: undefined method `display_name' for nil:NilClass # ./plugins/discourse-ai/lib/summarization/models/custom_llm.rb:8:in `display_name' — Reply to this email directly, view it on GitHub <#618 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAABIXM5Y5D3RHUDQJACPILZCFW37AVCNFSM6AAAAABHVE4MJ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBZGE2DCNJUG4> . You are receiving this because you were mentioned.Message ID: ***@***.***>