Updating SK to dotnet-0.24.230918.1-preview

[teresaqhoang]

Motivation and Context

This pull request updates the SK package and includes several updates and improvements to the project:

• Tokenizer change
• Error handling updates
• Chat optimizations

Description

• The SharpToken package has been added, and SemanticKernel packages have been updated to their latest preview versions dotnet-0.24.230918.1-preview.
• The ChatSkill has been updated to improve performance and bypass audience extraction for the default user.
• Update TokenUtilities.TokenCount to use custom SharpToken token counter implementation with cl100k_base encoding for calculating the number of tokens in a string, improving the accuracy and consistency of token counting in the project. Remove unused code for determining token usage. Improve error handling by logging and throwing the exception.
• Refactor ChatController and ChatSkill to use SafeInvokeAsync method for invoking asynchronous callback functions and tagging any exception that occurs with function name. Also, update telemetry tracking accordingly.
• Update BotResponsePrompt.cs constructor parameter name from systemResponse to systemInstructions
• Simplified AlertMessage in client
  

Contribution Checklist

• The code builds clean without any errors or warnings
• The PR follows the Contribution Guidelines and the pre-submission formatting script raises no violations
  - [ ] All unit tests pass, and I have added new tests where possible
• I didn't break anyone 😄