AI freshness April: update evaluation and tokenizer docs#52961

gewarren merged 4 commits intomaindotnet/docs:mainfrom

copilot/update-ai-docs-for-freshnessdotnet/docs:copilot/update-ai-docs-for-freshnessCopy head branch name to clipboard