Skip to content

Conversation

@pavelgj
Copy link
Collaborator

@pavelgj pavelgj commented Nov 13, 2024

   vertexAIModelGarden({
      location: 'us-central1',
      models: [claude3Sonnet, llama31],
    }),
    vertexAIEvaluation({
      location: 'us-central1',
      metrics: [
        VertexAIEvaluationMetricType.BLEU,
        VertexAIEvaluationMetricType.GROUNDEDNESS,
        VertexAIEvaluationMetricType.SAFETY,
        {
          type: VertexAIEvaluationMetricType.ROUGE,
          metricSpec: {
            rougeType: 'rougeLsum',
            useStemmer: true,
            splitSummaries: 'true',
          },
        },
      ],
    }),
    vertexAIRerankers({
      projectId: PROJECT_ID,
      location: LOCATION,
      rerankers: ['vertexai/reranker'],
    }),

@pavelgj pavelgj requested a review from cabljac November 13, 2024 14:54
Copy link
Contributor

@cabljac cabljac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@pavelgj pavelgj merged commit 34d914e into main Nov 13, 2024
4 checks passed
@pavelgj pavelgj deleted the pj/vertexPluginApiUpdate branch November 13, 2024 15:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

2 participants