Skip to content

Conversation

@YusakuNo1
Copy link
Member

@YusakuNo1 YusakuNo1 commented Apr 18, 2025

Choose a PR Template

Switch to "Preview" on this description then select one of the choices below.

Click here to open a PR for a Data Plane API.

Click here to open a PR for a Control Plane (ARM) API.

Click here to open a PR for only SDK configuration.

API: Get agent evaluation results

Sample request:
GET /runs/agents/{runId}

  • At Build 2025 with agent API v1, only the following URL is available (our document only mentions to use completion Id):

    • /runs/agents/thread_[unique-id]:run_[unique-id]
  • After agent API v2 release, both of the following URLs are working (our document only mentions to use run Id):

    • /runs/agents/thread_[unique-id]:run_[unique-id]
    • /runs/agents/run_[unique-id]

Sample response:
HTTP 200

{
  "id": "run_[unique-id]",           # For agent API v1, it's completion Id; for agent API v2, it's the run Id
  "status": "Succeeded",
  "results": [{
    "evaluator": "Coherence",
    "score": 4,
    "status": "Succeeded",
    "reason": null,
    "version": "",
    "threadId": "thread_22T5DPuaLl1gMIcmAcxxuph9",
    "runId": "run_99YbyqAZNiVclQpmQQRREQqF",
    "error": null,
    "additionalDetails": null
  },
  {
    "evaluator": "Fluency",
    "score": 3,
    "status": "Succeeded",
    "reason": null,
    "version": "",
    "threadId": "thread_22T5DPuaLl1gMIcmAcxxuph9",
    "runId": "run_99YbyqAZNiVclQpmQQRREQqF",
    "error": null,
    "additionalDetails": null
  }]
}

@openapi-pipeline-app
Copy link

openapi-pipeline-app bot commented Apr 18, 2025

Next Steps to Merge

Next steps that must be taken to merge this PR:
  • ❌ This PR is in purview of the ARM review (label: ARMReview). This PR must get ARMSignedOff label from an ARM reviewer.
    This PR is not ready for ARM review (label: NotReadyForARMReview). This PR will not be reviewed by ARM until relevant problems are fixed. Consult the rest of this Next Steps to Merge comment for details.
    Once the blocking problems are addressed, add to the PR a comment with contents /azp run. Automation will re-evaluate this PR and if everything looks good, it will add WaitForARMFeedback label which will put this PR on the ARM review queue.
    For details of the ARM review, see aka.ms/azsdk/pr-arm-review

@openapi-pipeline-app
Copy link

openapi-pipeline-app bot commented Apr 18, 2025

PR validation pipeline restarted successfully. If there is ApiView generated, it will be updated in this comment.

@YusakuNo1 YusakuNo1 changed the base branch from main to feature/azure-ai-projects-1dp-private April 18, 2025 23:19
@azure-sdk
Copy link
Collaborator

azure-sdk commented Apr 18, 2025

API Change Check

APIView identified API level changes in this PR and created the following API reviews

Language API Review for Package
Python azure-ai-projects-onedp

@azure-sdk
Copy link
Collaborator

API change check

APIView has identified API level changes in this PR and created following API reviews.

Azure.AI.Projects

@YusakuNo1 YusakuNo1 merged commit d8af047 into feature/azure-ai-projects-1dp-private Apr 24, 2025
28 of 39 checks passed
@YusakuNo1 YusakuNo1 deleted the feature/azure-ai-projects-1dp-private-agent-eval branch April 24, 2025 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants