Skip to content

[Feature Request] - Allow For Local Evals #2047

Description

@nxf5025

Description

Currently the agentcore CLI requires a deployed agent to execute evals. Considering the agentcore dev command can spin up the agent locally and stores the telemetry in the .cli folder it would be great if the agentcore CLI supported local evaluation executions.

Acceptance Criteria

  • When an agent and evaluator exists in the agentcore.json a user is able to run evals without first deploying the agent to their AWS account

Additional Context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions