Skip to content

Allow sharing output, feedback, and diff per run#264

Draft
niemela wants to merge 2 commits into
masterfrom
expose-output
Draft

Allow sharing output, feedback, and diff per run#264
niemela wants to merge 2 commits into
masterfrom
expose-output

Conversation

@niemela
Copy link
Copy Markdown
Member

@niemela niemela commented Apr 10, 2026

Closes #208

Adds team_output, judge_message, and diff to runs`.

Comment thread JSON_Format.md
| time | TIME | Absolute time when run completed.
| contest\_time | RELTIME | Contest relative time when run completed.
| run\_time | number | Run time in seconds. Should be a non-negative integer multiple of `0.001`. The reason for this is to not have rounding ambiguities while still using the natural unit of seconds.
| team\_output | array of FILE ? | The output produced by the team's submission for this run.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we say something about mimetypes of these 3? I'm not sure since we could have teams produce PNGs or something, so maybe we shouldn't say something about mime types...

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is in fact why I did not add a mime type.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Somewhat related: should we also say that this array of FILE contains exactly/at most a single file?

Comment thread JSON_Format.md
| run\_time | number | Run time in seconds. Should be a non-negative integer multiple of `0.001`. The reason for this is to not have rounding ambiguities while still using the natural unit of seconds.
| team\_output | array of FILE ? | The output produced by the team's submission for this run.
| judge\_message | array of FILE ? | The feedback message produced by the output validator for this run.
| diff | array of FILE ? | A diff between the team's output and the judge's answer for this run.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should clarify if this meant to be a (unified) diff output or just something that in a general sense represents a diff. I guess it's the latter.

Comment thread JSON_Format.md
| time | TIME | Absolute time when run completed.
| contest\_time | RELTIME | Contest relative time when run completed.
| run\_time | number | Run time in seconds. Should be a non-negative integer multiple of `0.001`. The reason for this is to not have rounding ambiguities while still using the natural unit of seconds.
| team\_output | array of FILE ? | The output produced by the team's submission for this run.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Somewhat related: should we also say that this array of FILE contains exactly/at most a single file?

@niemela
Copy link
Copy Markdown
Member Author

niemela commented Apr 13, 2026

Discussed on our meeting today. Several details left as homework to the drafter, but overall positive:

  • support output to file rather than just stdout. Maybe using the filename in the file reference?
  • support truncated outputs, but marked as such. Maybe using tags?
  • we should add file size
  • specify what kind of diff. Again, maybe using tags? Or mime-types?

@niemela niemela marked this pull request as draft April 13, 2026 22:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Expose problemoutput & checkoutput with /runs

3 participants