Test Report: {{specification.filename}}

Creation Date: {{date_created}}
Test Files: {{specification.metadata.test_path}}

Total Duration

{{ total_duration }}

Total Cost

{{ total_costs }}

Errors

{{ total_errors }}

Warnings

{{ total_warnings }}

Test Results

{% for test in tests %}

{{ test.test_id }}

{% if test.specification.type == "question" %} {% endif %} {% for test_outcome in test.outcomes %} {% endfor %}
Model (completion): {{ specification.metadata.model }}, {{specification.metadata.system_role}}
Status Input File Description Duration Cost
{{ test_outcome.status | value }} {{ test_outcome.input_sample.filename }} {% if test_outcome.error_message %}{{ test_outcome.error_message }}{% else %}-{% endif %} {{ test_outcome.duration }} {{ test_outcome.costs.costs }}
{% endfor %}

Errors and Warnings

No errors or warnings found.

System Role

{{ specification.metadata.system_role }}

Engineered Prompt

{{ specification.prompt }}