Measurement and Evaluation of Trustworthy Intelligent Systems
METIS
Specification-driven evaluation. Evaluate an application's performance against the system requirements that matter most.

Quick start
- Install METISInstallation and Setup
- Prepare the target connection and LangfusePre-requisites
- Create a specificationUse the Wizard or configure manually
- Run the test suite, then run the gradersSimulation or Grading
- Analyse your resultsInsights
Run all commands from the repository root. To use your own evaluation tools, export the specification.
Components
Wizard, Engine, and Insights are the three main tools. Web and API give access to them. Library and Core hold the shared parts.
Create a specificationDescribe your application in a guided Interview, or write the specification yourself.
Run an evaluationSimulate conversations with your target, then grade each trial.
The map groups the components by purpose. For package dependencies, read the architecture specification in the repo.