Evaluators
📄️ Create Evaluator
Create Evaluator
📄️ Fetch Evaluator
Fetch Evaluator
📄️ Edit Evaluator
Edit Evaluator
📄️ Archive Evaluator
Archive Evaluator
📄️ Unarchive Evaluator
Unarchive Evaluator
📄️ Query Evaluators
Query Evaluators
📄️ Create Evaluator Variant
Create Evaluator Variant
📄️ Fetch Evaluator Variant
Fetch Evaluator Variant
📄️ Edit Evaluator Variant
Edit Evaluator Variant
📄️ Archive Evaluator Variant
Archive Evaluator Variant
📄️ Unarchive Evaluator Variant
Unarchive Evaluator Variant
📄️ Query Evaluator Variants
Query Evaluator Variants
📄️ Fork Evaluator Variant
Fork Evaluator Variant
📄️ Retrieve Evaluator Revision
Retrieve Evaluator Revision
📄️ Create Evaluator Revision
Create Evaluator Revision
📄️ Fetch Evaluator Revision
Fetch Evaluator Revision
📄️ Edit Evaluator Revision
Edit Evaluator Revision
📄️ Archive Evaluator Revision
Archive Evaluator Revision
📄️ Unarchive Evaluator Revision
Unarchive Evaluator Revision
📄️ Query Evaluator Revisions
Query Evaluator Revisions
📄️ Commit Evaluator Revision
Commit Evaluator Revision
📄️ Log Evaluator Revisions
Log Evaluator Revisions
📄️ Create Simple Evaluator
Create Simple Evaluator
📄️ Fetch Simple Evaluator
Fetch Simple Evaluator
📄️ Edit Simple Evaluator
Edit Simple Evaluator
📄️ Archive Simple Evaluator
Archive Simple Evaluator
📄️ Unarchive Simple Evaluator
Unarchive Simple Evaluator
📄️ Query Simple Evaluators
Query Simple Evaluators
📄️ Transfer Simple Evaluator
Transfer Simple Evaluator
📄️ Get Evaluators Endpoint
Endpoint to fetch a list of evaluators.
📄️ Evaluator Data Map
Endpoint to map the experiment data tree to evaluator interface.
📄️ Evaluator Run
Endpoint to evaluate LLM app run
📄️ Get Evaluator Configs
Endpoint to fetch evaluator configurations for a specific app.
📄️ Create New Evaluator Config
Endpoint to fetch evaluator configurations for a specific app.
📄️ Get Evaluator Config
Endpoint to fetch evaluator configurations for a specific app.
📄️ Update Evaluator Config
Endpoint to update evaluator configurations for a specific app.
📄️ Delete Evaluator Config
Endpoint to delete a specific evaluator configuration.