RAGAS Evaluators and Traces in the Playground
We're excited to announce two major features this week:
-
We've integrated RAGAS evaluators into agenta. Two new evaluators have been added: RAG Faithfulness (measuring how consistent the LLM output is with the context) and Context Relevancy (assessing how relevant the retrieved context is to the question). Both evaluators use intermediate outputs within the trace to calculate the final score.
Check out the tutorial to learn how to use RAG evaluators.
-
You can now view traces directly in the playground. This feature enables you to debug your application while configuring it—for example, by examining the prompts sent to the LLM or reviewing intermediate outputs.
Both features are available exclusively in the cloud and enterprise versions of agenta.