• Integrated file input feature in the SDK
• Provided an example that includes images
• Upgraded the human evaluation view to present larger inputs
• Fixed issues related to data overwriting in the cloud
• Implemented UI enhancements to the side bar

• Resolved a bug related to saving the application

• Made minor adjustments

• Introduced chat-based applications
• Fixed a bug in 'export csv' feature in auto evaluation

• Fixed a bug impacting the csv reader
• Addressed an issue of variant overwriting
• Made tabs draggable for better UI navigation
• Implemented support for multiple LLM keys in the UI

• Enhanced and simplified self-hosting feature
• Added a tutorial for the Mistral model
• Resolved a race condition issue in deployment
• Fixed an issue with saving in the playground

• Enhanced bug tracking with Sentry integration in the cloud
• Integrated Intercom for better user communication in the cloud
• Upgraded to the latest version of OpenAI
• Cleaned up files post serving in CLI

• Conducted extensive Cypress tests for improved application stability
• Added a collapsible sidebar for better navigation
• Improved error handling mechanisms
• Added documentation for the evaluation feature

• Launched SDK version 2
• Launched the cloud-hosted version
• Completed a comprehensive refactoring of the application

This necessitated modifications to the SDK. Now, the LLM application API returns a JSON instead of a string. The JSON includes the output message, usage details, and cost:

{
"message": string,
"usage": {
"prompt_tokens": int,
"completion_tokens": int,
"total_tokens": int
},
"cost": float
}