You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The new failure handling significantly reduces failures due to API requests allowing you to perform robust model grading evaluations
Custom Operators 🧪
You can now define any custom Python functions as an Operator and use it to perform your evaluations using CustomOperator
New Readers for BigQuery and DuckDB 📖
Now, you can directly provide a query and UpTrain can read data from your BigQuery Database using BigQueryReader and DuckDB database using DuckDBReader
New Validation Retry Logic 💡
You can now set your own retry logic which dictates how to generate LLM responses in case of validation failures. This could be any Python function like modifying prompt, temperature, triggering a tool, returning a default response, etc.
You can also check if the LLM response is empty or not for the given query and get back a default message instead of the LLM response.