Skip to content

v0.3.6

Compare
Choose a tag to compare
@Dominastorm Dominastorm released this 29 Jul 04:20
· 378 commits to main since this release
2ec5d01
  • Improved documentation 📑
  • Better Failure Handling 🛡️
    • The new failure handling significantly reduces failures due to API requests allowing you to perform robust model grading evaluations
  • Custom Operators 🧪
    • You can now define any custom Python functions as an Operator and use it to perform your evaluations using CustomOperator
  • New Readers for BigQuery and DuckDB 📖
    • Now, you can directly provide a query and UpTrain can read data from your BigQuery Database using BigQueryReader and DuckDB database using DuckDBReader
  • New Validation Retry Logic 💡
    • You can now set your own retry logic which dictates how to generate LLM responses in case of validation failures. This could be any Python function like modifying prompt, temperature, triggering a tool, returning a default response, etc.
    • You can also check if the LLM response is empty or not for the given query and get back a default message instead of the LLM response.