Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
1 National and Kapodistrian University of Athens, Greece ([email protected]) 2 Harokopio University of Athens, Greece ([email protected]) 3 National and Kapodistrian University of Athens, Greece ...