Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
With years of experience applying AI, from early statistical machine learning models to state-of-the-art generative AI ...