Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Let’s talk about the elephant in the room, or rather, the elephant-sized building that houses what might be Minnesota’s most ...