Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

As a computer science student at the University of St. Thomas in St. Paul, Zin Khant likens the advent of artificial intelligence to the discovery of electricity — a modern Rosetta Stone that will ...