Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
If the rumors are true, Apple will refresh the iPhone, iPad, and MacBook lineups next month. Here's what I'm excited to order, and what you might want to add to your cart.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results