Amazon is warning that a Russian-speaking hacker used multiple generative AI services as part of a campaign that breached more than 600 FortiGate firewalls across 55 countries in five weeks.
Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.