Multimodal Knowledge Agent (MKA) benchmark

What it is

Artificial Analysis describes a benchmark developed with Google DeepMind for agents handling visually complex inputs and creating document deliverables across 200 tasks in 10 industries. Scores and cost estimates depend on its rubrics and evaluation harness; benchmark development is a partnership, not wholly independent of the model maker.

Topics