Login
Input
Output
Evaluation Input Image

The artist of the work (<image 1>) on the left is



(A) Masaccio


(B) Piero della Francesca


(C) Fra Angelico


(D) Giotto


Answer with the option's letter from the given choices directly. No punctuation.


Google: Gemini Pro Vision 1.0
mmmu / DesignPublic

A


Expected Answer: C

Difficulty: Hard

Subfield: Design History

Evaluation

Evaluation ID
d5b3b9cb-697c-4378-b06d-1387dd517f4b
Created
February 21, 2024
Raw Output
{
  "id": "gen-aB1Tv23iumGBLSYUZqdfoLlvx4s3",
  "model": "google/gemini-pro-vision",
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": " A"
      },
      "finish_reason": "STOP"
    }
  ],
  "object": "chat.completion",
  "created": 1708561346,
  "usage": {
    "prompt_tokens": 1264,
    "completion_tokens": 4,
    "total_tokens": 1268
  }
}