Login
Input
Output
Evaluation Input Image

The work (<image 1>) on the left was made for a



(A) royal palace


(B) religious institution


(C) private home


(D) civic building


Answer with the option's letter from the given choices directly. No punctuation.


Google: Gemini Pro Vision 1.0
mmmu / DesignPublic

B


Expected Answer: A

Difficulty: Medium

Subfield: Design History

Evaluation

Evaluation ID
ef25b860-3702-4755-931c-9e321790b443
Created
February 21, 2024
Raw Output
{
  "id": "gen-YDtYKQ8pyFxxPLSP8X7vJRX2Xyse",
  "model": "google/gemini-pro-vision",
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": " B"
      },
      "finish_reason": "STOP"
    }
  ],
  "object": "chat.completion",
  "created": 1708561263,
  "usage": {
    "prompt_tokens": 1256,
    "completion_tokens": 4,
    "total_tokens": 1260
  }
}