Login
Input
Output
Evaluation Input Image

The Chrysler Building was designed by?<image 1>



(A) Frank Lloyd Wright


(B) I. M. Pei


(C) William Van Allen


(D) Philip Johnson


Answer with the option's letter from the given choices directly. No punctuation.


Google: Gemini Pro Vision 1.0
mmmu / DesignPublic

C


Expected Answer: C

Difficulty: Easy

Subfield: Industrial Design

Evaluation

Evaluation ID
889f2925-7bba-4dca-9c1f-5b1829c22f12
Created
February 21, 2024
Raw Output
{
  "id": "gen-LDMJQ1WQvoi0AAQZQKP9eQkmSQwS",
  "model": "google/gemini-pro-vision",
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": " C"
      },
      "finish_reason": "STOP"
    }
  ],
  "object": "chat.completion",
  "created": 1708561861,
  "usage": {
    "prompt_tokens": 1264,
    "completion_tokens": 4,
    "total_tokens": 1268
  }
}