Evaluation

Input	Output
Mayan chacmool sculptures such as this one heavily influenced which of the following twentieth-century sculptors? <image 1> (A) Louise Bourgeois (B) Henry Moore (C) Barbara Hepworth (D) Constantin Brancusi Answer with the option's letter from the given choices directly. No punctuation.	Google: Gemini Pro Vision 1.0 mmmu / ArtPublic D Expected Answer: B Difficulty: Easy Subfield: Visual Arts Explanation: Mayan chacmool sculptures are typically made of stone and feature a reclining human figure with a head turned 90 degrees away from the body and looking directly at the viewer. Henry Moore saw a cast of a chacmool in a Paris museum and was fascinated by it. Moore's reclining figures, which are more abstract than chacmools but were inspired by the essence of chacmool form, became a major characteristic of Moore's work.

Input

Output

Mayan chacmool sculptures such as this one heavily influenced which of the following twentieth-century sculptors? <image 1>

(A) Louise Bourgeois

(B) Henry Moore

(D) Constantin Brancusi

Answer with the option's letter from the given choices directly. No punctuation.

Google: Gemini Pro Vision 1.0

mmmu / ArtPublic

Expected Answer: B

Difficulty: Easy

Subfield: Visual Arts

Explanation: Mayan chacmool sculptures are typically made of stone and feature a reclining human figure with a head turned 90 degrees away from the body and looking directly at the viewer. Henry Moore saw a cast of a chacmool in a Paris museum and was fascinated by it. Moore's reclining figures, which are more abstract than chacmools but were inspired by the essence of chacmool form, became a major characteristic of Moore's work.

Evaluation ID: 97b3db03-ed3b-47df-b1a2-196752bacf15
Created: February 21, 2024

Raw Output

{
  "id": "gen-kI9mkyY7vXyPnD8t15hgfZfeQZVQ",
  "model": "google/gemini-pro-vision",
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": " D"
      },
      "finish_reason": "STOP"
    }
  ],
  "object": "chat.completion",
  "created": 1708556455,
  "usage": {
    "prompt_tokens": 1320,
    "completion_tokens": 4,
    "total_tokens": 1324
  }
}