[5b4ecd]: / evaluation / prompt_cot / mmlu-general.py

Download this file

41 lines (41 with data), 3.1 kB

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
[
{
"prompt": """3 Cl−(aq) + 4 CrO_4^2−(aq) + 23 H+(aq) → 3 HClO2(aq) + 4 Cr3+(aq) + 10 H2O(l). In the reaction shown above, Cl−(aq) behaves as\n\nOptions:\nA. an acid \nB. a base \nC. a catalyst \nD. a reducing agent""",
"gold": "D",
"steps": [
"A molecule that behaves as a base accepts an H+ ion from another molecule, whereas a molecule that behaves as an acid donates an H+ ion to another molecule.",
"In the reaction, Cl− does not donate or accept an H+ ion, ruling out options (A) and (B).",
"A catalyst accelerates a reaction without undergoing a chemical change, but Cl− does undergo a change in this reaction, ruling out option (C).",
"Cl− carries a negative charge, which it donates in the reaction to form HClO2. This is the behavior of a reducing agent.",
"Therefore, a reducing agent is the correct answer."
]
},
{
"prompt": """Which of the following statements about the lanthanide elements is NOT true?\n\nOptions:\nA. The most common oxidation state for the lanthanide elements is +3. \nB. Lanthanide complexes often have high coordination numbers (> 6). \nC. All of the lanthanide elements react with aqueous acid to liberate hydrogen. \nD. The atomic radii of the lanthanide elements increase across the period from La to Lu.""",
"gold": "D",
"steps": [
"The atomic radii of the lanthanide elements decrease across the period from La to Lu, not increase.",
"Options (A), (B), and (C) are all true.",
"Therefore, the statement in option (D) is the only one that is NOT true."
]
},
{
"prompt": """Which of the following lists the hydrides of group-14 elements in order of thermal stability, from lowest to highest?\n\nOptions:\nA. PbH4 < SnH4 < GeH4 < SiH4 < CH4 \nB. PbH4 < SnH4 < CH4 < GeH4 < SiH4 \nC. CH4 < SiH4 < GeH4 < SnH4 < PbH4 \nD. CH4 < PbH4 < GeH4 < SnH4 < SiH4""",
"gold": "A",
"steps": [
"The thermal stability of group-14 hydrides decreases as we move from the top of group 14 to the bottom.",
"The order of elements in the group from top to bottom is C, Si, Ge, Sn, Pb.",
"Therefore in order of increasing thermal stability we have PbH4, SnH4, GeH4, SiH4, and CH4."
]
},
{
"prompt": """Predict the number of lines in the EPR spectrum of a solution of 13C-labelled methyl radical (13CH3•), assuming the lines do not overlap.\n\nOptions:\nA. 4 \nB. 3 \nC. 6 \nD. 24 \nE. 8""",
"gold": "E",
"steps": [
"The electron paramagnetic resonance spectrum will be split by two forms of interactions.",
"The first is the hyperfine interaction with the 13C (nuclear spin I = 1/2) which will split the spectrum into 2 lines.",
"This will be further split into 4 lines by the interaction with three equivalent 1H nuclei.",
"The total number of lines is therefore 2 x 4 = 8."
]
}
]