| {"doc": {"question": "What size of cannula would you use in a patient who needed a rapid blood transfusion (as of 2020 medical knowledge)?", "subject": "clinical_knowledge", "choices": ["A", "B", "C", "D"], "answer": 0, "index": 0, "query": "Question: What size of cannula would you use in a patient who needed a rapid blood transfusion (as of 2020 medical knowledge)?\n A. 18 gauge.\n B. 20 gauge.\n C. 22 gauge.\n D. 24 gauge.\nAnswer:", "gold": 0}, "task_name": "mmlu_clinical_knowledge:mc", "doc_id": 0, "native_id": 0, "label": 0, "requests": [{"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: What size of cannula would you use in a patient who needed a rapid blood transfusion (as of 2020 medical knowledge)?\n A. 18 gauge.\n B. 20 gauge.\n C. 22 gauge.\n D. 24 gauge.\nAnswer:", "continuation": " A"}, "idx": 0}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: What size of cannula would you use in a patient who needed a rapid blood transfusion (as of 2020 medical knowledge)?\n A. 18 gauge.\n B. 20 gauge.\n C. 22 gauge.\n D. 24 gauge.\nAnswer:", "continuation": " B"}, "idx": 1}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: What size of cannula would you use in a patient who needed a rapid blood transfusion (as of 2020 medical knowledge)?\n A. 18 gauge.\n B. 20 gauge.\n C. 22 gauge.\n D. 24 gauge.\nAnswer:", "continuation": " C"}, "idx": 2}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: What size of cannula would you use in a patient who needed a rapid blood transfusion (as of 2020 medical knowledge)?\n A. 18 gauge.\n B. 20 gauge.\n C. 22 gauge.\n D. 24 gauge.\nAnswer:", "continuation": " D"}, "idx": 3}]} | |
| {"doc": {"question": "The key attribute in successful marathon running is:", "subject": "clinical_knowledge", "choices": ["A", "B", "C", "D"], "answer": 3, "index": 1, "query": "Question: The key attribute in successful marathon running is:\n A. strength.\n B. power.\n C. stride length.\n D. stamina.\nAnswer:", "gold": 3}, "task_name": "mmlu_clinical_knowledge:mc", "doc_id": 1, "native_id": 1, "label": 3, "requests": [{"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: The key attribute in successful marathon running is:\n A. strength.\n B. power.\n C. stride length.\n D. stamina.\nAnswer:", "continuation": " A"}, "idx": 0}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: The key attribute in successful marathon running is:\n A. strength.\n B. power.\n C. stride length.\n D. stamina.\nAnswer:", "continuation": " B"}, "idx": 1}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: The key attribute in successful marathon running is:\n A. strength.\n B. power.\n C. stride length.\n D. stamina.\nAnswer:", "continuation": " C"}, "idx": 2}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: The key attribute in successful marathon running is:\n A. strength.\n B. power.\n C. stride length.\n D. stamina.\nAnswer:", "continuation": " D"}, "idx": 3}]} | |
| {"doc": {"question": "Which of the following is the commonest cause of dementia in the UK?", "subject": "clinical_knowledge", "choices": ["A", "B", "C", "D"], "answer": 0, "index": 2, "query": "Question: Which of the following is the commonest cause of dementia in the UK?\n A. Alzheimer's disease.\n B. Cerebrovascular (stroke) disease.\n C. Lewy body dementia.\n D. HIV infection.\nAnswer:", "gold": 0}, "task_name": "mmlu_clinical_knowledge:mc", "doc_id": 2, "native_id": 2, "label": 0, "requests": [{"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: Which of the following is the commonest cause of dementia in the UK?\n A. Alzheimer's disease.\n B. Cerebrovascular (stroke) disease.\n C. Lewy body dementia.\n D. HIV infection.\nAnswer:", "continuation": " A"}, "idx": 0}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: Which of the following is the commonest cause of dementia in the UK?\n A. Alzheimer's disease.\n B. Cerebrovascular (stroke) disease.\n C. Lewy body dementia.\n D. HIV infection.\nAnswer:", "continuation": " B"}, "idx": 1}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: Which of the following is the commonest cause of dementia in the UK?\n A. Alzheimer's disease.\n B. Cerebrovascular (stroke) disease.\n C. Lewy body dementia.\n D. HIV infection.\nAnswer:", "continuation": " C"}, "idx": 2}, {"request_type": "loglikelihood", "request": {"context": "The following are multiple choice questions (with answers) about clinical knowledge.\n\nQuestion: The energy for all forms of muscle contraction is provided by:\n A. ATP.\n B. ADP.\n C. phosphocreatine.\n D. oxidative phosphorylation.\nAnswer: A\n\nQuestion: What is the difference between a male and a female catheter?\n A. Male and female catheters are different colours.\n B. Male catheters are longer than female catheters.\n C. Male catheters are bigger than female catheters.\n D. Female catheters are longer than male catheters.\nAnswer: B\n\nQuestion: In the assessment of the hand function which of the following is true?\n A. Abduction of the thumb is supplied by spinal root T2\n B. Opposition of the thumb by opponens policis is supplied by spinal root T1\n C. Finger adduction is supplied by the median nerve\n D. Finger abduction is mediated by the palmar interossei\nAnswer: B\n\nQuestion: How many attempts should you make to cannulate a patient before passing the job on to a senior colleague, according to the medical knowledge of 2020?\n A. 4\n B. 3\n C. 2\n D. 1\nAnswer: C\n\nQuestion: Glycolysis is the name given to the pathway involving the conversion of:\n A. glycogen to glucose-1-phosphate.\n B. glycogen or glucose to fructose.\n C. glycogen or glucose to pyruvate or lactate.\n D. glycogen or glucose to pyruvate or acetyl CoA.\nAnswer: C\n\nQuestion: Which of the following is the commonest cause of dementia in the UK?\n A. Alzheimer's disease.\n B. Cerebrovascular (stroke) disease.\n C. Lewy body dementia.\n D. HIV infection.\nAnswer:", "continuation": " D"}, "idx": 3}]} | |