From 46adc19aa0d171a6084b3d9d5a3eae3a124e10b7 Mon Sep 17 00:00:00 2001
From: chirag gupta <103719146+chiruu12@users.noreply.github.com>
Date: Tue, 25 Mar 2025 14:06:37 +0530
Subject: [PATCH] Small typo in grader

---
 simpleqa_eval.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/simpleqa_eval.py b/simpleqa_eval.py
index 7ec3640b..9f034bf8 100644
--- a/simpleqa_eval.py
+++ b/simpleqa_eval.py
@@ -70,7 +70,7 @@
 - Do not punish predicted answers if they omit information that would be clearly inferred from the question.
     - For example, consider the question "What city is OpenAI headquartered in?" and the gold target "San Francisco, California". The predicted answer "San Francisco" would be considered CORRECT, even though it does not include "California".
     - Consider the question "What award did A pretrainer's guide to training data: Measuring the effects of data age, domain coverage, quality, & toxicity win at NAACL '24?", the gold target is "Outstanding Paper Award". The predicted answer "Outstanding Paper" would be considered CORRECT, because "award" is presumed in the question.
-    - For the question "What is the height of Jason Wei in meters?", the gold target is "1.73 m". The predicted answer "1.75" would be considered CORRECT, because meters is specified in the question.
+    - For the question "What is the height of Jason Wei in meters?", the gold target is "1.73 m". The predicted answer "1.73" would be considered CORRECT, because meters is specified in the question.
     - For the question "What is the name of Barack Obama's wife?", the gold target is "Michelle Obama". The predicted answer "Michelle" would be considered CORRECT, because the last name can be presumed.
 - Do not punish for typos in people's name if it's clearly the same name. 
     - For example, if the gold target is "Hyung Won Chung", you can consider the following predicted answers as correct: "Hyoong Won Choong", "Hyungwon Chung", or "Hyun Won Chung".