Miscs for Interro31
This commit is contained in:
+3
-12
@@ -39,11 +39,6 @@ Avoid giving feedback about confusing letters `n` with `m`, `x` with
|
||||
`n` or `h` with `k`. If it looks wrong, assume you read it wrong,
|
||||
unless the distinction is very important.
|
||||
|
||||
You should also give me a measure of confidence, from 0 to 1 that you
|
||||
were able to correctly understand the answer. A score below 0.5 means
|
||||
that you think it is likely that you couldn't understand an important
|
||||
part.
|
||||
|
||||
In some case, you may find that either
|
||||
- The student didn't answer the right question. Set the score to 0.
|
||||
Since it could be a labeling error, indicate is by setting `error`
|
||||
@@ -57,19 +52,17 @@ In some case, you may find that either
|
||||
If there's no error, set `error` to `\"\"`.
|
||||
|
||||
You will answer using json describing a list of dictionary with a key
|
||||
\"id\", and a key \"result\" that contains the \"score\", the \"confidence\", a
|
||||
list \"feedback\", and possibly an \"error\". Like this example :
|
||||
\"id\", and a key \"result\" that contains the \"score\", a list
|
||||
\"feedback\", and possibly an \"error\". Like this example :
|
||||
|
||||
[{ \"id\": \"01\",
|
||||
\"result\": {\"score\" : 2.5,
|
||||
\"confidence\" : 0.8,
|
||||
\"feedback\": [{text: \"Un retour générique. Il faut apprendre le cours.\", box_2d: null},
|
||||
{text: \"Non, la fonction n'est pas forcément continue\", pos: [145, 280, 340, 500]}],
|
||||
\"error\": \"\"}
|
||||
},
|
||||
{ \"id\": \"04\",
|
||||
\"result\": {\"score\" : 4.,
|
||||
\"confidence\" : 0.9,
|
||||
\"feedback\" : []
|
||||
\"error\": \"\" }
|
||||
}
|
||||
@@ -121,7 +114,6 @@ class FeedbackItem(BaseModel):
|
||||
|
||||
class ResultData(BaseModel):
|
||||
score: float = Field(description="The numeric score")
|
||||
confidence: float = Field(description="Confidence level")
|
||||
feedback: List[FeedbackItem] = Field(description="List of feedback items")
|
||||
error: str = Field(description="Indicates if an error occurred")
|
||||
|
||||
@@ -140,7 +132,6 @@ UNROLLED_SCHEMA = {
|
||||
"type": "OBJECT",
|
||||
"properties": {
|
||||
"score": {"type": "NUMBER", "description": "The numeric score"},
|
||||
"confidence": {"type": "NUMBER", "description": "Confidence level"},
|
||||
"error": {"type": "STRING", "description": "Indicates if an error occurred"},
|
||||
"feedback": {
|
||||
"type": "ARRAY",
|
||||
@@ -160,7 +151,7 @@ UNROLLED_SCHEMA = {
|
||||
}
|
||||
}
|
||||
},
|
||||
"required": ["score", "confidence", "feedback", "error"]
|
||||
"required": ["score", "feedback", "error"]
|
||||
}
|
||||
},
|
||||
"required": ["id", "result"]
|
||||
|
||||
Reference in New Issue
Block a user