Spaces:
Running
Running
Update Operational_Instructions/Live_Challenge_Day_and_Dry_Test_Instructions.md
Browse files
Operational_Instructions/Live_Challenge_Day_and_Dry_Test_Instructions.md
CHANGED
@@ -4,10 +4,11 @@
|
|
4 |
* Session 1: 7:00 β 9:00 UTC
|
5 |
* Session 2: 15:00 β 17:00 UTC
|
6 |
|
7 |
-
2. Just before your session start time, your team leader will receive an email containing the Question file (500 questions) in
|
8 |
|
9 |
-
3. You must generate and submit your Answer file in
|
10 |
-
3.1
|
|
|
11 |
3.2 It is **highly recommended** to parallelize and use retries when sending requests to Falcon β see a simple [script](Falcon_Ai71_Usage.ipynb) of parallel batch request with retries using AI71 Falcon\
|
12 |
**Remark:** Details about the exact Answer file upload procedure will be provided soon
|
13 |
|
|
|
4 |
* Session 1: 7:00 β 9:00 UTC
|
5 |
* Session 2: 15:00 β 17:00 UTC
|
6 |
|
7 |
+
2. Just before your session start time, your team leader will receive an email containing the Question file (500 questions) in JSONL format, where each line contains a Question JSON object β see Question [JSON schema](Question.json.schema) and [example](Question_Example.json)
|
8 |
|
9 |
+
3. You must generate and submit your Answer file in JSONL format, where each line contains an Answer JSON object β see Answer [JSON schema](Answer.json.schema) and [example](Answer_Example.json) β within 2 hours from your session start time\
|
10 |
+
3.1 **JSONL format:** Each line must be a single, complete JSON object, no line breaks within an object, and no multi-line formatting or indentation\
|
11 |
+
3.2 Here is a simple [script](Create_and_Verify_Answer_File_for_LiveRAG.ipynb) for generating and verifying a valid Answer file\
|
12 |
3.2 It is **highly recommended** to parallelize and use retries when sending requests to Falcon β see a simple [script](Falcon_Ai71_Usage.ipynb) of parallel batch request with retries using AI71 Falcon\
|
13 |
**Remark:** Details about the exact Answer file upload procedure will be provided soon
|
14 |
|