Orensomekh commited on
Commit
9cdbd80
·
verified ·
1 Parent(s): 901bdd0

Update Operational_Instructions/DM_Sandbox.md

Browse files
Operational_Instructions/DM_Sandbox.md CHANGED
@@ -2,7 +2,7 @@
2
 
3
  1. Sign in to the [AI71 website](https://platform.ai71.ai/login)
4
 
5
- 2. Click on "DataMorgana" at the left rail, and then click "New test" to start generating Questions-Answers pairs
6
 
7
  3. Question/User Categorizations\
8
  3.1 Each Categorization includes a Name\
@@ -11,26 +11,34 @@
11
  3.4 Categorizations includes multiple Categories (e.g., "User-Expertise" includes two categories, "Expert" and "Novice")\
12
  3.4.1 Expand a Categorization by clicking the caret icon on its right-hand side to reveal its Categories
13
 
14
- 4. Categories\
15
- 4.1 Each Category includes a Name and a Description\
16
  4.2 You may use the default Categories or add new ones\
17
- 4.3 Each Categorization allows only one selected Category (e.g., "Expert" or "Novice" under "User-Expertise" Categorization)
 
18
 
19
- 5. Once you set the Question/User Categorizations and their Categories, you enter a **single** FineWeb document ID (e.g., "\<urn:uuid:d69cbebc-133a-4ebe-9378-68235ec9f091\>") in the respective box below\
20
- 5.1 If you leave the document ID field empty, a random document ID will be assigned automatically
 
 
21
 
22
- 6. Click the "Generate" black button on the top right to generate a DataMorgana synthetic Question-Answer pair\
23
- 6.1 The results (i.e., question, answer, doc, doc ID, and Question/User Categorizations information) will appear momentarily in a new page\
24
- 6.2 You may copy the results to the clipboard by clicking the "Copy to Clipboard" button, or return to the setting page by clicking the "Clear" button\
25
- 6.3 You may find Question-Answer pair examples [here](https://docs.google.com/spreadsheets/d/1rWzRiFVRWHUruP5vK4P6PNxgZgpi9OLX5YRi5Kc7k4g/edit?usp=sharing)
26
 
27
- 7. Your remaining Question-Answer pairs budget is displayed by a counter at the top center
 
 
 
28
 
29
- 8. You may use JSON mode for entering and editing Question/User Categorizations/Categories, by sliding the knob at the top to "JSON Editor"\
30
- 8.1 Follow the JSON Schema in button right for correct Categorizations/Categories setting\
31
- 8.2 In case your resulting JSON is correct, it will be reflected in the "Visual Editor" once the knob at the top is shifted left
32
 
33
- 9. The default Categorizations/Categories settings may be restored by refreshing the page
 
 
 
 
34
 
35
 
36
 
 
2
 
3
  1. Sign in to the [AI71 website](https://platform.ai71.ai/login)
4
 
5
+ 2. Click on "DataMorgana" at the left rail, and then click "New test" to start generating Q&A pairs
6
 
7
  3. Question/User Categorizations\
8
  3.1 Each Categorization includes a Name\
 
11
  3.4 Categorizations includes multiple Categories (e.g., "User-Expertise" includes two categories, "Expert" and "Novice")\
12
  3.4.1 Expand a Categorization by clicking the caret icon on its right-hand side to reveal its Categories
13
 
14
+ 4. Question Categories\
15
+ 4.1 Each Category includes a Name, a Description, and a "Multi-doc" checkbox\
16
  4.2 You may use the default Categories or add new ones\
17
+ 4.3 Each Categorization allows only one selected Category (e.g., "Factoid" or "Open-ended" under "Factuality" Categorization)\
18
+ 4.3.1 In case at least one selected Question Categorization includes a selected Question Category which is checked for "Multi-doc", the generated Q&A will consider exactly two docs (i.e., "Multi-doc" request). Otherwise, it considers only one doc (i.e., "Single-doc" request)
19
 
20
+ 5. User Categories\
21
+ 5.1 Each Category includes a Name and a Description\
22
+ 5.2 You may use the default Categories or add new ones\
23
+ 5.3 Each Categorization allows only one selected Category (e.g., "Expert" or "Novice" under "User-Expertise" Categorization)
24
 
25
+ 6. Once you set the Question/User Categorizations and their Categories:\
26
+ 6.1 For "Multi-doc" requests you may enter **two** FineWeb document IDs (e.g., "\<urn:uuid:d69cbebc-133a-4ebe-9378-68235ec9f091\>") or **none**, in the respective box\
27
+ 6.2 For "Single-doc" requests you may enter **one** FineWeb document ID or **none**, in the respective box\
28
+ 6.1 If you leave the document ID field(s) empty, a random document(s) will be assigned automatically
29
 
30
+ 7. Click the "Generate" black button on the top right to generate a DataMorgana synthetic Q&A pair\
31
+ 7.1 The results (i.e., question, answer, doc(s), doc ID(s), and Question/User Categorizations information) will appear momentarily in a new page\
32
+ 7.2 You may copy the results to the clipboard by clicking the "Copy to Clipboard" button, or return to the setting page by clicking the "Clear" button\
33
+ 7.3 You may find Q&A pair examples [here](https://docs.google.com/spreadsheets/d/1rWzRiFVRWHUruP5vK4P6PNxgZgpi9OLX5YRi5Kc7k4g/edit?usp=sharing)
34
 
35
+ 8. Your remaining Q&A pairs budget is displayed by a counter at the top center
 
 
36
 
37
+ 9. You may use JSON mode for entering and editing Question/User Categorizations/Categories, by sliding the knob at the top to "JSON Editor"\
38
+ 9.1 Follow the JSON Schema on the bottom right for correct Categorizations/Categories setting\
39
+ 9.2 In case your resulting JSON is correct, it will be reflected in the "Visual Editor" once the knob at the top is shifted left
40
+
41
+ 10. The default Categorizations/Categories settings may be restored by refreshing the page
42
 
43
 
44