Orensomekh's picture
Update Operational_Instructions/DM_Sandbox.md
901bdd0 verified
|
raw
history blame
2.38 kB

DataMorgana Sandbox

  1. Sign in to the AI71 website

  2. Click on "DataMorgana" at the left rail, and then click "New test" to start generating Questions-Answers pairs

  3. Question/User Categorizations
    3.1 Each Categorization includes a Name
    3.2 You may use the default Categorizations or add new ones
    3.3 You can choose multiple Categorization (e.g., choosing "Factuality" and "Formulation" Question Categorizations)
    3.4 Categorizations includes multiple Categories (e.g., "User-Expertise" includes two categories, "Expert" and "Novice")
    3.4.1 Expand a Categorization by clicking the caret icon on its right-hand side to reveal its Categories

  4. Categories
    4.1 Each Category includes a Name and a Description
    4.2 You may use the default Categories or add new ones
    4.3 Each Categorization allows only one selected Category (e.g., "Expert" or "Novice" under "User-Expertise" Categorization)

  5. Once you set the Question/User Categorizations and their Categories, you enter a single FineWeb document ID (e.g., "<urn:uuid:d69cbebc-133a-4ebe-9378-68235ec9f091>") in the respective box below
    5.1 If you leave the document ID field empty, a random document ID will be assigned automatically

  6. Click the "Generate" black button on the top right to generate a DataMorgana synthetic Question-Answer pair
    6.1 The results (i.e., question, answer, doc, doc ID, and Question/User Categorizations information) will appear momentarily in a new page
    6.2 You may copy the results to the clipboard by clicking the "Copy to Clipboard" button, or return to the setting page by clicking the "Clear" button
    6.3 You may find Question-Answer pair examples here

  7. Your remaining Question-Answer pairs budget is displayed by a counter at the top center

  8. You may use JSON mode for entering and editing Question/User Categorizations/Categories, by sliding the knob at the top to "JSON Editor"
    8.1 Follow the JSON Schema in button right for correct Categorizations/Categories setting
    8.2 In case your resulting JSON is correct, it will be reflected in the "Visual Editor" once the knob at the top is shifted left

  9. The default Categorizations/Categories settings may be restored by refreshing the page