Skip to main content

Recipe Creation

To create a recipe, begin by clicking the Add Recipe button located at the top right corner of the recipes page.

Add Dataset Image

Recipe Details

In the Create Recipe window add the following details:

  • Recipe Name: Provide a name for your recipe.
Add Dataset Image

Adding a Tool

A tool is the fundamental component of a recipe. Each tool represents a specific annotation type such as RLHF, Classification, or QnA. Different tools can be combined to form a recipe, allowing users to perform various types of annotations on the same data in a single task. For instance, if a recipe includes tools for both classification and summarization, annotators can classify and summarize the data simultaneously, making more efficient use of their time. The compatibility of different tools with one another is outlined below.

Tool TypeAvailable Tool SelectorsRequired FieldsCompatible With
ClassificationRadio, ChecklistClassification labels/categories (e.g., positive/negative for sentiment analysis)NER, Summarization
RLHF-N/AN/A
NER-EntitiesClassification, Summarization
Summarization-Summary labels (e.g., for summarization in multiple aspects for a single text, different labels can be set)NER, Classification
QnA-N/AN/A
Text Matching-N/AN/A
PII Anonymization-N/AN/A

To create a new tool, click on the Add Tool banner in the recipe creation window. In the tool creation window, provide the necessary information about the tool. More details are given below:

Add tool Image
FieldDescription
NameName of the tool
LabelThe name of the label. The label will be used as the column name in the output csv/ as the key in the output json
Tool TypeType of annotation job
Tool SelectorType of tool selector used for annotating that task. Tools available for each type of tasks are given in the table given above.
Tool Image

Finish the recipe creation process by clicking the Create button.

Tool Image