TACTIC - Advanced Text Labeling

Developed by Ipsos ACE

Advanced Text Labeling offers fine-grained control of the process of discovering and applying meaningful labels to a text corpus. This is intended to be an iterative process that allows the user to discover labels, examine coverage and accuracy, refine the label set, and repeat as needed.

Labels should be specific with context and well separated meaning (include sentiment polarity if needed). Recommended to keep labels 3 words or less

Not all text is guaranteed to be labeled, as TACTIC is not designed to create an "other" or "unknown" label; instead, such texts will be left unlabeled.

1. Upload a CSV, XLSX, or SAV file containing a column of text using the "Choose File" button.
   1. If you uploaded a multi-sheet XLSX file, you will be given the option to select the sheet name which holds the text data.
   2. You will be given the option to select the column name for the text column.
   3. Hit the "Upload Text Data" button.
2. After uploading the file, you can view the data in the DATA tab at the bottom of the screen.
3. "Choose Initial Labels" section
1. Option A: Upload a CSV or XLSX file containing a column of labels using the "Choose File" and "Upload Label Data" buttons.
• If you uploaded a multi-sheet XLSX file, you will be given the option to select the sheet name which holds the text data.
• Once uploaded, you can view, alter, add, and delete labels in the LABELS tab at the bottom.
2. Option B: Enter the number of labels you would like TACTIC to automatically generate for you.
• If left blank, TACTIC will automatically determine how many to create.
• After hitting the "Generate Label Data" button, you can view, alter, add, and delete labels in the LABELS tab at the bottom.
4. Before hitting the RUN button, always evaluate the estimated cost and number of texts. Hit RUN.
5. After a few moments, general statistics on the process will be displayed in the LABELS tab at the bottom. To view results for each row, refer to the DATA tab.
   The number of labels and the percent of texts covered will appear above the Run progress bar.
6. Iterating
1. Examine the Frequency and Overlap columns in the LABELS tab. From here you can drop a label using the DELETE buttons, modify existing labels, or add new labels using the "Add new label" button at the bottom.
2. Use the toggle switches in the "Fixed" column of the LABELS tab to lock labels in place, ensuring they are retained during successive runs or label selection processes.
3. Examine the DATA tab to see the top three (or less) labels assigned to each text. This is a sortable and searchable table, allowing you to quickly identify areas of overlap or attempt to identify commonalities among unlabeled texts. If you identify any themes that TACTIC missed, be sure to add them in the LABELS tab.
4. (optional) "Iteratively Find New Labels" section --- "Recommend Missing Labels"
   For increasing document coverage by generating new labels.
1. Either enter the number of additional labels for TACTIC to discover or leave blank to permit TACTIC to determine how many to generate.
2. Hit the "Generate Missing Labels" button.
3. Assess the new labels in the LABELS tab.
5. (optional) The "Iteratively Find New Labels" section --- "Select Best Labels"
   For reducing the number of labels to only the most useful ones, based on label frequency and overlap.
1. Enter the total number of labels for TACTIC to consider for the data set.
2. Be sure to utilize the toggle switches in the "Fixed" column on the LABELS tab to lock in any labels which should not be dropped.
3. Hit the "Start Label Selection" button.
4. Assess the new labels in the LABELS tab.
6. Hit the RUN button again.
   Note: Depending on what alterations were made to the label list, successive runs may incur additional costs.
7. Repeat these steps as needed, keeping a close eye on the "Labels", "Data Labeled", and "Est. max cost/run" figures above the Run progress bar.
7. Once you are pleased with the results, you can download a XLSX of the results using the "Export Report" button in the "Data Control" section.

TACTIC Walkthrough Video 1

TACTIC Walkthrough Video 2

User Feedback & Bug Report Form