Getting Started¶
Configure¶
After having set up ads opctl
on your desired machine using ads opctl configure
, you are ready to begin using pii operator. At a bare minimum, you will need to provide the following details about your tasks:
Path to the input data (input_data)
Path to the output directory, where the operator will place the processed data and report.html produced from the run (output_directory)
Name of the column with user data (target_column)
The detector will be used in the operator (detectors)
You can check Configure Detector for more details on how to configure detectors
parameter. These details exactly match the initial pii.yaml file generated by running ads operator init --type pii
:
kind: operator
type: pii
version: v1
spec:
input_data:
url: mydata.csv
target_column: target
output_directory:
url: result/
detectors:
- name: default.phone
action: mask
Optionally, you are able to specify much more. The most common additions are:
Whether to show sensitive content in the report (show_sensitive_content)
Way to process the detected entity (action)
An extensive list of parameters can be found in the YAML Schema.
Run¶
After you have your pii.yaml written, you simply run the operator using:
ads operator run -f pii.yaml
Interpret Results¶
The pii operator produces the following output files: mydata-out.csv
and report.html
.
We will go through each of these output files in turn.
mydata-out.csv
The name of this file can be customized based on output_directory
parameters in the configuration yaml. This file contains the processed dataset.
report.html
The report.html file is customized based on report parameters in the configuration yaml. It contains a summary of statistics, a plot of entities distributions, details of the resolved entites, and details about any modelused. By default sensitive information is not shown in the report, but for debugging purposes you can disable this with show_sensitive_content
. It also includes a copy of YAML file, providing a fully detailed version of the original specification.