Executing a profiler task (mongo profiler)

Execute profiler.sh to generate masking inventory file.

CODE

$ ./profiler.sh -o masking-inventory -c db_connection_conf.yaml
Source Database Password:

..
[2024-04-29 13:45:55][INFO] Found podman environment.
..
2024-04-29 17:45:58,148 [INFO] (mongodb_connector:36) - Connected to MongoDB successfully!
..
2024-04-29 17:46:04,703 [INFO] (masking_inventory_creator:130) - Generating masking inventory at /app/sample_mflix_movies_masking_inventory.json
2024-04-29 17:46:05,215 [INFO] (masking_inventory_creator:71) - Masking inventory created and saved to /app/sample_mflix_movies_masking_inventory.json
2024-04-29 17:46:05,239 [INFO] (mongodb_connector:94) - Connection to MongoDB closed.
..
..
[2024-04-29 13:46:06][INFO] Recommending to review the masking inventory file[sample_mflix_movies_masking_inventory.json]
[2024-04-29 13:46:06][INFO] in the current directory. Validate it and fix the algorithms, if required.

Review the masking inventory file and modify it, if required.

Execute profiler.sh to create a dataset using the given masking inventory file.

CODE

$ ./profiler.sh -o data-sets -c db_connection_conf.yaml -e hsc-host-example.com -k <API Key> -d <connector id> -u <unload split>


[2024-04-29 13:50:58][INFO] Getting source database details from [db_connection_conf.yaml].
[2024-04-29 13:50:58][INFO] Getting target database details from [db_connection_conf.yaml].
[2024-04-29 13:50:58][INFO] Payload for API /data-sets is stored in payload_data_sets.json.
[2024-04-29 13:50:58][INFO] Executing API /data-sets.
[2024-04-29 13:50:58][INFO] Successfully executed API /data-sets.
[2024-04-29 13:50:58][INFO] Newly generated data-sets id:3