Parquet profiler

Identifying the schema of parquet files and aligning columns with the suitable masking algorithms from the Delphix Compliance Engine poses a challenge. Moreover, when dealing with a large number of files (similar/varied) in the source location, establishing a Hyperscale Parquet Connector dataset becomes challenging. The Parquet Profiler serves as a solution to address this complexity.

The main objective of the Parquet Profiler is to analyze the source parquet files and create a Hyperscale Parquet Connector dataset, essentially helping in creating a masking inventory for the source data.

The Parquet Profiler is tightly coupled with the Hyperscale Parquet Connector and cannot be used for other connectors.