Adding Transformations to a Cloning Job
Last updated
Was this helpful?
Last updated
Was this helpful?
You have the option to select tables for cloning and introduce transformations to columns.
Column renaming and string character masking have been introduced as configurable options for a cloning job. These transformations come into play when the cloning job is executed. The sequence of transformations, as specified on the Mappings, Assessments, and Transformations page, is the order in which they are applied. These are saved as transformations in the cloning job's JSON file, grouped by table column and table.
For validating the transformations added to the columns, click the Refresh button. In case a transformation is invalid, an error notification is displayed. Remove the invalid transformation, add a new one, and then click Refresh again for validation.
Since a transformation could be reliant on a preceding transformation, deleting a transformation results in the deletion of all subsequent transformations.
On the Mappings, Assessments, and Transformations page, to rename a column, select Transform > Rename and input the new column name.
Click Refresh for name validation.
Click Save.
While configuring a cloning job, there's the option to mask all fields within a string column. This is particularly useful for sensitive data like credit card numbers or social security numbers. Algoreus uses fixed masking, meaning a fixed length string is subjected to the specified pattern. Mask transformations follow this syntax:
mask <col_name> <direction> <masking_character> n
During the execution of the cloning job, Algoreus replaces all characters in each field with a mask character, with the exception of the first 'n' characters in the specified direction, before writing the data to the target.
The masking direction can either be left or right.
Algoreus offers the following masking transformations:
Show last 2: Masks all characters with * apart from the last two characters in the string.
Show last 4: Masks all characters with * except for the last four characters in the string.
Custom: Define the characters to mask and the masking character. For instance, 'right ? 3' masks all characters with ? except for the last three characters in the string. 'left # 2' masks all characters with # except for the first 2 characters in the string.
The mask is saved as a transformation that is applied to the data during the execution of the cloning job. For instance, if you enter 'right # 2' as a custom mask in a column named SSN, the transformation appears as: mask ssn right # 2
To mask fields in a column: On the Mappings, Assessments, and Transformations page, to rename a column, select Transform > Mask.
Select a masking transformation.
Click Refresh to validate the masking transformation.
Click Save.