Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Data masking in CDC

Hi Team,

I have a CDC configured with Oracle RDS as source and Snowflakes as destination, Please share the better approach to perform Data Masking of few sensitive data columns and also few other custom data manipulation on the fly when the synch/replication is in progress.

Thanks in Advance!!!!

3 Community Answers

Matillion Agent  

Ian Funnell —

Hi,

We don’t currently have a supported way to perform data manipulation during the CDC replication process; currently you can only perform transformations after the data has been replicated.
If there are date/timestamp fields available on the source tables which allow you to identify updated/new rows, an option may be extracting sensitive tables from the source by using the RDS query component and using a select statement (e.g. selecting only the fields you need and passing in the date/timestamp as a variable).

Hope that helps,

Best Regards,

Mike


Learning AtThirty —

Thanks a lot Mike. Please let me know how to proceed if i want to propagate only INSERT/UPDATE events in source Oracle RDS excluding DELETE record action into Snowflake while performing CDC job.


Matillion Agent  

Ian Funnell —

Hi Learning At Thirty,

As per your question in thread 23525, it’s not possible to selectively exclude certain DML operations in Matillion CDC.

Best regards,
Ian

Post Your Community Answer

To add an answer please login