Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Query- Live data Replication - Approach

Hi Team,

I have two queries with respect to live data replication. Please share the better approach to achieve the same.

Case 1. Source: RDS to Destination:Snowflake via Matillion.

Case 2. Source: On-Prem Oracle to Destination: Snowflake via Matillion (Without using any Query component as it will put more load in Oracle server)

Thanks in advance!!!

5 Community Answers

Matillion Agent  

Paul Johnson —

Hi
Matillion has a CDC Feature which supports Oracle as a Source for AWS hosted snowflake instances.

Check out the documentation here for an overview and how to configure

Regards,
Paul


Learning AtThirty —

We managed to configure CDC with Matillion and its working for record INSERT/UPDATE but unfortunately DELETE records in Oracle are not propagated through Matillion to Snowflake. Please advice on this.

Thanks in advance!!!!


Matillion Agent  

David Lipowitz —

Hello,

Thanks for writing in on the DELETE issue, though we’ve not seen that problem before. Community posts like this one don’t accept attachments; can you please forward your server log to support@matillion.com? You can download the log from the Admin menu to the upper-right of the canvas.

I expect there are clues to this behavior contained in that file. Also, please let us know if you’re seeing any other error message related to this issue.

Best Regards,
Dave


Learning AtThirty —

Dear Dave,

Please let me know how to proceed if i want to propagate only INSERT/UPDATE events in source Oracle RDS excluding DELETE action into Snowflake while performing CDC job.


Matillion Agent  

Ian Funnell —

Hi Learning At Thirty,

As per your question in thread 23525, it’s not possible to selectively exclude certain DML operations in Matillion CDC.

Best regards,
Ian

Post Your Community Answer

To add an answer please login