A few of my clients send footer lines. You don't have an option to skip the last line.
I've set skip file when n errors set to 2.
What I'd prefer is abort when n errors hits 2. Is this achievable, without some complicated loop back step?
Laura Malins —
I’m assuming this is in regard to the S3 Load component?
This is based on the Snowflake COPY INTO command which unfortunately doesn’t support either footers or the option to abort after a certain number of errors.
I think your best bet would be to remove the footer from the file first, perhaps using the sed command in a Bash component.
Post Your Community Answer
To add an answer please login