I set up a source to target extracting data from MySQL and pushing into Snowflake. After doing so my Snowflake Usage nearly doubled. I noticed that it seems that Rivery is creating tmp tables with what appears to be a select star from MySQL tables, the number of rows inserted into the tmp table grows over time. The end results seem to be what I expected, e.g. the rows inserted into the perm Snowflake table is correct. Is there a way to limit how much data Riverly consumes so my snowflake usage goes down?
Hi @dhallidy,
You can optimize the loads by using CDC or incremental loading with Standard Extraction. Have you tried either of these options? This way, only the ‘deltas’ in between each run are pulled.
thanks,
Taylor