This workflow "Send Torq Audit and Activity Logs to Snowflake" automates the process of integrating Torq's audit and activity logs with Snowflake. Scheduled to run every 10 minutes, it establishes a time checkpoint, retrieves logs from the Torq API for a specified time frame, formats the data, and pushes it into a specified Snowflake database for storage and analysis. Ideal for maintaining data integrity and ensuring logs are available for compliance or monitoring purposes.
Workflow Breakdown
Set and update a Global Variable for the time checkpoint if one does not already exist
Pull all audit and activity logs that exist for the given start/stop time
Adjust the dataset to be inserted in Snowflake
Push logs into Snowflake
Vendors
Utils, Snowflake, Torq
Workflow Output
Torq audit logs into Snowflake
Tips
Setup all of the Snowflake parameters and integration names in the first workflow variable step.