Skip to main content
Records how far a data synchronization has got, so a later run can pick up where this one left off. For each record passing through, it reads an identifier and a date from your data and marks that identifier as finished at that date in the storage. Pair it with Storage: Load progress, which reads this progress back at the start of the next run, to build a flow that only processes new or changed records. The data flowing through your transformation is passed along unchanged.

​
Fields

​
Sample data

This transformer writes progress into a configured storage and passes your data through unchanged, so it has no before/after of its own to show. The example below shows a typical configuration: for each record, the identifier at id is marked as processed at the date read from updated_at. A later Storage: Load progress run pointed at the same storage would then report that identifier and date as the resume point.