Skip to main content
Compares each incoming item against a storage you choose, using an identifier you provide. It looks the item up in storage and then decides, based on a condition, whether to let the item through or drop it. By default the condition keeps only items that are not yet in storage, which makes this a simple way to skip records you have already seen and process only new ones. When an item is kept it can optionally be saved into storage at the same time, so the next run knows it has been handled. Use this to avoid processing the same record twice, for example to import only the orders or products you have not imported before.

​
Fields

​
Sample data

This filter answers yes or no for each item, so there is no before and after. It relies on a configured storage, which cannot be exercised from a standalone example, so the illustration below is based on the feature’s behaviour rather than a recorded run. With the default condition (keep items that do not already exist) and a storage that already contains an entry for order 10041:
FieldValue
Storage entity identifier&{order_id}
Conditionkeep items that do not exist in storage (the default)
Save entity to storageon
Incoming itemResult
{ "order_id": "10041", "customer": "Jane Doe" }does not match (already in storage, so it is dropped)
{ "order_id": "10042", "customer": "John Smith" }matches (new, so it passes and is saved for next time)