I am building a workflow and need to discard existing pulled data. I am to provide data on a weekly basis. However, as of right now the workflow is built to pull all of the data from a database. What is requested is to provide NEW data every week. Is there any tool or combination of tools that can discard old records based off the Unique Key field provided? Example data is attached.
I was considering creating a dataset to contain the currently pulled keys and with an additional field to show completed then run a join followed by a filter to eliminate the ones completed after every week of pulls, however it will lack continuity to run itself without making changes constantly to the workflow.