Discussions

Ask a Question
Back to All

Need to sync the growing data

Hi. Our data (attendance and time offs) is growing in size, and there doesn't seem to be some reasonable mechanism for syncing on the Personio side of the API. Personio recently introduced filtering absences by updated-from filter, but it works only for some changes, so if the entry was deleted, then it doesn't get picked up by the filter. So I don't see any use case for that new feature as long as long as the status property (deleted) is not passed on. The only possibility left is fetching all records every time, but that's not feasible from the resource point of view. And at the same time I'd need to hope noone adds any new records while the fetch process, as some records would get lost due to pagination and offset logic. Webhooks for changes don't exist, no incremental logic.. How do you guys deal with fetching data from personio?