At Invex Systems , a proprietary platform sends inventory data every 6 hours to a cloud-based ingestion service. Each transmission includes a payload with multiple fields and a timestamp. If a transmission issue is suspected, the system may re-send the same data . As a data engineer, how can you efficiently deduplicate the incoming data?