In part one of this series, we discussed how to prepare for the ingestion of data. In this second part of the Art of Data Ingestion, we’ll discuss technical considerations for ingesting data. Once you’ve worked through the questions of what data it is you will be receiving, it’s time to think about the technical horizon for the data.
My preferred data to ingest, if I had my dream world of data ingestion (queue the birds and dancing data strolling through a nice meadow), would be from a third-party system that specializes in data extraction. For businesses that sell data,