A conversation about data pipelines is never complete without discussing ingestion practices, such as ETL and ELT. You might want to consider a hybrid solution.