Ask HN: Should data warehouses be the back end of data apps? Are data warehouses a bad choice for data apps because they lack freshness, latency, and query concurrency needs? Or if we're able to improve ingestion latency, query response time, and concurrency/scaleability, maybe it can be a good choice? |
If you need near real time data source for operational / transactional types of reporting then it is apparently not the right solution.
My company has no suitable in built reporting options in source systems so unfortunately we will be trying to serve near real time data via a data warehouse. We may be able to get the refresh pipeline down to about 1 hr by throwing resources at it.