Databricks launches LakeFlow to help its customers build their data pipelines

Databricks launches LakeFlow to help its customers build their data pipelines(techcrunch.com)

9 points by ctc24 2 years ago | 2 comments

datavirtue 2 years ago |

No mention of data lineage, governance or logging.

memhole 2 years ago | |

Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.

datavirtue 2 years ago |

No mention of data lineage, governance or logging.

memhole 2 years ago | |

Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.