Tabular Foundation Models (TFMs) logopeterindia.net
Knowledge Hub

Data Lineage Tools

Data lineage explained: open standards, open-source projects, SQL parsers, platform-native lineage and commercial products.

29 topics•6 categories•Updated October 2026

What Is Data Lineage?

4 entries

Data lineage records where data comes from, how it is transformed and where it goes, at table, column or pipeline level. Teams use it for impact analysis before changes, root-cause analysis when numbers break, compliance evidence and, increasingly, to give AI applications trustworthy context. Lineage is usually collected from query logs, SQL parsing or pipeline instrumentation and shown in a data catalog or governance platform.

01OpenLineageThe open standard for collecting lineage metadata from jobs and pipelines, which many tools below emit or consume. 02Metadata ManagementMetadata management platforms and tools, on this site. 03Enterprise Data Catalogs for DataOpsData catalogs that display lineage, on this site. 04Data Governance PlatformsGovernance platforms with lineage, on this site.

Open Standards and Open-Source Lineage

9 entries

Open projects for collecting and storing lineage. Release and activity facts are from each repository's GitHub page.

05OpenLineage (GitHub)Open standard for lineage metadata collection under Apache-2.0; GitHub lists 1.55.0 as the latest release, from 30 October 2026. 06OpenLineage Spark integrationDocumentation for collecting lineage from Apache Spark jobs with OpenLineage. 07Apache Airflow OpenLineage providerAirflow provider that emits OpenLineage events from DAG runs. 08MarquezReference implementation for collecting, aggregating and visualizing lineage metadata (Apache-2.0). GitHub lists 0.50.0 as the latest release, from October 2024, though the repository was updated in October 2026. 09Spline (ABSA)Data lineage tracking and visualization for Apache Spark (Apache-2.0). GitHub lists release/1.0.0-RC3, from June 2026, as the latest release. 10EgeriaOpen metadata and governance project (Apache-2.0) with lineage support; GitHub lists V6.2 as the latest release, from October 2026. 11Apache AtlasOpen-source metadata and governance framework whose lineage features are used across Hadoop ecosystems. 12OpenMetadata lineageOpenMetadata documentation on column, table and pipeline lineage. 13DataHub lineageDataHub's lineage feature guide. The site returns 403 to automated checks, so the link may need a manual click.

SQL Parsing and Column-Level Lineage Libraries

3 entries

Libraries that derive lineage by parsing SQL.

14SQLLineagePython SQL lineage analysis tool (MIT); GitHub lists v1.5.9 as the latest release, from September 2026. 15SQLGlotPython SQL parser and transpiler (MIT) that includes lineage utilities; updated in October 2026. 16dbt column-level lineagedbt documentation on column-level lineage for models.

Platform-Native Lineage

4 entries

Lineage built into data and cloud platforms. Descriptions follow each vendor's own documentation.

17Databricks Unity Catalog lineageDatabricks documentation on data lineage in Unity Catalog. 18Microsoft Purview lineageMicrosoft Learn documentation on data lineage concepts in Microsoft Purview. 19Google Cloud Knowledge Catalog lineageGoogle documentation says Data Lineage helps track the data lifecycle, analyze metadata movement and troubleshoot pipeline errors. 20Amazon DataZone lineageAWS documentation describes an OpenLineage-compatible feature that captures and visualizes lineage events.

Commercial Lineage Products

5 entries

Vendor products with lineage as a main feature. Descriptions follow each vendor's own pages and are not independent evaluations.

21Collibra Data LineageCollibra's lineage product page for tracing where data has been and where it goes. 22Atlan lineageAtlan says it provides column-level lineage across more than 80 systems, derived automatically from SQL, pipelines and APIs. 23Alation Data LineageAlation describes end-to-end lineage with overlays for data quality, Trust Flags and business context. 24IBM data lineage (watsonx.data intelligence)IBM describes a platform to record, track, visualize and optimize how data moves through systems; the older Manta address now redirects here. 25SolidatusDescribes business lineage for regulated enterprises with AI-powered mapping and human-governed results.

Frequently Asked Questions

What is data lineage?

A record of where data originates, how it is transformed and where it flows, usually shown as a graph at table or column level.

What is OpenLineage?

An open standard for collecting lineage metadata from jobs and pipelines. Many orchestrators, query engines and catalogs emit or consume OpenLineage events, which lets lineage from different tools be combined.

What is column-level lineage?

Lineage that traces individual columns through transformations rather than whole tables, which makes impact analysis and root-cause analysis more precise. It is usually derived by parsing SQL or from query logs.

Do I need a commercial lineage tool?

Not always. Platform-native lineage in tools such as Unity Catalog or Microsoft Purview, plus OpenLineage with Marquez or OpenMetadata, covers many needs. Commercial products add cross-platform coverage, business lineage and governance workflows.

How does lineage relate to a data catalog?

Catalogs usually display lineage next to descriptions, owners and quality scores, and many catalogs collect lineage themselves. See the Enterprise Data Catalogs and Metadata Management pages on this site.

How current is this page?

Links were checked on 31 October 2026. DataHub's site returns 403 to automated checks and may need a manual click. Release facts are from GitHub, and vendor descriptions follow each vendor's own pages and are not independent evaluations.