Unveiling the Power of Column-Level Lineage in SAP Datasphere

In June 2024, SAP Datasphere introduced a new column-level lineage feature that enhances data tracking and governance capabilities. This feature allows users to trace data lineage down to individual columns, providing detailed insights into data flow and transformations across different stages. By visualizing column-level dependencies, organizations can better understand the origin, movement, and transformations of data, ensuring higher data quality and compliance with governance standards​.

What is Column-Level Lineage?

Column-level lineage tracks the journey of data through each transformation, from its source to its destination, at the most granular level—the individual column. This means users can see exactly how data in each column is derived, transformed, and used across various datasets and reports. This level of detail is crucial for maintaining data accuracy, auditing changes, and ensuring compliance with data governance policies.

Steps to utilize this new feature

In the Repository Explorer or the Data Builder start page, select an object to analyse and click on the Impact and Lineage Analysis icon in the toolbar.

Here we can see the Impact and Lineage Analysis diagram which helps you understand the data lineage (provenance) of a selected object or its columns, along with its impacts. It shows which objects depend on it and will be affected by any changes made to it.

Click the columns button on the analysed object to open the list of columns.

Select one or more columns that you want to analyse and then click Select.

The diagram updates to display the selected columns under the analysed object and the related columns in their lineage or impacts within other relevant objects.

You can click any column in the analysed object to highlight its participation in the graph.

Conclusion

The introduction of column-level lineage in SAP Datasphere marks a significant advancement in data management and governance. By providing unparalleled visibility into data transformations, this feature enhances transparency, compliance, and trust in data processes. As organizations continue to navigate complex data environments, column-level lineage will be an invaluable tool for maintaining data integrity and driving informed decision-making.

If you or your colleagues have further questions or queries and would like to understand more about this new feature, please feel free to contact us at dearbhla.keenan@seaparkconsultancy.com .