Data Lineage
Data lineage records where data comes from, how it changes, and where it is used, helping teams trace an AI output back through its inputs.
Data lineage traces data from its origins through transformations to its destinations. It helps a reviewer follow the route behind an output. IBM
For an AI-assisted project, that route can explain which input file was used, which reviewed changes were applied, and which deliverable contains the result. It also reveals where the record stops.
A lightweight illustrative chain
This is a fictional teaching example:
feedback.csv → reviewed-codes.csv → memo.mdThe first file holds supplied comments. The second records reviewed labels. The memo uses checked counts and selected observations. A useful register names the versions and the transformations between them, including who reviewed the assignments when that is documented.
If the input is missing, the reviewer cannot inspect the starting evidence. If the input exists but the labeling decision is undocumented, the missing piece is interpretation. Those gaps need different repairs.
What traceability establishes
A hash identifies file bytes. A citation points to an evidence location. Lineage records movement and change across the chain. None alone proves correctness, permission, complete coverage, or legal compliance.
The AI project-handoff guide uses a source register as a lightweight traceability example, rather than a full lineage system. Snapshot Handoff inventories the supplied files; Project Handoff Auditor reviews the prepared packet against them. Those jobs still require evidence for decision status.
Grounding connects an answer to supporting material. Lineage adds the path through the materials and transformations that produced the deliverable.
Filed under
data-lineage · knowledge-work
Related
- Create an AI Project Handoff Another Teammate Can UseCreate a project handoff with AI that preserves source files, current decisions, open questions, owners, and an acceptance check for the next teammate.
- Project Handoff AuditorUse this agent to review a prepared human-to-human project handoff against its local source files: find missing deliverables, unsupported completion claims, unclear ownership, stale or conflicting decisions, and questions the receiving teammate cannot resolve from the packet. Report evidence and fixes without editing the packet.
- Snapshot HandoffCreate a deterministic inventory of an approved handoff directory: record relative file paths, byte lengths, and SHA-256 hashes with code, list skipped symlinks and unreadable files, and write a snapshot without interpreting project status or changing source files.
- GroundingGrounding ties a model's output to verifiable sources — retrieved documents, tool results, citations — instead of training-data memory.
- Decision Log ReconcilerReconcile an existing business-project decision log with supplied dated notes and change records: connect decisions to evidence, preserve explicit supersession links, separate accepted choices from proposals, and list contradictions awaiting an owner. Use when project records disagree about what was decided; do not write an architectural ADR or create meeting minutes.
- GleanGlean is an enterprise AI search and assistant platform that retrieves company knowledge through configured connectors and source access controls.