Skip to content

数据血缘,Hive/Sqoop/HBase/Spark等,发送到kafka后,解析处理使用neo4j生成血缘

Notifications You must be signed in to change notification settings

thestyleofme/data-lineage-parent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

data-lineage-parent

数据血缘,使用各种hook或sql解析,统一将血缘信息存到kafka后,在neo4j中进行储存展现

1. lineage-hooks

里面有各种hook,实现血缘采集

1.1 lineage-hive-hook

通过hive hook将血缘信息写入kafka

hive血缘neo4j示例

image

About

数据血缘,Hive/Sqoop/HBase/Spark等,发送到kafka后,解析处理使用neo4j生成血缘

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages