Light

leesf / hudi-resources Goto Github PK

View Code? Open in Web Editor NEW

533.0 38.0 157.0 24.21 MB

汇总Apache Hudi相关资料

hudi apachehudi apache hudi-resources datalake bigdata stream-processing incremental-processing data-integration

hudi-resources's Introduction

Hi there 👋

About Me 😄

I am PMC member and committer at Apache Hudi.
I am currently using Apache Hudi to build Lakehouse at large scale.
I am interested in big data technologies.
I love sharing technology about Apache Hudi, please checkout the summary resources at https://github.com/leesf/hudi-resources and you can follow on belowing ApacheHudi WeChat account to get info timely.

Get in Touch 📫

📮 E-mail: [email protected]

hudi-resources's People

Contributors

Stargazers

Watchers

Forkers

datalake123 jondamer chenxi0599 coder-xx-coder lxyuan8888 gottaboy wanderyukon wosow xuqianjin-stars humanai li36909 cooolcai yianz hivefans rongyousu zuoyebushiwo phenixmzy logicjwell houlinchn zhangyz11 sc-hello jijunwei jamindy vinnielhj mysky528 yichengzhong poseidonand wanghj0928 sanwen1221 zhangyue19921010 ztcheck gavinljj lcs559 liijiankang caidixi fhygh peanut-chenzhong rice668 kithunder xiejiajun wuhaiying83 yangrong688 recentprogress luketalent bmqmingqi bluebirddm putaozhi123 zfighter lvycc weicm doaneyang ellenadams tweet zzzhy qywoolala1314 finatech-21th x1aozhu jackwang1230 zhilongwen l-f-b 6heng jions7ihj wangyouzheng1994 czz7025833 yankee24 julianjsynnex allenwang616 zyclove jasoonpang hanhanzhang wulei0302 yanchenyun yingxuanwangxuan shursulei komahyz duhongbo123 helakelas dongkelun kindofblue michaelli916 lishiyucn yyf365 mint-boy-he maikouliujian run-lin colonelhou wangshubing1 sun07 lmagic233 wyunnpeng ssmjfish wuwenchi jekong-hao zacklin923 qy513449931 lingdu99 xuxin1983 zhangshunyu huanhuande upupfeng

hudi-resources's Issues

使用sparkstreaming实时把kafka数据写入Hudi时，50010端口有大量close_wait连接

你好，我在使用sparkstreaming将kafka中的数据组装成DF后写入Hudi中，但是使用中发现，每写一批数据，就会存留一些50010端口的close_wait状态的链接无法关闭，最后直到达到系统文件打开数上限，程序异常退出。请问为什么写入hdfs的链接无法自动关闭?我使用的是dataFrame.write.format("org.apache.hudi").mode().save()的方法写入hudi的。

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

Jobs

Jooble