[Enhancement] Accelerate tree learning by GPU about lightgbm

[chivee]

yes, we still need to investigate the bottleneck for (or give an statics about ) GPU computing, such as moving data via PCI v.s. computing gradients. However, the multiprocessor feature will definitely helping accelerate the computing process.

[gugatr0n1c]

according to benchmarks in xgboost project, GPU can speed-up building tree severel times (i7-6700K vs. Titan X (pascal)), what is impresive..

dmlc/xgboost@f0c6166

[chivee]

huanzhang12/lightgbm-gpu#1, a community version of gpu

[chivee]

@huanzhang12, glad to see you have the plan to create PR back. we can have discussion here, and work together to enable GPU training

[huanzhang12]

@chivee Thanks! I am working on finalizing my GPU code. One thing I need to do right now is to update my branch to the upstream LightGBM master. Since there are a lot of changes in v2 (commit 4f77bd2), I need to make sure I don't break anything. I will let you guys know if I have any questions or concerns. Thanks!

[chivee]

@huanzhang12 , Sure, feel to ask if you need any help.

[huanzhang12]

@guolinke @chivee Some quick updates: I have mostly finished upgrading my GPU code to v2: https://github.com/huanzhang12/lightgbm-gpu/tree/v2. I am currently working on implementing the Dense4bitsBin on GPU (which is new in v2), and doing more testing. I hope I can get the code ready to review and merge by the end of this week.

[guolinke]

@huanzhang12 awesome, looking forward to your contribution.

[chivee]

Refer to #368

[github-actions]

This issue has been automatically locked since there has not been any recent activity since it was closed. To start a new related discussion, open a new issue at https://github.com/microsoft/LightGBM/issues including a reference to this.