Comments (2)
652994331
commented on May 12, 2024
yes, you can, to do this , you need to modify the run_classifier.py and optimization.py.
from albert_zh.
652994331
commented on May 12, 2024
we use mirrored distribute strategy to use multi gpu to do the pretrtain using our own data. 2 gpus could make the speed x2. you also can deploy horovod, a new distribute strategy.
from albert_zh.
Related Issues (20)
- 有兄弟试过 iflytek 数据训练出的分类模型吗？albert_tiny 模型进行下游任务，得到的结果比较郁闷。
- 请问考虑将模型发布到 tfhub 上面吗？
- The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.
- 句向量特征提取的最佳实践
- 预训练语料构造问题
- 模型转换pytorch问题 HOT 5
- 'str' object has no attribute 'size' HOT 1
- 求助 HOT 2
- 请问中文albert训练过程中是按字符级分割还是按词语级分割？ HOT 1
- 请问预训练模型是文本分类模型吗? 想做语言模型，预测下一个单字或词应该怎么修改？
- whats the difference between `albert_tiny_zh` and `albert_tiny_google_zh` HOT 1
- 数据集下载不了 HOT 1
- 请问DataProcessor类在哪里呢
- 想請問模型的 license
- 预训练的差异 HOT 1
- 有相关onnx模型转换与调用的支持嘛？
- 在预训练生成特定格式的文件(tfrecords) 时内存不足问题 HOT 1
- File path error
- AttributeError: module 'tensorflow.contrib.tpu' has no attribute 'InputPipelineConfig'
- Internal: Blas GEMM launch failed : a.shape=(4096, 128), b.shape=(128, 312), m=4096, n=312, k=128
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from albert_zh.