Comments (11)
@soumik12345 do you have an example that I can play with?
The main concern is that we want it as easy to use as possible. Assume a participant who never heard of Weights & biases before; our goal is to make sure:
- they can follow the instruction to create wandb account, run the example script and just be able to understand how to use the dashboard with only intuition
- able to read over the part of code that does wandb logging and have a rough idea of how it works; and able to adapt it for their training script without having too much of a learning curve
So I'm not in favor of adding a fancier logging feature to our example training script that will make the code harder to read and may require additional steps to interact on the dashboard. However, if you want to write a separate inference script with this, we are happy to link it :)
from community-events.
That is a bit hard for me to look through. Could you maybe try to do a git diff
on the latest training script from this repository and provide the patch here?
from community-events.
cc: @sayakpaul
from community-events.
I am okay with the idea. Could you elaborate what are advantages of using wandb.Table()
here as opposed to not using it?
from community-events.
With wandb.Table
, it would become very easy to Interactively explore the results in the Weights & Biases UI, compared to the media panels, thanks to additional features such as query, group-by, filter, sort (reference). Since tables are stored as artifacts, the results also become part of the lineage.
from community-events.
Thanks for providing the additional context!
Having used tables before, I can definitely see where you are coming from!
That said, we want our scripts to be minimal in terms of the features we support so that they are easily customizable. Do you have a (git) patch view of the changes that might be needed here to incorporate tables?
from community-events.
Hi @sayakpaul I have the changes on my fork here.
from community-events.
from community-events.
how do you compare different runs?
from community-events.
how do you compare different runs?
On your dashboard, tables from different runs are actually concatenated in the same table if they are logged under the same key. The best way to compare against different runs, therefore, is to add an additional column called Run
or Experiment
which with have the value wandb.run.id
, and after the table is logged, you can group by this column to compare results across different runs.
Note that I prefer to log run.id
in the table instead of run.name
because the run name is subject to change as per the user's convenience in the UI even after the run has been completed. The run.id
is a unique id assigned to each run and its updated run name can still be viewed upon hovering over the index column of a table with logs from multiple runs as shown below.
from community-events.
Hi, @sayakpaul @yiyixuxu
Please let me know your thoughts on this. I would love to raise a pull request if you give a green signal.
from community-events.
Related Issues (20)
- How to use the resulting whisper checkpoints when finetuning HOT 9
- Fine-tuned Whisper models perform worse than OpenAI HOT 8
- Super large number of epoch HOT 1
- Using finetuned whisper checkpoints for inference HOT 1
- Whisper parameters HOT 1
- Add Keras Dreambooth notebook to this repo
- Lambda platform doesn't support Tensorflow-Gpu HOT 1
- WhisperPositionalEmbedding HOT 1
- this is more question than an issue HOT 2
- Padding conflict in loss computation HOT 2
- Whisper finetune HOT 1
- common_voice map error in the notebook of fine-tune-whisper-non-streaming HOT 1
- huggan.pytorch.lightweight_gan.lightweight_gan.LightweightGAN _from_pretrained requires use_auth_token but this is not passed by the from_pretrained method inherited from ModelHubMixin HOT 5
- Increasing WER & Validation Loss During Whisper Fine-Tuning HOT 1
- Poor Real-Time Performance of Whisper Models Fine-Tuned on Synthetic Data HOT 1
- Colab runtime crash HOT 2
- How to prepare audio dataset for whisper fine-tuning with timestamps?
- The fine tuning script run_speech_recognition_seq2seq_streaming.py use interleave_datasets which will truncate the train split HOT 2
- Using rename_column and remove_column method for a IterableDataset object leads to its feature property become None --- in the Whisper Fine-Tuning Event HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from community-events.