Create a Holdout Set about malaria-detection

[BALaka-18]

@aryanVijaywargia Assigned

[aryanVijaywargia]

Thanks for clarifying @BALaka-18

[aryanVijaywargia]

I would like to work on this @HarshCasper

[macabdul9]

Holdout set will be from the same distribution, hence the performance will be the same as validation. This is the main problem of machine learning models that they do not perform well on out of the distribution data. For the demo at the client end, we can take few samples (ie: 10) from the main directory and then split the data into train, Val/test set (so that model doesn't get trained on demo data). @aryanVijaywargia @HarshCasper

[HarshCasper]

I guess we can create a seperate issue for that @macabdul9

[BALaka-18]

Holdout set will be from the same distribution, hence the performance will be the same as validation. This is the main problem of machine learning models that they do not perform well on out of the distribution data. For the demo at the client end, we can take few samples (ie: 10) from the main directory and then split the data into train, Val/test set (so that model doesn't get trained on demo data). @aryanVijaywargia @HarshCasper

@macabdul9 open a new issue for this. You'll be assigned to work on it.

[aryanVijaywargia]

I have a query. I have written a python script that generates 100 samples at random from each class and moves the images to the holdout_dataset directory. So should my pr contain both the holdout_dataset directory (containing the images) as well as the code or only the code will suffice? @BALaka-18

[BALaka-18]

I have a query. I have written a python script that generates 100 samples at random from each class and moves the images to the holdout_dataset directory. So should my pr contain both the holdout_dataset directory (containing the images) as well as the code or only the code will suffice? @BALaka-18

@aryanVijaywargia both. The sample you created can be used for initial testing, or as an example when we document our model.

[macabdul9]

Holdout set will be from the same distribution, hence the performance will be the same as validation. This is the main problem of machine learning models that they do not perform well on out of the distribution data. For the demo at the client end, we can take few samples (ie: 10) from the main directory and then split the data into train, Val/test set (so that model doesn't get trained on demo data). @aryanVijaywargia @HarshCasper

@macabdul9 open a new issue for this. You'll be assigned to work on it.

I think mentors can not contribute

[BALaka-18]

Holdout set will be from the same distribution, hence the performance will be the same as validation. This is the main problem of machine learning models that they do not perform well on out of the distribution data. For the demo at the client end, we can take few samples (ie: 10) from the main directory and then split the data into train, Val/test set (so that model doesn't get trained on demo data). @aryanVijaywargia @HarshCasper

@macabdul9 open a new issue for this. You'll be assigned to work on it.

I think mentors can not contribute

@macabdul9 I'm sorry I forgot. Open an issue then, participants will be assigned.

[rutujadhanawade]

Is this issue open?