Comments (3)
Hi. There are several ways to import your own dataset.
For data with a single label per data, you can save each data to a separate file and categorize the files in sub-folders corresponding to each label. Then you can use the built-in DIR_Database database driver to load your data, as explained in the manual.
If all inputs are saved in one file and labels in a separate file, I guess you are looking to a driver similar to the MNIST_IDX_Database. But depending on how the data is stored, you may need to write your own database driver module.
Do you have an example of input data and labels you want to handle? Is it images, vector of numbers?
We will see what is the best way to handle them!
from n2d2.
Thank you for the fast response. You are right, the data is stored in a MNIST kind of way.
As an example the data is stored one input per line and comma separated:
2.070008516069267,4.339715409523769,-1.2698122291539113,-7.00010533569940957
As the Input should be 2D a reshaping needs to be performed, but as far as I have seen this can be handled by N2D2.
Another point would be whether the output data need to be the labels themselves or also could be probabilities for each label. (So basically the output of a teacher-network.)
from n2d2.
Closing this old issue, which should be solved using the new CSV_Database driver.
from n2d2.
Related Issues (20)
- Do not insert Target in ONNX HOT 1
- Bug ONNX HOT 1
- N2D2 Cross Compilation HOT 2
- ONNX not available when using dockerized N2D2 HOT 2
- Feature maps HOT 1
- multiple common.config in .ini file HOT 1
- Import Onnx give a segfault HOT 20
- VGG on CIFAR HOT 2
- Compilation n2d2 : 'runtime_error' is not a member of 'std' HOT 2
- Issue while running MNIST HOT 4
- Reshape Quantization not supported? HOT 1
- Invalid registrar key "Transcode" HOT 2
- Could not find NVML during CMake on a Jetson Orin (iGPU) HOT 2
- Make fails during linking HOT 2
- Make fails to compile HOT 1
- Install Gnuplot but still giving this error "Could NOT find Gnuplot (missing: GNUPLOT_EXECUTABLE)" HOT 4
- Multiples issues on Windows HOT 1
- Adapt scripts to Python 3
- Loading ONNX models results in invalid path on Windows HOT 1
- Log labels mapping only 2 classes HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from n2d2.