Comments (7)
Thank you for pointing this out! This will be added to the README but process_data.py
assumes you have an output directory with three empty subfolders for train
, test
, and hold
when extracting the polygons. However, since the challenge provides you with separate train and test downloads, you can modify the script for lines 165 - 175. from what is below to the second code snippet. Then you can run it on the train and test dataset directories independently and structure the directories like https://github.com/DIUx-xView/xview2-baseline#other-methods
In addition, please change line 148 to be the CSV name of your choice:
df.to_csv(INSERTNAME.csv)
Before Modification
logging.info("Started Processing for Train Data")
process_data(args.input_dir, args.output_dir, 'train')
logging.info("Finished Processing Train Data")
logging.info("Started Processing Test Data")
process_data(args.input_dir, args.output_dir, 'test')
logging.info("Finished Processing Test Data")
logging.info("Started Processing Holdout Data")
process_data(args.input_dir, args.output_dir, 'hold')
logging.info("Finished Processing Holdout Data")
After Modification
logging.info("Started Processing for Data")
process_data(args.input_dir, args.output_dir, '')
logging.info("Finished Processing Train Data")
from xview2_baseline.
Thanks for replying @ssajeev .
I understand output folder will have train
, test
and hold
dirs. My doubt was regarding the input directory. I suppose your modification will solve the issue above.
However this creates a subsequent issue. Addressing it here:
After finishing the process_data.py
step, next step is to run damage_classification.py
script that also takes --test_data
and --test_csv
as input. Looking at the script, this set has to be the validation set.
Now to obtain this validation set, I feel process_data.py
needs changes to rng output train.csv
and test.csv
for the same input train
directory.
Hopefully I made myself clear.
from xview2_baseline.
For now, we recommend splitting the train data beforehand rather than doing it in process_data.py
. We will provide an updated process_data.py
script that will split the data in train into train and validation. We will update the README to reflect this.
from xview2_baseline.
Great!
I would prefer not to close the issue before it's actually addressed in the code.
Thanks again.
from xview2_baseline.
The code and README have been updated with new instructions for process_data.py
. Please verify that it works for you.
from xview2_baseline.
@ice-pice Thanks for putting in this issue. We are going to mark it resolved. If you see any other problems please open a new issue, thanks again!
from xview2_baseline.
Hello, where did you get the label in the test dataset? The test data set I downloaded has no labels.
from xview2_baseline.
Related Issues (19)
- Question about inference
- Final output image issue in inference steps HOT 3
- Discrepancy in fire names in xBD dataset? HOT 5
- Question about the Baseline results in your paper HOT 7
- Question about xBD dataset HOT 1
- xview_geotransforms.json HOT 2
- Potential bug in scaling in damange_inference.py
- Error while loading weights for damage_inference.py HOT 5
- Unable to view images after downloading "Full datasets with GEOTIFF metadata" HOT 6
- Path in Dockerfile does not exist in the repository HOT 2
- Format checking of train.csv
- Can not Decompress xview2 dataset HOT 3
- Cannot run data_finalize.sh HOT 9
- Issue in running train_model.py HOT 1
- Problem with process_data.py HOT 2
- Do we have some code or a software that can label the training image?
- Problem with inference.sh HOT 4
- problem with train_model.py HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from xview2_baseline.