justjoshtings / satellite_image_segmentation

Experimented with a U-Net variant to perform pixel wise multi-class classification to segment high resolution satellite imagery into land use types with potential applications in deforestation and flood monitoring. Developed with TensorFlow framework.

Satellite Imagery Semantic Segmentation with CNN

Project Description

Predicting land cover types on remote sensing data using Convolutional Neural Networks. Experimented with U-Net and and U-Net with RestNet50 Encoder backbone architectures to segment satellite imagery.

Sample Predictions

Table of Contents

1. How to Run
2. Folder Structure
3. Datasets
4. Neural Network Architectures
5. Presentation
6. Report
7. References
8. Licensing

How to Run

1. Clone this repository. Navigate to desired directory and use:

git clone [email protected]:justjoshtings/satellite_image_segmentation.git

2. The Python notebook is optimized and set up for proper execution in Google Colab. I'd recommend to upload Land_Cover_Segmentation.ipynb and execute from there. Please see Folder Structure section for how to set up the initial folder structure. The Python notebook will move and create new directories to accomodate for certain preprocessing procedures but the initial setup is shown below.
3. Download the data from the competition³ and upload all data into Google Drive workspace based on the prior mentioned folder structure.
4. Execute the Python notebook. Note that for training, it is recommended to connect to a GPU enabled runtime for faster training speeds.

Folder Structure

Initial Google Drive Folder Setup for Google Colab:

satellite_image_segmentation
│    Land_Cover_Segmentation.ipynb
│
└───data
│    │   class_dict.csv
│    │   metadata.csv
│    │
│    └───test
│    │    │ 1499_sat.jpg
│    │    │ 1500_sat.jpg
│    │    │ ...
│    │
│    └───train
│    │    │ 199_sat.jpg
│    │    │ 199_mask.png
│    │    │ ...
│    │
│    └───valid
│    │    │ 1074_sat.jpg
│    │    │ 1074_sat.jpg
│    │    │ ...

Datasets

DeepGlobe Land Cover Classification Dataset from the Competition³

or Kaggle.

Neural Network Architectures

2 types of Fully Convolutional Networks⁴ were explored with similar final results on validation and testing data.

U-Net Architecture

Ronneberger et al. (2015)'s U-Net¹

RestNet Encoder Backbone, U-Net Decoder Architecture

Neven, Robby & Goedemé, Toon. (2021). A Multi-Branch U-Net for Steel Surface Defect Type and Severity Segmentation. Metals. 11. 870. 10.3390/met11060870.²

Report

• Medium Post
• Google Slides Presentation

References

1. Ronneberger et al. (2015)'s U-Net
2. Neven, Robby & Goedemé, Toon. (2021). A Multi-Branch U-Net for Steel Surface Defect Type and Severity Segmentation. Metals. 11. 870. 10.3390/met11060870.
3. DeepGlobe Land Cover Classification Dataset from the Competiton

@InProceedings{DeepGlobe18,
 author = {Demir, Ilke and Koperski, Krzysztof and Lindenbaum, David and Pang, Guan and Huang, Jing and Basu, Saikat and Hughes, Forest and Tuia, Devis and Raskar, Ramesh},
 title = {DeepGlobe 2018: A Challenge to Parse the Earth Through Satellite Images},
 booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
 month = {June},
 year = {2018}
}

4. Long et al. (2015)'s Fully Convolutional Network (FCN)

Licensing

• The DeepGlobe Land Cover Classification Challenge and hence, the dataset are governed by DeepGlobe Rules, The DigitalGlobe's Internal Use License Agreement, and Annotation License Agreement.
• MIT License

satellite_image_segmentation's Issues

unet_model_v3_epoch6.h5 file missing

Thank you very much for sharing your implementation. I am learning a lot from your Land_Cover_Segmentation.ipynb file.
Unfortunately, I cannot find the file "Land_Cover_Segmentation.ipynb" to load the pretrained weights. Can you please help me?

Thanks

Dataset source

Hi, I saw you recently changed the dataset source from kaggle to the official website, however I note it is not actually available there and moreover there appear to be many unanswered requests for access on https://competitions.codalab.org/forums/15208/
You could suggest both locations with the above caveat.
Cheers

Data preparation process

Would you please explain the data preparation process?