Issues with S3DIS Dataset about superpoint_graph

[lostcolony]

Area_6/copyRoom_1/copy_Room_1.txt needs to be moved to Area_6/copyRoom_1/copyRoom_1.txt

[lostcolony]

Thanks! Yeah, there's apparently a single unprintable character (non-breaking space in between -9.1 and a trailing 0) in hallway_2.txt that causes choking. Interestingly, using np.fromfile will load it fine, but numpy.loadtxt will not.

Using sed to remove unprintable characters will clean the data -

sed -i 's/[^[:print:]]//g' hallway_2.txt

[lostcolony]

Just going to post here any other data corruption issues I encounter, along with fix -

Area_5/hallway_6/Annotations,ceiling1.txt, line 180389 has a null byte instead of a space (I just cleaned it using a text editor, since most of those will show null bytes)

[Amrsaeed]

Applying the patch results in an error in Area_3/hallway_2/hallway_2.txt
ValueError: Some errors were detected ! Line #926337 (got 7 columns instead of 6)
The line after applying the batch is 19.302 -9.1 0 1.785 146 137 106 where it should be only 6 columns.
The removed corrupted character was supposedly a number. So needed to make third column into -9.160 in keeping with the pattern in this column

[lostcolony]

It doesn't appear to. Pulled the latest, cleared prior clouds, features, and superpoint_graphs output directories, undid the try/except I stuck in, re-ran. THe changed code did indeed address the first issue, but I got the second error again, same area (Area 3).

[loicland]

Hi,

the first issue is the same as issue #25. It should now be fixed with the latest commit, let me know if it fixes the second bug as well.

loic

[loicland]

I remember a similar error. It could be due to either typos in the s3dis dataset or packet error during the downloading.

Check the xyz value you got from reading the file area3/hallway2, and find the nan value (with np.isnan and np.where). Once you found the faulty line in question check the txt in /data, there should be an unrecognized character. Fix it and run partition again.

[loicland]

Great, thanks for the tip. I'll add it to the doc soon.