Segmentation Fault about onnxstream

[vitoplantamura]

hi, can you try without the "--rpi" option? On the RPI 5 it shouldn't be necessary, but I haven't had the opportunity to test it. Can you then do a second test by adding the "--not-tiled" option? Thanks, Vito

[vitoplantamura]

As for the RPI5, it could be a XNNPACK problem. We could try with the same version of OnnxStream used by LivingLinux in his video, which is commit 580cd67. The XNNPACK version is different, so you should follow the instructions here: https://github.com/vitoplantamura/OnnxStream/tree/580cd677310a70fe35c8aecbffbbaa012ae54855 regarding the RPIZero2, this problem happened to me too, and it depends on Git LFS when run on the RPIZero2. Solved by adding 1GB of swap. Vito

[vitoplantamura]

hi, I don't think memory would be an issue, as SD 1.5 requires 1.1GB of RAM in OnnxStream in its least conservative configuration. I've tried the latest version of OnnxStream on my RPI Zero 2 and in Windows, and it works, so this isn't a problem introduced with the latest commit. My guess is that it could be an incompatibility between XNNPACK and the Amlogic S905X. Unfortunately I can do little without having the SBC in my hands. This is a great guide that I have in my bookmarks: https://jvns.ca/blog/2018/04/28/debugging-a-segfault-on-linux/ Let me know if you need help, Thanks, Vito

[rhalai]

I get the same (or similar) segmentation error, a fresh build as of 7th April 2024;
On a raspberry Pi 5; I dont believe its a memory issue either; I did note the build returned a number of warning messages

free command shows
total used free shared buff/cache available
Mem: 8241616 256128 426704 5616 7663600 7985488
Swap: 102384 0 102384

time ./sd --turbo --rpi --models-path $baseDir/stable-diffusion-xl-turbo-1.0-onnxstream --prompt "An astronaut riding a horse" --steps 1 --output astronaut.png
----------------[start]------------------
positive_prompt: An astronaut riding a horse
SDXL turbo doesn't support negative_prompts
output_png_path: astronaut.png
steps: 1
seed: 526336
----------------[prompt]------------------
Token: "A"
Token: "n"
Token: "astronaut"
Token: "riding"
Token: "a"
Token: "horse"
----------------[diffusion]---------------
step:0 101016ms
----------------[decode]------------------
Segmentation fault

real 3m47.597s
user 9m8.696s
sys 0m33.962s

Warning messages shown on compilation :-
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c: In function ‘cpuinfo_arm_linux_decode_chipset’:
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: warning: ‘cpuinfo_arm_fixup_raspberry_pi_chipset’ reading 64 bytes f rom a region of size 9 [-Wstringop-overread]
3931 | cpuinfo_arm_fixup_raspberry_pi_chipset(&chipset, revision);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: note: referencing argument 2 of type ‘const char[64]’
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3855:14: note: in a call to function ‘cpuinfo_arm_fixup_raspberry_pi_chipset’
3855 | void cpuinfo_arm_fixup_raspberry_pi_chipset(
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: warning: ‘cpuinfo_arm_fixup_raspberry_pi_chipset’ reading 64 bytes f rom a region of size 9 [-Wstringop-overread]
3931 | cpuinfo_arm_fixup_raspberry_pi_chipset(&chipset, revision);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: note: referencing argument 2 of type ‘const char[64]’
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3855:14: note: in a call to function ‘cpuinfo_arm_fixup_raspberry_pi_chipset’
3855 | void cpuinfo_arm_fixup_raspberry_pi_chipset(
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c: In function ‘cpuinfo_arm_linux_decode_chipset’:
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: warning: ‘cpuinfo_arm_fixup_raspberry_pi_chipset’ reading 64 bytes f rom a region of size 9 [-Wstringop-overread]
3931 | cpuinfo_arm_fixup_raspberry_pi_chipset(&chipset, revision);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: note: referencing argument 2 of type ‘const char[64]’
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3855:14: note: in a call to function ‘cpuinfo_arm_fixup_raspberry_pi_chipset’
3855 | void cpuinfo_arm_fixup_raspberry_pi_chipset(
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: warning: ‘cpuinfo_arm_fixup_raspberry_pi_chipset’ reading 64 bytes f rom a region of size 9 [-Wstringop-overread]
3931 | cpuinfo_arm_fixup_raspberry_pi_chipset(&chipset, revision);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3931:25: note: referencing argument 2 of type ‘const char[64]’
/home/pi/onxx-stream/XNNPACK/build/cpuinfo-source/src/arm/linux/chipset.c:3855:14: note: in a call to function ‘cpuinfo_arm_fixup_raspberry_pi_chipset’
3855 | void cpuinfo_arm_fixup_raspberry_pi_chipset(
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

[rhalai]

Same error as before this time without the --rpi parm

pi@raspberrypi:~/onxx-stream/OnnxStream/src/build $ time ./sd --turbo --models-path $baseDir/stable-diffusion-xl-turbo-1.0-onnxstream --prompt "An astronaut riding a horse on mars" --steps 1 --output astronaut.png
----------------[start]------------------
positive_prompt: An astronaut riding a horse on mars
SDXL turbo doesn't support negative_prompts
output_png_path: astronaut.png
steps: 1
seed: 0
----------------[prompt]------------------
Token: "A"
Token: "n"
Token: "astronaut"
Token: "riding"
Token: "a"
Token: "horse"
Token: "on"
Token: "mars"
----------------[diffusion]---------------
step:0 67418ms
----------------[decode]------------------
Segmentation fault

real 3m31.399s
user 7m33.962s
sys 0m22.208s
pi@raspberrypi:~/onxx-stream/OnnxStream/src/build $

I will try this on a PI Zero 2, as soon as I can find it

[vitoplantamura]

have you tried adding the "--not-tiled" option? I just remembered that LivingLinux managed to run OnnxStream on the RPI5, without any problems: https://www.youtube.com/watch?v=D0qG2OIpbUk Vito

[rhalai]

let me try that, I found my Zero2 and been trying to get that working; different problems!
cant get it to complete build, forget running the sd command; no matter you learn more when it fails :)
Thanks for you help

[rhalai]

Same error; same with and without --rpi parameter

pi@raspberrypi:~/onxx-stream/OnnxStream/src/build $ time ./sd --turbo --not-tiled --models-path $baseDir/stable-diffusion-xl-turbo-1.0-onnxstream --prompt "an astronaut riding a horse on mars" --steps 1 --output astronaut.png
----------------[start]------------------
positive_prompt: an astronaut riding a horse on mars
SDXL turbo doesn't support negative_prompts
output_png_path: astronaut.png
steps: 1
seed: 882688
----------------[prompt]------------------
Token: "an"
Token: "astronaut"
Token: "riding"
Token: "a"
Token: "horse"
Token: "on"
Token: "mars"
----------------[diffusion]---------------
step:0 35758ms
----------------[decode]------------------
Segmentation fault

real 2m3.277s
user 4m11.563s
sys 0m16.113s
pi@raspberrypi:~/onxx-stream/OnnxStream/src/build $

I also tried and failed to get it working on PI Zero 2 (see screenshot),

it go so far into the build and got stuck filtering content 15% 406/2640; left it running overnight and did not progress further, could not break out of it had to pull the power out

I will take a break and follow the instructions u shared previously, the steps are a little different; I will keep everyone posted

[rhalai]

Thanks Vito, appreciate the feedback, I found myself going round in circles and each turn was a failure; I'm taking a breather and will try again over the weekend. the livinglinux example you shared the website lists a command which downloaded a windows package, which threw me somewhat when it failed. ill do a clean build later to ensure I dont get any errors from the past installs