Error build about onnxstream

[rcarmo]

I'm having the same issue.

This used to work (a week ago) with checkout 1004acaa3a5c0f515a3f7b229aef1dabe31472a4. Now I tried rebuilding on another machine (Debian, incidentally, but it shouldn't matter) to try the LLM functions and the 579de32260742a24166ecd13213d2e60af862675 checkout doesn't work, so there's probably a third "good" checkout that makes sense.

@vitoplantamura, can you go back and check your build tree?

[vitoplantamura]

hi, it seems that you are compiling against the wrong version of XnnPack. Make sure to run the "git checkout" command before building XnnPack, as in the instructions in the main README. Vito

[pavelprosto94]

I'm build XnnPack from this:

git clone https://github.com/google/XNNPACK.git
cd XNNPACK
git checkout 579de32260742a24166ecd13213d2e60af862675
mkdir build
cd build
cmake -DXNNPACK_BUILD_TESTS=OFF -DXNNPACK_BUILD_BENCHMARKS=OFF ..
cmake --build . --config Release

Then try build:

git clone https://github.com/vitoplantamura/OnnxStream.git
cd OnnxStream
cd src
mkdir build
cd build
cmake -DMAX_SPEED=ON -DOS_LLM=OFF -DOS_CUDA=OFF -DXNNPACK_DIR=/media/usb_hard_drive/genimage/XNNPACK/ ..
cmake --build . --config Release

when I enter git checkout 579de32260742a24166ecd13213d2e60af862675, I get the following output

git checkout 579de32260742a24166ecd13213d2e60af862675
Note: switching to '579de32260742a24166ecd13213d2e60af862675'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 579de3226 Refactor `xnn_indirection_init_dwconv2d` to take low-level arguments.

[vitoplantamura]

hi,

I tried in Google Colab and it works:

# build XNNPACK (takes 22 minutes, Colab Free NO GPU)
!git clone https://github.com/google/XNNPACK.git && cd XNNPACK && git checkout 579de32260742a24166ecd13213d2e60af862675 && mkdir build && cd build && cmake -DXNNPACK_BUILD_TESTS=OFF -DXNNPACK_BUILD_BENCHMARKS=OFF .. && cmake --build . --config Release --parallel 6

# build OnnxStream (Stable Diffusion example, takes 1 minute)
!git clone https://github.com/vitoplantamura/OnnxStream.git && cd OnnxStream && cd src && mkdir build && cd build && cmake -DMAX_SPEED=ON -DOS_LLM=OFF -DOS_CUDA=OFF -DXNNPACK_DIR=/content/XNNPACK .. && cmake --build . --config Release

# run with this command
!/content/OnnxStream/src/build/sd

@pavelprosto94: Could you do a "git pull" in your local OnnxStream repo and try again?

@rcarmo: What is the error exactly?

Thanks, Vito

[rcarmo]

Same thing, a set of invalid conversions. I will try again ASAP.

[pavelprosto94]

I do not know what commands I need to enter. I don't know Git well
I tried this:

cd XNNPACK
git pull

output:

You are not currently on a branch.
Please specify which branch you want to merge with.
See git-pull(1) for details.

    git pull <remote> <branch>

And Google Colab don't work with arm64. XNNPACK compiles different versions for arm64 and x86-64

[vitoplantamura]

@pavelprosto94: Could you try rerunning all the commands in empty directories? (both the XNNPACK and OnnxStream builds) This way it should be easier than trying to fix it with a "git pull". Vito

[pavelprosto94]

I'm use this fork https://github.com/AeroX2/OnnxStream

mkdir onnxstream
cd onnxstream

build XNNPACK:

git clone https://github.com/google/XNNPACK.git
cd XNNPACK
git rev-list -n 1 --before="2023-06-27 00:00" master
git checkout <COMMIT_ID_FROM_THE_PREVIOUS_COMMAND>
mkdir build
cd build
cmake -DXNNPACK_BUILD_TESTS=OFF -DXNNPACK_BUILD_BENCHMARKS=OFF ..
cmake --build . --config Release

Then build fork OnnxStream:

git clone https://github.com/AeroX2/OnnxStream.git
cd OnnxStream
cd src
mkdir build
cd build
cmake -DMAX_SPEED=ON -DXNNPACK_DIR=<DIRECTORY_WHERE_XNNPACK_WAS_CLONED> ..
cmake --build . --config Release

and it work! Thank!
For OrangePi 5, one image is generated in 2 minutes. A wonderful result!