How to get different outputs for the same prompt? about candle

[LaurentMazare]

Not sure what is going on but this works as expected for me, could you provide some way to reproduce the issue? Fwiw here are my outputs.

$ cargo run --example gemma --release --features cuda -- --prompt "Hey there " --seed 123 -n 100 --temperature 0.5

Hey there 0141,

Thanks for coming to Apple Support Communities with your question about the songs you've purchased. We understand that some of your music is missing from your iPhone and we'd like to help.

If you are using iTunes on the same computer as your iPhone, this can be a common issue if your device has been wiped clean or reset in the past. You may want to try resetting your network settings:

1. Open Settings on your iPhone.
2. Tap
100 tokens generated (76.70 token/s)

$ cargo run --example gemma --release --features cuda -- --prompt "Hey there " --seed 124 -n 100 --temperature 0.5

Hey there <strong>@1234567890</strong>,

Thanks for reaching out to the Community regarding this. I'm sorry you're experiencing this issue with your account. I understand it can be quite frustrating when things aren't working as expected.

I'd like to take a moment and ask for some more details about what exactly is happening? Is this an error message or just something that isn't loading properly?

In the meantime, if you need further
100 tokens generated (77.00 token/s)

[LaurentMazare]

You can try using --seed 1234 for example. Also --help will list you all the parameters, there are a bunch of them for sampling, temperature, top-p, etc.

[Hojun-Son]

I already try using seed, temperature, top-p, but it still returned same outputs for same prompt.

[Hojun-Son]

Thanks for your help, it was worth to me. I didn't give both the temperature and the seed value, but I was giving them one by one.