Hi everyone,
I am working on getting an exact response from the Llama3.1:8b-instruct.
I have set the following parameters:
- temperature = 0
- top_k = 1
- seed = 0
but the results vary.
Out of 10 requests, I got responses like ~3, ~3, ~3, and ~1, which are quite similar.
Any ideas, to get exactly same responses
Thanks 😊