May 15 in 💬 General discussion
Top-k Sampling
Another fine tuning technique: use top-k sampling to limit the model's choices to the top k most likely next tokens. This helps in producing more coherent and contextually appropriate responses. For instance, setting k to 50 restricts the model to the top 50 choices. This can be done using API, refer to my temperature adjustment post earlier!
9
0 comments
Top-k Sampling
skool.com/promptmonkey
Stay Ahead in 2024. Join us to transform learning into success. Master AI, apply skills to real-world tasks, and unlock side hustles and careers.
Leaderboard (30-day)
1
+6
2
+6
3
+5
4
+5
5
+4
powered by