Huge hosting savings while keeping the accuracy?

I just came across a post on X saying that fine tuned SQLCoder 7B is 60x cheaper and slightly more accurate than ChatGPT. The price of hosting SQLCoder on AWS was 300$/month assuming a 3 year plan and was running on g5.xlarge.

It sounds awesome to me. And that's why I wonder, isn't it a little bit colorized to look that way? Or the open source models are finally outperforming commercial solutions?

Feel free to share your thoughts.

2 comments