In SOME cases, it is cheaper than on prem.
If you need a lot of compute power occasionally, it can be cheaper.
If you actually scale up and down according to the load (which a lot of companies do not do), it might be cheaper.
But a large amount of companies don't fall in those cases or don't do it efficiently.
Some spend in a year the same amount they would have paid for on prem servers they would have kept 5 years or more.
Cloud providers offer other things like multi regional redundancy, which can be hard to achieve for smaller businesses.
The setup was a bit of a challenge as I like to do it the RTFM way abd that there is a bunch of concepts to grasp before you really understand what you are doing, but since then it's been working pretty great !
And it's free (as in you are providing them with data on the occurence of threats etc, so you don't pay)
I'm properly in awe at this project.
Not only does it support a wide range of protocols and runs practically everywhere, but it can play audio, video, display images and has keyboard shortcut support ???
It's got everything I could think about and so much more.
I can't wait to try it out !
Thank you so much for your time and for making this open source.
Your question is probably rethorical but I feel the need to put it out there : It's because it's been advertised as such. LLMs are not advertised as language based AI but as something "intelligent" with "reasoning" abilities, which they inherently do not have.
But that's not what most people were told. For a large amount of them, LLMs can "think" and should be able to solve problems, such as chess…
I have a rough idea of their efficiency as I've used them, not in professional settings but I wager it would not be too different.
My point is more that it feels like the rugs are finally starting to get pulled.
This tech is functionnal as you said, it works to a point and that point is enough for a sizeable amount of people. But I doubt that the price most people are paying now is enough to cover the cost of answering their queries.
Now that some people, especially younger devs or people who never worked without those tools are dependant on it, they can go ahead and charge more.
But it's not too late, so I'm hoping it will make some people more aware of that kind of scheme and that they will stop feeding the AI hype in general.
Hopefully (?) this is the start of a trend and people might begin to realize how all those products are not worth their price and AI is an overhyped mess made to hook users before exploiting them...
I don't know how I should feel about getting this joke