Anyone planning to make a profit by billing this as metered is dreaming when agents suck down 40k tokens in a single prompt. I did the math, at like 0.2 cents a token that would still be 8k. No one is paying 8k for a single prompt. At 0.015, thats still 600 dollars. Its never going to make sense.
Yeah I guess I did twenty cents, I realized this earlier when I paid for shipping at work. 80 dollars is still a lot for a single session. I think I’ve easily seen 100k+ sessions too, but Idk how many of those were just people burning tokens.
Edit: two cents is 0.02, 800 dollars. Just quadruple checked.
In the frame of a company, yes. For individuals, not really imo. What’s going to happen is the big models will probably move to being only accessible by corporations and rich while the public moves more towards open weights and self host able options.
Anyone planning to make a profit by billing this as metered is dreaming when agents suck down 40k tokens in a single prompt. I did the math, at like 0.2 cents a token that would still be 8k. No one is paying 8k for a single prompt. At 0.015, thats still 600 dollars. Its never going to make sense.
You might want to recheck your math.
.2 cents is $0.002
40000 * .002 = $80
deleted by creator
Point two cents is not the same as two cents.
deleted by creator
Yes, and?
Yeah I guess I did twenty cents, I realized this earlier when I paid for shipping at work. 80 dollars is still a lot for a single session. I think I’ve easily seen 100k+ sessions too, but Idk how many of those were just people burning tokens.
Edit: two cents is 0.02, 800 dollars. Just quadruple checked.
80 bucks for a session could be a lot, but if it saves you 4 hours of work, I’d say it’s worth it.
OTOH, I’ve seen some articles claim that using AI tools actually slows you down. In that case, it’s a giant boondoggle.
In the frame of a company, yes. For individuals, not really imo. What’s going to happen is the big models will probably move to being only accessible by corporations and rich while the public moves more towards open weights and self host able options.
True, I’m very much looking at it in terms of work tooling. I don’t have much use for the ELIZA-with-delusions-of-grandeur models in my personal life.
Thats the problem with LLMs. They’re too big for their own good.