[Question] How much does this project cost you?

[GeorgeAndreiBals]

Hey there, randomly stumbled upon your blog and came up to this project which I find quite intriguing. I saw you are using Claude and was wondering how it compares to ChatGPT in terms of costs per request. I looked into Anthropic's API pricing but couldn't really understand what the differences between input/output prices are? I have a feeling that the total cost is input+output.
Thanks for any reply and nice job with this project!

[danielcorin]

Just seeing this now. Yes, cost is input + output. For the tool, input is the entire chat history + your newest message and the existing document. Output is the newly generated doc and the models most recent conversation response. These days, you could use prompt caching to reduce these costs, but that didn't exist when I built this.

Since no one uses it, the cost is quite low. I have use a price-capped API token in case someone manages to find this and use it a lot. Since your post here, API prices have changed a lot. They continue to change most months across all the big labs, so it's hard to give an exact estimate. For personal daily use, I've never gone much over single digit dollars in API costs for a tool like. With bigger documents, it could be more but this project was more experimentally and hasn't been something I've continued to use daily. All handwavy estimates. This could be quite expensive to run as a tool with a large user base.