Show HN: Log every LLM call with tokens, cost, latency, and time to first token

3 comments

• joshka 4 hours ago
  Existing option that Theo Browne uses (i.e. cliproxy + clickhouse etc.):

  https://gist.github.com/t3dotgg/59a521d2ee8d70aaf90e280c1750... via https://www.youtube.com/watch?v=D8PikZ1KhUo or https://github.com/pingdotgg/t3code/blob/e07585e5fba9bdc112a...
• jbloggs777 5 hours ago
  I remember when Hello World was the first program we'd write.

  I too wrote an LLM gateway.. then I did it again, with protocol translation. ;-)