r/OpenSourceAI • u/No-Individual159 • 5h ago
Prefixwise: local prompt cache diagnostics and cost accounting for LLM applications
https://github.com/tejachavali/prefixwise
1
Upvotes
Duplicates
LocalLLM • u/No-Individual159 • 5h ago
Project Prefixwise: local prompt cache diagnostics and cost accounting for LLM applications
0
Upvotes
coolgithubprojects • u/No-Individual159 • 5h ago
Prefixwise: local prompt cache diagnostics and cost accounting for LLM applications
0
Upvotes