Skip to content
View qaisermehdi3-coder's full-sized avatar

Block or report qaisermehdi3-coder

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
qaisermehdi3-coder/README.md

Qaiser Mehdi

I measure what LLM inference actually costs, down to the GPU.

  • qvunex_single.py: one file, no install, no network code. Records cost per finished task, and a call whose cost is unknown is marked unknown, never counted as $0. For self-hosted vLLM, --reconcile checks your client's counts against the server's own counters, and --gpu-rate gives the cost per request at the load you actually ran. Both tested live on vLLM.
  • GPU cost data: the same benchmark on T4, L4 and L40S, repeated. On one L40S, minutes apart, CUDA-graph timings repeated within 0.7% on average and eager timings moved up to 78%.
  • Reported in pydantic-ai, #8704: responses with no usage were recorded as $0 and slipped past spending limits. Confirmed by their triage.
  • Proposed in AgentMeasure, #26: self-hosted servers as a known measurement limit, with the server-side way to close it, tested live.
  • Cost audit: I run the meter on a day of your traffic and write up where the money goes.

Contact: qvunexaudit@gmail.com, or open an issue on qvunex.

Popular repositories Loading

  1. qvunex qvunex Public

    Measure what your AI inference actually costs. Local only, no dependencies.

    Python 1

  2. qaisermehdi3-coder qaisermehdi3-coder Public