diff --git a/transformers-ci-observability.md b/transformers-ci-observability.md new file mode 100644 index 0000000000..2c3ac98af2 --- /dev/null +++ b/transformers-ci-observability.md @@ -0,0 +1,49 @@ +--- +title: "Building CI Observability for Transformers with pytest, OpenTelemetry, and Grafana" +thumbnail: /blog/assets/96_hf_bitsandbytes_integration/Thumbnail_blue.png +authors: +- user: tarekziade +- user: ydshieh +--- + +# Building CI Observability for Transformers with pytest, OpenTelemetry, and Grafana + + +## The CircleCI Era + +XXX explain what we did with circle CI +historicaly only CPU , we added GPU in our own github runners + + +## Moving all runners to our infrastructure + +XXX explain how we moved all runners to our infra + +## The Gap : Observability + +XXX GH Action alone dont give us the Observability we need. +XXX we needed a circle CI replacement and build our custom UI + + +## Pytest and OpenTelemetry + +XXX explain how it was simple to instrument our pytest suite with OpenTelemetry + +XXX show the plugin and a small example + +## Grafana, Tempo and Prometheus + +XXX Describe the Grafana and Tempo stack +XXX describe the plumbing between grafana and github events to make grafana as live as possible + +## Grafana as a wrapper + +XXX Explain that more and more poanels are served by a custom Py web server +XXX in iframes. Grafana is just becoming a a grid +XXX an the py app is more efficient using tempo as its DB + +## What we plan next + + +XXX +