From PRs to Performance: Using Metrics and AI to Coach Stronger Engineering Teams

Velocity is useful, but it is not leadership. Most organizations either stop at team velocity and “gut feel,” or they overcorrect into individual scoreboards that erode trust and create perverse incentives. This talk shares a pragmatic middle path: how engineering leaders can use metrics to understand delivery health, code quality, and collaboration, without turning measurement into micromanagement. I built an internal metrics web application that connects to common systems like code repositories and agile/project tools (GitHub and Linear in my case, but the approach generalizes to Jira and other platforms). It tracks velocity and estimation trends over time, compares individual and team patterns, and adds pull request analysis to surface quality signals. I also integrated AI (Claude) to review commits and PR discussions and generate a quality assessment across four dimensions: code quality, testing habits, adherence to standards, and collaboration. This session is designed for senior engineers through executive technology leaders. You will learn which metrics are actually useful, how to implement a dashboard in your environment, and how to apply guardrails so metrics drive coaching and continuous improvement rather than fear or gaming. The examples use anonymized data and precomputed AI outputs, so the approach works even with limited connectivity. You’ll leave with a concrete dashboard blueprint and an implementation plan you can apply immediately: what to measure, how to visualize it, how to layer in AI responsibly, and how to use the signals to coach, improve standards, and raise delivery confidence. Key takeaways * A leadership-oriented metrics framework: outcomes vs system signals vs behaviors * A practical dashboard design that combines velocity, estimation reality, and PR signals * How to use AI as an assistant for qualitative insights * Guardrails for trust: privacy, transparency, and preventing metric gaming * A step-by-step path to build this in your org using APIs from your existing tools 45-minute outline * Why most engineering metrics fail in practice (5 min) * Velocity, estimation, and forecasting that leaders can actually use (10 min) * PR signals that reveal quality and delivery risk (10 min) * AI-assisted quality analysis (12 min) * How to apply the signals: coaching, expectations, and intervention (6 min) Recording of the similar talk I gave at StirTrek May 2026 https://www.youtube.com/watch?v=dONrn3uU20A