If you’re building products at any scale, whether you’re a small startup or a sprawling enterprise, one thing has become abundantly clear to me over the years: you simply cannot make good decisions without evidence. I’ve seen too many teams, and too many organisations, fall into the trap of “gut feel” decision-making. It’s seductive, but it’s also a fast track to mediocrity. Evidence-based management isn’t just a buzzword; it’s the foundation for real, sustainable improvement.
Now, evidence can take many forms. At the business level, it might be hypothesis-driven experiments. At the delivery level, it’s all about flow metrics, lead time, cycle time, work in progress, and so on. The challenge is always the same: how do we get the right data, and how do we make it visible in a way that actually helps us improve?
The Visibility Imperative
One of the most fundamental lessons I’ve learned, sometimes the hard way, is that without visibility, you’re flying blind. If you can’t see what’s happening, you can’t change it. And if you can’t see the impact of your changes, you’re just guessing. This is why telemetry is so critical, not just telemetry from your product, but telemetry from your process.
Azure DevOps, for all its quirks, is actually a fantastic system for gathering this kind of telemetry. Every value of every variable in your work items is collected and stored. Add a custom field? No problem, the full history is there. This means you can pull and analyse any data you like, in any way you like. That’s powerful.
Out-of-the-Box: The Good, the Bad, and the Rudimentary
Let’s be honest: the visualisations built into Azure DevOps are a bit basic. Microsoft’s approach is to provide the data layer, the API layer, and a few “table stakes” visualisations. The expectation is that partners and customers will build the value-adds that are specific to their needs.
- Lead Time & Cycle Time: Out of the box, you get these metrics, plus a bit of work in process. On your boards (let’s call them Kanban boards, though that’s a stretch), you can set WIP limits for each column. They’re not enforced, if you go over, the column just turns red. There’s no system-wide limit, which is a bit of a miss.
- Averages: The dashboards show average cycle and lead times. Personally, I’m not a fan of averages. I want to see the 85th percentile, the spread, the outliers. But Azure DevOps picks one metric and sticks with it.
- Cumulative Flow: You get a basic cumulative flow diagram. It’s straightforward, and it’s free.
All of this is built on a rich data foundation. Microsoft is opinionated about when work starts and finishes, but all the underlying data is there. You can access it via APIs, or load it into PowerBI and build whatever graphs you want. If you’re a large organisation with an internal engineering team, you can build custom boards, controls, and dashboards, and share them across the company. If you’re small, you probably don’t want to do that, you want a vendor solution that just works.
My Recommendations: Tools That Make a Difference
If you want to go beyond the basics (and you should), there are two tools I recommend:
-
Flow Viz
- Pre-built PowerBI reports that connect to Azure DevOps.
- Pulls your data and displays all the key flow metrics.
- Free to use, download, install, and you’re off.
- Great for teams who want more insight without building everything from scratch.
-
Actionable Agile Metrics for Predictability
- A plugin for Azure DevOps, interactive, JavaScript-based, and your data stays in your system.
- Costs about $20 per user per month, but worth every penny in my experience.
- Provides rich visualisations: lead time, cycle time, percentiles, WIP overlays, and more.
- My favourite feature: the work-in-progress view with percentile overlays, so you can instantly spot items at risk.
Both tools give you far more than the out-of-the-box experience. You get deeper insights, more actionable data, and a much clearer picture of your flow.
For the Coders: Azure DevOps Admin Tools
If you’re a developer and prefer the command line, Ben’s Azure DevOps Admin Tools are worth a look. It’s a CLI toolkit that pulls most of the data you need, cycle time, lead time, graphs, and more. It’s not as user-friendly for non-developers, but it gets the job done if you like to script your way to insight.
Making the Invisible Visible
With all these options, it can feel a bit overwhelming. But the goal is always the same: make your work visible. Move from gut feel to data-driven delivery. When you can see your flow, your bottlenecks, your risks, you can actually do something about them. You can experiment, measure, and improve with confidence.
If you’re ready to stop guessing and start making decisions based on real evidence, let’s talk. I’ve helped teams of all sizes make their work visible and their delivery more predictable. It’s not magic, it’s just good practice, backed by the right data.
Let’s make your work visible, and your outcomes better.
Smart Classifications
Each classification [Concepts, Categories, & Tags] was assigned using AI-powered semantic analysis and scored across relevance, depth, and alignment. Final decisions? Still human. Always traceable. Hover to see how it applies.
What to read next
Stop Flying Blind: Why Telemetry Belongs in Your Definition of Done
Stop flying blind after release, learn why telemetry is vital to your Definition of Done and how real feedback drives better software, …
3 best ways to wreck Kanban. Use vanity metrics
Learn how to avoid common Kanban mistakes by focusing on actionable metrics like WIP, cycle time, and throughput instead of vanity metrics …
Velocity isn’t how many story points a team burns down
Velocity measures how quickly teams turn ideas into value, using build, test, deploy, and feedback times, not just story points, to track …
Technical Debt Management for Long-Term Quality
Explains how managing and repaying technical debt improves software quality, delivery speed, and long-term value by addressing both known …
Illuminate Your Workflow: Harnessing Candan Strategies for Continuous Improvement and Transparency
Learn how Candan strategies use flow metrics and transparency to reveal workflow issues, drive continuous improvement, and support …
The Importance of Visualizing Your Work in a Kanban Strategy
Explains how visualising work in Kanban boosts team clarity, transparency, and alignment, and offers steps to define workflows, avoid …
Detecting agile theatre with real delivery signals
Why Most Companies Operating Models Fail in Dynamic Markets
A concise comparison of Predictive and Adaptive Operating Models, explaining why traditional structures fail in dynamic markets and how …
Don’t Manage Dependencies, Remove Them
Explains why dependencies are a sign of poor system design and outlines steps to eliminate them by aligning teams, clarifying ownership, and …
The Estimation Trap: How Tracking Accuracy Undermines Trust, Flow, and Value in Software Delivery
Tracking estimation accuracy in software delivery leads to mistrust, fear, and distorted behaviours. Focus on customer value, flow, and …
Flow of Value vs Flow of Work – Misnomer or Useful Shorthand?
Compares “flow of value” and “flow of work” in Kanban, explaining why only validated outcomes count as value and stressing the need for …
Why Outsourcing DevOps Fails, and How Real Engineering Excellence Starts With Your Team
Avoid DevOps vendor lock-in, discover how true engineering excellence starts with partnership, not outsourcing. Ready to transform your …
Detecting agile theatre with real delivery signals
Don’t Manage Dependencies, Remove Them
Explains why dependencies are a sign of poor system design and outlines steps to eliminate them by aligning teams, clarifying ownership, and …
The Estimation Trap: How Tracking Accuracy Undermines Trust, Flow, and Value in Software Delivery
Tracking estimation accuracy in software delivery leads to mistrust, fear, and distorted behaviours. Focus on customer value, flow, and …
Flow of Value vs Flow of Work – Misnomer or Useful Shorthand?
Compares “flow of value” and “flow of work” in Kanban, explaining why only validated outcomes count as value and stressing the need for …
Why Outsourcing DevOps Fails, and How Real Engineering Excellence Starts With Your Team
Avoid DevOps vendor lock-in, discover how true engineering excellence starts with partnership, not outsourcing. Ready to transform your …
Estimating Better in an Overloaded System Is a Poor Man’s Strategy
High work in progress (WIP) causes delays and unpredictability; improving estimates won’t help. Limiting WIP and focusing on flow is key to …
Why Outsourcing DevOps Fails, and How Real Engineering Excellence Starts With Your Team
Avoid DevOps vendor lock-in, discover how true engineering excellence starts with partnership, not outsourcing. Ready to transform your …
Why Big Bang Rewrites Fail: How Sustainable Change and Engineering Excellence Transform Legacy Systems
Ditch the Big Bang rewrite. Discover why sustainable, in-place change drives true engineering excellence and lasting transformation in your …
Are We Still Pretending Coding Was the Bottleneck?
AI exposes that coding was never the main bottleneck in software delivery; real constraints are in system flow, team practices, and …
Why Azure DevOps Wins for Governance, Security, and Scale, Right Out of the Box
Unlock seamless governance, security, and scale with Azure DevOps, integrated tooling that lets you deliver value, not just manage …
Should You Use One Project to Rule Them All in Azure DevOps?
Explores when to use a single Azure DevOps project versus multiple projects, detailing impacts on flow, visibility, governance, and team …
Stop Testing Quality In: How Shifting Left Builds Better Software, Faster
Stop testing quality in, start building it in. Learn how shifting left, automation, and fast feedback loops drive engineering excellence in …
Why Most Companies Operating Models Fail in Dynamic Markets
A concise comparison of Predictive and Adaptive Operating Models, explaining why traditional structures fail in dynamic markets and how …
Don’t Manage Dependencies, Remove Them
Explains why dependencies are a sign of poor system design and outlines steps to eliminate them by aligning teams, clarifying ownership, and …
The Estimation Trap: How Tracking Accuracy Undermines Trust, Flow, and Value in Software Delivery
Tracking estimation accuracy in software delivery leads to mistrust, fear, and distorted behaviours. Focus on customer value, flow, and …
Kendall Guide - A System of Work for AI Adoption
Flow of Value vs Flow of Work – Misnomer or Useful Shorthand?
Compares “flow of value” and “flow of work” in Kanban, explaining why only validated outcomes count as value and stressing the need for …
Estimating Better in an Overloaded System Is a Poor Man’s Strategy
High work in progress (WIP) causes delays and unpredictability; improving estimates won’t help. Limiting WIP and focusing on flow is key to …