In order for development teams to identify development issues within their implementation they need to be able to see under the hood of their implementation and inspect the qualitative metrics of their implementation.

Additionally, within our production environment, we should have a variety of metrics available to us to diagnose the quality of an implementation. These metrics would help guide our investigation as the

Currently, this is missing and we have major issues with partner and customer implementations because of it and our MTTR within our production environments is protracted because of the lack of this information.

We also need co-locality of analytics. We need metrics to be co-located in the same system to do time-based analysis (such as correlating response time spikes to other internal metrics to identify cause) to prevent us from having to cross systems.

We also need all of these analytics accessible by the customer because otherwise we end up owning the analysis burden because of lack of access by the partner and customer dev teams.

This idea is really a request for "the entire suite" of metrics that are necessary. I have not enumerated every metric that are needed as of yet, but I could assist with that exercise.

I haven't listed the counters necessary as there is a whole suite of them.