January Metrics — 2 adjustments, 2 conclusions
We committed to reporting on metrics monthly, to give you some transparency into our progress. Here you go.
Business metrics — Strong
Our churn and conversion rates are strong. These metrics are a proxy for the overall experience in Mind Settlers as well as our success at delivering enough value during onboarding.
As I mentioned last month, we were watching to see if the December improvement in conversions continued, and I’m happy to report yes it did!
Click here to see definitions for each metric.
Platform metrics — Adjusted.
We recently discovered that improvements delivered in the late December app release skewed our active user numbers. A new event category for notification events was not excluded from our active users calculation and inflated our active user count. We have corrected 2 of the metrics for December, shown in the table above.
Therefore, the jump in % of active users reported last month was overstated and the average content views reported was too low. (More on this later…)
Content metrics — Strong
Growth in content picked up again, providing more quality, actionable ideas for players to explore, share and use. We have also started introducing authors to the new content management portal as noted last month. It’s looking better and better (contact me through Slack if you want to take a look).
There are many initiatives underway that will lead to the capture of new, quality content for players:
- 2 enterprise pilots are underway that include content for teams, some of which will be public best practices.
- An experiment involving answering requests for advice is also underway and generating some amazing tracks like this one in Mind Settlers.
- A pilot using Mind Settlers for workshop activities is underway, and pilots for post -workshop activities and services will be next.
We’re headed in the right direction.
Looking at our Conversion/Churn metrics, the work we’ve done is having a positive impact. We need to continue to make it easier for players and deliver on the 5 areas of value.
We need better platform activity metrics.
Clearly, we need new platform metrics that do a better job measuring value delivered to users. Tracking content views per user is not the indicator of value or positive progress that we need. The metric doesn’t help us measure the success of our experiments or releases.
- Content views does not correlate with value delivered. Someone finding something great could leave as soon as they found it. Someone who searched for answers, looked at 15 content items could give up and not have a successful visit despite spending a lot of time in Mind Settlers. But someone browsing content could have a GREAT time exploring many items.
- To further muddy the ‘content view’ waters — our recent release included a redesigned Practice layout that now embeds activity content on the same page, which reduced the screens needed to access the same content as before. This well-received improvement will definitely reduce the average content views per user.
We know what we’re going to do.
We have spent a lot of time looking at our next phase. We need platform metrics that better measure the VALUE people are getting from Mind Setters. They should be our primary focus, as business metrics are simply the result of successfully delivering value.
We’ve chosen a value-focused North Star metric for the next 3 months. Look out for another post soon with more details.