Beta tests are great. They give your team the opportunity to test the waters with a new feature.
- Is it what people were expecting?
- Are there crucial missing pieces?
- What bugs are there?
It's great to answer these questions before rolling the feature out to your entire user base. The more polished you can get it, the better off you'll be when you launch it.
What we've found successful is scoping down the feature to its most basic components. Essentially, an MVP for the feature. Which pieces are a must?
When the MVP is ready, we invite people to beta test the feature. Letting them in at a controlled pace allows you to make incremental improvements without being too overwhelmed and rushed.
People who are willing to beta test are often very willing to give feedback. This is your chance to see how the feature is being received. There are probably things you can iron out in the overall experience. You might want to increase the scope to cover new use cases that come up from your betas.
We love building Canny because it's something we use all the time. We found it quite useful for our latest beta test.
Beta testing with Canny
Canny makes running beta tests a breeze. Assuming you're building a popular feature request, you already have a list of people who want it.
When the feature is ready for beta testing, just leave a comment on the post. As an admin, your comments get sent out to everyone who voted. This is a highly targeted message. It's also a great way to thank customers who gave feedback by giving them early access.
If the voters list isn't enough, send a wider message to your user base looking for people interested in trying the beta. We send in-app messages via Intercom. Describe what the feature is, explain it's in beta, and include instructions on how to join.
Once you have the beta running, make sure you keep track of who is in the beta. We create tags in Intercom. You can send out additional requests for feedback and see how people are using the new feature. You can also keep them updated with any improvements.
Your main goals of the beta should be to gauge usage and gather feedback. Sometimes, we make a private Canny board specifically for beta testers. They can leave feedback specific to the beta on that board. It keeps things organized.