Startup Commons

  • Startup Commons
    • About Us
    • Our Team
    • Our Customers
    • Services And Pricing
    • Our Business Model
    • Our Digital Solutions
    • Our History
    • Contact Us
    • Partner With Us
    • Request For Speakers
    • Job Opportunities
    • International Internships
  • Business Creators
    • About Business Creators
    • Creating Businesses
    • What Is A Startup
    • Startup Development Phases
    • Growth Academy Elearning Platform
    • Founders Shareholders' Agreement and Team Building Online Training
  • Support Providers
    • About Support Providers
    • Learn About Startup Ecosystem
    • Startup Development Phases
    • Providing Support Functions
    • Innovation Entrepreneurship Education
    • Innovation Entrepreneurship Curriculum
    • Growth Academy eLearning Platform
    • Certified Trainers
    • Become Growth Academy Provider In Your Ecosystem
    • Growth Academy Training On-Site By Startup Commons
  • Ecosystem Development
    • About Ecosystem Developers
    • What Is Startup Ecosystem
    • Ecosystem Development
    • Ecosystem Development Academy eLearning Platform
    • Subscribe to Support Membership
    • Ecosystem Operators
    • Development Funding
    • For Development Financiers
    • Startup Ecosystem Maturity
    • Case Studies
    • Submit Marketplace App Challenge
    • Become Ecosystem Operator
  • Digital Transformation
    • Digital Transformation
    • Ecosystem Operators
    • Apply To Become Ecosystem Operator
    • Applications Partnership
    • Ecosystem OS
    • General Data Protection Regulation (GDPR)
    • Digital Ecosystem Applications
    • App Developers
  • Contact Us
  • Startup Commons
    • About Us
    • Our Team
    • Our Customers
    • Services And Pricing
    • Our Business Model
    • Our Digital Solutions
    • Our History
    • Contact Us
    • Partner With Us
    • Request For Speakers
    • Job Opportunities
    • International Internships
  • Business Creators
    • About Business Creators
    • Creating Businesses
    • What Is A Startup
    • Startup Development Phases
    • Growth Academy Elearning Platform
    • Founders Shareholders' Agreement and Team Building Online Training
  • Support Providers
    • About Support Providers
    • Learn About Startup Ecosystem
    • Startup Development Phases
    • Providing Support Functions
    • Innovation Entrepreneurship Education
    • Innovation Entrepreneurship Curriculum
    • Growth Academy eLearning Platform
    • Certified Trainers
    • Become Growth Academy Provider In Your Ecosystem
    • Growth Academy Training On-Site By Startup Commons
  • Ecosystem Development
    • About Ecosystem Developers
    • What Is Startup Ecosystem
    • Ecosystem Development
    • Ecosystem Development Academy eLearning Platform
    • Subscribe to Support Membership
    • Ecosystem Operators
    • Development Funding
    • For Development Financiers
    • Startup Ecosystem Maturity
    • Case Studies
    • Submit Marketplace App Challenge
    • Become Ecosystem Operator
  • Digital Transformation
    • Digital Transformation
    • Ecosystem Operators
    • Apply To Become Ecosystem Operator
    • Applications Partnership
    • Ecosystem OS
    • General Data Protection Regulation (GDPR)
    • Digital Ecosystem Applications
    • App Developers
  • Contact Us

5 mistakes we all make with product feedback

11/12/2014

Comments

 
Picture
It rarely makes sense to take feedback from all users and it never makes sense to get it all at once.

At the outset of a new project, or especially if you’ve recently taken over a product, it’s tempting to survey all your users to appraise where things are. It’s usually a mistake. In fact there are five common mistakes that we see over and over. Intercom makes getting feedback extremely easy, and as a result, it’s easy to become a little trigger happy with the feedback requests. Here’s five quick fixes for product feedback:

1. Stop talking to “all users”
Picture
When you survey all your users together you ignore the specifics. You mix up yesterday’s sign-ups with life long customers. Those who used your product every day with those who log in just to update billing details. Those who only use one specific feature with those who use them all. It’s a mess.

Solution: There’s a much cleaner way to get much better feedback. Here’s some examples:

  • If you want to improve your onboarding, only listen to people who recently signed up.
  • If you want to improve a feature, only talk to those who use it.
  • If you want to understand why people aren’t using a feature, only talk to those who don’t use it.
  • If you want to find areas of concern, only talk to active users who use all your features.
2. Feedback should be on-going
Picture
The default approach to feedback is to solicit it on demand. But that means when you realise you need it you have to wait a week doing nothing while it comes in. To compensate for this you cast a very wide net, ask a lot of questions, and sit back. If you’re particularly naive you’ll act on each piece as it comes in, rather than waiting and analysing it in whole. The problem here is twofold: firstly you never have feedback to hand when you need it, but secondly you only hear about problems when you choose to ask about them. This means you’re blind to gradual degradation of your product.

Solution: Periodically check in with users. The simplest, yet still valuable, version of this is to ask users for feedback on day 30, 60, 120, 365, etc. This takes about 20 seconds to set-up in Intercom, and will pay for itself in a day or two. A slightly more advanced version would be to gather feature specific feedback based on usage. For example, if you have a calendar tool, you might ask someone for their thoughts on the first, twentieth and fiftieth time they use. As a user gets used to a product their feedback matures. The first usage feedback will explain what’s confusing, the twentieth will explain the frustrations, the fiftieth will explain the limitations.

3. Distinguish Free from Paying Feedback

Picture
Related to point 1, it’s easy to assume all requests are of equal value, regardless of the state of an account. This is roughly true within certain thresholds (e.g. $50->$500) but there’s a noticeable difference between the type of requests you get from free users and from paying users. Long term free users are only capable of giving you feedback on how to improve your free plan, which is rarely a focus for a business. Typically, free plans exist to draw customers in and upsell them. You can’t listen to hypothetical feedback: “I’ll upgrade if…”, “I’ll upgrade when…”. Espoused behaviour is rarely useful, learn from things that actually happened.

Solution:

  • To improve your product for your paying customers, only talk to your paying customers.
  • To learn what makes people upgrade from free, only talk to customers who upgraded from free.
  • When you want to improve your free product, only talk to your free customers.
4. Don’t fall for the vocal minority
Picture
It’s often said the plural of anecdote is not data, but that does not mean anecdotal evidence is not useful. The plural of anecdote is a hypothesis, or narrative. Something that’s easily verifiable. So on a day when five users ask for a simpler event form in the calendar, you don’t assume five people represent all users and immediately kick off an “event simplification” project. First you should attempt to verify if these five users represent all users. You start talking to calendar users, and see what else comes up.

Solution: Treat every clustering of feedback that you see as a hypothesis, and then don’t build it, verify it. Once you verify that the pain is real, the next step is never “build the requested solution”, you have to go deeper. Which brings us to the last point.

5. Don’t assume users request the right feature

Picture
To paraphrase Confucious, when customers point to the moon, the naive product manager examines their finger. The faster horses tale is often used to justify not listening to customers, but that’s an epic way to miss the point. If a customer says they want a faster horse, what they’re actually telling you is that speed is a key requirement for transport. So you think about how you deliver that. In our previous example, our friend had five people complaining that her new event form was too complex. She could have lost weeks building a natural language input, or streamlining the UX of the form, but it turns out none of that would have helped. When she talked to all the calendar users, she quickly learned the pain came not from the form complexity, but from how often it had to be used. What actually solved the pain was recurring calendar events, and making events easy to duplicate.

Solution: Be aware that customer feature requests are a cocktail of their design skills, their knowledge of your product, and their understanding of their current pain point. They know nothing of your product vision, what features you’re currently working on, or what’s technically possible. This is why it’s essential to abstract a level or two above what’s requested, into something that makes sense to you, and benefits all your customers.

Of course it’s worth noting occasionally a feature request will be spot on. It will rhyme with every thing else and perfectly fit in the world the way you see it. On these occasions you can skip steps, namely verification, abstraction, and clustering and trust your gut. Your product intuition gives you wonderful shortcuts, so long as you’re still a true user of your product, and constantly in touch with the needs of your users.

But on every other occasion, talk to your customers, it makes you smarter.
______________________________________________________________________________________________
This is an edited version of a post originally posted at http://blog.intercom.io, by Des Traynor, Co-founder @intercom.You are free to re-edit and repost this in your own blog or other use under Creative Commons Attribution 3.0 License terms, by giving credit with a link to www.startupcommons.org and the original post.


Comments
    Our Services
    Supporting startup ecosystem development, from entrepreneurship education, to consulting to digital infrastructure for connecting, measuring and international benchmarking.
    Picture
    ​Subscribe for updates
    Startup ecosystem development updates with news, tips and case studies from cities around the world. 
    Subscribe

    Join Us?

    Are you interested to join our global venture to help develop startup ecosystems around the world? 
    Learn more...
    ​

    Archives

    December 2023
    November 2023
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    January 2021
    November 2020
    June 2020
    May 2020
    April 2020
    March 2020
    October 2019
    June 2019
    February 2019
    November 2018
    October 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    May 2017
    February 2017
    December 2016
    July 2016
    March 2016
    February 2016
    January 2016
    November 2015
    October 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    July 2013
    June 2013

    Categories

    All
    Accelerator
    Africa
    Asia
    Australia
    Commitment
    Concepting
    Design
    Digital
    Ecosystem
    Establishing
    Europe
    Event
    Growth
    Incubator
    Infrastructure
    Innovation
    Investment
    Leadership
    Lean Startup
    Mentor
    North America
    Report
    Scaling
    Startups
    Team
    Validation
    Vietnam
    Vision

    RSS Feed

Startup ECOSYSTEM DEVELOPMENT
To Scale INNOVATION Entrepreneurship

Business
​Creators

What is a Startup?
Startup Development Phases
Business Creation
​
Growth Academy eLearning 

​​Support
​Providers

Supporting Startups
​
Startup Curriculum
​
From Technology Transfer to Open IPR
Support Providers
​Knowledge Center
​
Funding Sources
Growth Academy eLearning ​

​​Ecosystem
​Developers

What is Startup Ecosystem?
​From Innovation Ecosystems to Startup Ecosystems
Startup Ecosystem Development
Startup Ecosystem Maturity
Ecosystem Developers 
​
Development Funding 

Ecosystem Operators

About Ecosystem Operators
Funding Sources
​Digital Ecosystem Applications
EcosystemOS​


Picture
Subscribe to our mailing list
Entrepreneurship, innovation and startup ecosystem development updates, with news, tips and results from cities and organizations around the world.  #startupecosystem
Subscribe
Growth Academy eLearning | Resources | Blog
Join Us | Sharing Policy
Picture
Service by Digiole Oy
​© 2025 Digiole Oy some rights reserved