A Developer and a User Walk into a Bar: 5 Steps to Getting Users’ Insights while Avoiding a Bruised Ego


As a developer working on consumer online software, you’re invested in creating meaningful experiences for users. At the same time, if you ask customers what they want, they will – as Henry Ford remarked – ask for a faster horse. But it’s worse than that, because users don’t just ask for a faster horse; they insist that it have an extra leg, and then tell you about how the current version of the horse has a lazy eye and is generally kind of a drag to hang out with.

This is unsatisfying feedback: It is both unhelpful for prioritizing feature development and a morale bummer.

Having experienced user interactions as either pointless or cruel (or both), developers tend to avoid talking with them; but it doesn’t need to be that way. Here are five steps for approaching customers that can help you make concrete decisions for your sweet new Web application, while feeling pretty good about the whole affair.

Okay, you’re on this team, building this thing, beholden to the decisions of lots of other people. So why should you talk to a user? For one, it can be an invigorating experience: You built a thing people like! That they appreciate! It’s fun!

More importantly, though, if you better understand and internalize why people want to use the thing you are making, you can make better decisions at the level of system design, particularly regarding data. Especially in an online social application, data is in terrifying abundance, and “scaling” a nascent application is ripe ground for over-engineering.

Developers of all backgrounds and levels of expertise struggle with trying to anticipate user needs, but we can’t. However, there is a middle-ground between reactive hacking and building pointlessly elaborate behemoths, and you can get there by strategically approaching your customers and users for feedback.

Step #1: Forget the question, “Will you use this?”

You’re going to get “Yeah, sure” and it will probably mean “No, but you’re sweet so I won’t hurt your feelings.”

The following steps, individually or in combination, yield better results!

Step #2: Approach Potential Users in Groups of Two or Three.

Some people respond better to a conversation in small groups rather than a one-on-one interview. Approach people in groups of two or three so you avoid dominating the interaction. Plus, watching friends or acquaintances have an organic argument is a lot more useful (not to mention more fun) than prying an individual with “hows” or “whys.”

That means you need to find such small groups of people, however. Depending on your software and its current reach, it may be anywhere between “trivial” and “basically impossible” to find users – but a lot of online products are targeted at some kind of “everyday” individual. If your application has to do with productivity, grocery shopping, or other such topics of daily existence, you may as well approach people at a bus stop.

However, that has all sort of creepy written all over it for everyone involved, so I suggest instead unconferences, meetups, and low-key networking events where you can meet a variety of technology oriented-people who may not represent your average user, but who could well be one of the pivotal early adopters your product needs. (For more on the importance of early adopters, check out this TED talk from about 9:25 to 11.)

Step #3:  Ask, “Which Do You Prefer?”

If you have prototypes to show, ask users to compare and contrast rather than to criticize. Especially when faced with a more polished UI, users feel more comfortable telling you their feelings about fonts and colors and layout. As a product developer, though, I have never really been as invested in fonts,  colors, and layout as much as I am in whether the data representation is appropriate, whether all the relevant and important information is shown, whether the experience feels valuable and unique relative to other products.

But asking a customer to compare and contrast different implementations can upend my assumptions about how often what kind of data is accessed, and which features take priority.

Try showing people two similar, but different, prototypes. The prototypes can be made of paper or be interactive; I prefer interactive, because it’s easier to approach people in public places with a pair of tablets or smartphones rather than a stack of paper, and because I’m awful at explaining interactions.

A difference can be pretty subtle but still interesting. If you’re making a Twitter client, for example, do new tweets show up at the top or the bottom of the stream? To a seasoned Twitter user, observing new tweets arrive at the bottom may be shocking and bizarre and he will surely make his outrage known. The key here is to dig into why the user thinks one thing is better than the other.

And remember – you’re not trying to test whether one UI is better than the other! The objective is to find interactions that (in the user’s eyes) have to be a certain way and in which any deviation is seen as utterly wrong. And you want to know about features that are so useless no one cares whether they exist. In both of these cases, when you have the opportunity to make a decision about when to load an asset or how to store data, you can be reminded of the context of use – and, perhaps, make a decision that saves you time and better serves your users.

Step #4: Ask Deep Questions About what Your Users want – But keep it Concrete!

If you find yourself perplexed by your users’ reactions to your prototypes, it may be because you’re making erroneous assumptions about their values and motivations. More interview-esque questions can be helpful in connecting the dots between a feature and a surprising reaction to it. These can also help you connect to the user researchers on your team, potentially improving the dynamic within your team.

Always ask about a specific event, “When was the last time you used [app]? What was the context?” The moment someone starts telling you about how she usually uses an application or what she likes or dislikes, she is relaying a narrative she thought about and constructed in her head. This narrative is full of rationalizations and retrospective details that make it a lot less useful than a more concrete account of actual events.

Asking about the last time the software was used, rather than using an app in general, shifts the mindset of the person you’re speaking to from the practiced, ready-made story to a more spontaneous description of interacting with an application. You can ask about your application if this is an existing user, or competing applications, or even applications that you hope to integrate with. If you were working on ReadItLater, for example, you could ask people about the last time they emailed themselves a link using their smartphone.

Invite your target audience to get passionate. “What’s the best thing about ___? What’s the worst thing about ___?”  This is the second installment of the “be specific” rule of talking to users: Don’t ask what they like or don’t like. Make them describe a time that was awesome that involved an app you care about, or a time that really sucked. “What,” “when,” “who,” and “where” questions – rather than “how” or “why” – keep things simple and concrete. Always break down a “how” to “…and what happened next?” and take a “why” into “Who else was involved?” and so on.

Step #5: Distinguish Between Identity and Utility (and save yourself a giant headache).

Almost every social application has two purposes that can conflict dramatically: to express an identity and to consume information. Data about how information is consumed on a social application can be a private thing even if revealing some of it is useful.

When Facebook reveals the list of people who have seen a post, that is useful for the person who made the post (it serves their information need). However, it can be uncomfortable to the people who saw the post, as the information potentially violates their identity. What if they don’t want to be seen as the sort of person who looked at this kind of post and didn’t comment on it or like it? So instead of showing the whole list, showing just the count would make everybody happier. (Don’t believe me? Test this out using the strategy in step #3!)

If you just look at the UI, the design decision seems trivial: show an array or its size. But there can be a non-trivial performance overhead in how long a page takes to load, because you’ve got a join in your query instead of just sticking to plain old SELECT COUNT(*) WHERE.

So here we are: You’re at the precipice of pouring resources into optimizing a data fetch operation you may not need because you’re swimming in data, and so someone on your team decided it’s a good idea to show as much of that data as possible to users. You’re in the unique position of knowing what is hard to change and what is easy to change, which allows you to explore those options with real users and come back with a greater understanding of which features to prioritize. Make it so!

If you try some of these strategies, I’d love to hear about it! What worked? What didn’t? What problems did you encounter?

See also:


  1. Retired fee-only portfolio man says:

    I hope this will be what I am searching for. In order to get a group of two or three together at one time and focusing on my latest attempt to deliver information they need to magnify gains and minimize risk in their mutual fund portfolios.
    Steve Blank says the initial effort should be a Minimally Functional Design. My first effort was to send out what in fact was a spreadsheet that we used internally for asset allocation decisions. That was not so bueno.
    Next I “simplified” it by doing the scoring and ranking, filtering and cut and pasting but that was not well received either.
    Next was a spreadsheet that, via logic and links to the other three spreadsheets in the workbook, interacted with the end user to the extent that all they had to do was enter the ticker symbols (a list alpha sorted by fund name with associated ticker symbols is provided) of the funds they have in their portfolio in the cells provided. This seems to be acceptable BUT only by those who are engaged with their 401k/IRA. I thought this would be 10% of plan participants but after years of frustration it seems that only 1% of the population is willing to give ten minutes of their week to their life’s savings.
    So maybe the interactive workbook is not the best way to go. Perhaps a static “the System holds these funds in its portfolio” sent whenever there is an asset allocation change dictated by change in the current market environment.
    Hopefully your guide will aid me as I “get out of the building” that quote is from Steve Blank in his book A Startup Owner’s Guide.
    By the way would you happen to be fluent in C++?

  2. I’m impressed, I must say. Really rarely do I encounter a blog that’s both educative and entertaining, and let me tell you, you have hit the nail on the head. Your idea is outstanding; the issue is something that not enough people are speaking intelligently about. I am very happy that I stumbled across this in my search for something relating to this.

  3. Aw, this was an incredibly good post. Spending some time and actual effort to produce a superb article… but what can I say… I procrastinate a lot and don’t seem to get nearly anything done.

Speak Your Mind