Friday, March 29, 2013

Documenting customer research

All too often, in-house customer research efforts are ineffective because the results are poorly documented. My rules of thumb are:
  • Write up your results as soon as possible after conducting research. No matter how good your notes or recordings, you had "ah-ha" moments that you won't recall later.
  • Write your results in an effective way. Make the important points resonate. Don't bog down your report in useless details. When writing up one-on-one interviews, think of it as writing personas. Think of it as telling a story.
  • If you archive your results in a PowerPoint presentation, make use of the Notes feature to fill in all the information that you impart verbally. Think of the deck as an artifact that will be read on its own.

When I started working at one place, I learned that my manager had done a round-table discussion with customers the year before. I asked if I could read her results and she said that she hadn't written anything because she recorded the session. I listened to the recording, but the way the mike was placed I could only make out what she was saying: the customers were largely inaudible. It was clear that I was the first person (including her) who had bothered to wade through the three hour recording.

This recording-in-place-of-report seems to be a common problem. Recordings are supplemental to reports, not a replacement for them. Whether audio or video, recordings can be very useful when snippets are excerpted and presented. They are also hugely useful for writing reports. But in almost every case that's the end of their usefulness.

I have frequently found that the only report of a research study is a PowerPoint presentation, with lots of cute photos, lots of headings, and virtually no results.

At the other end of the scale are the faux scientists who write hundred page reports filled with large pie charts, with numbers reported to four decimal places (NO decimal places, please!), and a complete lack of understanding of how to report results of research where the sample is not representative of the population.

Even the most dismal interview can be useful if the results are well-presented. This isn't about window-dressing. It's about ferreting out what's important, and as with most things, it requires hard work to be successful.

2 comments:

  1. Ruth, I feel your pain. For many years I worked in the aerospace feild, and although I was an instructional designer during that time (not a tech writer), it was very difficult to get engineers and others to document exactly what they wanted to say or what what was said in meetings. I think the problem is that you and I are trained to write, they're not. Since that time I've had stints as a tech writier,instructional designer and back and forth again, and I always ran into the same problems you describe. I'm sure you have pleaded with them to take detailed and accurate notes, but those get lost in the fog. Aside from equipping your customers with digital recorders, or attending these meetings yourself, there's really no way of ensuring the quality of documentation. It might be worthwhile to eqip your customers with a toolkit (tips, tricks, and reminders) that they can refer to when it comes to documenting their own research.

    Mike

    ReplyDelete
  2. Hi anonymous,

    Thanks for the comment. Great point about providing toolkits. I have done that in the past but forgot about it.

    ReplyDelete