BunnyfootBunnyfootBunnyfootBunnyfoot
  • Our services
  • About us
  • UX training
  • Our clients
  • Blog
  • Contact us
    Home Brain Feasts: Longer Reads You agree that closed and leading questions are bad don’t you…?

    You agree that closed and leading questions are bad don’t you…?

    By Cathy Carr | Brain Feasts: Longer Reads | 0 comment | 2 October, 2015 | 0

    Asking a leading, loaded or closed question is undesirable when it comes to researching how your customers really behave. These kinds of questions (often asked unwittingly) risk giving you the answers that you or your development team want to hear, but are likely to mask real, relevant and reliable insights that you can work with to improve the design. Leading the witness is basically a bad idea and you should do all you can to avoid it.

    At Bunnyfoot we frequently use ‘formative’ face-to-face usability testing, where we observe people carrying out realistic tasks whilst they use something (like a website or app or prototype). This is used to detect usability issues within a design and can also be used as a way of exploring their needs and behaviours.

    Tests are carried out 1-on-1 with a moderator and the test participant in the same room and sometimes in order to try to clarify what has happened or get more insight into a need or issue the moderator may ask the participant open questions about their experience. In the middle of a testing session the moderator needs to take care not to introduce leading, loaded or closed questions – it takes experience and practice. Below are some tips to help you if you are considering carrying out your own research, or that might help you spot if your research is being carried out to a good standard.

    How to spot if you are asking a leading, loaded or closed question…

    Leading or loaded questions make someone think in a certain way. They either include the answer, point the listener in a certain direction, or include some form of carrot or stick to send them to the ‘right’ answer.

    Leading or loaded questions can appear in a variety of different ways:

    • Assumptive questions include an assumption about the outcome, for example ‘How late do you think that the item will be delivered?’ This question assumes that the item is not going to be delivered on time.
    • Linking a personal point of view and asking them if they agree, for example ‘The newer version is better, isn’t it?’
    • Questions clearly asking for agreement, which coerce the other person into saying ‘yes’, for example ‘Do you agree that this new site is better than competitor XYZ?’
    • Closed questions are usually much shorter and more focused and are therefore easier to answer as the choice of responses are limited, usually ‘yes’ or ‘no’ – these risk masking the true picture by forcing a binary choice.

    Open questions require a person to pause, think, and reflect

    Answers to open questions can include detailed descriptions of events, personal feelings, opinions, or ideas about a subject. When using open-ended questions, the control of the conversation transfers to the person being asked the questions therefore making them feel more relaxed.

    Open-ended questions typically begin with words such as ‘What’, ‘Why’ and ‘How’, or phrases such as ‘tell me about…’ or “describe…”.
    Some examples include; ‘What did you just do?’, ‘Why do you say that?’, ‘What would you think it does?’ ‘Where are we now?’.

    Screen Shot 2015-10-01 at 16.40.20

    Other useful tips to remain open (neutral) during a research session

    • The Echo or Parrot technique – you repeat back the last phrase or word that the participant said while using an interrogatory tone. Using the exact words the participant said ensures you do not bias them by making a suggestion or describing anything within the interface. For example if the participant says “The purple banner is odd…” – you say “The purple banner is odd?”
    • The Boomerang technique – you turn the participants question or comment back around to the participant. Using a generic, non-threatening question to divert the participant’s question back to them rather than attempt to half answer the question.
      For example if the participant asks you a question about the user interface you can say:
      “That’s a really great question what do you think?” (Positive reinforcement for them to think about the answer themselves) or “What would you do if you were at home and you came across this?” (Reminder that in reality you will not be there to answer questions like this for them).
    • And one we catch ourselves using a lot, the Columbo technique – be smart but act dumb in a similar way that Columbo used to catch his criminals by enticing them to underestimate his investigative skills. While we are not trying to catch anyone as Columbo was, we are trying to create tasks and questions that coax participants into acting naturally and telling he truth.
      Just ask part of a question, and trail off, rather than asking a thorough question for example if the participant says “Will clicking here add it to my basket?”
      You say “hmmm, you were wondering (pause) if (pause)…..”
      The participants will fill in the rest.
    • Silence. If your moderator during a usability test is talking too much it probably indicates they are inexperienced or there is something wrong with the test planning. Observing real behaviour is far better than asking questions about it, and interrupting real behaviour with constant questions is poor practice and is to be avoided. In addition, a well timed ‘almost becoming awkward’ silence in any type of one to one research stimulates participants into filling in the gaps (and of course avoids leading the witness). So simply shutting ones mouth can often be the best technique of them all.

    Want to learn more?

      • Training course: User Testing
      • Training course: Beyond Usability
      • Services: UCD and our approach
    Usability testing

    Cathy Carr

    More posts by Cathy Carr

    Related Posts

    • What’s in a name? User Experience and UX Design vs. Design Thinking

      Nov 24, 2020

      User Experience (UX), UX design, and design thinking are popular buzzwords and often used interchangeably. But are they interchangeable? What do they mean, exactly, and how should we use them? User experience continues beyond a single touchpoint Let’s unravel the... Read more

    • Tips from Airbnb on Designing a 5 Star Website

      May 30, 2019

      It’s 9:00am and you’ve just touched down in sunny Barcelona and arrived at your Airbnb. You open the door and your eyes dart around the room — lots of light, modern furnishing and most importantly, it’s clean! First impressions are... Read more

    • Highlights from the Service Design Fringe Festival 2018

      Dec 18, 2018

      Giving myself enough time to reflect on the Service Design Fringe Festival as one of the 2018 organisers I can firmly say that the Festival was a success and worth of my time and energy investment putting aside/greying out countless... Read more

    • Video Games – Addictive By Design?

      Nov 5, 2018

      If you were asked to characterise a ‘gamer’, chances are, you’d describe a socially awkward teenage male. That’s the general perception of a gamer – and something that has been perpetuated by films and TV for decades – but it’s... Read more

    Leave a Comment

    Cancel reply

    Your email address will not be published.

    NextPrevious

    Recent Posts

    • ‘AR’-commerce – a novel and functional shopping experience January 26, 2021
    • Webinar: UX & Sustainable Service Design January 12, 2021
    • AR isn’t mainstream… or is it? January 7, 2021
    • What makes an effective UX Consultant? Bunnyfoot speaks to UX Usability Podcast December 11, 2020
    • What’s in a name? User Experience and UX Design vs. Design Thinking November 24, 2020

    Categories

    • Brain Bites: 2 Minute Insights
    • Brain Feasts: Longer Reads
    • Brain Licks: 10 Second Wisdom
    • Bunnyfoot Updates
    • Content: White Papers, Research Reports and More
    • Events
    • News and Announcements
    • Talks and Presentations
    • Tools and Resources
    • Uncategorised

    LONDON

    4th Floor
    54 St John’s Square
    Farringdon
    London
    EC1V 4JL

    Tel: 0207 608 1670

    SHEFFIELD

    The Old Chapel
    8 Mortimer Street
    Sheffield
    South Yorkshire
    S1 4SF

    Tel: 0114 478 2950

    OXFORD

    Boston House
    134 Downsview Rd
    Wantage
    Oxfordshire
    OX12 9FF

    Tel: 01235 606 140

    Cyber Essentials (PLUS) Logo
    • Copyright Statement
    • Terms & Conditions
    • Training Course Terms & Conditions
    • Privacy Policy
    • Jobs
    © Bunnyfoot Ltd 2020 | Bunnyfoot is part of the Sideshow Group
    • Our services
    • About us
    • UX training
    • Our clients
    • Blog
    • Contact us
    Bunnyfoot
    We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
    Privacy PolicyREJECTACCEPT
    Privacy & Cookies Policy

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are as essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
    Necessary
    Always Enabled

    Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

    Non-necessary

    Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.