|
It
seems media is not the only functional area where marketers
are running like scalded dogs from what they believe
is not working, into what they think is or surely will.
Just as they are pulling out of the traditional media,
they've come to know and loathe (i.e., TV), so too are
marketers jettisoning their once beloved research toolfocus
groupsin favor of emerging new methods, such as
ersatz psychoanalystics, brain wave analysis, "immersion
groups", and archetype analysis. "My research
department doesn't know it, but I'm killing all of our
focus groups," announced Cammie Dunaway, CMO at
Yahoo!, to a receptive audience at a conference in September.
As BusinessWeek recently reported:
Exasperation
with focus groups, while not universal, is growing
as companies look for better ways to get inside consumers'
heads, often assisted by new technology and the Internet.
The dissatisfaction and the proliferation of new research
approaches has been escalating so rapidly that the
ad industry's main trade group has been spurred to
conduct the first widespread study of testing methods
since the 1950s.
John
Osborne, CEO of BBDO, echoed the sentiments of many
frustrated practioners: "There's peer pressure
in focus groups that gets in the way of finding the
truth about real behavior and intentions." Fanning
the fire, Malcolm Gladwell, author of the best-selling
Blink: The Power of Thinking Without Thinking,
has repeatedly criticized focus groups with statements
like, "asking someone to explain [their behavior
and intent] is not only a psychological impossibility....but
it biases them in favor of the conservative, in favor
of the known over the unknown."
As
is the case with the rush from traditional to non-traditional
media, marketers are, very unfortunately, moving into
something else without first examining the root cause
of their frustration. The main beef with focus groups
is the huge disconnect between the information that
comes out of a focus group and what actually happens
in the real-world. Product concepts, for instance, may
receive favorable ratings in a group, but absolutely
bomb when launched into market or, vice versa, the concept
bombs in the focus group, but the company goes ahead
anyway and achieves unprecedented success.
The
source of the disconnect isn't exactly a complex mystery,
however. Sociologist Robert K. Merton, the father of
focus groups, repeatedly warned about what he called
the "misuse" of focus group data (he called
them focused groups, which is correct English). While
he believed focus groups were an excellent technique
for stimulating new ideas and concepts, collecting general
information about a particular category or topic, and
generating hypotheses about buyer behavior, problems,
needs, etc., he warned that under no circumstances
should marketers treat focus group data as reliably
valid. Focus groups were intended to be a first step
in a rigorous research process; not the only step. Focus
groups cannot provide projectable data about the likelihood
of a new product's success, an advertising campaign's
impact, or a marketing program's profitability. Disturbingly,
many of the up-and-coming methods of choice that marketers
are moving into have many of the same limitations as
focus groups in terms of their scientific merits and
projectabilitythey are still based on the opinions
of a small number of people who may or not be representative
of the company's or brand's most profitable targets
and have no standards of interpretation.
Take,
for example, BusinessWeek's report on the movement
away from focus groups. It cites the example of Pepsi
Edge, a new product introduced by soda giant Pepsi in
2004, as a "classic case of a focus-group false-positive."
Copernicus took a closer look to see how accurate this
statement really is. Pepsi went to market with Edge,
a lower carb and lower calorie version of the original,
allegedly after focus groups warmly embraced the concept.
However, we wonder if participants were given an actual
product to taste and advertising to view or just a concept
to look at. In other words, did Pepsi expose participants
to what they actually brought to market? It had an unclear
target and an even fuzzier positioning; it tasted terrible;
it went onto store shelves in June to coincide with
the launch of Coke's similar low-carb/low-cal offering,
but advertising support didn't come until several weeks
later; and did we mention it tasted terrible? In this
case, as in myriad others, failure could have had as
much, if not more, to do with what happened AFTER the
research than what came out of it. True, Pepsi should
never have made a final go/no go decision based on the
opinions of 20 or so people, but no research methodeither
qualitative or quantitativecan predict success
or failure with any degree of accuracy if what's tested
bears only a remote resemblance to what is actually
launched and/or how it was launched.
The
problems with traditional focus groups go way beyond
their inability to "get inside the consumer's head,"
and the reasons research sometimes appears to give marketers
inaccurate and/or inadequate information aren't limited
to the short-comings of a particular research method.
If marketers really want to get the information that
will lead them to the most profitable marketing decisions,
they need to understand why a particular research toolbe
it a focus group, simulated test market, or something
elsedidn't give them the necessary, adequate,
or correct insights. The "out with the old, in
with the new" mentality needs to apply to habits,
not just tactics, if marketers want to see improved
performance.
Back
to top.
|