Skip navigation

Tag Archives: business leadership

View this post on greenbook here or read below:

This is part 4 of a 9 part series by Carrie Robbins, a recent Master’s Degree recipient who did her thesis on Mobilizing Market Research: The state-of-the-art, future evolution and implications of mobile data collection methods in the field of market research. In this one, we’re getting into the meat of the matter; what are some of the current limitations of the mobile model and what does the future hold for us as we overcome these limits. Many thought leaders participated in giving Carrie their views and I think you’ll find it very informative.

Editors Note: This is part 4 of a 9 part series by Carrie Robbins, a recent Master’s Degree recipient who did her thesis on Mobilizing Market Research: The state-of-the-art, future evolution and implications of mobile data collection methods in the field of market research. The previous sections are:

Part 1: Why Go Mobile?

Part 2: Industry Insights

Part 3: Benefits & Current Uses

In this one, we’re getting into the meat of the matter; what are some of the current limitations of the mobile model and what does the future hold for us as we overcome these limits. Many thought leaders participated in giving Carrie their views and I think you’ll find it very informative.

Many references are cited in this piece. For a complete list of all of the references click here.

Since the GreenBook is also a Co-Sponsor of the Market Research in the Mobile World Conference, for the next 5 weeks as we run up to that event we’ll be posting a new section of Carrie’s report here. Registrants of the event will get access to a complete version that will be available via download. Carrie will also be attending MRMW11 and participating on one of our expert panels at the event!

This truly is a comprehensive review of the current state of the industry, the views of many industry thought leaders on what the future holds, and of current best practices being used. It should serve as a great resource for anyone interested in or actively engaged in utilizing mobile technologies for research-based initiatives. Enjoy!

By Carrie Robbins

The main limitation of mobile research is the short length of mobile surveys. Hobson explains, “The promise of immediacy is somewhat balanced by the challenge of the small screen and the fact that somebody doesn’t want to be sitting with their mobile phone for two hours answering a survey.” However, Luck sees the short nature of mobile questionnaires as an opportunity for more thoughtful research. She states, “There’s been a lot of industry discussion about survey length and how it impacts data quality and respondent satisfaction…You just have to do much shorter surveys on mobile, you don’t really have a choice.” Luck considers this aspect of mobile surveys to be an improvement over longer, traditional versions.

Many interviewees note penetration as a limitation of mobile methods (including President of BrainJuicer North America Ari Popper, as well as Coleman, Luck, Sunada and Robbibaro). Although this should become a non-issue in the future as smartphone penetration deepens, a representative sample is currently difficult to obtain through smartphones alone, unless of course the population of interest is smartphone users. In addition to limitations on penetration, mobile methods can lack depth, and due to their self-reported nature are not as open to examination as other methods. The inability to dig deep and obtain detailed information is a shortcoming mentioned by Robbibaro and others. Stork similarly explains that it is difficult to get at the inconsistencies that usually emerge when data is self-reported, as it tends to be with mobile.

Other more minor limitations of mobile are that participants can experience technical difficulties (Schwitzer), app-based research is impacted if people do not wish to download the app (Popper), and Stork warns that in emerging markets affluence can affect entry into a study rather than age, as tends to be the case in developed countries where mobiles are generally used more frequently by a younger population.

At the same time, Murphy suggests that rather than focus on the limitations of mobile, one should consider mobile to be a shift towards building stronger relationships with participants. Bhaskaran also refers to it as a paradigm shift rather than allowing the limitations to deter him. He champions the idea of reframing how research is done, insisting one must reach participants through their preferred channel, which appears to be mobile.

The Mobile Future

Though not currently a widespread method, an increase in mobile research is predicted in the near future. As previously mentioned, Murphy’s 2011 GRIT report shows that firms foresee an increase in its use in the next year. Interviewees believe this will occur much more quickly than the uptake in online research did, citing the exponential acceleration in technological advancement and adoption described by Moore’s Law (Murphy, Coleman), as well as a rush to stay ahead of the curve (Bhaskaran). As smartphone adoption increases and mobile research becomes more popular, mobile methods will become normalized and may cease to be referred to as a separate technique, becoming integrated with other methods (Stork).

Many agree that integration across mobile methods as well as between the back and front ends of mobile research systems will occur in the future (McCrary, Popper, Coleman, Murphy). In this way, mobile will become increasingly agile, or ‘smart’ (Murphy). A few experts suggest that the personal mobile device itself might change, becoming something between a mobile phone and a tablet device in terms of size and capabilities (Murphy, Coleman). Mobile devices could allow finger movements to be tracked on touchpad screens, which may lead to a better understanding of how consumers explore advertisements and other web components (Murphy).

While Clarke and others admit that the future of mobile is unclear, most interviewees are in agreement that there is a need to establish best practices and to gain a better understanding of the ideal contexts for mobile methods. Popper points out that like any new method, it will solve some problems while creating new ones.

Most interviewees agree that app-based research is the future of mobile. Bhaskaran explains that this is because companies like Apple “have invested very, very heavily in each of these [app] systems…and obviously all these are a great revenue generator for them. So…they will…not let it die.” Coleman goes a step further and speculates that apps will continue to become increasingly sophisticated and more richly embedded into the actual hardware of the device itself as mobile browsers become a thing of the past.

However unclear the future of mobile may be, most interviewees agree that the technology has brought about a shift in the relationship between researchers and participants that amounts to a type of continual conversation. Hobson refers to it as a shift away from “monolithic questions and answers” towards an “ongoing dialogue.” Interviewees also expect social media to become increasingly interconnected with mobile research (Murphy, Bhaskaran, Stork, Popper, Whaley, Luck). Whaley predicts the integration of social media will incite a shift away from the use of panels and towards the use of communities where participation takes on a more social aspect for members. Luck anticipates that geolocation data also may be combined with pshychographic information culled from social media . The result could be used to profile participants for segmentation purposes, to perform network analysis, to map influence and to understand how word-of-mouth travels in the real world.

Another evolution expected by the interviewees is that the overlap between market research and marketing on mobile devices will expand. Bhaskaran offers as an example of this the flow of coupons and discounts to participants’ mobile devices upon the completion of a mobile study. McCrary also predicts that measuring the effectiveness of mobile marketing will emerge as a new field, and more customer satisfaction and relationship management will be conducted through mobile methods. These changes would fundamentally alter the market research landscape, leading to the convergence of the market research field with marketing, advertising, and other industries.

This is Part 4 of a 9 part series. The next section will be posted the week of June 6th and will detail a “Mobile to-do list” to help move mobile research adoption forward.

———————————————————————————-

The background research on mobile methods, detailing the benefits and uses as well as the limitations, give a good indication of why proponents of mobile research urge others to adopt it. Surveys of market research firms have quantified what the industry thinks of this new method (Macer & Wilson, 2009a ; 2009b ; 2011 and Murphy 2011 ), but a more in-depth, qualitative understanding of what leading experts think about the topic could be useful to supplement these numbers. This qualitative approach offers insight into when and how mobile methods can best be leveraged, going beyond the numbers to take an in-depth look into the mobile market research landscape.

Editors Note: This is part 2 of a 9 part series by Carrie Robbins, a recent Master’s Degree recipient who did her thesis on Mobilizing Market Research: The state-of-the-art, future evolution and implications of mobile data collection methods in the field of market research.

Here is the link to Part 1: Why Go Mobile?

Since the GreenBook is also a Co-Sponsor of the Market Research in the Mobile World Conference, for the next 9 weeks as we run up to that event we’ll be posting a new section of Carrie’s report here. Registrants of the event will get access to a complete version that will be available via download. Carrie will also be attending MRMW11 and participating on one of our expert panels at the event!

This truly is a comprehensive review of the current state of the industry, the views of many industry thought leaders on what the future holds, and of current best practices being used. It should serve as a great resource for anyone interested in or actively engaged in utilizing mobile technologies for research-based initiatives. Enjoy!

By Carrie Robbins

The background research on mobile methods, detailing the benefits and uses as well as the limitations, give a good indication of why proponents of mobile research urge others to adopt it. Surveys of market research firms have quantified what the industry thinks of this new method (Macer & Wilson, 2009a ; 2009b ; 2011 and Murphy 2011 ), but a more in-depth, qualitative understanding of what leading experts think about the topic could be useful to supplement these numbers. This qualitative approach offers insight into when and how mobile methods can best be leveraged, going beyond the numbers to take an in-depth look into the mobile market research landscape.

Further, many industry leaders and firms have published case studies individually; therefore an overview of what mobile proponents think of these methods is opportune. The Industry Insights section of this white paper aims to offer just that – a summary of what some of the industry experts currently say about mobile research methods. In speaking with these thought-leaders, themes emerge regarding the convergence of market research with other industry sectors and a shifting relationship between researchers and consumers. The interviewees provide a thorough look at the state-of-the-art of the market research industry as it pertains to mobile methods.

Fifteen industry leaders were interviewed during March and April 2011 to determine their opinion of the state of mobile methods, the future of these methods as well as the implications of a shift towards mobile to the field of market research. The interviewees consisted of both professionals from market research firms who use mobile methods for data collection, and those whose organizations’ create the technology used for such research. Firms that provide samples for the specific purpose of mobile research were also included in the interviews. The interviewees are listed below, and the following is an overview of the collective opinions of these industry experts.

First Name Last Name Title Company
Vivek Bhaskaran President and CEO Survey Analytics
Greg Bovitz President Bovitz Research Group
Mike Clarke VP/GM Lieberman Research Worldwide
Elaine Coleman Chief Research Officer and Co-Founder Resolve Market Research
Chris Hobson Chief Operating Officer Txteagle
Palanivel Kuppusamy Founder iPinion Surveys
Kristin Luck President, Chief Brand Egvangelist Decipher
Michael McCrary Managing Director Cint, AB
Leonard Murphy CEO BrandScan360
Ari Popper President, North America BrainJuicer
Joanne Robbibaro SVP, General Manager Lieberman Research Worldwide
Kristin Schwitzer President Qualitative Research Consultant Beacon Research
Sabine Stork Senior Partner & Owner Thinktank
Cris Sunada Senior Field Director Lieberman Research Worldwide
Jim Whaley VP & Social Media Consultant Globalpark USA

 

 

The Current State of Mobile Methods

When asked how they define mobile data collection methods, most experts mention mobile devices including smartphones, feature phones, basic cell phones as well as tablet devices. Leonard Murphy, CEO of market research firm BrandScan360, defines mobile methods as

An approach that’s optimized to engage consumers in real time at the point of their experience to give feedback on that experience via a mobile device. And a mobile device would primarily be a mobile phone or tablet.

Some of the experts did not consider tablet devices in this definition, arguing that they are too similar in size and format to laptops and desktops to be considered a separate mobile category. Kristin Luck, President of market research firm Decipher, makes an argument for tablets as a mobile research tool, explaining,

“it is different…It’s kind of like a hybrid between a mobile device and a laptop…It is inherently more portable just because of its design.”

Vivek Bhaskaran, President and CEO of software provider Survey Analytics, describes mobile as both a research-facing and consumer-facing tool, as it can be used to aid researchers in the field in addition to being a means of connecting with participants through their personal mobile devices.

In general, the interviewees noted that mobile methods have existed for a while, but in a much more basic form – mainly through SMS polling. This generally consists of sending a text message to a consumers’ mobile phone and having them reply with a numbered response option. Both Luck and Bhaskaran consider this method to have limited capabilities and a fundamentally weak consumer interaction. Mobile methods recently have taken on a much more interesting and dynamic role, thanks to an explosion in connected mobile devices with online capabilities. Although Michael McCary (Managing Director of market research firm Cint, AB) considers this method to be in  its third iteration (text being the first, web-based the second and app-based the third), he and  the other interviewees described mobile methods as emerging and in a state of exploration and experimentation.

When asked about the state of mobile methods, Jim Whaley (VP at Globalpark USA ) was careful to make a distinction between different actors involved in the methodology, including end-user clients, respondents, and market research agencies as well as those actors who provide the technology and the best practices needed to use it. Whaley’s insightful distinction between actors allows him to point out that the state of mobile methods is different depending on the point of view of the various actors. He states,

From a technology standpoint there are really no limitations at this point in time…from an agency standpoint…they still are…struggl[ing] with the idea of…their sampling methodology.

Some interviewees compared the current stage of mobile methods to the emergence of online methods. Some interviewees, such as Luck, believe people need time to catch up and get used to the idea of mobile methods before embracing them. However, Bhaskaran thinks there is actually less resistance to mobile from the market research community than there was to online methods because people do not want to be behind the trend. He states,

…I’ve been through these kinds of paradigm shifts…in 2003 and 2005 the paradigm really shifted…online…The difference that I see right now is that during that time there was enormous resistance from the entire market research community to go online…I think this time around I have not seen that much resistance…So I think that’s good news.

Palanivel Kuppusamy, Founder of mobile survey provider iPinion Surveys describes the move towards mobile as being driven by an increase in smartphone users, while Murphy describes a sort of ‘perfect storm’ of distinct elements, stating,

…Social media was this explosion in terms of the ability to get unstructured, unasked feedback…At the same time…was the smartphone revolution…So there are these two converging technology drivers that really kind of changed the equation. And at the same time, there was the recession…research became very commoditized…They all kind of converged where mobile becomes this ideal delivery system.

 

The interviewees emphasize the importance of mobile methods, explaining that they are imperative in order to combat drop-off in traditional online surveys. Luck states:

“We did a big study for a client of ours and we found that almost 40% of the people coming into the survey…were actually accessing it from their mobile device.”

Mobile is also considered an effective way to generate an increase in participation, which is currently seen as a serious problem in the field of market research. Bhaskaran explains:

“…The fundamental key…is engagement really…It’s got to be fun, it’s got to be engaging, it’s got to really be something the users want to do rather than they are forced to do.”

Mobile is considered a useful way to engage younger participants, and a shift in paradigm to a participant-centered model, in which the researcher goes to the participant, rather than the participant coming to the researcher.

A desire to stay ahead of the curve of emerging methods also is cited as an important consideration. In Bhaskaran’s words,

“We want to get a head start over everybody else…It’s better to start a little bit early than come into the party a little bit late.”

This is Part 2 of a 9 part series. The next section will be posted the week of May 30 and will explore the benefits and current uses of mobile research approaches.

Check out my 9 part series on Mobilizing Market Research in Greenbook.org. I will copy the content below as well!

Mobilizing Market Research: Part 1 of a 9 Part Series

This truly is a comprehensive review of the current state of the industry, the views of many industry thought leaders on what the future holds, and of current best practices being used. It should serve as a great resource for anyone interested in or actively engaged in utilizing mobile technologies for research-based initiatives. I think you’ll be as impressed as I was upon reading it. Enjoy!

Editors Note: Earlier this year myself and several others involved with mobile research were approached to be interviewed by Carrie Robbins, a brilliant Grad Student doing her thesis on Mobilizing Market Research: The state-of-the-art, future evolution and implications of mobile data collection methods in the field of market research. I was so impressed with the results of her work that the GreenBook and I agreed to publish her paper. Since the GreenBook is also a Co-Sponsor of the Market Research in the Mobile World Conference, it seems fitting that for the next 9 weeks as we run up to that event we’ll be posting a new section of Carrie’s report here. Registrants of the event will get access to a complete version that will be available via download. Carrie will also be attending MRMW11 and participating on one of our expert panels at the event!

This truly is a comprehensive review of the current state of the industry, the views of many industry thought leaders on what the future holds, and of current best practices being used. It should serve as a great resource for anyone interested in or actively engaged in utilizing mobile technologies for research-based initiatives. I think you’ll be as impressed as I was upon reading it. Enjoy!

By Carrie Robbins

Traditional market research methodologies, such as mall intercepts, mailed or online questionnaires, and telephone surveys have been modernized. Mobile devices now aid mall intercepts, questionnaires can be sent directly to participants’ cell phones, and mobile ‘ethnographies’ are developing, which allow researchers to collect user generated content (UGC) such as images and videos directly from participants’ mobile phones as they go about their daily lives.

There is considerable interest in mobile research methods in the field of market research. The literature and expert interviews cited in this white paper as well as upcoming conferences intended to join practitioners, academics and industry leaders to discuss the topic[1] attest to this increasing awareness of mobile. 

This white paper uncovers the state of mobile data collection methods and where they are headed, and describes the implications to the field of market research due to this shift towards mobile. Whether the interest in mobile technology indicates a revolution or merely an evolution[2] in market research methodology, there is much being written on the topic as firms consider whether and to what extent they will pursue new methods of data collection. This paper will guide such decisions and help market research firms select mobile solutions based on their unique market research needs. While I have found ample written evidence of a shift towards mobile methods, a collective overview of the many disparate reports and opinion pieces is necessary. This paper represents such an overview, offering a unique contribution to the field of market research.

1      WHY GO MOBILE?

Market research firms seem increasingly interested in pursuing mobile methods. The 2010 Globalpark industry survey predicts self-completion using mobile devices to be the fastest growing methodology in 2011, which is the first time since 2004 that the study has not predicted the web to be the fastest growing methodology (Macer & Wilson, 2011). The recently published 2011 GRIT[3] report supports this, predicting an increase in the use of mobile methods over the next year. 54% of those surveyed reported they would conduct mobile surveys, 31% would conduct mobile qualitative research and 29% would conduct mobile ethnographic research over the next year (Murphy, 2011: 26). In a predictive market exercise, mobile surveys ranked 2nd after social media analytics among emerging methods that will gain the most market share over the next year (Murphy, 2011: 28). These figures are quite promising for the future of mobile.

The benefits of mobile research are reported to be convenience for participants, improved participation rates, getting closer to the ‘moment of truth,’ reaching more of the population, obtaining faster turnaround time, capturing geolocation data, increasing accuracy of data collected, reducing costs, and allowing for more personal ways of reaching participants (Macer & Wilson, 2009b). Interestingly, the most popular benefits of mobile research have to do with increasing the quality of research and are based on the respondents’ point of view, rather than focusing on the needs of the market research firms. A respondents’ positive experience during a research project is now the main concern.

The Benefits of Mobile Research

(Macer & Wilson, 2009b: 16)

Fortunate timing as the mobile industry reaches maturity in the U.S. leads to the increased viability of mobile methods. The use of mobile phones in the U.S. continues to rise. Currently, over 90% of mobile phones are Internet ready (Decipher, 2011). In 2010 “smartphones reached 1 in 4 mobile Americans and 3G penetration crossed the 50 percent threshold, signaling the maturation of the mobile industry”  (comScore, 2011: 25). This trend allows for mobile research methods, which take advantage of this technology, to flourish. While the mobile Internet is a great way to engage with a younger audience, Forrester Research predicts that the mobile user profile will broaden and the audience will expand in the near future (Husson, 2009). At the same time, a noteworthy decline in landline use also points to mobile as the best way to reach participants (Barber, 2009)

Mobile methods are fast and efficient for the researcher. Data is entered in a digital format, allowing for easy integration with a range of electronic systems and various computer-aided analytical programs. In terms of mobile devices used to aid researchers in the field, such as tablets like the iPad, the portable nature of such devices is a definite convenience for researchers.

Mobile devices allow researchers to gather qualitative information, which simulates ethnography, in that the practitioner collects data from the participant while in his or her natural habitat rather than bringing the participant into an artificial environment to conduct research. The mobile ‘ethnography’ allows the researcher to view and understand how products and services are integrated into consumer’s daily lives and homes, without the presence of a researcher, which can influence results (Reitsma, 2009a; Stork, 2010; Schwitzer, et al. 2011).

Location or event-based surveying and self-administered ethnographic studies appear to be the most original mobile methods (Reitsma, 2009a). Mobile methods allow the researcher to collect data from a participant over the course of consecutive ‘slivers of time’ and then analyze that information to understand how consumer behavior changes or remains consistent over time. This type of data is known as ecological momentary assessment (EMA) in the field of healthcare, substance abuse studies, organizational research, and other fields (Beal and Weiss, 2003; Collins et al., 2003; Maddock, 2009). In the past this type of research may have been done in person through observation, in constructed environments, or with mall intercepts and similar methods, but the ability to capture such data while intruding less into participants’ lives and over a longer period of time increases the relevance of mobile methods. For a more extensive overview of these methods, see Appendix C (Editor’s Note: to be published at the end of the series).

Incorporating mobile methodologies can help differentiate a market research firm in a field where 94% of firms offer online services, but few have gone mobile (Confirmit, 2010). Firms should seriously consider incorporating mobile capabilities into their portfolios if they want to get ahead of emerging trends in the industry and differentiate themselves from the competition.

However, the benefits of mobile data collection are by no means unilateral. A Globalpark report found that among the challenges mobile research presents, market research firms were most discouraged by its small format which limits questions, followed by issues with access to samples, a lack of support for different devices, the complex cost structures of networks, a lack of support in software, safety, difficulty delivering SMS messages, and confidentiality (Macer & Wilson, 2009b).

The Challenges of Mobile Research

(Macer & Wilson, 2009b: 17)

Although there is still much to learn about the ins and outs of mobile research, market research firms would seem to be well advised to consider incorporating mobile methods into their toolboxes sooner rather than later. In the near future penetration levels will rise and the process behind mobile methods will become increasingly seamless and standardized. 


[1] Mobile Research Conference 2011 in London, UK April 18-19, 2011 http://www.mobileresearchconference.com/; Confirmit Community Conference in Las Vegas, Nevada May 9-11, 2011 http://www.confirmit-community.com/?source=201010_website_mr-feature-banner1; and the 2nd International conference on Market Research in the Mobile World 2011 in Atlanta Georgia July 19-20, 2011 http://www.merlien.org/upcoming-events/mobileresearch.html

[3] GreenBook Research Industry Trends

This is Part 1 of a 9 part series. The next section will be posted the week of May 23rd and will explore the views of 10 industry leaders on the mobile research space.

Follow

Get every new post delivered to your Inbox.