by Elizabeth Kormesser
With any scenario there will be unforeseen changes that will impact a project. A key to success in project management lies in planning and mitigation of risks. In international projects, these are five techniques in order to ensure a successful project.
- Understand the Cultural Norms of the Countries
Before you begin a new project, it is important to understand the cultural norms of the region and city. Across global markets, there are certain idiosyncrasies that are critical to project success. A moderator from Spain may likely have a different vocabulary from one in Mexico. If you ask someone in Australia where the nearest parade is, they would direct you to a street, not necessarily a social event. I recommend spending a few moments before kickoff getting acquainted to the political climate, socio-economic considerations, geographic concerns, and holidays.
- Strengthen Your Partnerships in that Region
The best asset to ensure a successful project in a specific region is your partnerships. Having more than one trusted partner in each region will help provide the insight into specific cultural considerations, neighborhoods, pricing, and best practices. For example, for a study in Mexico a partner would provide insight into concerns about mobile data usage, and purchase of SIM cards in that area. Excellent communication, collaboration, and feedback are the key to a successful and strong partnership, both internationally and locally.
- Prepare Ahead for Technical Challenges
Each region has its own technological considerations, which may affect the success of a project. Certain countries have firewalls to prevent transmission of data or specific websites. Others may have a focus on mobile phone usage, and you may find it difficult to find a user with a PC. In this process, it’s important to review any potential roadblocks in technology, and address those in advance, or set appropriate expectations of the tech availability. Knowing ahead of time what things you have to adjust for, whether it be internet connectivity, use of specific tools, or local devices, are critical in order to have an international study go off without a hitch.
- Set Realistic Expectations with Stakeholders
I’d say this is one of the more challenging aspects of international projects. It’s both exciting and challenging to work with teams across the world. In our technical environment, the remote stakeholders love the idea of being able to be in the moment 10,000 miles away. As we strive to deliver this level of service, it can be a challenge in some areas where the world of high-speed Wi-Fi is not a reality. One key component of an international study is being transparent with the stakeholders about what is realistic in different markets.
- Focus on Successful Communication
If you have seen one theme around all of the tips above, they all involve successful communication. Communicating clearly and professionally with your colleagues, partners and stakeholders is essential. In international projects, there are so many moving pieces. Allowing information to slip, or failing to provide an important detail can lead to disaster if not addressed immediately. As an agilest, I personally like to check in with my team on a daily basis to ensure that any updates are communicated clearly to all parties.
Global Research pros from Groupon, eBay, Google and Key Lime Interactive were seated on a panel at the International UXPA Conference event in San Diego in late June. They came together to share their words of wisdom for successful global user testing endeavors.
Their theme: Make it a priority to plan ahead AND be culturally sensitive/aware.
Infinite perspectives are available around the globe, spanning multiple languages, habits, patterns, cultural priorities, etiquette and more. The requirement to meet the needs of a diverse audience is clear, and with that comes diversity of your recruited panel. In a recent study that spanned four continents, Key Lime’s Eugenio Santiago, VP of User Research, noticed that the stakeholders in the research weren’t aware of the relevant needs of each country when they outlined their vision of a successful project. “That’s my job.” Eugenio stated. “I have to make sure that all of the nuances that organically associate with a culture are considered from the early stages of research design. I need to rely on strong in-country partnerships to bring the surface any minute detail that I may have overlooked.”
Key Lime leverages their UX Fellows global partnership for this. With a mission to make “international user experience and usability testing as easy and professional as domestic studies,” there are checklists in place to ensure success. Simple things ranging from proper power requirements, to considering the time of day you’re asking users to test, to understanding pace punctuality; customary greetings are all to be part of a successful testing experience.
Other panelists stressed the importance of building in time for debriefs and dialogue with all parties involved solidifies strong findings and reporting. The in-country perspective is invaluable when reporting user satisfaction.
When speaking with the audience, it was clear that international work was on the rise. Much of the feedback was that folks were already testing in a global setting, or in the process of preparing themselves for this leap. They happily walked away with what was the start of their own actionable checklist of considerations to be successful testing around the world. A few points to get you started as you build your own list:
Consider Cultural Elements:
This goes beyond language. Customary greetings, pace, punctuality, and etiquette should be considered. For example: One panelist reported that during their first global foray they planned to field a study that investigated the way users interacted with a product in their homes in India. They created a study plan that included six thirty-minute home visits in a day, and presented it to their Indian Research Partner. He took one look and said “Oh no. Not possible.” Why? Because traffic wasn’t being considered. It was assumed that 50% of the day would be spent getting around, so three in a day was pushing it. Adjustments were made in advance vs. sweating it out; rearranging on the fly and failing to meet the schedule.
Consider Technological Capabilities and Be Prepared:
“You may run this exact study 355 days a year in NYC, but when you endeavor to replicate in a different country outside of the US on that one day, you can’t take the ‘little things’ for granted”, says Santiago. Wifi, power, keyboard setup, and a host of other things need to be considered. To overcome unforeseen challenges, the panelists advise to stay on the side of caution. “Backup web connectivity options if the facility can’t provide what you need.” Of course, there are times when that connectivity needs to be considered as PART of the test, but we need to do our best as researchers to isolate the technological variable to best influence design.”
Have a Contingency Plan:
Eugene opened with a funny story about an awkward time when he experienced an in-country moderator and a client bang heads mid study. “My observation, even as a non-native speaker, was that these two had opposing viewpoints of the way this research was to go down, and they were making it known. By the end of the day I had to make significant changes to satisfy the client.” He had done his homework and let two other facilities and two other moderators know that Key Lime was in town testing, and that he may need their help if he runs into a pickle. That simple notification gave him an option to make a moderator change for the remainder of the study.
Popular tweets during the talk #globalresearchpanel:
“Aha moment tips for global studies. Don’t forget your international power converters.”
“Schedule downtime to research when fielding for long 2-week periods.”
“Eugenio shares the importance of multi-tasking and using our partnership with @UX Fellows for global reach.”
“@Google is experimenting with a new approach to shorten the study time since stakeholders want answers now.”
“@eBay speaking about importance of translation and the challenge of emotional measures.”
More from the panel:
With 5+ years of experience in the field at eBay Inc. for most of her tenure and now at Groupon, Anosha has a deep understanding of the international e-commerce landscape that spans across developed and emerging markets.
Donna Tedesco is a Senior User Experience Researcher at eBay Inc. She has experience using moderated and unmoderated studies for global research while working for in-house research teams over the last 13 years.
Chelsey is a user experience researcher whose skills have impacted a wide variety of enterprise and consumer technologies at diverse companies including Google, Salesforce, Udacity and T-mobile. Motivated to help others avoid her early UX career mistakes, she often writes and gives talks on the topic of UX Careers.
Sin Lee Loh
Sin Lee Loh is a user experience researcher at eBay, currently focused on buyer experiences but previously focused on conducting research in Latin America and Russia. Sin most recently conducted ethnographic research in Brazil.
Key Lime Interactive
Eugenio Santiago is a ninja in user experience research helping the world’s most admired brands optimize their digital and product experiences. As Vice President of User Research, he manages the team of both qualitative and quantitative researchers. Eugenio has been recognized by clients for his ability to quickly spot patterns and provide actionable recommendations. Most recently, Eugenio’s focus has been in the areas of Mobile, Finance, and Retail while still maintaining a passion for sports and gaming.