THE CHALLENGE

Mobile gaming experiences must be seamless in order to maintain an engaged user base; bad user experiences mean lost revenue. Jam City’s games must provide exceptional user experiences as soon as they are deployed. However, testing the users’ experience in diverse locations around the world proved to be a large challenge.

 

  • Not all regions are the same

Diverse regions like Malaysia and Egypt offer unique challenges to building a consistent user experience. Tests conducted on flagship phones inside of Jam City’s US headquarters offer little insight about real-life game performance on slower networks elsewhere in the world using lower-tier phones.
 
  • Testing carrier billing flows

In order to make the user’s experience is as seamless as possible, many in-app purchases (such as purchasing more lives or unlocking another level) are charged to the user’s wireless bill. To ensure that these billing flows are seamless, these tests must be conducted on the carrier’s actual networks.
 
  • Simulations ≠ real life

Emulators and simulators testing on wifi networks didn’t accurately depict actual user experiences in other parts of the world, where devices are often running on 3G (or even 2G) networks.
 
  • Testing via contractors proved to be ineffective

Jam City attempted to utilize contractors to test user experience in regions where games were being deployed — but this strategy created more headaches. Managing testors in different time zones created a huge amount of extra work. Jam City needed actionable insights that could be gained in real time.
 

THE SOLUTION

HeadSpin provides Jam City with an innovative testing platform that lets the company improve user experience around the world.

HeadSpin devices are deployed in locations around the world to perform user experience testing for Jam City's mobile games. Tests are conducted on various networks using real Apple, Samsung and Google Pixel devices.

 

Test on real networks, using real devices

With 22,000 real, SIM-card equipped devices in more than 150 locations globally, HeadSpin allows Jam City to test real-life performance of their apps anywhere in the world. Jam City no longer has to rely on simulations or tests conducted in another part of the world to determine whether an game will work. When Jam City wants to deploy a game into a new region, they can do so with confidence that their app has been tested and will work seamlessly.

 

Detailed understanding of performance

Rather than relinquishing power to a group of third party test contractors, HeadSpin gives Jam City engineers the ability to conduct real-time tests themselves. HeadSpin allows Jam City to obtain a thorough real world understanding of their app performance, so they can diagnose performance and customer experience issues of critical user flows, easily reproduce bugs with visibility into specific background issues causing the bugs and identify the highest priority issues to fix — whether its with server, CDN, network, device, or application.

 

Seeing is believing

HeadSpin provides Jam City engineers with a powerful one-two punch. In addition to detailed logs and critical insights about issues, HeadSpin provides recorded UX sessions to help engineers understand aspects of the user’s experience that might be difficult to quantify.

 

Improved user experience, improved revenue stream

For in app purchases, HeadSpin allowed Jam City to make changes that allowed in-app purchases to work correctly — charging them directly to the user’s carrier bill. Prior to HeadSpin, testing these transactions on Orange’s network in Egypt and Ex-Telecom’s network in Malaysia relied on problematic SDK integrations. HeadSpin’s simple, intuitive platform allowed Jam City to perform this crucial testing — which ultimately lead to a more streamlined purchase experience for the user (and additional revenue for Jam City)

Get started with HeadSpin

Free Demo
Learn More