Skip to content

Instantly share code, notes, and snippets.

@HeliosInteractive
Created December 6, 2013 18:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save HeliosInteractive/7829375 to your computer and use it in GitHub Desktop.
Save HeliosInteractive/7829375 to your computer and use it in GitHub Desktop.
EventTech 2013 - Analyze, Synthesize, Maximize: Measuring Digital Experiences Ben McChesney Full Speaker Notes
Slide 2
My educational background is in design, development and economics.
My role at Helios is the strategic outlook and the establishment of our processes to become more effective and more efficient.
Slide 3
Our core competencies at Helios include retail , tradeshows , events, and permanent installations
We use a variety of technologies including touch , gesture, AR, and mobile platforms.
Slide 4
Where we differ from other small studios is that we do not create interactive art projects. Is it justifiable to create things that are just new and cool ? Why should clients work with us if we cannot measure how successful an event is ?
Like most of you in the audience we are working in many different environments. Where analytics start to get tricky is that we are not laser focused on single medium such as : digital signage, mobile applications, or microsites. So our metrics approach has to span across many different types of deployments.
Slide 5
We work with a wide variety of industries and a wide varieties of clients. Our methodologies apply across the board.
Slide 6
There’s quite a few approaches for what we are trying to achieve : better products. INFLUENCED BY THESE
Jeffery Liker. MAIN PRINCIPLES OF : continuous small improvements and small controllable batch sizes.
The Lean startup by Eric Reas APPLIED THESE TO STARTUPS AND SOFTWARE PRODUCT DEVELOPMENT.
Lean Analytics is MORE GRANULAR. as Key Performance Indicators and specifically the data side of building a better business.
Nate Silver is most known for his work as NY Times Elections Prognosticator and his work with statistics at ESPN. He’s one of the most recognized faces in statistics and his work merits looking at.
Anyone interested in these sort of topics on data or analytics read these books their really interesting for their perspective.
Slide 7
BIG DATA , easy to get distracted from the data is telling.
We can measure almost anything measure but it’s important to measure what matters.
Slide 8
What are your goals ? And what does success looks like ?
this will involve a little bit of assumption and risk but without a yardstick for success numbers are less helpful.
Sound simple but is it ?
Slide 9
Quantitative data = numbers / spreadsheet.
Qualitative data = observational / feedback.
Slide 10
Vanity Metrics – CURRENT PROGRESS, big numbers, make you look good.
Actionable Metrics – guides future decisions. These are what will improve your experience.
If you are unsure – ask yourself : “How does this data change what we are doing?” If it doesn’t , or causes a panic : It’s a Vanity Metrics.
Slide 11
Create a memorable experience with the maximum amount of fans
Slide 12
We measured how many people created photos, how many had an intent to share, and how long on average it took people.
Slide 13
Contest Element and Prize Giveaways
Experience took too long.
Next steps - improve the overall length of the experience and have a higher throughput.
Share station time is far to high, should be about 50% of experience time to prevent congestion
Slide 14
StubHub asked us to engage with their fans and create a multifaceted kiosk with a few different experiences.
Slide 15
DATA allowed pinpoint problem
Improved internet, UX , more robust printer. Cutting the time in half because of the data we had.
Slide 16
Video wall with Stubhub Mascot and instagram NEAR side entrance. Annonymous face tracking used in digital signage.
More development can let you know which content has the greatest reach.
Are these numbers good ? We’re not quite sure. We’re establishing context to improve the experience in the future.
Slide 17
Activation was a success by focusing on the fans.
Next steps – measure social media reach and the mascot interactions.
Slide 18
Very secretive industry, client placed touch kiosks outside their booth.
Slide 19
Qualitative + Quantitative data.
1 ) Engagement with the app was VERY LOW,
2 ) Users stuck in the radial menu
3 ) Product groups with the highest quality content had the best numbers.
Slide 20
The Enterprise and tradeshow relationship is very different from fan and sports event one.
We created a more inviting attract loop.
The app was simply too busy
Test and improve across a few events
Slide 21
There are many different ways to measure and it really depends on context. You should know going into your event.
If your event is purely promotional for one week, it’s going to be really tough to gather enough data to see trends to improve it. The more iterations the more experimenting and using data can improve the event.
Even if you are unsure how to use this data right now, it’s important to collect to use as contextual samples in the future.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment