Spring 2023, Design Jam

Fansense - Enhancing Performance Outcomes for Performing Artists

Overview

For the Strategic Foresight course (sixth semester, Spring 2024), our class was split into teams and participated in a design jam centred on the idea of “ideating for the future of different industries”.

My team created a product that helps artists understand audience reception of their performances through facial recognition and artificial intelligence (AI).

Roles

  • Research

  • Ideation


  • Lo-fi Design

  • Presentation

Tools

  • Figma

  • Miro

Team

  • Takwah Ahmad

  • Shavar Blackwood

  • Louis Lu

  • Sarah Park

  • Nikki Policarpio

    Yeojin Yoo

Problem Statement

Entertainment has always hinged on the artists’ reputation amongst people; with the prevalence of social media, it is more important than ever to make music performances memorable, positive and enjoyable for fans.

How can we use emerging technologies to help performers understand their audience’s reception of their performances in extensive detail?

Background

Live music inhabits a substantial place in modern entertainment, and has evolved with new technological advancements.

But, the vital importance of audience reception has always stayed the same. With countless ways to entertain yourself and the unpredictability of the industry, how do you keep people coming back for more?

Understanding your audience

A key aspect to making a live performance successful is to understand what your audience wants, whether its a beloved song, nice visuals or interaction.

I did preliminary research on what people regard as a "good live music performance" through Facebook, Twitter and Reddit.

Solution Overview

1

Database of Recorded Performances

Users can look through an organized list of recorded performances and choose the one they'd like to see in more detail.

2

Comprehensive Live Performance Report

Users can view results extrapolated from scans from the audience, through either text or data visualization.

3

Chatbot Feature

The chatbot answers a range of questions regarding the report, troubleshoots common issues and performs processes for the user, such as exporting the report or sending it to other virtual channels.

PESTLE Analysis

Understanding the current landscape of entertainment

Our group decided on the entertainment industry as our vertical - we all had a collective interest in different forms of media, and felt that there were many opportunities for exploration due to the pandemic and emerging technologies. We conducted a PESTLE analysis to understand the landscape of the industry.

Across the PESTLE factors, we felt like the music industry had the most relevancy. Along with our own personal and professional passions in music, we narrowed our choice to the music industry.

Scenario Planning

Beginning the ideation stage through broad explorations

Each group member created three scenarios of what the future of the music industry would look like -- two plausible scenarios, and one “wild card" scenario. Here are my scenarios.

Many scenarios tackled the live music aspect of the music industry (i.e. im, so we continued to delve into this line of ideation.

Trend Clustering

Grouping similar concepts and creating intersections

We then grouped them into wider categories called “clusters”, or groups that have overlapping themes. Afterwards, we thought about which categories could intersect with each other in the future, and grouped them together (visually, we displayed that through circling them).

We believed the most compelling intersection was the group consisting of AI, data collection and the future of in-person concerts; as a team, we were already envisioning a future where emerging technologies could bridge the gap between audiences and musical artists.

Axial Analysis

User needs and feasibility

From there, we synthesized this cluster (AI, data collection and the future of in-person concerts) into concepts we’d like to explore, and plotted them on an axial chart. Our goal was to find an idea that had high benefit for users and a high feasibility with today's technology.

We decided to combine the three most valuable ideas into a product that provides performers with data on audience reception -- facial expressions, reactions and presumed emotions -- through camera recordings during the event.

Persona

Focusing on our user

We needed to understand the needs, pain points and motivations of our target users, who were musical artists and their teams. We created a persona for Doja Cat, a popular performing artist.

User Flows

How would the product serve users?

After we had solidified a concept, we sought to make it tangible. We knew we wanted a data visualizations and recommendations (outcomes), but we needed to balance the need to make the information extensive and useful, with the incomprehensibility that comes with overly-complicated designs.

Key design choices

We approached the design with quick and easy comprehensibility in mind. Artists and their teams often have packed schedules, especially around the times they’re touring/performing.

Clear, easy-to-skim Dashboard and Results page

Users have two ways they can read performance analytics: through text or data visualizations

AI Chatbot

Accounts for user needs that deviate from the analytics, such as exporting files

Glossary of Terms

Users who are unsure about the definitions of terms like "Audio engagement" can use the Glossary located on the left-hand side

Lo-Fi Prototype

Reflection

What we did well, and what we could improve upon in the future

Although our product lacks in deep exploration and detail, the goal of the assignment was to create a concept that reflected future trends and execute a prototype in a short time period, which we achieved. I believe that a tool like this would be really useful to musical artists, especially given our current culture in recording and scrutinizing their live performances. This would be a valuable tool in gauging audience reception.

I think we neglected thinking about the privacy concerns this software would raise; if FanSense is based on the assumption that everyone in the audience will be recorded, this could breach their right to anonymity. More research into how data can be collected whilst keeping people's’ privacy intact, and how consent can be obtained ethically, would be great benchmarks in further research. 


More iteration would be needed for FanSense to become a viable product, but from a personal standpoint, this project was valuable to my team and I because it reinforced the value of design jams and similar, quick design sessions.