Case Study

CBS Fantasy Baseball App

As an avid baseball fan and stat geek, I naturally gravitated towards fantasy baseball. I love the league I play in and the managers that I compete against. There’s only one small problem with the league and that is the app we depend on throughout the 162-game season is lackluster.

KEY GOAL

Improve the experience of the CBS Fantasy Baseball App by revamping its user flow.

TASKS

User Research, User Flow, Wireframing, Prototyping, User Testing, Visual Design

so What is Fantasy Baseball?
Fantasy baseball is an online game where participants assemble virtual teams of real players from Major League Baseball. These virtual teams compete based on the statistical performance of those players in regular season games. This performance is converted into points that are compiled and totaled according to a roster selected by each fantasy team’s manager.
1
IN MY Opinion
The Good & Bad

Some very common tasks are annoyingly inefficient in this app. Important pages are buried within subpages, while quite a few actions require too many clicks to get from point A to point B. The side menu acting as the app’s primary navigation counterintuitive.

Pro's
  • It has all the functionality a fantasy baseball app should have
  • Extensive league news resources
  • Abundance of CBS-generated Major League Baseball news
  • The app is not a dumbed-down adaptation of its desktop counterpart
Cons
  • Some very important pages are hidden
  • Too much CBS-generated content on the homepage
  • Within navigation, too many confusing page titles (i.e.: What’s the difference between Scoreboard and Standings?)
2
User Research
What Does Everyone Think?

To get an idea of what other seasoned fantasy players thought about the app, I interviewed 2 groups of users:

The Informed:
5 managers in my league
We had free-flowing conversations revolving around these 2 questions:
  • Most important aspects of a fantasy site?
  • Strength and weaknesses of the app?
The Uninformed:
5 fantasy player who've never used the app
Video recorded a usability test in which the participants are encouraged to talk thru their thought process when doing the tasks. I posed 3 tasks and followed that up with 1 question:
  • Objective #1: Substitute a player for next the upcoming week’s set of games
  • Objective #2: Check Roto Standings and choose a team to make a trade with (for more details, see here)
  • Discuss Pro’s and Con’s of the app
Key Insights
2X2 Matrix: The Informed group was able to show me the app’s most and least important pages. The Uninformed group were able to show me how accessible these pages are.
Insights from the Informed:
  • There is no home base; the home screen lacks the functionality generally associated with an app that features so much interactivity.
  • The reliance on the side menu is cumbersome.
The Informed proclaimed these the 3 most important pages of a baseball fantasy app:
  • My Team
  • Home
  • Scores
The Uninformed provided valuable information regarding the brand new user:
  • It took a number of tries before any of the users could figure out that the hamburger side menu was the main way to navigate the league.
  • Major confusion between Standings and Scoreboard. 0/5 were able to find Roto Rankings.
  • Uncertainty in how to view other team’s lineups. Given the choices in the side menu, there were no clear cues.
  • Users were looking for more out of the homepage. Tabs and content could have been used for more team relevent information.
  • Too many extra taps to find essential information.
3
User Research
Define the Problem

The app does not prioritize some of the most important features fantasy managers most rely on. An inefficient navigation pattern and redundancies throughout the app make for a convoluted user experience.

Painpoint #1:

A Homepage That Lacks Engagement

Ideally, the Home should act as a place where the most important features of the app can be accessed. Instead, many of the app’s useful features are hidden within the hamburger menu.

Painpoint #2:

You Need a Good Memory

The app’s lack of hierarchical structure makes it difficult to find what you’re looking for. Whether in Home’s tabs or the sidebar’s list, there are too many choices to comb through for a new user to have a seamless user experience.

3
User Research
Define the
Problem

The app does not prioritize some of the most important features fantasy managers most rely on. An inefficient navigation pattern and redundancies throughout the app make for a convoluted user experience.

Painpoint #1:

A Homepage That Lacks Engagement

Ideally, the Home should act as a place where the most important features of the app can be accessed. Instead, many of the app’s useful features are hidden within the hamburger menu.

Painpoint #2:

You Need a Good Memory

The app’s lack of hierarchical structure makes it difficult to find what you’re looking for. Whether in Home’s tabs or the sidebar’s list, there are too many choices to comb through for a new user to have a seamless user experience.

Not only are there a lot of links to choose from, but a major problem is there are too many confusing titles to decipher. Below are 3 pairs of examples that contain similar content. UX is hindered by titles and links that lack clarity.
Please see below for more in-depth analysis.
4
The Solution
The App Update

Home Dashboard

The web version of the platform’s Home provides a navigational hierarchy to follow:

The objective of updating Home is to provide a snapshot of the leagues most up-to-date activity while intuitively providing access to the platforms most sought after content.  

Drop Standings, Highlight Team Rankings

Live Boxscore is found in My Team

Screens

5
Conclusion
Improved Task Flow

To get an idea of the effectiveness of the new changes, the Uninformed users retested Objective #2 with the updated version. Informed users try Objective #2 for the first time. Both groups are interviewed after taking finishing test.

Task: Check comprehensive standing and find a team to make a trade with
Objectives: 1) View Comprehensive Standing to see where my team is lacking 2) Find a team to trade with 3) Propose trade

Current CBS App (Initial Test)
Findings:
  • In the 4 minute time limit I gave each user, only 1 of the 5 finished the task. 2 of the users were unable to complete the first objective of finding the Roto Standings page. 
  • Of the 2 users who were able to complete the task, neither performed the tasks efficiently. It required both users to "try things out" in order to find what they were looking for.
  • One of the successful users completed the task in 2:45 while the other finished just under the wire at 3:53. 
  • The major sticking point was getting to the Roto Rankings page. All of the users looked to Standings first.
  • Only one user immediately looked to the hamburger menu for answers.
CBS App Update (Three Weeks Later)
Findings:
  • Much fewer steps necessary to complete task
  • All users were able to complete tasks in under 2 minutes
  • Taking all of the league-related links out of the hamburger menu was helpful.
  • Anchored tab bars for league-related links greatly improved the users' chances of finding what they were looking for.