Players expect high quality matchmaking and ranking in today’s world of free-to-play, AAA-quality competitive multiplayer games. Engaging players with matchmaking requires correctly balancing a player’s perception of playability, fairness, latency, wait time, and other variables for each activity a game provides. Engaging players with ranking requires balancing players’ trust in the system’s accuracy, its fairness, a sense of progression, and aspiration, in addition to understanding matchmaking’s effect on ranking. Designers also need to know how to evaluate and improve both systems using data.
This course will draw from industry experience working on competitive systems for Blizzard, Call of Duty, and Halo franchises and will cover:
- How to accurately find a player’s skill for use in both matchmaking and ranking
- How to determine the best way to balance the use of skill, latency, and wait time in matchmaking
- Best practices for ranking players given different games and audiences
- Principles from state-of-the-art matchmaking and skill systems like TrueSkill 2 and TrueMatch
One-Day Course: This is a single course that takes place over one full eight-hour day with breaks.
Designers, however because of heavy overlap with related disciplines, engineers and data scientists will also find valuable takeaways.
- How to engage players using matchmaking and ranking systems
- How to maintain a positive player perception of fairness in both matchmaking and ranking
- What the state-of-the-art is in skill and matchmaking systems
- How to decide what to include in determining a player’s skill or expected performance
- How to use data to balance the use of skill, latency, and wait time in matchmaking
- How matchmaking interacts with both skill and ranking
- Best practices in modern ranking systems
- How to tune a ranking system to balance accuracy against a sense of progression
- How to tune the way a player’s rank updates at the end of a match to balance accuracy and a player’s perception of fairness
Attendees will be given the choice of two exercises to complete prior to the course to better prepare for the type of problems that matchmaking and ranking systems are designed to solve.
Josh Menke has spent the last 15+ years designing skill, matchmaking, and ranking systems, primarily for the Halo and Call of Duty franchises, as well as multiple Blizzard entertainment games. He is now working as an engagement designer on Halo Infinite, designing the flows and systems that will help players find and engage with what they will most enjoy. He is also running the Live team for Halo 5. Josh holds a PhD in Computer Science specializing in skill systems and neural networks.