Sherlock Holmes, Heuristics and the RTS Road Map: Part II

by | Nov 12, 2020

Sherlock Holmes Was Right – We Need to Become Movement Detectives

If you haven’t already, read Part I.

I have quoted Claude Benard when I give presentations on why we need to develop better assessments to test the neuromuscular capacities of athletes after ACL injury. The quote is:

“[Those] who have excessive faith in their theories or ideas are not only ill-prepared for making discoveries; they also make poor observations.”

I use this quote when speaking about the mistakes that often get made when an athlete is “cleared“ to get back to sport too early. We all want to focus on the positive, and because bias is a part of the human condition, we tend to overlook the negative. It‘s at this point that mistakes get made and we miss the deficits the athlete is hiding, even though they are sitting right in front of our eyes. In short, we have too much faith in our ideas and beliefs, we tend to think our practitioner‘s eye is accurate enough for decision making, and we roll the dice.

A close up of a persons eye

Description automatically generated

Figure 8: Experience and clinical judgement are key. But we need data to support the practitioner‘s eye.

We rarely debrief what we could have done differently or what was missing in the event of a reinjury. Instead we chalk it up to bad luck.

Let‘s take a second to ideate grandly with a look into the future.

The future with Norman the AI is that he will most likely learn to extract insights from our movement patterns to mitigate some of the pitfalls around return to sport decision making. That‘s the cool thing about machine learning; it works in a very similar way to how the human brain learns. Just how experienced practitioners probably do have an eye for picking out errant movement strategies, Norman will likely be able to extract the nuance from our movement patterns that can help find athletes who need a bit more time to train before returning to sport.

Just a heads up – Norman can already predict to within a few weeks when someone had an ACL injury. The more data he‘s fed, the better his predictions. This opens up huge potential for us because Norman can tell us whether an athlete is tracking according to expectations, behind expectations, or ahead of expectations, and he can do this based on the objectively determined information that is recorded from our everyday movements.

This will no doubt be a huge revolution in the world of physical medicine and rehabiliation.

But Norman still has some work to do.

As we discussed in the first blog post, the challenge with determining when an athlete is ready to return to sport after injury is that we are dealing with complex-adaptive systems. Complex-adpative systems can‘t be understood with a few functional tests, especially when those functional tests are performed nowhere near the inciting event for the reinjury. Remember the idea about predicting a tornado next summer from today‘s weather data? Not going to happen! 

But we still need to manage athletes returning from injury more effectively. And we can use heuristics to help manage the complexity and uncertainty that arises with complex-adaptive systems. 

Here are a few heuristics that I like to follow when it comes to managing decision making for athletes as they are returning from injury:

  1. It‘s an n=1 game so treat an athlete‘s journey back to health, sport, and performance on an individual-by-individual basis (i.e. scrap the generalized timeline approach).
  1. Come up with a functional milestone roadmap in advance that will support decision making – this is a “green means go“, “yellow means proceed with caution“, and “red means stay where you are and keep training“ approach to guide the rehabilitation process. These milestones must be measurable!
  1. If the athlete was strong to begin with, use pre-injury baseline data as a benchmark to measure progress.
  1. If this data doesn‘t exist or if the athlete was not strong to begin with, use benchmark data from a comparative group to measure progress.
  1. If we don‘t have adequate data from a comparative non-injured group, we can use the non-injured limb as a benchmark to measure progress – this is called a limb symmetry index or a limb aymmetry index. This is ok, but we need to remember an injury on one side often impacts the other side – we can find athletes who are symmetrical but weak on both sides.
  1. Remember that the process of return to health, return to sport, and return to performance after injury is non-linear – athletes may experience progressions and regressions. This means we can‘t treat the return to sport readiness test like a final exam where the athlete crams, passes the test, and then gets a high-five. Instead, we need to treat this whole process like a transitional developmental pathway and we need to monitor, monitor, monitor.
  1. Finally, we need to be like Sherlock Holmes: search for clues that can be objectively verified and start each evaluation timepoint or meeting about an athlete‘s rehabilitation plan with these clues. Lead with the evidence!
An example functional milestone roadmap tailored to each person (n=1) using symmetry, strength, and performance metrics with bookended baseline profiles (use benchmark data if there’s no initial baseline).

“It is a capital mistake to theorize before one has data. Insensibly one begins to twist facts to suit theories, instead of theories to suit facts.”

Arthur Conan Doyle, A Scandal in Bohemia

Take the quote above.

This might be another quote I should include in my presentations! This describes confirmation bias at its core.

A person holding a gun

Description automatically generated

Figure 9: Treat each injury and return to sport project like Sherlock Holmes. Search for clues.

To manage the uncertainty surrounding complex-adaptive systems like athletes returning from injury, we need objective data. I’m not trying to imply that clinical judgment and experience aren’t valuable here. They are key as well. 

Figure 10: We are constantly balancing our experience and judgment with the facts. A good rule is to be nurturing our instincts but constantly searching for facts. But when we find facts that don’t fit with our beliefs, we need to change our beliefs and not twist the facts.

But, if left unchecked, subjectivity leads us to twist facts and distort reality. Just like the quote says, starting a conversation about the return to sport readiness of an athlete without data is a capital mistake.

A picture containing table

Description automatically generated

Figure 11: We are all prone to confirmation bias. It’s a natural part of the human condition. But to avoid the regrettable cases of athletes sustaining reinjuries due to physical limitations that were trainable, we need to account for this eventuality using objective data.

Athletes can trick us into thinking they have sufficiently prepared to move onto the next functional milestone or return to sport by finding creative ways to alter their movement strategies and masking the real deficits. At worst this could make them susceptible to another injury, or at best limit their ability to get back to their pre-injury performance level.

A close up of a suitcase

Description automatically generated

Figure 12: Athletes are complex-adaptive systems and injury prevention is tough due to the complexity and the uncertainty. Rather than getting hung up on preventing an injury, let’s focus on preparing our athletes physically and mentally for the demands of sport. We will enhance performance and we might even prevent a few injuries along the way.

But what type of data do we need and how can we use data to improve our decision-making process? This is a huge challenge because many of us in the world of sport performance or rehabilitation don’t actually use objective data to make decisions. 

Again, let’s turn to Sherlock Holmes.

Think about your favourite Sherlock Holmes mystery. He showed up to the scene of the accident with his magnifying glass, fingerprint kit, and specimen jar to look for clues so that he could arrive at a plausible explanation for “who killed the butcher”.

This is sometimes called a Bayesian approach or inductive reasoning. The same process can be applied for monitoring and assessing an athlete across a functional milestone continuum as they recovery from injury. This is a great way to begin to wrangle the complexities of managing the return to sport process after injury.

Figure 11: Deductive and inductive reasoning are two ways humans can arrive at understanding the natural world. Inductive reasoning allows us to go from a set of isolated experiences to building testable hypotheses. We can use inductive reasoning in return to sport to improve return to sport management by uncovering the physical limitations that are holding the athlete back.  

The only difference is that unlike Sherlock Holmes, our measurement instruments need to target important capacities like maximal muscle strength, rate of force development (RFD), and power. They also need to target functional abilities like walking, running, jumping, change of direction movements, and, most importantly, movement ability on the field of play in a sport-specific manner. We need to use a battery of tests to find clues and we need our testing methods to be versatile. 

I often say this to friends and colleagues who contact me for advice on using dual force plate systems to capture force-time asymmetries in jumping – it’s a great tool, but don’t hang your hat on one or two tests! 

We need a test battery and we need a functional milestone roadmap.

This is where Plantiga addresses a very important gap. We can measure capacities like lower body maximal muscle power, running speed, walking speed, and vertical jump height. We can measure movement abilities like stride length, stride variability, ground contact time, and limb speed in walking and running. And we can take the system onto the field, court, snow, or ice to measure movements in a real-world environment, where they likely matter most. We can also move from a single discrete timepoint of testing to a ubiquitous monitoring system that flags potential problems before they have disastrous consequences, like a full-blown reinjury.

Dr Matt Jordan
Dr Matt Jordan PhD

My name is Matt Jordan. My PhD is in Medical Science. I’m an applied sport scientist working with elite athletes. Head to my website: www.jordanstrength.com

Applications webinar Nov. 27, 12-1 PST.
Find out how Plantiga can be used for
health + wellness and sport + performance.

Share This