This article was originally posted on FanGraphs: http://www.fangraphs.com/community/revisiting-the-stuff-metric/
This article was co-authored by Daanish Mulla – @DanMMulla
Last month, we wrote an article on calculating a pitcher’s “stuff”. We were quite pleased with how our equation performed with respect to predicting a pitcher’s strikeout rate and his xFIP. Part of the discussion surrounding the equation was what exactly is stuff? Well, in our case, stuff can be thought of as a three-dimensional shape, where the three axes of the shape represent a pitcher’s peak velocity, a pitcher’s change in velocity between their fastest and slowest pitch, and the amount of distance that their pitches can break. In other words, it aims to represent the range in pitch velocity and movement batters must account for during any given at-bat against a particular pitcher.
However, there was still some room for improvement, and with help from the FanGraphs community, we’ve slightly modified our equation to improve various performance predictions. The first major change came from comparing faster breaking balls versus slower breaking pitches with greater movement. In our original stuff metric, pitchers with a slow, looping breaking ball received more benefit than pitchers throwing a fast breaking ball. I queried the PitchF/x database to see how swinging strike rates and batting average changed against curveballs with respect to pitch speed during the 2014 season. Pitches that were thrown for at least 1% of all pitches were included in this analysis. As you can see in the figure, swinging-strike percentage increases exponentially after 75mph, and is nearly 15% higher at 85mph than at 75mph. This encouraged us to find a better way to account for faster breaking balls.
Secondly, the original metric did not account for pitch frequency. The Pitch Arsenal metric was improved from it’s original state by accounting for this, and realistically – a pitcher should be given more credit for a great pitch that they throw frequently, as opposed to a great pitch that they rarely throw. To account for this, pitches were classified as either off-speed/breaking or fastballs. The sum of pitch uses for each of these classifications was then used to modify the values in the equation. With that in mind, here’s how we have proposed to modify the stuff equation.
For a pitch to be included in the analysis, it had to be thrown by the pitcher 100 times. Just like the original stuff equation, z-scores were determined for the fastest pitch the pitcher threw, and for the amount of movement that could be seen with respect to that fastball, from the remaining pitches. For further analysis, only qualified starters were used (those who threw 162 innings in the 2015 season).
Furthermore, z-scores were also determined for the % change in speed between the pitcher’s fastest and slowest pitch. Another z-score was determined for the velocity of the fastest pitch, between curveball, slider, or knuckle-curve. Frequencies were determined for the proportion of fastballs thrown by a pitcher, and the remaining non-fastball pitches. The z-score for velocity was multiplied by the fastball percentage, and the remaining z-scores were multiplied by the non-fastball frequency. The z-scores for peak velocity of breaking pitch and change in velocity were used to determine “pitch strategy” – either, power breaking ball, or change in speed. Whichever z-score was greater, was used in the final stuff equation.
So, the final “stuff” equation is as follows:
To begin validation of the equation, the stuff value was then correlated with K/9 for all qualifying starters. This resulted in a predicted R value of 0.53 (figure 2), compared to the value of 0.42 from the original stuff equation.
We’ve since applied the stuff equation to all pitchers from 2007 to 2015 to try and get an idea of the range of the metric. Here’s what we found. For interpretation of this figure, if a pitcher has a stuff value of 0.90, his stuff is better than 75% of all pitchers since 2007. If the value is 2.0, they have stuff that is better than approximately 99% of all pitchers since 2007. To put that in perspective, that means their stuff is better than nearly 4000 other starting pitchers. You’ll notice that in our list of the top 30 pitchers from 2015 – all of these pitchers fall within the top 15% range of stuff. These are elite pitchers with respect to this metric.
These data have a wealth of applications, such as how a pitcher returns from injury or has even changed his repertoire between years. For example, the jump Chris Bassitt made from 2014 to 2015 – going from someone in the bottom half of the metric to the 99th %ile. Similar to the Arsenal score, there is an application of these data in determining a pitcher on the verge of a breakout (perhaps the Joe Kelly of the second half of 2015 is the real Joe Kelly).
However, we felt that it would be in our best interest to let the community decide just how useful the metric was, so we’re making our evaluation data from 2007 to 2015 available in the form of a Google sheet. Simply select the pitcher you’d like to evaluate, and their stuff scores and xFIPs will be graphed for you. We’ve also posted the entirety of stuff scores from the 2015 season.
2015 Season
https://docs.google.com/spreadsheets/d/1picxCRD1OWpaeDq2H8uxC7jyR6fH7fpj5gOZjQGWsu4/pubhtml
Stuff worksheet
https://docs.google.com/spreadsheets/d/1PU3u3sJpr_jv70VAJIlyXnvOh4pq56l7eXuo70Py81Y/edit?usp=sharing
Philosophically, we feel that the stuff metric has a great benefit for advanced scouting, because it relies on measures that are solely dependent on the pitcher, and not an interaction of the pitcher and the hitter. Thanks to the FanGraphs community, r/baseball, and Eno Sarris for all of the support with this project.
0 Comments
3 Pingbacks