As Sabermetrics progress, stats become more accurate and cover more ground. Recently some of the best out there have been turning their attention to defense.
Usually when people talk about defense, they like to phrase it in the following format:
Player X is (an all-star, above average, an asset, terrible) because his defense is worth (exactly the amount of runs it would take to prove the point in question), didn’t you see (one random play in a sample of hundreds that is indisputable evidence of player x’s greatness/deficiency). It’s an exercise in selective memory and egregious misuse of numbers
Recently, a few people have begun to think that defense is the next OBP. As it becomes more and more quantifiable people say that it is the most undervalued stat around. Defense is a skill that contributes to a team’s success. Not quantifying it into an evaluation of a player is foolish if there is a way to quantify it. Luckily, there is.
But how much is defense worth????
As the Mariners found out, on a team basis this is very valuable, on an individual basis, it is still worth a good amount. The Bill James Fielding Bible lists all players on a plus/minus scale. The info is compiled by Baseball Info Solutions. They describe the methodology on the site, but it appears that each play is painstakingly reviewed, and all plays a player makes that at least 1 player missed is worth +1, all plays a player misses that at least one player made is worth -1. While objective, this has been hailed as the best system ever, as a masterpiece, I’d say it really adresses the problem with things like zone rating and would say this is one of the best systems available now. The +/- system does what many people would say is ideal the way to evaluate defense, but wouldn’t even dream of investing the time to actually compile. Overall, a play is valued as slightly less than half of a run (no explicit formula stated). So what does it say???
At every position there are a few guys worth at least a win over the average defender. Albert Pujols (+37 plays) is worth about 17 runs, or 1.7 wins just with is glove. Derek Jeter (-34) is at -15 runs. (I use +/-*.45 and round). For a majority of players the results are pretty small.
Mariners players in the top 10 or bottom 5 at their positions
Player +/- approx. runs
Richie Sexson -15 -7
Adrian Beltre +7 +3
Raul Ibanez -23 -10
Ichiro! +4 2
All players are not listed (only the top 10 and bottom 5), but it is pretty safe to assume that all other players are worth between -2 and +2 runs, and at that level I wouldn’t feel confident saying a player was below or above average. Next time you compare Ibanez to the average player, subtract 10 runs, his defense cost the team a win. His Base Runs Above Average rated him at 32 runs; you can factor his defense down to 22 runs above average. Still a good player, but that difference is quite a few OPS points.
Can it be used?
Defense matters. There is likely to be improvements as with all stats, but the numbers at the fielding bible site are pretty good numbers to apply to players, and I would have no problem using them. It should be noted that the baseline is a .500 defender, while replacement level is I believe in the .350 range, so combination with VORP is not applicable, only metrics against the average player. I think defense can be used as an advantage in roster construction, like OBP was. OBP wasn’t used to figure out that Albert Pujols was a good player; it was used to discover Scott Hattebergs. It is possible that some team could garner an advantage this way. Suppose you have two guys, one is +10 runs with his bat and average with his glove, the other is average with his bat and +10 with his glove. Both players would rate as equal in your system, but the first player is going to be more expensive, and even if he was rated slightly higher, the salary difference would likely make the second player a much more money-efficient choice. As defensive metrics improve and more and more teams jump on the bandwagon, it is likely that teams will in fact add accurate defensive numbers like these to their ratings. As with OBP, the first teams to do so will a) run the risk of this whole thing being bologna and blowing up in their face and b) run the risk that they will have more accurate rating systems and will find many players at salaries that are much lower than their values and reap the advantages while other teams catch up.
1. I am willing to say that BIS’ ultra-thorough method of looking at every single play is good enough for me to consider this a good start, and I am willing to say you can put a run value to defense and that this is a pretty close approximation.
2. As with all statistics, more data is good, using 3-year aggregate data is going to be a better way to evaluate a defender, unless you have reason to believe (injury, age decline) that he is not the same defender.
3. If defense is quantifiable, and I believe it is, than teams that incorporate defense into their player evaluation methods, whether on data from BIS or their own, stand to take a competitive advantage over the teams that do not.