Okay, so we’ve already done two posts looking at OOTP leagues filled with clones of two players: Slappy Slapstick and Sluggish Slugger. One showed that Sluggish, the low BA guy with sexy power, got walloped head to head by Slappy, the unsexy high BA no power guy. The second showed the same in an MLB environment, but only when Slappy and Sluggish both had OPS high above the league average. Sluggish was better in the MLB environment when both had league average OPS.

These sims showed the limitations of OPS – the first big sabermetric stat to make its way into national telecasts – certainly lacks somewhat in being a robust stat to value all players. Being an arbitrary stat simply combining OBP with SLG it’s not surprising that it lacks robustness. So we went looking for something that might work better.

So we turned to wOBA (weighted On-Base Average). This stat, created by Tom Tango, is based on the common sense premise that all hits are not created equal. The stat uses aggregate league totals to weight the value of each method of getting on base (a good description of wOBA and how it is calculated can be found at FanGraphs).

Unfortunately, OOTP does not deal with wOBA, so transferring this to the Slappy/Sluggish universe took a little bit of work. First, we ran one season with Slappy and Sluggish and calculated the weights for wOBA using league totals, and modified the abilities of Slappy and Sluggish to make them equivalent in wOBA and equal to the wOBA from the previous season. This, by the way, gave a rather sizable advantage in OPS to the Sluggers (.887 to .799). Their attributes stats predicted a line for the Slappy’s of .347/.452/.799 with no HR. The Sluggers were designed to go .253/.303/.887 with 42 HR.

Then we set them loose on 5 seasons – after each season we restored the league back so as not to mess with the weights for wOBA which change from year to year.

In this universe, the results were much closer. Teams made up of Slappy’s won an average of 85 games a year with teams made up of Sluggish Slugger’s won an average of 77. While this still might seem an advantage for the Slappy’s, you have to keep in mind we took two very extreme players – the Slappy’s were give the lowest possible rating (1) for gap and power attributes. Teams made up of Slappy’s never hit more than 2 home runs in any single season (and while I didn’t bother to comb through the individual box scores I would not be surprised if they were all inside-the-park jobs). Also, to create a league made solely of these players (along with clones of the same average pitcher), would greatly amplify any differences between the two groups. In a MLB environment where there is a variation in terms of players’ skills, these differences would likely be noticeable at all.

Then we did the same with RC (Runs Created), created by Bill James. This is in thanks to a suggestion made by a member of the Baseball Sim Addicts!!! Facebook group. As with wOBA this took a little bit of tweaking but both Slappy and Sluggish were made to have an equivalent RC of 99. Slappy’s stat line was created to be .371/.491/.862 with Sluggish’s working out to .220/.332/.868. After running 5 additional seasons we came out with nearly the exact same overall results: Slappy’s teams finished with an average of 84 wins with the Sluggers finishing with an average of 78.

wOBA and RC certainly did a lot better at evening out the two teams. One could argue that a difference of 7 or 8 games in a simulation designed to greatly exaggerate any differences goes a long way in demonstrating the robustness of the two metrics. And even with these small but consistent differences they are the best metrics available when applied to a typical ML team. It does lead me to wonder though what is behind the small (and in the real world likely meaningless) advantage the Slappy’s have. Do the formulas need some minor tweaking? Is there something in the OOTP game engine?

Update: After a night of thinking about it, it likely has to do with fielding. All players were set to equivalent fielding ratings – but they were all average. Since the Slappy’s had a greater number of balls put in play, it allowed for more opportunities for errors. Looking back at the yearly stats the Sluggers did consistently produce more errors, some of which would have led to runs. While I cannot say for certain at this time, it would look like that could very well be the deciding factor between the two teams.