Friday, January 31, 2020

World Handicap System Adopts a Few Recommendations from this Blog


Over the years, this blog has pointed out some deficiencies and oddities of the USGA’s Handicap System.  The new World Handicap System (WHS) has addressed some of the points made in the blog and instituted minor improvements. This post reviews what the blog recommended and how the World Handicap Committee(WHC) responded.

Bonus for Excellence- The Bonus for Excellence, .96 in 2019, is multiplied by the average of a player’s 10 best scoring differential to calculate a player’s Handicap Index.  Dean Knuth, former Senior Director of Handicapping for the USGA, described the purpose of the BFE when he wrote in Golf Digest:

 “Historically, the USGA wanted to reward the accomplishments of better players…For a six-stroke difference in handicaps the better player gains a one-shot advantage (due to the BFE) and should win 60 percent of the matches.”[1]

In a post, “The USGA’s Bonus for Excellence Ruse, January 15, 2013,” it was shown the BFE is neither an effective incentive to improve nor a reward for superior performance and should be eliminated from the USGA Handicap System.  The WHC, perhaps heeding the wisdom of the post, eliminated the BFE.
   
Treatment of Women – The USGA’s treatment of women was analyzed in “Why Does the USGA Treat Women Differently, October 2, 2014.“  Before the WHS, the USGA recommended different handicap allowances for men and women.  For example, in four-ball stroke play men are allowed 90 percent of their handicap while women are allowed 95 percent of their handicap.  Why are women treated differently?  Much of the USGA’s research on multi-team events was done over 35 years ago and there appears to be no mention of any differences due to the gender of the player. [2]   It is likely the USGA had no empirical evidence for the women’s allocation, and the percentage was just a consensus guess by members of the Handicap Procedure Committee.   If women were studied, it is probable any difference in the estimated optimal allowance for men and women would not be statistically significant.  Remember, all the studies used to justify four-ball allowances were completed long before the introduction of the Slope System.  With this error and others, it is likely any difference as small as five percent was not significant.  Since the USGA does not release its research for peer review, the accuracy and validity of the USGA’s allowance may never be known. 
The following recommendation was made in the post: To make a small step toward the equal treatment of women, however, the USGA could keep the hallowed men’s allowances and simply eliminate any allowance specific to women.  The WHC has followed this recommendation and eliminated separate allocations for women.

Sec. 10-3 - Index Reduction for Exceptional Tournament Performance – Section 10-3 supposedly cracks down on Sandbaggers by reducing their Handicap Index based on exceptional tournament performance.  A post, “The Truth About Section 10-3, April 15, 2014,” made the following observation:
“The USGA has never published any research on the effectiveness of Sec. 10-3.  When asked recently how many players receive a reduced index, the USGA replied “We do not keep such statistics.”[3] Apparently the USGA does not want to know the effectiveness of this section.  Sec. 10-3 lives on since it: 1) gives the illusion of curing the sandbagging problem, 2) does not generate negative feedback since so few are affected, and 3) relieves the indolent handicap committee of the responsibility for rooting out the unethical player.  In essence, Sec. 10-3 is the perfect bureaucratic solution.”   
The WHS has eliminated Sec. 10-3 and placed more responsibility on the Handicap Committee to monitor tournament performance.   Such an approach has not been successful in the past and is not likely to be successful in the future.   But the WHS did put the onus on the Handicap Committee where it belongs and not on a statistical formula that was never effective. 

Four-ball Stroke Play and Four-ball Match Play Allowances – Under the USGA Handicap System, players are assigned their full handicap (Sec 9-4aiii) in four-ball match play.  In four-ball stroke play, men are assigned 90 percent of their course handicap (Sec. 9-4bii). 
A post, “Chapman Handicaps and Sec. 3-5: Proposed Changes in Allowances, August 19, 2013,” questioned the different treatment of the two types of play.  If high handicap teams have an edge in stroke play, why don’t they also have an edge in match play?  And why does the USGA recommend a maximum difference in handicaps for four-ball stroke play, but not four-ball match play?  The USGA is of no help in answering these questions.  As mentioned above, the USGA’s research on the equity of multi-ball competitions (e.g., four-ball match four-ball-stroke play) is clearly out-of-date. 
The WHS includes several changes.  First, it now recommends a 90 percent allowance for four-ball match play.  Second, it reduces the allowance for four-ball stroke play from 90 percent to 85 percent.  Third, it omits any mention of a restriction of the difference in handicaps between partners.  It is difficult to describe these changes as an improvement.  The WHC has not presented any evidence the new allowances provide more equitable competition than the old allowances.  The new allowances do have one thing in common, however. All changes in the allowances favor the low-handicap player. This suggests the changes were based more on politics than statistics. 
  
Stroke Allocation -Under the USGA recommended stroke allocation procedure, holes were ranked by the difference in average score by low and high handicap players. The USGA argued this allocation would produce the most halved  holes but never explained why this should be a criterion for choosing an allocation procedure.  In a post “Problems with the USGA Stroke Allocation Procedure, January 17, 2015,” defects in the USGA’s method were exposed.  The USGA gave an example of where strokes should be given.  In the example, however, the high handicap player lost 5 and 3, hardly an equitable competition. The post recommended holes should be ranked by difficulty subject to certain guidelines such as spreading low stroke holes evenly over the 18 holes.
The WHS adopted this recommendation as presented in Appendix E: Stroke Index Allocation.  Holes are now ranked on playing difficulty relative to par subject to the same conditions mentioned in the blog post.  It is not known why Stroke Allocation was changed to Stroke Index Allocation. Index plays no part in the allocation procedure. But the change is gratefully received, and the superfluous language is overlooked.

Summary and Conclusion - The minor improvements discussed above do not impact on the efficacy of the WHS.  The evaluation of the WHS requires an experimental design that measures performance against various criteria (cost, equity, consumer satisfaction, etc.).  Does the World Handicap Committee have such an evaluation plan?  Probably not.  Bureaucracies rarely fund evaluations whose results could prove embarrassing.  




[1] Knuth, Dean,”Handicaps,” Golf Digest, September 2008  as reprinted at www.popeofslope.com.
[2] Ewen, Gordan, What the Multi-ball Allowances Mean to You, www.usga.org, Far Hills NJ, 1978.  The USGA has not released the original research for peer review. 
[3] E-mail to author from Annie Pollock, USGA, November 20,2013.

Friday, January 17, 2020

Dean Knuth: Is the Pope of the Slope Fallible?


The World Handicap System (WHS) has a feature called the par adjustment.  Basically, a player’s course handicap is just his former USGA handicap plus the difference between the course rating and par—usually a negative number.  In an article (The flaw in the new World Handicap System, Golfdigest.com, January 1, 2020) Dean Knuth, who has promoted himself as the “Pope of the Slope,” made arguments against the par adjustment.  He relies on his credentials (e.g., former Director of Handicapping at the USGA, etc.), and foregoes any reliance on theoretical or empirical evidence to make his case.   His arguments against the par adjustment are either specious, untrue, or unsubstantiated.  Unlike his namesake, the Pope of the Slope is clearly fallible.  Golf Digest did Knuth a disservice by printing his article without the proper vetting.     

Excerpts from Knuth’s article are presented below in italics.  After each excerpt, a brief analysis demonstrating the “flaws” in Knuth’s arguments is shown.

Knuth: Let’s start with the fact that par is hardly the most reliable measure of course difficulty (that would be course rating). Almost any golfer can list two courses that are both par 72s but vary greatly in how tough they play. Differences in length, in obstacles, in penalty areas, make one drastically harder than another even when they have the same par. Par as a metric, then, is somewhat arbitrary…. Maybe you don’t want to go that far, but calculating a handicap around a less reliable measure of difficulty inherently makes for a less equitable system.

Knuth is correct that “par” is not a accurate measure of course difficulty, but that claim is irrelevant to the equity of the WHS.  For stroke play (i.e., not Stableford) competitions, the WHS could have picked any number to subtract from the Course Rating and competitive results and handicap differentials would remain the same.  The par adjustment simply adds or subtracts a fixed number from a player’s handicap under the expired USGA Handicap System.  If players are competing from the same tees, differences in handicaps among players remain the same.  There might be small changes in handicaps due to rounding, but they are random and would not affect equity.    When players compete from different tees, the course handicap is calculated with all players playing to the highest (or lowest) par.  Again, what particular par number is used will not affect the equity of competition.  Knuth’s conclusion that the par adjustment makes for a less equitable system is not substantiated. 

Knuth: …the new formula changes course handicap values from tee to tee as you compare the WHS to the USGA system at any course.  For example, where once a course handicap was a 12 from the back and middle tees, and an 11 from the front, under the new WHS calculations there will be much larger variations—as many as 18 shots in some instances—between tees. Part of the reason for this is that during the calculation, an approximation is being approximated again by adding Course Rating minus Par creating an imperfect “over-spreading” of the course handicaps  Knuth adds “ It’s why, to me, the WHS produces an unacceptably large course handicap variation for the same ability player.”


Knuth never explains why a large course handicap variation for the same player is unacceptable.   The reader just has to take his word for it.  It is not the variation of handicaps, but the difference in handicaps among competitors that determine fairness as discussed above.  Knuth states the par adjustment creates an imperfect “over-spreading”   of the course handicap. He never sets forth the criterion for “perfect spreading.”  He simply hopes his readers will assume “over-spreading,” whatever it is, must be bad.  

Knuth:  Golfers competing from more forward tees will be receiving fewer strokes than is truly equitable.  And if you want to follow the USGA’s “Tee it Forward” initiative, there is a disincentive because playing from shorter tees more drastically lowers your course handicap.


This is where an editor at Golf Digest should have interceded and asked for evidence.  Instead, Golf Digest was complacent and just assumed Knuth, with all of his credentials, must know what he talking about.   If Knuth’s claim that the forward tee player is treated unfairly was true, it would drive a stake through the heart of the WHS.  Of course, it is not true.   A player competing from the forward tees will receive a reduction in handicap, but so will his fellow competitors.   There is no change in equity due to the par adjustment.   Even one with a rudimentary knowledge of the WHS (e.g., Jerry Tarde, Editor of Golf Digest) should know this. 



There is a lot not to like about the WHS and its par adjustment. The USGA simplified the Rules of Golf to make them more understandable to new and casual players.  Then, paradoxically, the USGA adopted an arcane handicap system that baffles and discourages these same players.   This blog has openly opposed the WHS, but firmly believe its efficacy should be determined on empirical evidence and not on conjecture by so-called experts.   Knuth’s article makes no contribution to that end.  If Golf Digest had any integrity, Knuth’s flawed article would be taken down from its website.