Monday, June 14, 2021

How often do players that appeal their rating down get disqualified? Interesting Tennis League Stats

One of the challenges of USTA League is that players that are bumped up may feel they can't compete at the higher level and get frustrated with the game, or in some areas getting bumped up to a certain level, say 4.5 or 5.0, may limit or even kill one's ability to play league as there are no teams in an area at that level.

Similarly, players who aren't bumped up may feel their game has declined, or the situation in their area has had a reduction of players at their level, and they would like to appeal down to a lower level.

The "solution" the USTA has for these players is the option to appeal their rating.  And there are two ways to appeal, the auto-appeal or a manual/medical appeal.  And if you self-rate, as a new player or due to an expired rating, you can appeal as well.

For auto-appeals, after year-end ratings are published, there is a link on TennisLink to appeal your rating, and if your year-end rating meets various criteria, your request may be granted automatically right then and there.  The criteria can vary a bit year to year as the USTA can and does change it periodically, but it is basically that you didn't go to Nationals the prior year and your rating is close enough to the threshold.

If your auto-appeal does not work, you can file a manual appeal and it will be reviewed by an area/district/section committee tasked with reviewing appeals.  These are generally limited to medical appeals where a medical condition is permanent and affects some aspects of a player's game.  From what I've been told, you are not likely to get a medical appeal granted for a temporary medical condition that you are expected to recover from.

Now, before you go click the appeal button or file a manual appeal, beware that if your appeal is granted, you do become subject to strikes and 3-strike disqualification/promotion similar to that for self-rated players.

A natural question then is how often to players that appeal down get a 3-strike DQ?

Looking at data I have since 2014, it does not appear to be very often at all.  I only see 141 players that had an 'A' rating that subsequently were disqualified.  My data may not be complete or perfect, but I doubt there are many more than that and even considering we had a pandemic 2020, that is only about 25 per year.  Given there are around 5K-7K appeals each year, this is not a very high rate.

Why might this be?

I believe the reason is that players that appeal have an established rating that is lower than the appeal threshold, just over the threshold for their appealed to level, and the strike threshold is higher than that.  So if a player simply goes back to playing at their prior ability, they will generally remain below the strike threshold.

For example, while the USTA doesn't publish what all these thresholds are, lets assume a 3.5 is bumped up to 4.0 (their year-end rating is 3.51 or higher) but is just a few hundredths over (say 3.55) and this is within the appeal threshold and they can appeal down to 3.5.  Let's also assume the strike threshold is 3.7.  If this player simply goes back to playing at their 3.55 ability and their rating stays around that point, they will remain short of the strike threshold.

So, we can surmise that the majority of legitimate appeals probably don't result in a DQ.  A player simply plays similar to the prior year and they won't get strikes.  It is those that perhaps aren't justified that end up getting strikes and getting DQ'd.

One can probably debate whether giving players the option of appealing is really necessary.  While it can be used for the category of players I described above that are arguably legit, it can also be used by players that can compete at the higher level and are simply looking for an unfair advantage of being at the lower level.  Worse, players might have lost intentionally to manage their rating down to be able to appeal.  It is likely these that are DQ'd as going back to their real ability is higher than the strike threshold.

What do you think?

Are appeal players wildly out of level in your area?  Or are they basically the same as the strongest players at a given level?

Should the auto-appeal option remain?  Or is it ripe for abuse and all appeals should be reviewed or at least the criteria beefed up to weed out the non-legit uses?

Leave a comment and let me know.

Tuesday, June 8, 2021

Expired rating? Need to self-rate? Here is how it works

When the USTA didn't publish 2020 year-end ratings, they also didn't change the rules regarding expired ratings.  The result is that a number of players that would have gotten 2020 year-end ratings didn't, and as a result had their rating expire meaning they have to self-rate again to play in 2021.

For example, consider a player that played in 2017 and got a year-end rating, but didn't play the minimum number of matches in 2018 or 2019, but did in 2020 before/after the pandemic shut things down.  Normally this player would have gotten a 2020 year-end rating and been fine for 2021 but now has to self-rate.

And for older players that have a 2-year expiration, they could have played in 2018, not had enough matches in 2019, but did in 2020, so missed just one year, and in 2021 they have to self-rate again.

This seems like a miss on the USTA's part.  First of all they should have published 2020 year-end ratings, but if they weren't going to, they should have suspending expiring ratings for one year, at least for those that played in 2020.

But they didn't so we have the situation we are in now.  Between all the self-rates from 2020 that didn't get ratings and these players that have to self-rate that perhaps shouldn't have had to, we likely have record numbers of self-rated players.

This has contributed to the increased rate of 3-strike DQs, but also raised questions on how self-rating works.

I was reminded of this when someone pointed me to an Essential Tennis video where Ian goes through the self-rate process as he is planning to begin playing USTA League again.  He raises a number of questions or criticisms of the process, and I left a comment there explaining things, but I thought it would be a good idea to write it up here too.

The USTA has a set of guidelines and a self-rating questionnaire to help players identify the minimum level they can self-rate at.  Ian goes through the guidelines and questionnaire, and concludes that the guidelines would require him to self-rate at 4.0 or higher based on his Div II college experience, but he knows he is competitive with 4.5s so he'd like to self-rate at that level.  But when he completes the questionnaire, the system spits out 5.0 as the minimum!

Before explaining what happened, I'd point out that Ian saying he'd elect to self-rate at 4.5 instead of 4.0 is the right thing to do.  What the self-rate questionnaire spits out is not the level for a player, but the minimum, and the USTA expects players to self-rate higher if they feel it is appropriate and Ian is following this guidance.  That said, he could always self-rate at 4.0 and play up at 4.5 which gives him a safety net of being able to play 4.0 if he plays 4.5 and finds out he is in over his head (not suggesting he would be, just offering an example).

Now, what happened?  While Ian didn't fall into the exact situation I explained above of an expired rating that wouldn't have happened with 2020 year-end ratings, he did have a prior 5.0C rating from 2013 when he was bumped up from 4.5 (that my ratings agree with BTW).  The USTA has a rule that when you have an expired rating and self-rate again, you can self-rate no lower than your most recent prior rating, which means Ian's 5.0 sets that as the minimum.

Does doing this make sense?  I think so, as while the questionnaire helps get players with no USTA record at a reasonable level, a real playing record is almost always better, even if the rating is several years old.  Basically, real match results, even from 8 years ago, are more indicative of a players ability than how they answer questions about their high school or collegiate experience from 15-20 years ago.

But why ask all the questions then if the answers were just going to be ignored?  The answer is that not everyone with an expired rating falls into Ian's situation.  It is possible that since the player last played USTA, their playing history has "improved" and the guidelines would call for a higher minimum rating than their last rating.  Take for example a high school senior that plays USTA League the Spring before graduating and gets a 4.0 year-end rating.  But then they go on to college and play and get experience that the guidelines require a minimum rating of 4.5.  If the questions weren't asked and answered, but instead it just said a minimum of 4.0 from the prior rating, the self-rate process couldn't spit out the 4.5 that is now appropriate.

Ian also pointed out that while the guidelines have age as an input, the questionnaire never asked for his age.  This is because he was logged in to his account which has his date of birth so it already knew his age to factor that in.

The guidelines also have a lot of granularity regarding varying levels of collegiate experience which makes things look complicated.  Ian asks if all of that is necessary.  I think it is as someone could play at a junior college and a 4.0 would be appropriate, but someone who is a top player at a Div I school could very well be a 5.5 or 6.0.  To get players slotted in at the right level, you need a lot of questions to narrow in on that.

Now, Ian last played in 2018 which was 8 years ago now, so shouldn't the process factor that in and consider while he was a 5.0 in 2013 he might not be now?  That is a good point and perhaps it does in some cases, but he is at an age where a decline due to age is not a given, so the system errs on the side of not letting the player get too low a level automatically.

So what is Ian to do if he really thinks being a 5.0 is too high a level?  There are provisions for appealing the minimum self-rating that is spit out, and a player can make their case and have a person/committee review it and perhaps grant the appeal.  And appeals are sometimes successful so it isn't just theoretical.

Hopefully this helps explain how things work.  Feel free to leave a comment with any questions.

Monday, June 7, 2021

Update on 3-strike DQs in 2021 - Interesting Tennis League Stats

About two months ago I wrote about the trends with 3-strike DQs in 2021, in large part because 2021 is a unique year as it is really an extension of 2020 as no year-end ratings were published by the USTA for 2020.  At that time, the DQ rate in 2021 was up about 60% over the same period in 2019.  As more areas are playing, it seemed like a good idea to update the stats.

Through June 1st this year, I show 314 DQs while through the same date in 2019, there were 253.  That is up 24% which is no where close to the 60% we saw earlier, so has the rate of DQs slowed?

As I did last time, it isn't enough to just look at raw DQs, but we need to look at the rate per individual or team.  Since 2020 halted play in March, we can't really compare with it so we'll look at 2019 as I did above with the counts.

In 2021, there have been just over 69K team matches played in 18/40/55 and over leagues, while in 2019 there were just over 91K.  That puts the 2021 DQ rate at 0.45% and in 2019 just 0.28%, which means the rate in 2021 is 63% higher.

In 2021, there have been just over 169K players that have played in 18/40/55 and over leagues, while in 2019 there were just over 221K.  That puts the 2021 DQ rate rate at 0.19% while in 2019 it was just 0.11%, which means the rate in 2021 is 62% higher.

So, the rate continues to be in the 60% range, supporting my hypothesis that one of the issues from not publishing 2020 year-end ratings would be more players out of level, which leads to more DQs.

The good news is the system appears to be working and DQs are happening for those self-rated and appeal players that are now wildly out of level having well over a year to play at their original self-rating or appealed rating.  The bad news is this means there have been more out of level players in league play which has perhaps led to frustrations from players who feel they have to play out of level players.

I obviously still believe it was a mistake to not publish 2020 year-end ratings, but read my earlier blog article to see more details.

What do you think?  Or what is your experience in your area?

Saturday, May 1, 2021

Wanting to follow Northwest Washington (Seattle) 40 & Over playoffs? Don't use TennisLink!

The saga of the USTA's technology challenges as it relates to leagues and tournaments seems to be continuing.

Local playoffs for the 40 & Over league in Seattle are going on this weekend, and I went to TennisLink to see how some friends had done in the matches.  Let's ignore for now that TennisLink is terrible as trying to follow along with local playoffs like this as there is no central place to see the schedule or get to draws, you more or less have to find a player or team and then find their championships and navigate to the draw where you can see only that draw.  Want to see other draws or NTRP levels?  Prepare to search and navigate a bunch more.  But I said I'd ignore that for now, so moving on.

I found the draw I was after but no score had been recorded yet.  But my wife got a text from a spectator saying our friend's team won and I refreshed the draw and indeed I saw the match was now recorded ... except the draw said the other team won!

Confused, I clicked on the match, and court by court our friend's team had won 3 courts to 1, but going back to the draw, it showed the other team winning 3-1.

Thinking this was perhaps a TennisLink web-site issue, I went to the iPhone app but it too showed a draw with the other team winning and advancing.

Clearly something is amiss with TennisLink, perhaps the issues in the new Serve Tennis/Play Tennis site have found their way into TennisLink, and it turns out our League Coordinator knows, as she is using a Google Docs spreadsheet to keep track of playoffs and pointing folks to it!  And it is even linked to from the Northwest Washington page on USTA.com.

Kudos to Jill for recognizing the issue and coming up with a solution, but it is sad she has to do that.  She is effectively having to do double work to enter results in the spreadsheet and eventually go get them in TennisLink.

But going back to it being hard to follow events like this, it is doubly bad when TennisLink is messing up as I don't think it is well known that a Google Docs spreadsheet is being used so fans don't know to look there and may look at TennisLink and get incorrect information it appears.

So, if you are trying to follow playoffs this weekend, don't head to TennisLink, but instead go here and click on the 2021 A40 Playoffs sheet where you can see a much nicer than TennisLink schedule for the whole event in one place and all the results.

Saturday, April 10, 2021

2021 NTRP Tournament Nationals is happening, ... but is using TennisLink?

A few years ago the USTA introduced a new "Nationals" event, one for NTRP tournament players.  Players qualify from their section based on tournament ranking lists and/or playing in a Sectionals tournament, and then the event is held in the Spring for those players that qualified from the prior year.

The 2020 event was not played due to the suspension of play due to COVID-19, and with few tournaments played in 2020 in many sections, qualifications for the 2021 event were a bit different, some player's who qualified for the 2020 event were given invitations to this year's event, but the 2021 event is on and in fact being played this weekend.

The 18 & Over singles event is being played in Arizona and the 50 & Over singles players are in Orlando.  Next weekend, the 18 & Over doubles are in Arizona and 50 & Over doubles will be in San Diego.

The links I gave above are to the new Serve Tennis (Play Tennis) site, which was launched for 2021, but interestingly the draws are not found there and instead are found on TennisLink.  The USTA appears to be continuing to have challenges with the new site, they even sent an e-mail out a month or two ago apologizing for all the snafus, and they still aren't out of the woods it appears.

I've heard rumblings about lots of issues and TennisLink having to be resuscitated, but elected not to pile on and write about them all, but it appears even NTRP Nationals, an event I would have thought would have been a key use case for the requirements for the new site, has had to resort to using TennisLink for draws.

Never the less, good luck to all the players competing the next two weekends!

Wednesday, March 31, 2021

Are 3-strike DQs up in 2021 USTA League? Interesting Tennis League Stats

As we slowly make our way through the (hopefully) downhill side of the COVID-19 pandemic, USTA League play is taking place in most sections.  Some areas have mask wearing or other restrictions, while others are just playing as normal.  Regardless, it is good to see play going on.  See my earlier analysis of where play was happening through January.

This also provides an opportunity to look at potential impacts of the pandemic, or decisions the USTA made as result.

First, we can look at matches played.  For this, I'll look at matches between January 1st and March 13th, as the latter date is when the USTA suspended play in 2020.  I will also only look at Adult 18/40/55 for consistency.

In 2020, there were nearly 34K team matches played which was up 4.5% from 2019 when there were just over 32K played.  During the same period in 2021, there have been just over 22K played, a drop of 34%.

This isn't a big surprise, a number of areas delayed starting league play so the match played count would be expected to be lower and I'd think is primarily due to the USTA adhering to local rules regarding competitive sports, especially in those areas where play early in the year is indoors.

Second, we can look at the number of players who have played in the same period.  The counts by year are 126K in 2019, 124K in 2020, and 86K in 2021.  Here there is a 31% drop from 2020 to 2021, basically mirroring the drop in team matches, so no surprise.

Third, we can look at DQs during this same period.  The counts by year are 63 in 2019, 59 in 2020, and 64 in 2021.  This is pretty consistent, so you'd think nothing to be alarmed at, except the 64 in 2021 has been achieved in 34% fewer team matches.  If you look at the rate per team match, DQs are actually up 65%, and the rate per player is up 59%.  This, at least to me, is alarming.

Why the significant increase?  Has something gone haywire with the self-rate guidelines or questionnaire or how TennisLink spits out the minimum self-rate level?  Are more players lying when answering the questionnaire and self-rating too low?  Are players not managing their rating effectively anymore?  Has the USTA tightened up the strike thresholds?

While any of the above could contribute, I don't think any of those are a significant factor, or a factor at all.  Instead, I'd offer that what I wrote about last Fall was likely to happen simply is happening.

Last Fall, the USTA made the decision to not publish 2020 year-end ratings.  I saw a number of potential issues with this decision, one of those being there would be a lot more self-rated players, and many of those would be out of level.  It would appear that some of those that are way out of level are simply having this recognized via 3-strike DQ, specifically a rate 59% higher than the prior year.

You might say, 64 DQs is a small number and not a big deal, but for there to be this large an increase in the DQ rate, there is likely a similar increase in the number of self-rated players that are out of level and just not DQ'd yet.  These players get to continue to play at too low a level which isn't terribly fair to the at-level players that are required to play them.  And this doesn't even count all the C-rated players who should have been bumped up (or down) and are playing at the wrong level in 2021 and aren't subject to DQ.  My earlier estimates of put the number of players playing at too low a level at 15K, which is not insignificant and to me at least, is a big deal.

The solution was obviously to publish 2020 year-end ratings, at least for self-rates that had played enough, but the USTA didn't do that and so we are stuck with what we have.

Note that through the end of March, the number of DQs has already gone up from 64 to 120, so the rate increase was not a early blip and is continuing.  Stay tuned as I continue to monitor this.

But these are all just numbers.  What are you observing in your area?  Are you seeing more DQs than normal?  Is there a disparity in the ability within levels regardless of S-rated or C-rated?  Is the lack of 2020 year-end ratings having a detrimental effect on USTA League play?

Wednesday, February 24, 2021

2021 USTA League Nationals is on! (Fingers crossed)

COVID-19 wreaked havoc with our lives in 2020 and USTA League tennis was not spared with league play canceled or postponed in all areas and USTA League Nationals canceled and not held for 2020.

The new year has brought some hope that we can return to something closer than normal, and USTA League play has begun or is set to begin in many, but not all, sections and that gives hope that league play can happen, and those that qualify can advance on through playoffs including to Sectionals and Nationals.

Adding fuel to the hope is the USTA publishing information about 2021 USTA League Nationals including the schedule as of 2/11 and updated FAQ regarding COVID-19.

This is great news, that Nationals is at least being planned for as without the plans, and certainly wouldn't happen.  And with encouraging news about vaccines and declining hospitalization rates in most areas, hopefully the events can be played as planned.  And coupled with Tri-Level Invitational being run by the USTA this year and occurring shows sone positive momentum.

So what are the plans?

Nationals will be held as usual in October and November, and the host sites for Nationals will be:

  • Phoenix, AZ - Phoenix Tennis Center
  • Scottsdale, AZ - Scottsdale Ranch Park
  • Surprise, AZ - Surprise Tennis and Racquet Complex
  • Oklahoma City, OK - Oklahoma Tennis Center
  • Orlando, FL - USTA National Campus

This is very similar to what had been planned for 2020 Nationals with the exception that Las Vegas was to be used for three events last year but appears to have been replaced by Phoenix/Scottsdale.  Here is the week by week schedule with locations.

October 1-3

  • OKC - 18 & Over 3.0
  • Surprise - 18 & Over 3.5
  • Phoenix - 18 & Over 5.0

October 8-10
  • Scottsdale - 18 & Over 2.5W
  • Surprise - 18 & Over 4.5
  • OKC - 40 & Over 4.0

October 15-17
  • Surprise - 18 & Over 4.0
  • OKC - 40 & Over 3.5
  • Scottdale - 40 & Over 4.5
  • Orlando - 55 & Over 7.0 (clay)

October 22-24
  • Surprise - 40 & Over 3.0
  • Orlando - 55 & Over 8.0 (clay)

October 29-31
  • Orlando - 55 & Over 6.0/9.0 (clay)
  • Surprise - 18 & Over Mixed 6.0/8.0/10.0

November 5-7
  • Surprise - 18 & Over Mixed 7.0/9.0

November 12-14
  • Surprise - 40 & Over Mixed 7.0/8.0
  • Orlando - 40 & Over Mixed 6.0/9.0

Obviously the Phoenix area is the focal point for Nationals with at least one event being held there every weekend and more than half of the events in that area.

It appears the USTA is paying attention to weather patterns and past lessons with weather related fiascos and trying to reduce the chances of weather delays.  Oklahoma City is used early before the weather perhaps gets colder/worse, and Orlando is used later to avoid the increased chances of Hurricanes in September/October.  Weather can always be unpredictable, but at least it appears the plan tries to avoid problems as much as possible.

Let's hope USTA League remains on schedule and gets played and the above schedule can happen.  Good luck to all those teams with aspirations of making it to Nationals!