Corporate Evaluation Sites – A Response to Dean Blevins and the “Stargazers”

Image credit not available

For those of you who are regular visitors to our site you have heard us refer to the “corporate evaluation websites” many times. Our references to those sites are usually not particularly complimentary and we have considered writing a note to you all in order to further explain our position on those websites and their “star” ratings. We received a note about a tweet that sportscaster and former Sooner QB, Dean Blevins, sent out that compelled us to respond. Here is the tweet:

DeanTweet

We will say at the outset that we have nothing but respect for Dean Blevins and in truth his tweet really only created the impetus to write this piece. The response is really meant for all the “stargazers” out there – the folks who believe wholeheartedly in the star rating system by corporate evaluation websites like Rivals, Scout and 247.

The argument posed by Mr. Blevins is a fallacious one in that the issue we, and we suspect others, have with the star rating system isn’t so much the “stars”, rather it is the process by which those “stars” are given. We believe that the process is not a legitimate evaluation process and it is in fact, in large part, disingenuous and even, in some cases, unconscionable.

We speak to a lot of people in the football world and one thing we want to make very clear to the reader is that these star ratings absolutely affect the way a high school athlete is perceived by many colleges. And this, in fact, is one of the many reasons we chose to start this small website and why we are even concerned with the issue at all. We aren’t journalists by trade. We are former athletes who are business owners, NFL players, managers, musicians and lawyers. We don’t charge money for our website and we have no intention to ever charge money. We started this website because we love college football and we wanted to create an alternative voice in the public sphere to counter the corporate voice that tells people what a kid is and isn’t with a few yellow stars. We spent multiple posts on this website talking about Oklahoma commit Dwayne Orso because a) we believe in his talent even if the corporate sites say he is a 2-star and b) we wanted so ardently for the Oklahoma fan base to appreciate the evaluation job of our coaches and appreciate this young man’s commitment to our university. How disappointing it is to see people online say things like “oh he’s only a 2 star” in such a disparaging way. As if those star ratings define the value of that young man to our program.

We are not saying that the corporate sites are wrong all the time and we aren’t saying that we will be right all the time. What we are saying is that the process by which those stars are given isn’t, in our estimation, an earnest evaluation. It is our belief that what those sites primarily do is catalog a recruits offers and then bump their rating based on that offer. An Alabama offer gives you a bigger bump than say, a Michigan State offer. A USC offer gives you more star credibility than a Nebraska offer. So even when those sites claim some kind of statistical accuracy based on NFL numbers that accuracy isn’t based on anything unique to them – your grandmother could catalog the offers and allocate star ratings based on those offers and she’d manage to make a good statistical case for herself come draft day. That isn’t evaluation.

And to be honest we don’t expect them to be great evaluators. They don’t employ a majority of former athletes or coaches. They are made up primarily of journalists. Being a journalist in itself doesn’t preclude you from being a good evaluator but they seem to discover quite a few good football evaluating journalists. And at this point let us pause for a moment and be very clear on something. When we criticize the corporate websites we are not criticizing their local affiliates. Guys like Josh McCuistion at Rivals’s SoonerScoop and Bob Pbrzybylo at Scout do a fantastic job. They are real journalists who do a great job bringing Sooner fans news and recruiting information and we encourage our readers to purchase subscriptions to those sites because they offer information that we do not provide. And we actually respect their football opinions.

We obviously disagree on things with them at times but so what? We disagree with one another at times. Recruit evaluation is not an exact science and no one is always wrong or right. But what we do offer and what people like Josh offer are actual thoughts on a recruit based on what we see irrespective of “hype”, offers or anything else. Unfortunately though Rivals does not allow their local affiliates like Josh to determine those “star” ratings. Need proof? Here is Josh’s most recent Oklahoma HS rankings:

http://rivals.yahoo.com/oklahoma/football/recruiting/rankings/rank-3201;_ylt=Au.o2bDp7uDfKXLv0DGjpX3wOrF_

You’ll notice that in some cases there are 3-star players rated above 4-star players and 2-star players rated above 3-star players. That is why we are taking time out to credit guys like Josh and Bob. They do a good job and they are genuine about what they see and that is something we completely respect.

Again our issue is with the national corporate evaluation sites. The problem is when you base your evaluation system primarily on “hype” or offers you are a) not doing what you claim to be doing and b) you are basing your process on a very flawed system. What many fans don’t realize is that the college recruiting process is extremely flawed. And there are many factors that make it that way. In order to keep this write-up within a reasonable length we won’t go into too many details but we’ll mention a few things.

The first is one we mentioned in our Trey Carter post a week or two ago. Namely that many college coaches have the same insecurities that folks in other fields of employment have. Trey Carter camped at Arkansas and OSU over the summer. He is a 2-star player according to Rivals. OSU and Arkansas are not exactly known as defensive juggernauts. Neither school offered Trey. Trey camped at TCU. Coach Gary Patterson saw him workout and the offer came shortly thereafter. Coach Jerry Montgomery saw him one time and offered. Shortly thereafter guess who offered? Arkansas and OSU. Sure, people will tell you that OSU and Arkansas wanted more time to evaluate the kid. But this kind of thing happens all the time and the high school coaches will be the first to tell you. And let’s be serious – what possible drastic change in Trey Carter’s game occurred in the past 2-3 months? And what possible 5-star commits did either school reasonably believe they were going to land that would cause them to hesitate on their offer to Trey? The fact is Trey could play then. And he can play now. Oklahoma saw it. TCU saw it. And then everyone else magically saw it. He never was a 2-star except in a database on Rivals.com. And now that he has all these offers I suspect he won’t be a 2-star for too much longer. In fact we were told by someone very close to Trey that Rivals has told them they will bump him up to a high 3-star. Perhaps they won’t now just to spite us. (Post note: Rivals has bumped Carter to a high 3 star and went from being unranked to the 19th best DE in the country)

The fact is kids play out of position in high school, they have varying levels of exposure to colleges, and varying levels of development. You must make a genuine attempt to evaluate these young men if for no other reason than to be true to your word – when you say you are “evaluating” then evaluate! Coach Mike Stoops saw three plays of OU commit Tito Windham and offered. Three plays! And sadly, because Rivals claims he is a 2-star Tito won’t get his due from some fans. Last time I checked the Rival’s “evaluators” hadn’t coached  a single All-American defensive back. Unfortunately, in the Rivals world an Oklahoma offer just doesn’t mean as much anymore so it has yet to affect his star rating. On the flip side Alabama’s DT commit, OJ Smith, was a 2-star defensive tackle in the summer. He committed to Alabama. And by the end of the summer he was a high 3-star and rated as a top 30 defensive tackle in the nation! As far as we know he did not attend a number of camps in the summer. So exactly what was this sudden bump based on?

So in addition to Mr. Blevins argument being the wrong argument entirely he likely doesn’t take into account the fact that Coach Nick Saban actually does his own evaluations and Rivals follows his movements closely. Fortunately our coaches do their own evaluations as well. We’ve been told directly by high school coaches that the Oklahoma coaches have told them, and we’re paraphrasing, we do not care about star ratings or hype – if a kid can play he can play. That is not the case with many other colleges and high school coaches will tell you that as well. Let us offer one final example before we attempt to end this overly wordy piece. With all due respect to Florida LB Greg Miclisse, in our opinion, he is a border line BCS player if at all. I don’t know what scale Rivals is using to rate him as a 3-star while an incredibly talented and refined DB like Trai Mosley is a 2-star but it’s not accurate. Ok, we’re lying…we do know what scale they are using…offers. If you check Rivals site it would appear that Greg has numerous offers from all around the country including Oklahoma. But he doesn’t. We won’t speculate on how the error was made but he does not have an offer from Oklahoma – at least not a committable one.

In the end there are a number of kids who are obviously 4 and 5 “star” kids. It doesn’t take a football savant to figure that out. There are some kids that every college coach wants because the kid is special. It doesn’t take a good eye to see that. So it works great for the corporate sites because you simply make a very small grouping of kids called “4-stars” and you throw all the other kids into a huge “3-star” or “2-star” category and then tell everyone that a higher percentage of 4-star and 5-stars as related to the total number of 4 and 5-star kids get drafted. Sorry but that doesn’t demonstrate any real knowledge of football though it is a very convenient business model. And then of course you add to it the fact that they “update” their rankings throughout the year to account for the new offers and play it off like these are actual “re-evaluations” and it only strengthens their fallacious statistical argument. You want to prove you’re a great evaluator then evaluate. If we believe that’s actually what the corporate sites we’re doing we would not be saying a word. In fact we probably would not have started this website at all.

And let us lastly say that the timing of Mr. Blevins tweet could not be worse. Oklahoma coaches have recruited more 2 and 3-star kids this year than we have in a long time. Perhaps the tweet was directed at our coaches. But the timing also isn’t great when a Florida team that is literally loaded with 4 and 5 star talent (there isn’t a 3-star player on their defensive depth chart) lost to lowly Georgia Southern. Or when an Auburn team with a similar roster as last year and couldn’t beat anyone, now has only one loss. His tweet is, however, convenient in that FSU is doing quite well but we pounded them twice in a row despite the fact that they’ve had plenty of talent throughout the years. And of course Alabama remains Alabama. But the fact is there are a lot of good ball players out there. And when the right player with the right attitude meets the right coach and the right scheme then, stars be damned, he’s going to have success and so will that team. Fortunately for Oklahoma fans Oklahoma coaches don’t give two flips about what Alabama or Florida State or anyone else think of a recruit. They do their own homework and despite the suggestion to the contrary by Mr. Blevins, so do we.

 

 

 

 

32 Comments

  • Josh says:

    I have been a hs coach the last 6 yrs and have seen 1st hand players being rated as 2* or 3* and go on and have very successful college careers. Staying away from kids I’ve coached because obviously I’m biased, but a few yrs back i was scouting for the playoffs and came across a certain cb playing for Keller Central. Only had 3* according to the recruiting sites, was kind of thin didn’t have huge measurables. But kid could flat out play. Great motor, great hussle, good technique for a hs kid. Well sooner fans saw that 3* kid get his first of many pick6 Saturday after staying all yr as a RS Frosh! How many stars would sooner fans give Sanchez today? I’ll take heart, attitude, and coaches opinion over stars every day of the week.

    • Super K says:

      Thanks for the feedback Josh. Love having a ball coach on here as well! Keep sharing your thoughts bud!

      • Boom says:

        Great article. Big sooner fan and I’m tired of hearing negative comments about our recruiting. Here is the way I look at it. Look at every draft, do the players all come from big schools. Don’t get me wrong, a lot do but there are a lot of players in the hall who came out of no where. Jerry Rice, Larry Allen, and to many others to count. Guess Joe Montana was a 5 star and highly drafted. No. Look at the potential not the stars.

  • Josh says:

    *starting

  • bjwalker82 says:

    I completely agree with the article. The Sooner coaching staff knows talent and as Bob frequently says “We like our guys,” when asked about stars. Still, it helps when OU can land those players with eye-popping obvious talent, that everyone and their grandmother can see (AD and Ryan Broyles) and wants. Mike also mentioned that it’s nice to get your first choice guys that they go after.

    Something that doesn’t mean. It doesn’t mean 2 stars, 3 stars and No stars can’t explode. They frequently do. I think if you look back over 10 years of the star system, the stars are indicative of their talent around 60% of the time. So it’s a bit of a crapshoot. I remember Dom Whaley when people asked…uhhh…where did this kid come from and why is he a walk-on? All of the evaluation sites missed him because he was moving around and didn’t participate in camps. The talent was still there.

    The point is the star sites shouldn’t assign a rating if they don’t actually know the talent or upside of 17 year old kids. I’m guessing it’s not practical for them to do so since there are thousands of kids playing HS football. Sadly that won’t satisfy fans.

    • Super K says:

      Our main beef with the stars is that if you’re just cataloging offers then don’t act like you’re evaluating kids. And if you’re just cataloging offers then of course you’re going to be write a lot of the time; you’re letting the schools that actually do evaluations do the evaluations for you.

  • Zach14 says:

    Dean makes multiple fallacious assumptions:
    1. He assumes that with top star ratings are what make the program..,.That isn’t true. It takes player development. I am a novice, but I’d posit that Alabama not only gets top star kids, but they also develop them at a superior level. They have a superior system. (Notice that their running backs haven’t all torn up the NFL.) Otherwise, would you really need to evaluate talent? Just buy a subscription.
    2. He assumes that those who criticize the system are saying that top star ratings are completely meaningless…that isn’t true, either. Nobody is saying that 4/5star guys are just like everyone else. Nobody is saying OU should have passed up on AD for a gutsy 2 star player. Rather, they are saying that those ratings don’t always reflect actual evaluation. Sometimes they do. Sometimes they don’t.
    3. He assumes that all schools CAN recruit like Alabama….not true at all. Most schools may have a shot at some top recruits, but they will HAVE to rely on their evaluation and system to garner success. Even a school like OU doesn’t have the recent success to turn heads like Bama or other SEC schools. To get back to that level, OU will have to get some top players, but also recruit for their system and find their own guys to fit that system.

  • AlexOU says:

    Gotta wonder what’s going on in Bob’s head when he does shows with ole Deano, after comments like this. Bob could teach ole Deano a thing or 2, or 3.

    • Super K says:

      Exactly what Broyles and I talked about this morning. He sits next to a man who recruits 2 and 3 star players.

  • Indy_sooner says:

    If there’s one thing this season has taught me is you cannot spout off before you get to see someone play. The fact that kids like Sanchez have come in and done what they did is incredible, when we were ready to write off the season… or that Lane came in as an unrated, 0 star QB and leaves as a top 5 pick….As a lineman. If that doesn’t scream “evaluation”, then I am not sure what does. Another (incredibly important) issue that OU seems to be addressing is attrition. The coaches have changed the game plan to focus more on the entire body of work that the recruits bring to the table and for them to be counted upon in the long run. There is a method to the madness… I can guarantee you that.
    Obviously, the demographics don’t always pan out, but the idea is to reduce the overall risk deviation and I will take the evaluation of any of the coaches before giving 2 flips what these sites think. At the very least, the kids deserve the chance to demonstrate their ethic and production on the field before getting BS from people.

    • Super K says:

      Good post bud. We have no problem with people being wrong on their “evaluation” but we have a problem with people claiming they are evaluating if that isn’t really what’s happening.

    • Billy Jackson says:

      Exactly. So, what does Dean think of Texas and all those 4 and 5 star athletes? Those are working out so well for the Horns.

    • JJsooner1 says:

      I completely agree with your comment. How many “5 star” recruits have gone to any school and turned out to be overrated or problem kids that can’t keep their nose clean or don’t want to work in the classroom? I’ll take a disciplined “football player” over a prima donna all day everyday.

  • Nathan Brenneman says:

    I”m really glad you typed this up, thanks for sharing it! Completely agree that Josh and Bob are great in their evaluations as well. Only thing I’d like to add being a novice in evaluations is an interesting point that seems to be something of a catch 22…yall have mentioned in other posts that some coaching staffs (most notably of the burnt orange veneer) have all but put their faith in these corporate ratings systems and go and offer the 4 and 5 star kids…however the catch 22 of it is that the sites are as you’ve said rating them based on what offers they have as well as a half hearted eval at best. So if the staff is waiting for the 4 and 5 star ratings to go out to offer and the rating is based on the offers received it creates what I”m talking about lol…this also adds to the lunacy you’re talking about and also the sad part of it getting these athletes caught in the mix and affecting their futures…VERY intriguing! Thanks again for posting this information as I’ve been curious about this for a while.
    Next question I’d like to pose:
    and forgive my ignorance please!
    IF the college game is ALL ABOUT getting QUALITY evals done on kids and done on as many as humanly possible to get the kids you want. Why aren’t schools hiring “eval/recruiting” teams to do this full time for them? the business model seems to support the idea? We seem to be moving that direction IE: recruiting director or whatever position Bama has and we’re looking to implement as well. Why aren’t more of the bigger schools doing this?

    • Super K says:

      Programs are definitely moving in that direction. But there are still numerous limitations including the human limitation of trusting your eyes. I can’t tell you how many coaches will see a kid they like and will hesitate to offer but as soon as someone else offers they suddenly feel confident enough to offer. Had a big time Texas HS coach tell us that UT has been burned by letting the corporate evaluation sites tell them who is good and who isn’t and they are trying to move away from that.

    • Scott Martin Bowles says:

      Actually, I think it’s been even more insidious than that. The pro sites, with only a handful of people in any given state, can’t track all the recruits, especially before they could watch highlight film on the Internet, so they would use a lot of information that they gleaned from college program recruiters, and the recruiters who were more forthcoming tended to see the players they signed get higher rankings. And when a program like Texas developed the habit of only officially offering kids they knew would accept the offer, well, the whole ratings system became too self-referential to be of much validity.

      I used to take this stuff a lot more seriously until I got a Max Emfinger publication that listed a DB recruit from the Houston area named “Alief Hastings.” Since then, I’ve developed my own informal recruit ranking system — can play, can’t play and reach — and that system has proven remarkably accurate. Although it led me astray with Tom Wort.

  • Ne'erdowell says:

    This is a good discussion of what talent looks like and how many fans react to an evaluation, either from “evaluators” or coaches. No one is infallible, but, most often, I’d take the coaches evaluation. Some coaches evaluate in different ways. I’ve never really understood Venables’ evaluations of LBs. Perhaps too many projects… Others may have a much more defined set of characteristics they want, based on the scheme they are running. I’ve recently seen a lot more transparency in what the coaches at OU are looking on defense, for example. At this transparency has emerged in a matter of two short years. Prior to that it was difficult for me to understand what the coaches were looking for in defensive recruits. It was like they were recruiting “athletes” and then they’d find a position for them later. That’s not a focused evaluation, but that just my opinion.

    I’m not convinced that the evaluators at these sites understand football well enough to know what scheme and position they will fit best. It seems they say a kid is a (name a position) because that’s what many of the college coaches are recruiting him for. That’s not evaluation.

    What also seems to be part of an evaluation is how other sites rate the player. 24/7 calculates a composite rating of all other site’s ratings.

  • ctsooner says:

    K, I think you are about 95.6% correct in your thoughts, lol. I agree with you about the local sites being good evaluators, but only when they go to see the kids play like the OU Rivals guys do. They are all former players in HS and do share WHY they rate a kid the way they do, like you said. I told JY that I loved the idea of this blog when he told me about it. You are offering a different opinion and what you base it on. Very refreshing and I think it will also improve traffic for OUFans as folks read things here and go back and post about it on Rivals (I don’t read the other two, but assume it’s similar). Personally I love this as the two sites are just different, but complementary. Please keep on giving us all a different way to view things. Thanks.

    • Super K says:

      Thanks for the feedback CT! My main point regarding the local sites is that even if we disagree with their perspective on a kid, I totally appreciate the fact that they are giving one based on their eyes and not based on a resume of offers. Always great to get your feedback bud!

  • Billy Jackson says:

    Nice write up. The moral to the story is Communism looks good on paper, too. It’s just that actual implementing it in real life part that’s been kinda tricky.

  • JD says:

    Wat, no kudos to James Hale?! LOL I’ve seen him ruin too many announcements to have any respect for him

  • Cary Newman says:

    As a former Rivals and Scout recruiting analyst, I understand how difficult and time consuming it is to accurately rank players. Coaches who now make millions understand how critical it is to make those same rankings and subsequent offers. That is why I’m so impressed with the work and effort done by these gentlemen on this site. The fact they played big-time college football gives them great credibility in my mind.

    • JY says:

      Cary, thanks so much. As in the case of Patrick Choudja, we want the world to know if a kid can play, he can play. Dwayne Orso, Michael Warren, and on and on. So many kids are underrated and it affects their futures. That is why we wanted to do this. Thanks again for the kind words.

  • CoachStauder says:

    Did anyone ask Dean what FSU had done with the same caliber star recruits the previous decade? Doesn’t fit his argument….

  • JJsooner1 says:

    Am I correct in thinking, that in rare cases, the difference between a 3 star and a 5 star is almost negligible?

  • ctsooner says:

    I keep reading responses in regards to stars and rankings. I’ve been seeing the same thing year after year. One camp: Stars don’t matter. Look at so and so, he was only a two star and won the Heisman. There isn’t a big difference between a 5 star and a three star anyways. Look at all the 5 star busts.

    Second camp: Stars matter more than anything. I want a roster of all 5 stars like USC had and now Bama has. THAT’S what wins NC’s. If your average star rating for the year is less than 4.2 per kid, you’ll suck for years to come and your coach should be fired.

    There is always middle ground. Just reread K’s post and it stays a lot. It also doesn’t say that stars aren’t indicative of how good many players are. There are too many variables that fans will never know about. Character is MOST important. How much upside does a kdi have? Will he chose the right program/system for his talents or will he go to the local school or the one with pretty green sequins and camo helmets? Maybe he cares most about education and choses the right school even though the program may not fit him.

    What support system does said student have? Does he need to get away from bad influences or is he THE bad influence?

    I think that OU does and has done a good job overall, however the last three years have sucked at three of the most important positions. That’s why Sooner fans are ape crap about stars, but I’d simply say they were ape crap about having Coach Kish at OU before the season started. I have and will defend him to the limit as I feel his body of work isn’t even started and look at what his last second additions have already contributed. Pretty soon, he’ll get more 4 and maybe 5 star kids to come to OU. The difference will be that they will have the right answers to all the questions above and be coachable. That’s the difference maker in any scenario. It’s still about the coaching and the commitment. You take a 2 or three star with similar physical talent, but is driven and you have a two to three year starter.

    OU will never get the ‘rated’ recruits that the coastal powers will get or the football states will get. OH, Texas, SEC territory schools have all locked down the doors and we have to be selective when offering kids so as not to waste time or money. Even in TX we are highly selective. People don’t understand what great connections you need to uncover top talent that isn’t being highly recruited. BJW is that man at OU and Monty and Kish (Mike also) have strong connections in their areas of recruiting. I see all the OU coaches working very very hard cultivating their efforts among the TX/OK/KS/MO HS coaches and it’s already paying off. Wish we had done all of this prior to this year, but we are quickly fixing what’s been ailing. I don’t think stars have been ailing, I think a couple of our coaches who are not longer here just got VERY LAZY and stuck in a rut. Again, stars are and can be nice as we have offered a lot of highly ranked kids, but struck out. That doesn’t mean that others didn’t have better Sr. seasons and are NOW more deserving. This is why you always want a third of your class to commit after Thanksgiving and not before. JMHO