PDA

View Full Version : NFL Draft Statistical Analysis: Projecting NFL QB Failure Using College Stats


The Franchise
02-26-2013, 03:33 PM
I originally posted this in the Official Geno Smith thread.....but I was told that this needed it's own thread.

It was brought up a while ago that Matt Stafford was a lock for the Lions at #1 back in 2009 from the very beginning. I didn't think that was true....so I did some research to see what the "experts" were saying about Stafford in advance of the draft. And I found this article (http://espn.go.com/blog/nfcnorth/post/_/id/1620/finding-context-in-the-stafford-debate).

This is from the 1st half of the article.

The experts are hedging. The fans are sweating. The team is making clear it is considering all of its options.

There are 47 days remaining until the 2009 NFL draft, giving the Detroit Lions some 1,125 hours before they are required to make the No. 1 overall pick. The Lions might need every minute of that span, especially if their internal discussion at all reflects the raging public debate on Georgia quarterback Matthew Stafford.

A classically built, strong-armed quarterback, Stafford has not yet caught on as the consensus No. 1 pick. ESPN.com draft analyst Todd McShay, for example, said recently the Lions face a "nightmare" decision because Stafford is "not mentally ready" to take on the pressures of being the No. 1 overall pick. McShay said that scouts from at least 10 teams agreed with that assessment and added: "I just don't feel great about building my organization around him."

NFL Network draft analyst Mike Mayock told a Detroit radio station that "there are some things about him that bother me," and even Stafford's biggest supporter advocates with a negative argument. Yes, Mel Kiper Jr. said the Lions should select Stafford primarily because "there is nobody else to take."

Even fans are getting into the act. On the day the Lions announced they were playing host to Baylor offensive tackle Jason Smith, Jim of Cincinnati wrote:

Matthew Stafford? Why are people thinking he is a good fit for an 0-16 team? I have seen Stafford play. He gets rattled easily. His arm is ok but his leadership skills lack. Next year they can get a much better QB. This year they need to fill in the holes on defense and on the line.

Why all of this generalist hate against Stafford, who by all accounts offers fine character as well as the draft's strongest arm?

So....typical bullshit that we're hearing right now. Not worth the #1 overall pick....blah blah blah.

What I found really interesting was the 2nd half of the article....which is this.

Our friends at ESPN Research have developed a method for fleshing out the debate with statistical analysis. Using time-honored performance standards to predict future success for "blue-chip" quarterbacks, the formula placed Stafford between Akili Smith and Cade McNown in a category reserved for busts.

Does this mean Stafford is guaranteed to crash and burn? Of course not. But this evaluation documents in specific fashion the previously ill-defined criticisms of Stafford, helping to explain why there is so much disagreement about him with the draft little more than six weeks away.

The formula takes into account three statistics: Career starts, completion percentage and touchdown-interception ratio. The theory is that experience, accuracy and production versus mistakes can provide substantive indicators for college quarterbacks.
Formula Explanation
ESPN Research developed this formula to measure quarterbacks relative to a baseline completion percentage of 60 and a touchdown-interception ratio of 2.25. The multipliers allow each figure to have equal weight with career starts, which provides an important measure of experience.

The total score is the sum of the three adjusted figures.

The separate parameters for BCS and non-BCS quarterbacks help level the statistical playing field. They are based on the assumption that NFL-caliber quarterbacks playing against non-BCS opponents are going to have inflated numbers.

For those mathematically inclined -- it took me 10 readings to get it after having nightmare flashbacks to eighth-grade algebra -- below is the formula itself. (Note: This is the updated, corrected version. The formula in the original post was incomplete. Thanks to SwampThing86 and a few others for the heads-up.)

For BCS quarterbacks
(Career Starts x 0.5) + [(Career completion pct. - 60)x5] +[(Career touchdown-INT ratio - 2.25)x10]

For non-BCS quarterbacks
(Career Starts x 0.5) + [(Career completion pct. - 60)x2.5] + [(Career touchdown-INT Ratio - 2.25)x5]

(For a complete explanation of the formula, see the text box on your right.)

To test the formula, ESPN Research plugged in the 31 quarterbacks taken in the first round over the past 12 drafts, dating back to 1997. The results are below.

You'll see the quarterbacks broken into three categories. If their college statistics translated into a value of 20 or more, there was a strong likelihood for success. (Alex Smith and Tim Couch notwithstanding.) A value between 1 and 19 essentially meant "iffy."

Group I: Strong likelihood of success
Player School Draft year Score
Matt Leinart USC 2006 64.04
Philip Rivers NC State 2004 48.44
Tim Couch Kentucky 1999 47.64
Alex Smith Utah 2005 44.88
Aaron Rodgers California 2005 40.58
Peyton Manning Tennessee 1998 39.47
Jason Campbell Auburn 2005 38.75
Byron Leftwich Marshall 2003 36.39
Ben Roethlisberger Miami (Ohio) 2004 33.85
Chad Pennington Marshall 2000 33.53
Mark Sanchez USC 2009 32.63
Daunte Culpepper Central Florida 1999 30
David Carr Fresno State 2002 23.97
Joe Flacco Delaware 2008 23.92
Eli Manning Ole Miss 2004 23.14
Donovan McNabb Syracuse 1999 21.62

Group II: Hit-or-Miss
Player School Draft year Score
Brady Quinn Notre Dame 2007 18.93
JaMarcus Russell LSU 2007 18.64
Rex Grossman Florida 2003 18.39
Vince Young Texas 2006 18.21
Carson Palmer USC 2003 16.35
Matt Ryan Boston College 2008 9.14
Patrick Ramsey Tulane 2002 9.06
J.P. Losman Tulane 2004 7.86
Jay Cutler Vanderbilt 2006 2.39
Josh Freeman Kansas State 2009 1.94

Group III: Busts
Player School Draft year Score
Akili Smith Oregon 1999 0
Matthew Stafford Georgia 2009 -4.55
Cade McNown UCLA 1999 -6.41
Joey Harrington Oregon 2002 -6.85
Michael Vick Virginia Tech 2001 -11.32
Ryan Leaf Washington St. 1998 -16.92
Jim Druckenmiller Virginia Tech 1997 -20.25
Kyle Boller California 2003 -50.67

I decided to do some research and throw together the college stats of the QBs drafted since 2009 and see where they fall.

Here are the numbers of the last 3 years based on their stats and that formula.

Geno Smith 83.1
Matt Barkley 75.4
E.J. Manuel 50.7
Tyler Wilson 19.1


Andrew Luck 68.7
RG3 74.4
Ryan Tannehill 23.65
Brandon Weeden 56.35
Russell Wilson 36.3
Nick Foles 48.3

Cam Newton 54.3
Jake Locker -17.9
Blaine Gabbert 19.7
Christian Ponder 20.3
Andy Dalton 34.6
Colin Kaepernick 28.1

Sam Bradford 74.5

Keep in mind these things when comparing those numbers to the list from 2009.

1. How much do you knock down the numbers of QBs that come from a "spread offense"?

2. These numbers aren't 100% cut and dry on whether those players will succeed or fail. I mean fuck....is Locker worse than Leaf? Probably not. Is Alex Smith better than Aaron Rodgers? No way. But it's basing everything off of the number of starts, the completion percentage and the TD/INT ratio they had during college.

3. These numbers ONLY factor in passing stats. They do not include rushing statistics.

4. These numbers don't factor in extenuating circumstances or outside factors that they can't account for (David Carr having no offensive line or Matt Leinart being a playboy that didn't care about football). This is only based on stats.

When McShay, Mayock and Jim from Cincinnati express their concerns about Stafford, it's primarily for these reasons: College quarterbacks don't typically improve their accuracy in the NFL. If his decisions were at all suspect against SEC opponents, then it's reasonable to wonder how he will react to professional defenses.

PaulAllen
02-26-2013, 03:36 PM
What about Flacco?

Pasta Little Brioni
02-26-2013, 03:36 PM
So, basically it's too risky NOT to take Geno.

The Franchise
02-26-2013, 03:36 PM
What about Flacco?

Considering he was drafted in 2008.....he's already in the first list.

The Franchise
02-26-2013, 03:37 PM
I'll be the first to admit two things....

1. My math sucks.
2. You may find more concrete stats than I did. This was over the course of my lunch hour and it was a pain in the ass to find the games started stats for everyone.

PaulAllen
02-26-2013, 03:37 PM
Cool

DeezNutz
02-26-2013, 03:37 PM
Should have attached a diaper to this thread for True Fans.

BlackHelicopters
02-26-2013, 03:37 PM
Interesting.

duncan_idaho
02-26-2013, 03:44 PM
What about Flacco?

Joe Flacco comes out to 24.15. Still safely above the "iffy" threshold.

Playing at an FCS school hammered him.

Same numbers with FBS formular works out to 34.8.

FringeNC
02-26-2013, 03:45 PM
Interesting. Matt Barkley is the best QB ever to come out of school running a pro-style offense.

The Franchise
02-26-2013, 03:46 PM
Interesting. Matt Barkley is the best QB ever to come out of school running a pro-style offense.

Considering that he has 47 starts under his belt....

htismaqe
02-26-2013, 03:49 PM
Considering that he has 47 starts under his belt....

Yep.

RyFo18
02-26-2013, 03:49 PM
This is for the first person that points out Matt Leinart and/or Tim Couch:

rochambeau

Pitt Gorilla
02-26-2013, 03:55 PM
It appears we should sign Leinart immediately.

;)

Dante84
02-26-2013, 03:55 PM
I think a metric that should be included would be quality of opponents. He slightly accounts for that with a broad stroke of "BCS or Non-BCS." They should look at the teams they played against and calculate those opponents win/loss percentage over the course of the respective QB's starts.

Also, you could take that one step further and take into account the quality of the defenses they played against over the course of their starts.

This way it would better categorize those shitty ass QB's from USC and the rest of the lame ass PAC 10/12.

EDIT: Additional thoughts -

ALSO

You should take into account the quality of the QB's own Defense, Special Teams, Running game, and WR dropped balls. This way you know what kind of support they had.

If they have a ton of support, it might ding them. If they performed well in spite of shitty support (Geno) it would be a credit to them.

htismaqe
02-26-2013, 03:58 PM
I think a metric that should be included would be quality of opponents. He slightly accounts for that with a broad stroke of "BCS or Non-BCS." They should look at the teams they played against and calculate those opponents win/loss percentage over the course of the respective QB's starts.

Also, you could take that one step further and take into account the quality of the defenses they played against over the course of their starts.

This way it would better categorize those shitty ass QB's from USC and the rest of the lame ass PAC 10/12.

It wouldn't change much really. For instance, one of the most glaring examples at the top of the list is Tim Couch, who played in the SEC.

RyFo18
02-26-2013, 03:58 PM
This is for the first person that points out Matt Leinart and/or Tim Couch:

rochambeau

It appears we should sign Leinart immediately.

;)

Kidding or not: rochambeau

htismaqe
02-26-2013, 03:59 PM
This is for the first person that points out Matt Leinart and/or Tim Couch:

rochambeau

This isn't a predictor of success. It's a predictor failure. As you near the top of that list (working up from the bottom), the presence of Tim Couch indicates that your chance of being a complete bust is decreasing into the sub-20% range.

Dante84
02-26-2013, 04:00 PM
I think a metric that should be included would be quality of opponents. He slightly accounts for that with a broad stroke of "BCS or Non-BCS." They should look at the teams they played against and calculate those opponents win/loss percentage over the course of the respective QB's starts.

Also, you could take that one step further and take into account the quality of the defenses they played against over the course of their starts.

This way it would better categorize those shitty ass QB's from USC and the rest of the lame ass PAC 10/12.

ALSO

You should take into account the quality of the QB's own Defense, Special Teams, Running game, and WR dropped balls. This way you know what kind of support they had.

If they have a ton of support, it might ding them. If they performed well in spite of shitty support (Geno) it would be a credit to them.

The Franchise
02-26-2013, 04:01 PM
Look at Peyton Manning compared to Ryan Leaf just based on college stats...

digger
02-26-2013, 04:02 PM
Quarterback Rating
The NCAA formula is: [ { (8.4 * yards) + (330 * touchdowns) - (200 * interceptions) + (100 * completions) } / attempts ].

Hootie
02-26-2013, 04:02 PM
lets remember one thing

Flacco is a recent phenomenon.

if Rahim Moore didn't exist the majority would still consider him an inconsistent, non-franchise QB

htismaqe
02-26-2013, 04:03 PM
ALSO

You should take into account the quality of the QB's own Defense, Special Teams, Running game, and WR dropped balls. This way you know what kind of support they had.

If they have a ton of support, it might ding them. If they performed well in spite of shitty support (Geno) it would be a credit to them.

I don't think you're going to appreciably alter the results, you're just making the calculation more difficult.

htismaqe
02-26-2013, 04:05 PM
lets remember one thing

Flacco is a recent phenomenon.

if Rahim Moore didn't exist the majority would still consider him an inconsistent, non-franchise QB

This is precisely why I made the post I did.

This isn't an indicator of SUCCESS, it's an indicator of FAILURE.

Flacco is clearly NOT a failure and his number would put him at the very bottom of the "strong likelihood of success" category. That means he might have a 30 or 40% chance of sucess if he's at the bottom of that group.

But it also means he has a near zero chance of being a COMPLETE BUST.

Dante84
02-26-2013, 04:05 PM
I don't think you're going to appreciably alter the results, you're just making the calculation more difficult.

Maybe. I'm just throwing shit out there.

Maybe CDCOX wants to get all nasty with it.

unlurking
02-26-2013, 04:07 PM
Maybe. I'm just throwing shit out there.

Maybe CDCOX wants to get all nasty with it.
You're missing the point. This is ESPN's formula. ESPN is telling us there are no good QB options. According to THEIR formula, Geno is about as can't miss as you can get.

The Franchise
02-26-2013, 04:09 PM
You're missing the point. This is ESPN's formula. ESPN is telling us there are no good QB options. According to THEIR formula, Geno is about as can't miss as you can get.

Keep in mind......from 2009.

unlurking
02-26-2013, 04:13 PM
Keep in mind......from 2009.
True, but that's a few seasons, not a decade or anything.

You should send this in and ask them if their research team's formulas are bullshit, or if their current analyst predictions are bullshit. One way or the other, that's pretty blatant hypocrisy.

Dante84
02-26-2013, 04:16 PM
True, but that's a few seasons, not a decade or anything.

You should send this in and ask them if their research team's formulas are bullshit, or if their current analyst predictions are bullshit. One way or the other, that's pretty blatant hypocrisy.

http://espn.go.com/sportsnation/mailbag/_/id/21413

Hootie
02-26-2013, 04:16 PM
anybody who puts Flacco in the top 10 is CRAZY

he had a postseason of a lifetime...he also got a 1% on par with the Music City Miracle to have said postseason

PERHAPS NEXT YEAR if he parlays this Super Bowl into an actual regular season where he doesn't have 4 Tom Brady games, 4 Matt Schaub games, 2 Andy Dalton games and 6 Mark Sanchez games I'll be willing to reconsider.

As of right now, Flacco is who he is...a SUPREMELY talented INCONSISTENT QB who sometimes looks like the best in the league but often looks like Mark Sanchez as well.

He is the most confusing QB I've ever watched in my life. Maybe it really was Cam Cameron holding him back...I don't know.

but there is no way that, because of one Rahim Moore I'd take Joe Flacco over:

Aaron Rodgers
Tom Brady
Peyton Manning
Eli Manning
Drew Brees
Colin Kaepernick
Russel Wilson
Andrew Luck
RGIII
Matt Ryan
Ben Roethlisberger
Cam Newton (I admit I appear to be higher on him than most)

but again...I'm not ruling out this Super Bowl elevating Flacco to 'swagger mode' where he finally stops with the inconsistency and becomes a true franchise QB.

Until then, no way. He still has something to prove in my eyes.

Dante84
02-26-2013, 04:17 PM
http://espn.go.com/sportsnation/mailbag/_/id/21413

Andy maybe copy Bill Williamson's fat ass.

Still pissed about that Revis bullshit. :mad:

unlurking
02-26-2013, 04:19 PM
anybody who puts Flacco in the top 10 is CRAZY

he had a postseason of a lifetime...he also got a 1% on par with the Music City Miracle to have said postseason

PERHAPS NEXT YEAR if he parlays this Super Bowl into an actual regular season where he doesn't have 4 Tom Brady games, 4 Matt Schaub games, 2 Andy Dalton games and 6 Mark Sanchez games I'll be willing to reconsider.

As of right now, Flacco is who he is...a SUPREMELY talented INCONSISTENT QB who sometimes looks like the best in the league but often looks like Mark Sanchez as well.

He is the most confusing QB I've ever watched in my life. Maybe it really was Cam Cameron holding him back...I don't know.

but there is no way that, because of one Rahim Moore I'd take Joe Flacco over:

Aaron Rodgers
Tom Brady
Peyton Manning
Eli Manning
Drew Brees
Colin Kaepernick
Russel Wilson
Andrew Luck
RGIII
Matt Ryan
Ben Roethlisberger
Cam Newton (I admit I appear to be higher on him than most)

but again...I'm not ruling out this Super Bowl elevating Flacco to 'swagger mode' where he finally stops with the inconsistency and becomes a true franchise QB.

Until then, no way. He still has something to prove in my eyes.
Dude, don't derail this thread with your Flacco hate.

htismaqe
02-26-2013, 04:19 PM
anybody who puts Flacco in the top 10 is CRAZY

He's not in the top 10. Your whole rant is silly. He's 14th.

And that list doesn't include ANY QBs drafted earlier than 1998 nor does it include anybody that wasn't drafted in the 1st round.

Hootie
02-26-2013, 04:20 PM
it's not Flacco hate and I won't derail this thread but I just want everyone to relax and calm down with this whole idea "Joe Flacco is an elite NFL QB"

unlurking
02-26-2013, 04:21 PM
it's not Flacco hate and I won't derail this thread but I just want everyone to relax and calm down with this whole idea "Joe Flacco is an elite NFL QB"
Then start your own damned thread. No one has stated that in this thread.

Channeling your inner mememe?

htismaqe
02-26-2013, 04:22 PM
it's not Flacco hate and I won't derail this thread but I just want everyone to relax and calm down with this whole idea "Joe Flacco is an elite NFL QB"

Nobody said he was. Get a grip.

Hootie
02-26-2013, 04:23 PM
Nobody said he was. Get a grip.

relax LMAO

it was someone in a different thread the other day

I'm sorry for talking about an NFL QB in a QB thread. ROFL

my fault carry on everyone

htismaqe
02-26-2013, 04:25 PM
relax LMAO

it was someone in a different thread the other day

I'm sorry for talking about an NFL QB in a QB thread. ROFL

my fault carry on everyone

I'm just giving you shit man.

Take a look at the formula, apply it to Flacco, and then you'll get it.

CrazyPhuD
02-26-2013, 04:25 PM
Just for those who wanted to know......

Matt Cassel -27.5

unlurking
02-26-2013, 04:26 PM
Just for those who wanted to know......

Matt Cassel -27.5
Actually, I really don't think I did. But thanks anyway.

ROFL

Dante84
02-26-2013, 04:26 PM
Just for those who wanted to know......

Matt Cassel -27.5

ROFL

candyman
02-26-2013, 04:37 PM
I remember that, I remember when they picked him everyone was saying how its just their luck that the best option the year they had the first pick and desperately needed a QB was Matt Stafford, who most didn't think was all that great including myself. I dont think Stafford was any higher regarded then than Geno is now, people just cant seem to get past Luck, Wilson, and RG3 and cant comprehend that a QB draft class like that is rare and probably wont happen again anytime soon.

RealSNR
02-26-2013, 04:45 PM
relax LMAO

it was someone in a different thread the other day

I'm sorry for talking about an NFL QB in a QB thread. ROFL

my fault carry on everyone
He's only a success on that list because of the number he generates in the formula, for crying out loud.

You're still free to think Flacco is mediocre.

Dave Lane
02-26-2013, 04:59 PM
Here are the numbers of the last 3 years based on their stats and that formula.

Geno Smith 83.1
Matt Barkley 75.4
E.J. Manuel 50.7
Tyler Wilson 19.1


Andrew Luck 68.7
RG3 74.4
Ryan Tannehill 23.65
Brandon Weeden 56.35
Russell Wilson 36.3
Nick Foles 48.3

Cam Newton 54.3
Jake Locker -17.9
Blaine Gabbert 19.7
Christian Ponder 20.3
Andy Dalton 34.6
Colin Kaepernick 28.1

Sam Bradford 74.5


http://24.media.tumblr.com/tumblr_lr4xxed2cC1r2hybuo1_500.gif

Dave Lane
02-26-2013, 05:04 PM
I think a metric that should be included would be quality of opponents. He slightly accounts for that with a broad stroke of "BCS or Non-BCS." They should look at the teams they played against and calculate those opponents win/loss percentage over the course of the respective QB's starts.

Also, you could take that one step further and take into account the quality of the defenses they played against over the course of their starts.

This way it would better categorize those shitty ass QB's from USC and the rest of the lame ass PAC 10/12.

EDIT: Additional thoughts -

ALSO

You should take into account the quality of the QB's own Defense, Special Teams, Running game, and WR dropped balls. This way you know what kind of support they had.

If they have a ton of support, it might ding them. If they performed well in spite of shitty support (Geno) it would be a credit to them.

Have that on my desk by 9am sharp.

O.city
02-26-2013, 05:43 PM
Well put together Pest.

Dante84
02-26-2013, 05:52 PM
Have that on my desk by 9am sharp.

heh....

I am the king of floating out assignments in hopes that someone picks them up and runs with them. I am occasionally lucky. Most of the time not.

I'm sure someone like CD or InDigestion would be happy to dedicate an hour or two to something like that.

A "NEW QB FORMULA" that they can call their own.

I would be the first to read that thread and provide copious amounts of pos rep.

The Franchise
02-26-2013, 10:34 PM
Bump for the night crew.

KurtCobain
02-26-2013, 10:52 PM
Bump for the night crew.

My stomach is a little upset.

cdcox
02-26-2013, 11:01 PM
To develop an objective formua to assess which QBs are likely to thrive or fail at the NFL level is challenging.

The first challenge is to quantify a rating for each player in the pros. Phillip Rivers would have been rated higher 2 years ago than he is now. Daute Culpepper would have had a high rating his first couple years, but probably should be considered a bust. NFL QB rating doesn't cover it all. I consider QB outcomes to be binary (is he a franchise QB, yes or no) while others might prefer a more nuanced approach. For example if you look at a binary outcome, I would assign Chad Pennington a 0, but someone else might think he was worth a first round pick because he played OK for a couple of seasons before injuries and his obvious physical limitations caught up with him.

The second challenge is to gather all of the college level data that you want to throw into the formula. This could take hours, especially if you want to do things like include the strength of their competition.

Once all that is done, you can start the data analysis and probably account for a large part of the variance. It won't be perfect. Even with the best model you are going have some variance that isn't accounted for. My guess is that the ESPN model probably gets you 70 to 90% of what is possible in terms of accounting for the variance.

Right now I'm too busy at work to spend meaningful time on Sandbox, so I can't make time for something like this, as interesting as it would be.

Sorter
02-26-2013, 11:05 PM
Pennington played more than "Ok" before his shoulder was destroyed IIRC.

Also Culpepper had his knee destroyed after he put up solid seasons.

Dante84
02-26-2013, 11:13 PM
Thanks for the insight, though!

Now, why aren't you Saber-metricsing your way onto the Chiefs staff?

cdcox
02-26-2013, 11:23 PM
Pennington played more than "Ok" before his shoulder was destroyed IIRC.

Also Culpepper had his knee destroyed after he put up solid seasons.

At his peak, Pennington could not make all the throws due to lack of arm strength. That limits the amount of field that needs to be defended and makes the defenses job a lot easier. He wasn't going to take a team deep in the playoffs using his arm especially after the Raiders exposed him in the playoffs after the 2002 season. I called it then, and 2002 turned out to be the high water mark of his career.

Culpepper is an interesting case. We don't really know how his career would have panned out if he had stayed healthy. A lot of people think whatever success Culpepper had was largely due to Randy Moss. So assigning a rating to his pro career is very difficult.

Dante84
02-27-2013, 12:09 AM
At his peak, Pennington could not make all the throws due to lack of arm strength. That limits the amount of field that needs to be defended and makes the defenses job a lot easier. He wasn't going to take a team deep in the playoffs using his arm especially after the Raiders exposed him in the playoffs after the 2002 season. I called it then, and 2002 turned out to be the high water mark of his career.

Culpepper is an interesting case. We don't really know how his career would have panned out if he had stayed healthy. A lot of people think whatever success Culpepper had was largely due to Randy Moss. So assigning a rating to his pro career is very difficult.

Not to question the master, but couldn't you apply similar metrics (quality of defensive opponents, amount of support from various positions, completion percentage, td:int, clutch-ness, redzone efficiency, YPP, etc...) to the pro career and then see what the variance is between the college/pro, and then set the bar from there?

Yes, yes.... information gathering would take years. You need minions.

cdcox
02-27-2013, 12:21 AM
Not to question the master, but couldn't you apply similar metrics (quality of defensive opponents, amount of support from various positions, completion percentage, td:int, clutch-ness, redzone efficiency, YPP, etc...) to the pro career and then see what the variance is between the college/pro, and then set the bar from there?

Yes, yes.... information gathering would take years. You need minions.

This is essentially what I am trying to do through Sandbox: develop a set of metrics that quantify a player's contribution isolated from his opponents and team mates. It takes a lot of data and a lot of analysis. Several years from now, I'll have a decent data set on the pro-side. It's hard to go back in time due to: my time available and some of the data I use has only been collected for a few years.

Minions would be nice, but for most of the work I do, I don't know how to do it until I've done it. So it's hard to delegate.

htismaqe
02-27-2013, 08:26 AM
At his peak, Pennington could not make all the throws due to lack of arm strength. That limits the amount of field that needs to be defended and makes the defenses job a lot easier. He wasn't going to take a team deep in the playoffs using his arm especially after the Raiders exposed him in the playoffs after the 2002 season. I called it then, and 2002 turned out to be the high water mark of his career.

That doesn't make him a ZERO. A guy that never contributed at all is a ZERO.

Basically everybody on the bust list minus Stafford and Vick.

It seems to me this formula easily, and quite accurately, predicts failure.

Culpepper is an interesting case. We don't really know how his career would have panned out if he had stayed healthy. A lot of people think whatever success Culpepper had was largely due to Randy Moss. So assigning a rating to his pro career is very difficult.

Assigning a rating to anyone, as I explained earlier, is extremely difficult, if not impossible. It's too subjective.

But assigning them a binary value - "bust or no bust" - is actually pretty easy and this formula seems to accomplish it with repeatability.

Chiefshrink
02-27-2013, 08:38 AM
Still can't measure the 'intangibles' other than what you see on film and who the QB played against(competition as some of you have said)

The question I would have in measuring a QB other than all the stats would be "Did he play big in big games and WIN most of the time" ??

htismaqe
02-27-2013, 08:58 AM
It's hilarious seeing people wanting to add and subtract from the formula.

What's the matter, not happy with the results?

The simple fact is that it's pretty damn accurate when it comes to predicting failure.

Stop trying to alter it so that it says what you want.

MagicHef
02-27-2013, 09:09 AM
EJ Manuel is going to be awesome.

the Talking Can
02-27-2013, 09:21 AM
great thread

pretty much confirms the idea that there is a threshold above which QBs are simple worth the 'risk'...

Geno is obviously above the threshold, ditto for barkley

MagicHef
02-27-2013, 09:21 AM
Huh. For some reason he got left off the list.

Tim Tebow: 85

Pasta Little Brioni
02-27-2013, 09:23 AM
Everybody but the Doncos realized he's not a QB, so that wasn't a mistake at all.

KChiefs1
02-27-2013, 09:42 AM
Interesting. Matt Barkley is the best QB ever to come out of school running a pro-style offense.

That's what stuck out to me too...

The Franchise
02-27-2013, 10:43 AM
Huh. For some reason he got left off the list.

Tim Tebow: 85

He's not a starting QB. Clausen got left off as well.

Dave Lane
02-27-2013, 10:47 AM
Huh. For some reason he got left off the list.

Tim Tebow: 85


Sure deal Skippy...

MagicHef
02-27-2013, 10:53 AM
He's not a starting QB. Clausen got left off as well.

That's stupid. This is trying to predict NFL success using college stats. Only college stats should matter.

Also, he has started more games than Kaepernick, Weeden, or any of the 2013 QBs.

Hammock Parties
02-27-2013, 10:58 AM
This includes several QB busts in the high numbers so I don't like it.

I prefer the simpler rule of 26-27-60.

http://www.sbnation.com/nfl/2013/2/13/3981124/2013-nfl-draft-predicting-quarterback-success

The rule predicted that if a NFL prospect scored at least a 26 on the Wonderlic test, started at least 27 games in college, and completed at least 60 percent of his passes, he would succeed in the NFL, if he did not meet all three criteria, he would fail.

At the time of the article the rule was a fairly accurate at dividing successful NFL quarterbacks from disappointments. The rule predicted success for Peyton Manning, Philip Rivers, Eli Manning, Drew Brees, Tony Romo, Matt Schaub and Matt Ryan. Meanwhile it predicted failure for Ryan Leaf, Joey Harrington, Akili Smith, Tim Couch, David Carr, Vince Young and JaMarcus Russell.

RealSNR
02-27-2013, 10:58 AM
It's hilarious seeing people wanting to add and subtract from the formula.

What's the matter, not happy with the results?

The simple fact is that it's pretty damn accurate when it comes to predicting failure.

Stop trying to alter it so that it says what you want.
Geno Smith scored in the 80s. No amount of fuxing around with the formula is going to put him below 20, which is technically all that matters.

htismaqe
02-27-2013, 11:02 AM
He's not a starting QB. Clausen got left off as well.

Jimmy wasn't a 1st round pick. This only includes 1st rounders.

htismaqe
02-27-2013, 11:03 AM
Geno Smith scored in the 80s. No amount of fuxing around with the formula is going to put him below 20, which is technically all that matters.

Somebody gets it.

:thumb:

htismaqe
02-27-2013, 11:03 AM
This includes several QB busts in the high numbers so I don't like it.

I prefer the simpler rule of 26-27-60.

http://www.sbnation.com/nfl/2013/2/13/3981124/2013-nfl-draft-predicting-quarterback-success

You're looking at it incorrectly.

Start with the low numbers first.

MagicHef
02-27-2013, 11:09 AM
Geno Smith scored in the 80s. No amount of fuxing around with the formula is going to put him below 20, which is technically all that matters.

Absolutely. He's right there below Tebow.

slimdagreat
02-27-2013, 11:18 AM
Considering that he has 47 starts under his belt....

i wish there was a way to adjust the formula for QBs that played in spread offenses so their stats are inflated

slimdagreat
02-27-2013, 11:20 AM
This includes several QB busts in the high numbers so I don't like it.

I prefer the simpler rule of 26-27-60.

http://www.sbnation.com/nfl/2013/2/13/3981124/2013-nfl-draft-predicting-quarterback-success

I don't like using the Wonderlic as an indicator because we have to assume players are taking it seriously, and didn't Dan Marino get like a 10?