The National Football League is nine days away from the kickoff of its regular season. If social media, fantasy sports, and hype are any indication 2014 is set up to one of the most watched seasons in history. There are plenty of story lines abound: from each division, to playing time of newly drafted players, to veterans returning from injury, and of course concussions.
The league is doing its best to keep concussions from overriding the game itself, as they should be. Concussion is but just one of a myriad of injuries sustained in the sport; plus it is not unique to just American Football. However this issue continues to gain/keep traction because of the relatively late and “slow-footed” response to this topic. Even though the settlement with the players has been all but signed-sealed-delivered (there are some interesting issues posed by Patrick Hruby that are worth noting), the youth arm of the league is promoting and teaching a “safer” way of tackling, and the talking points about this injury are becoming more evident from players and the league; there still is a shroud of secrecy. In all the hand-wringing and court battles and public relations scuffles the leader of this glorious sport has yet to “rip the band-aid off” and assess the situation.
How can you assess the situation? I think it is rather simple: gather data to find out the “true” value of actual concussions sustained in the NFL over a season. Then and only then can you see if any changes brought forth are actually helping the cause.
Sure the league has its own data and is probably doing just that, but it is so far behind a curtain, tucked in a corner where light has no chance of hitting it. I have always thought we should be transparent on this issue; or at least have a truly (Pollyannaish) independent data collection group for it. At the very least an Ombudsman should be hawking this situation, for this is not going to go away over night. It won’t go away until we can definitively say ‘X’ is the way to play this game with ‘Y’ ‘Z’ at the professional level; then each subsequent level below the pro ranks need to modify based upon age and development.
The NFL probably doesn’t want this responsibility for it comes with some liability, not only on the medical front but in the public relations department… SO WHAT! When I chose to have a child I didn’t have the choice to be a role model and change the way I played life in order to make sure my children grew up safe and learned a better way to live. The NFL is basically the “father figure” for the other levels of this great sport. I have heard a great saying, it was applied to business in general: “the tree rots from the top”. This is exactly the case in a family, in a business and in sport.
When the blog began in 2010 there was no way to find out how many concussions were occurring in the NFL without piecing together the Official Injury Report. So, for posterity sake I started to catalog all of the injuries for my own curiosity; lo and behold I had created my own data collection. But a few weeks into that season I noticed something; players that were said to have “their bell rung” or even reported as having a “head injury” in the TV coverage or print media following were not showing up on the injury reports. This was in 2010. That is when I refined the way I searched for concussions and had a database that was – at the time – unique to the interwebs. By the end of Week 7 in 2010 the data was getting massive attention from all sorts of different media outlets (still top 30 of most viewed pages on this site).
I have since collected not only player, team, week injured and position but helmets and if they were on special teams at the time of injury (so difficult). With all this information staring at me I could see things, but I didn’t know how to present them other than showing you the raw numbers. But, in 2012 I was approached to possibly publish what I have found, all I needed was someone smarter than I with statistics and someone to capture an angle on this issue from the “inside” to give our words/data context. That I did and we wrote a paper and subsequently it was rejected, almost out of hand.
Initially I was bitter – as most would be – but upon reflection of the reviewers submission (can be found at the end of post) it was clear that even if we were to “clean up” the writing style they were never going to get it. There is a massive difference between in vitro and in situ; when you try to write about real world data/collection and present to those that mostly deal with laboratory observation there will be conflict. Moreover, those that have not had extensive training/experience when dealing with actual human interaction and the subtleties of behavior cannot fathom how that affects this type of data, concussions.
Rather than change the entire narrative of what we came up with and resubmit to another journal we are going to publish it as a white paper here, on the Concussion Blog. It is with great pleasure I present to you (WAIT A SECOND… Read the paper then look at this post to answer most of the questions you may have before going nuts in comment section or twitter…), try again.
It is with great pleasure I present to you Trends In NFL Concussion Recording 2010-2012.
I will address some of the pertinent questions (also known as #hottakes) regarding this paper below. They will be basically question/answer format. I will keep them as brief as possible. As with about every piece of research you can glean what you want from the numbers, I understand that. I also know that simply throwing this information in the trash will do nothing for the advancement of the concussion cause. Finally, I want to unequivocally state that I love the sport of football, I want it to remain as an option for players of all ages (albeit with hitting modifications for younger players); the overall objective of this information is to bring to light data that may have been glossed over or never even broached before. This information can and should help the sport become more proactive with this injury. I cannot wait for the season to begin! Now on to the Q/A…
This is unofficial data, how do you know you captured all the data?
Simple answer is that I don’t know, but I do know that there are plenty of players included on the data that were never on the NFL Official Injury Report (NFLOIR) but were confirmed via other methods. Over the past few years it has become much easier to collect the data due to the great work of journalist and social media data miners (@nflconcussions).
Your numbers are only regular season, why?
Simple, preseason concussion reporting is unreliable, period. You will note the reasoning in the paper but to illustrate, in 2010 there were only 4 reported concussions in all media outlets, FOUR! This year, (as of 8/20/14) there were 50. Each season since beginning in 2010 has produced an increase in concussions in the preseason. As for postseason, read the paper.
Dustin, dude, this isn’t scientific… You realize this, right?
Certainly I do. The Journal of Athletic Training said so. As I mentioned above we feel that there is a conflict in how we are read and we feel the data was captured. THIS IS THE ONLY WAY POSSIBLE to collect this data (biggest objection of reviewers) outside of internal mechanisms from the league itself. Moreover it is our opinion (put on tin hats and I need a pair of asbestos underwear for this), the editor has benefited from NFL support and was even trained by someone we consider and NFL insider.
Do you know what else isn’t “scientific”:
- all the apps we use for assessment
- the educational material we disseminate
- “Heads Up Football”
- force sensors
- clinical evaluation/judgement
- rule changes
How can you include data that you see on TV, don’t you have to be there and actually assess the individual?
First, I cannot diagnose any injury, but if it walks like a duck and quacks like a duck often times it will not be an elephant. It takes training and education to understand the concussion paradigm; in short yes you can identify someone who’s brain is not properly functioning after a traumatic event. Although you cannot “diagnose” a concussion from a distance there are overt signs that would indicate inclusion for concussion after a traumatic incident. These are but not always limited to: being knocked unconscious and the Fencing Response. It is widely accepted that you do not have to have either sign to be concussed, but it should be known and accepted that if you produce either of those signs after a traumatic incident that, in fact, you have disrupted the brains normal activity. Thus, fitting the criteria for inclusion of concussion. This has been and will always be the case 100% of the time.
Fink’s Rule, now you are just making stuff up!
Perhaps, but it makes logical sense – to me, at least. Fink’s Rule was developed by the primary data collector, Dustin Fink, for a way to notify those interested in determining concussion as an indicator of potential forces great enough to disrupt normal brain activity. This “rule” was only applied one time in the data in 2011, since that time each instance where the rule could have been applied the athlete was classified as having a concussion.
Why again are you only including regular season numbers and even excluding Week 17?
This is the only time that injuries in the NFL are reported in a standardized manner. During preseason there is no mechanism for teams to formally – nor required – to publish an injury list. In fact, the NFLOIR produced by teams only have to include players that will have some degree of uncertainty playing in the next contest. In the post season, there is so much riding on the outcomes of games for the winning teams that often times reporting can get away from being as accurate as needed for data collection.
Data can also be missed during bye weeks as teams going into a bye are not required to furnish an injury report, this is especially an issue in Week 17 when over half the league will not play another game. The data during those periods of non-reporting is completely dependent upon journalistic reporting and team information on their own volition.
How are your numbers better than the leagues numbers?
We don’t know if they are, rather this is a data set we feel is as accurate as possible given the extreme limitations from afar. This data was never meant to be used as weapon against the players, teams or league. Rather, an independent analysis using what was available.
What is the number of concussions we might expect as a “true” value?
Given evidence based methods employed by the Ivy-league schools, it would not be surprising to see between 1 and 2 concussions per team per game.
We thank you for the time you have taken to read the paper and the questions here on the blog. You can feel free to address this further in the comment section or on Twitter, the inbox is also open (you can see the JAT Reviewers Comments by clicking on the hotlink). Be forewarned that I do have a “real job” that keeps me rather busy and I will get to you as soon as possible.
We look forward to producing follow-up data that will include 2013, 2014 and beyond. Remember our conclusions;
The NFL and NFLPA should be commended for having made enormous strides in publicly communicating the serious nature of mild-traumatic brain injury in the past few years. Further, there has been a nearly uninterrupted stream of media coverage surrounding the topic. The number of concussions recorded by the NFL increased during the period of this study; however, it is unlikely this result is approaching the true value. In fact, it may not approach a stable level for many years.
‘None of us is as smart as all of us.’