Lies, Darned Lies And Statistics

Wednesday, July 16, 2014

Over the last few years, chambers of commerce have taken a more active role in public education. Some of their efforts have been applauded, while others seem to indicate an organization in search of a mission. It begs the question: what is a chamber of commerce? The American Chamber of Commerce Executives defined a chamber of commerce as “an organization of businesses seeking to further their collective interests, while advancing their community, region, state or nation.” 

That seems simple enough. Then they added, “While most chambers work closely with government, they are not part of government, although many consider the process of appropriately influencing elected/appointed officials to be one of their most important functions.”

So, in essence, they are a lobbying organization that functions to further their collective interests, presumably business interests. That sounds a lot like our organization, Professional Educators of Tennessee, with the one exception: we only advocate on behalf of public education.  

In 2007, the U.S. Chamber of Commerce released the report: Leaders and Laggards: A State-by-State Report Card on Education Effectiveness. In this report Tennessee received an “F” for “Academic Achievement of Low Income and Minority Students,” “Truth in Advertising about Student Proficiency,” and “Postsecondary and Workforce Readiness.” Policymakers in Tennessee have called for specific education reforms ever since. We have touted this now seven year old report for the reason to enact reforms of every nature in our public education system, yet nobody has ever once questioned why we are following this specific report to change our state education system.  

Looking the categories that the U.S. Chamber of Commerce considered, they are all areas our state should analyze regularly: academic achievement, academic achievement of low-income and minority students, return on investment, truth in advertising about student proficiency, rigor of standards, postsecondary and workforce readiness, 21st century teaching force, flexibility in management and policy, and data quality. However, was this report the right measuring tool for Tennessee? By the U.S. Chamber of Commerce’s own admission, they did not conduct new research. Instead they reported that they “organized and analyzed existing evidence to inform and promote reform efforts across the nation.”  

Therein lies the rub. The entire paper was a marketing piece by a business interest group to promote specific educational reforms. Certainly many changes in Tennessee were and are still needed. However, policymakers must ask themselves if the changes we have made were right for our children and if reforms were enacted for the right reasons.

Another consideration is that some researchers may purposely distort the statistics. As Mark Twain wrote, “There are three kinds of lies: lies, damned lies, and statistics.” One must wonder which of these the US Chamber of Commerce relied on. Our data quality also was awarded a “B” in the 2007 report. It is not clear how we can score so high on data quality, and yet score an F in “Truth in Advertising” regarding student proficiency. If the data is there, doesn’t that tell the story?  

Why is the “Truth in Advertising” score discussed more often than the “Academic Achievement of Low-Income and Minority Students” score? Certainly the academic achievement of our most marginalized children has a higher significance than some formula utilized to determine the accuracy of our definition of “proficient.” And in calling our cut scores into question, were they calling state leaders liars? If so, which ones? Why didn’t they specifically name responsible parties at that time?

Additionally, grading on postsecondary and workforce readiness was tied to on-time high school graduation and college entrance rates. This area had already been addressed in the Tennessee Diploma Project in 2009, prior to the Federal Race to the Top grant being awarded to Tennessee. People going into college today may well be less prepared than those of an earlier generation, or acceptance rates may be higher in other states. Let’s also temper these scores with the fact that not every graduate desires to go to college, and not every job requires a college degree.

We must also consider the fact that policy changes in one area most certainly can impact or necessitate changes in the other areas. For example, our teaching force scored a “B.” In our frenzied effort to enact reforms, many educators are retiring or leaving the profession because of some specific reforms directed at them, namely tenure reform, licensure, teacher salary changes and teacher evaluations. Will that diminish the quality of our 21st century teaching force?  

As a Chamber of Commerce member, our organization would suggest the U.S. Chamber advocate for a reduced role by the federal government in public education. Directing education policy from Washington can create unintentional consequences, not to mention that states and local districts can be overwhelmed with compliance requirements created by federal programs, rules, and regulations. This takes away time and resources from our local schools and educators.

Stakeholders and policymakers should look at the data in their state or district for themselves. If the U.S. Chamber of Commerce really wants to make an impact for public education, we recommend that they include actual educators and stakeholders in that discussion. We would also advise a different approach to assigning grades to states based on an effort to inform and promote reform efforts. And policymakers should certainly consider the value and impetus behind such efforts in any single research study.   

J.C. Bowman, Samantha Bates

J.C. Bowman is the executive director and Samantha Bates is the director of Member Services of Professional Educators of Tennessee, a non-partisan teacher association headquartered in Brentwood, Tenn.


Don't Be Quick To Discard Common Core

Let's not be too quick to discard Common Core. A recent article in the Tennessean on  Sunday detailed Common Core successes the Kingsport, Tennessee school system.  I encourage you to read it.  The article also noted that Tennessee was recently ranked as one of the fastest improving states in education after implementing portions of the Common Core curriculum ... (click for more)

Roy Exum: Our Tubman Goat-Roping

Every spring there comes a bright day on the ranch when the straw-boss decrees a goat-roping should take place. What really happens is the veteran cowboys arm the greenhorns with some lariats late in the afternoon and take them to the pen that holds some Billy goats. This is before they get into bigger beasts -- horses and cattle – yet what appears to be easy most certainly is not. ... (click for more)

2 Chattanooga Bounty Hunters In Jail After Man They Sought Not Home And They Take His Wife

Two Chattanooga bounty hunters are in jail near Atlanta after police said they took a man's wife away in handcuffs after the man they were seeking was not home. Khalil Abdullah and Kevin Roberson were charged with kidnapping, false arrest and false imprisonment. In an incident in Gwinnett County, police said the pair broke into a home wielding guns and found the man they were ... (click for more)

Bradley County Police Investigating Shooting; Victim Dies

The Bradley County Sheriff’s Office is investigating a shooting that occurred in the area of Georgetown Road. The sheriff's office said Sunday night that the victim had died. The victim's name has not yet been released.  A BCSO officer was waved down at the intersection of 25 th Street and Peerless Road by the driver of a vehicle who told the officer a gunshot victim ... (click for more)

Vols' Jones: Vanderbilt will Present Various Challenges

Tennessee coach Butch Jones held his weekly press conference on Monday at Neyland Stadium, discussing last week's loss to Missouri and Saturday's critical SEC game at Vanderbilt. The Vols (5-6, 2-5 SEC) must beat the Commodores (3-8, 0-7) to become bowl eligible for the first time since 2010. The transcript: Head Coach Butch Jones (Opening Statement) "Quick recap ... (click for more)

Missouri Hangs On, Turns Back Tennessee, 29-21

KNOXVILLE, Tenn. – Missouri pin-pricked Joshua Dobbs’ bubble of invincibility Saturday night at Neyland Stadium. The nationally ranked Tigers drove a stake in Tennessee’s heart with Maty Mauk’s 73-yard touchdown pass to Jimmie Hunt in the fourth quarter, held Dobbs in check most of the game and beat the Vols, 29-21, before 95,821 fans on a chilly night on the banks of the Tennessee ... (click for more)