Police Magazine Logo
MenuMENU
SearchSEARCH

The Measure of Our Success

Good intentions are not enough when we make decisions for criminal justice.

March 1, 2018
The Measure of Our Success

Illustration: Sequoia Blankenship

5 min to read


Some of the strangest things I have noticed over the last 30 years are the lack of measurement of outcomes for decisions made in law enforcement, and the absence of direction-setting based on these outcomes. It used to be that when we chose an action to deal with a specific problem we expected to see a result within a certain timeframe. And then we assessed the result and modified the action as needed. Unfortunately, nowadays, regardless of the results of our actions, we choose to ignore feedback and just "stick with the program," effective or not.

Take, for example, drugs education in our schools.

Ad Loading...

After assessing whether or not this was a challenge law enforcement could resolve (and at least there was an assessment—this step is also skipped these days) it was decided to implement D.A.R.E. nationwide. "Drug Awareness Resistance Education" was a program started by the Los Angeles PD  to nip drug use in the bud at the elementary school level. Additionally, the contact between the kids and a local police officer was to be a positive example of  caring professionals interacting with the children they were trying to keep safe.

The key problem with this decision was the lack of two critical elements of planning: First, no timeframe was set within which we would measure the results of the program, positive or negative. Second, we did not identify what those expected results should actually be, and test to see if they were achieved. From its beginning in 1983, until its rewriting in 2009, D.A.R.E. trained millions of kids, and spent billions of dollars, without any performance measurements applied. It was a popular program that kids and cops seemed to like, and therefore we assumed it was working.

My wife, the Sarge, ran her agency's D.A.R.E. program and will attest to the positive feedback each officer received when helping the kids deal with the real-world problem of drugs. Cool seizure vehicles, treasured T-shirts, and signature teddy bears became the symbols of the program. Every American school kid knew their "D.A.R.E. Officer," and these cops were minor celebrities in the grade schools in their towns. D.A.R.E., it was assumed, would be the final charge in the war on drugs, and negative feedback was not sought or accepted.

The problem was, the program was not actually making a difference in the use of drugs among the youth who had completed the curriculum. Repeatedly, researchers found the program was not doing what it was designed to do. And yet, year in and year out, funding, grants, and personnel went to the schools as they dutifully tried their best—and they truly tried—to stem the tide of drug use. If we are honest, we must admit that the problem of drugs is not truly a law enforcement issue, as much as it is a challenge for families, schools, neighborhoods, and social institutions. Yet these entities all too often step aside, wrongly thinking that crime fighters can take the reins and steer society away from dependency.

And now we have a new plethora of "recommendations" demanding that we "change the culture of law enforcement" without clearly 1. defining the problem, 2. collecting the data required to assess the problem, 3. identifying meaningful alternatives based on the data, 4. setting an expected time when these drastic changes should work, or 5. measuring whether the changes were successful or not. Good intentions are not enough when we make decisions for criminal justice, since unintended consequences can lead to increased officer deaths and civilian causalities. For example, the "Ferguson Effect" may have led to passive policing, increased crime, and training that has not been evaluated for efficacy; its only "evaluation" is how it "looks" to politicians and the media.

Ad Loading...

The blueprint for planning and change that I was taught was based on the textbook Criminal Justice Planning, by O'Neill, Bykowski, and Blair (1976). It uses a systems-based approach to planning and executing change in an organization. Essentially, it is the good old Aristotelian Scientific Method applied to planning: Identify the Problem; Gather Data;  Develop Possible Alternatives; Choose One; Develop an Implementation Plan; and finally, Conduct an Evaluation. This last process may lead to changing the original plan, or choosing a different alternative. It is called feedback and it works!

This model will look familiar to you crime-fighters who are proponents of the OODA Loop. Created by USAF Colonel John Boyd, OODA stands for Observe, Orient, Decide, Act. The "secret sauce" is that it's a Loop; after Act, we Observe the results of the Act, and then run through the loop again; and again; and again—forever. This system has proven effective in a broad range of applications, and yet we neglect this process in high-level decision-making for law enforcement.

Too often, we get a demand to train our crime fighters in bias, de-escalation, or some other "cultural change," in this strange non-loop way. We have no means to determine what other options we have, what it looks like when it works, what data exists to support the training or expenditure, or an expectation that we will refine the process over time to increase its effectiveness. It's time we stop genuflecting to every social justice warrior with a PhD, or academic idea that grows out of the teacher's lounge, and get back to effective planning that achieves the true mission of law enforcement: freedom and security.

Dave Smith is an internationally recognized law enforcement trainer and is the creator of "JD Buck Savage." You can follow Buck on Twitter at @thebucksavage.

Subscribe to our newsletter

More Patrol

POLICE Magazine graphic featuring a close-up of a tick on human skin with the headline “Tiny Creature, Big Threat” and subtitle “What officers need to know about ticks and alpha-gal syndrome.”
Patrol•November 4, 2026

The Threat That Fits Under Your Fingernail

What cops need to know about alpha-gal, the tick-borne allergy that can turn an ordinary exposure into a problem weeks or months later.

Read More →
Bradenton, Florida, Police Department’s September 2026 Officers of the Month: Sergeant Andres Perez and Officers Rosey Bautista, Michael Wall, and Alexandra Fallacaro, pictured in uniform beside American flags.
Patrol•October 30, 2026

NLEOMF Honors September 2026 Officers of the Month

Four Bradenton Police Department officers were selected as the NLEOMF Officers of the Month for September 2026 for a nighttime water rescue.

Read More →
BLACKHAWK! Mini EDC multitools displayed in tan and black, showing open pliers, knives, and other tools alongside their folded configurations against a textured gray background with the BLACKHAWK! logo.
Patrol•October 29, 2026

Blackhawk Debuts Mini EDC Pocket Multi-Tool

The Blackhawk Mini EDC Pocket Multi-Tool stows easily in pants pockets thanks to a sturdy stainless steel pocket clip and incorporates several essential/emergency tools into a single, high-mobility unit.

Read More →
Ad Loading...
Team Wendy EXFIL Endurance ballistic helmet in olive green with tactical rails and chin strap, displayed alongside the Team Wendy logo and product headline against a textured black-and-gray background.
Patrol•October 23, 2026

Team Wendy Introduces the EXFIL Endurance Ballistic Helmet, Engineered to Reduce the Burden of Extended Wear

Team Wendy has launched its EXFIL Endurance, a new lightweight ballistic helmet engineered to deliver protection, comfort, and fit during demanding, extended operations.

Read More →
Collage featuring paramedics, firefighters, police officers, and emergency vehicles surrounding the First Responders Children’s Foundation logo, highlighting the organization’s support for families of first responders.
Patrol•October 22, 2026

The First Responders Children’s Foundation National First Responders Day Roll Call of Heroes Ceremony Returns to Times Square, NYC

First Responders Children’s Foundation (FRCF), in collaboration with T-Mobile, will host the Roll Call of Heroes ceremony in Times Square to commemorate National First Responders Day on Wednesday, Oct. 28. During the event, FRCF will present 18 Hero Awards.

Read More →
Streamlight promotional graphic showcasing four lighting products: TLR-3X, PolyTac 1X, ProTac Rail Mount 1L-X, and ProTac Rail Mount VIR Pro, displayed against an orange and black background with the Streamlight logo.
Patrol•October 22, 2026

Streamlight to Showcase Newest Lighting Products for Law Enforcement Professionals at IACP 2026

Streamlight will showcase its newest lights for law enforcement at the International Association of Chiefs of Police Annual Conference & Expo. Featured lights will include the TLR-3 X, the PolyTac 1X, and more.

Read More →
Ad Loading...
Streamlight Portable Scene Light III featuring a tripod-mounted LED work light and close-up product view, with a badge recognizing it as the 2026 OH&S New Product of the Year winner.
Patrol•October 15, 2026

Streamlight Portable Scene Light III Wins 2026 OH&S New Product of the Year Award

Streamlight’s Portable Scene Light III has won the 2026 Occupational Health & Safety (OH&S) New Product of the Year Award in the Lighting category.

Read More →
Hands insert an Adept Armor protective plate into a camouflage tactical plate carrier, demonstrating how the armor plate fits inside the vest.
Patrol•September 17, 2026

Adept Armor Introduces Two New Rifle Plates

Adept Armor has launched two new Level IV ballistic plates, the Emperor and the Archon Mark 2, which brings Adept Armor’s new Quatroid ceramic to the high-threat, performance-value center of the range at 5.2 pounds.

Read More →
Open Benchmade folding knife with a bronze-colored blade, textured dark handle, and braided lanyard resting on weathered wooden boards.
Patrol•by Wayne Parham•September 17, 2026

POLICE Product Test: Benchmade Bailout

The Benchmade Bailout is a slim, lightweight carry knife with a deep-ride pocket clip and comes in a variety of blade steels and scales. Here is a detailed review of the Taiga Green Bailout, released earlier this year.

Read More →
Ad Loading...
Officer of the Month graphic honoring Deputy Lorne Juday of the Osceola County, Michigan, Sheriff’s Office for July 2026, featuring a portrait of Juday in uniform.
Patrol•September 17, 2026

NLEOMF Announces July 2026 Officer of the Month

NLEOMF honored a Michigan deputy sheriff as the July 2026 Officer of the Month for rescuing a trapped driver from a burning vehicle following a Fourth of July crash.

Read More →