The legal industry wants more innovation. The missing ingredient is strong leadership.


Several years ago, a good friend threw me to the lions, though that was not his intent.

My friend, who works in legaltech, asked me to show up at the headquarters of a Fortune 100 company to present some prototypes I had developed on giving feedback to law firms.  Cost pressures were rolling downhill to the legal department.  Thus, in an effort to better manage costs, the senior leadership winnowed their outside law firms to a panel of preferred providers.  In theory, the firms were supposed to work cooperatively with each other to deliver world-class quality within a large predefined budget.

From a distance, this all sounded innovative. But up close, implementation was a challenge. The only management tool was an annual rating system that measured law firms on a 1 to 5 scale (1 = poor, 5 = excellent). Because performance was aggregated across dozens of lawyers and dozens of matters, the narrative comments were too general and lacking in context to be helpful. Further, all the quantitative scores were clustered in the 4.8 to 4.9 range, making them useless for making merit-based adjustments.  Indeed, if in-house lawyers gave scores any lower, they’d be tacitly admitting a problem with their own oversight.

I had approximately 90 minutes to present my prototype to a room full of BigLaw relationship partners.  Basically, my proposal was to have in-house counsel complete a monthly survey tool for each significant matter they were managing (a 10 to 30-minute commitment per lawyer who managed outside counsel). In turn, the results would roll up to a centralized knowledge management system that would generate practice group, firm, and legal department-level reports.

Although the proposed prototype required the in-house lawyers to do all the work to generate the feedback, the law firm partners disliked everything they heard, arguing that the work to review the feedback would be burdensome and counterproductive. One especially vociferous partner remarked, “If there’s a problem, I’d rather have a phone call.” He would not concede that there was any value to timely bucketing specific examples of good and bad behaviors, nor that the resulting data could provide a roadmap to help the client and create a factual basis for higher fees.

As I was getting pummeled by the BigLaw partners, the in-house lawyers looked on in silence.  And in hindsight, I really don’t blame them.  They, like me, were learning the depth of the opposition to systematic measurement of performance.  It would have been a different dynamic if the general counsel, who operated at a level above these lawyers and was not supervising this initiative, had communicated that the company was going to use a feedback system to better manage millions in legal spend and that the purpose of this meeting was not to question the premise, but collaborate on implementation.

At this juncture in my career, I had not witnessed many examples of strong and decisive leadership among lawyers and thus did not appreciate how essential it was to organizational progress.  Over the next several years, however, I began to see the pattern.

Who should run the feedback process?

A few years later, in December of 2014, I spent the afternoon with two law firm insiders who were in charge of strategic initiatives at their respective firms.  Both believed in the importance of client feedback to not only enhance the quality of service but also deepen relationships with clients and build a path to more meaningful and sustainable growth.  Yet, they expressed frustration at its limited value to drive firm-wide or industry-level change.

Here’s why.  Imagine a large corporate client that uses 20 outside law firms.  In most cases, that means that there are nearly 20 different ways that the client provides feedback. One firm sends the managing partner for an annual dinner with the general counsel. Another sends the relationship partner. A third sends the Chief Value Officer. A fourth has an annual client survey system, albeit only 30% of the in-house lawyers reply. Several other firms use a third-party service, such as Acritas, Wicker Park Group, BTI, or PP&C Consulting.  And a surprising number of firms are content with feedback in the form of paid bills and continued work.

Virtually all of these feedback mechanisms are fragmented and lacking in context, making it easy for lawyers to rationalize away negative information. Under the best case scenario, only 20-30% of the total feedback time will result in significantly better performance.  That means that 70-80% of feedback has zero ROI. That’s an enormous amount of waste.

Yet, what if clients took control of the feedback process? As my colleagues pointed out, if clients rigorously evaluated their outside counsel, the information would be too direct and specific to be ignored. Then we laughed at our Panglossian idea, “This is never going to happen.”

Sometimes it’s good to be wrong

One of my law firm friends in the December 2014 meeting was John Fernandez, who was at the time was the US Chief Innovation Officer at Dentons (now Global Chief Innovation Officer).  One of John’s projects was the launching of NextLaw Ventures and NextLaw Labs, which identified promising new legal technologies for investment and piloting within the firm.

In June of 2015, John fielded an inquiry from a corporate GC who had, over the course of eight years and two different companies, developed a feedback system for managing his outside law firms.  The general counsel, Mark Smolik of DHL Supply Chain Americas, was looking for guidance on whether this idea had commercial application. John asked if I wanted to join a meeting with Mark to help vet the opportunity for NextLaw.  I said “sure.”

That meeting was very fateful because (a) John and I had already identified that this was a problem worth solving, and (b) Mark Smolik had years worth of data showing that his system worked.   Miscommunication and derailments were going down, value per dollar spent was going up, and Mark had more bandwidth to focus on other company priorities.

Borrowing from HR

I think readers will benefit from understanding the origins of Smolik’s system, as it reveals the power of simple ideas and insights.

The first insight occurred to Mark over a decade ago when he was general counsel of Safelite Auto Glass, a national company doing on-site windshield repair.  In addition to running the legal function, Mark was also in charge of HR. One day, Mark became a Safelite customer when the windshield on his wife’s car got damaged.  While at work, Mark took a call from his wife, who told him that a somewhat frightening looking guy claiming to be with Safelite showed up at the house to repair the damage  “I have no idea who this person is. Why should I open the door?” Wanting to reassure his wife, Mark contacted the Columbus service center and asked them to send their best technician to perform the work. “Please tell me his name and at least what he looks like.”

That incident gave Mark an opportunity to experience Safelite through the eyes of the customer.  Shortly thereafter, Safelite developed a standard practice of sending a technician profile email to all its mobile customers that included name, photo and credentials of the auto glass technician.  Safelite also implemented a client feedback tool to track the quality of each service call.  By the time Smolik left Safelite in 2009 (two years after its successful sale to Belron), Safelite was planning a national ad campaign that would make the quality and friendliness of their glass technicians the centerpiece of the company’s branding.

The systematic tracking of the customer-facing personnel at Safelite created a desire in Mark to apply the same logic to the many law firms that he was managing.  “If the company is going to spend a few hours each year reviewing the performance of each of its employees, then why aren’t we devoting at least that much attention to the large sums we spend on law firms?”

Thus, Mark applied basic HR principles to his outside counsel, developing performance criteria, applying it to firms, sharing results, and collaborating on a plan for improvement.  Mark used this methodology to winnow and consolidate the number of firms he worked with. This reduced his overall communication overhead while increasing the value of each dollar Safelite spent on legal.

Building a company around scorecards

By the spring of 2016, Mark Smolik’s outside counsel scorecarding system became the basis for Qualmet, one of the first companies in NextLaw Ventures investment portfolio.

Along with John Fernandez, the other law firm insider at my December 2014 meeting was Jim Beckett, who at the time was Chief Business Development Officer at Frost Brown Todd.

Beckett started his legal career as a Frost Brown Todd associate before going in-house at RJ Reynolds. A few years later, he moved to the business side, running an RJ Reynolds operating unit in Puerto Rico.  Jim came back to the firm partially because it enabled him to raise his family in his hometown of Louisville.  But having spent eight years inside a large company, he felt he had a roadmap in his head for how a law firm could grow market share. Jim and the firm’s chairman, John Crockett, had worked together when Jim was an associate and John was a young partner.  John wanted to give Jim’s ideas a try.

Jim’s business development strategy was very simple.  Spend time with your clients and listen to what’s on their mind.  Then make their problems your problems, using all your creative energies to identify, anticipate, and solve what’s happening in their world. This may sound obvious, but many lawyers struggle to get out of their comfort zone and then blame the lack of immediate returns on client resistance.

At his core, Jim is an impatient person who wants to change the industry.  Thus, in December of 2014, when we discussed the possibility of the client owning the feedback process, Jim couldn’t get it out of his head.  By the time Fernandez and I met with Smolik, Jim was sketching out a business plan.  Thus, during the June 2015 meeting, I told Mark, “There is a guy, Jim Beckett, who you’ll want to talk to. He has been on both the buy and sell side and is already fixated on this idea.”  John nodded in agreement, “I can’t think of a better guy to run with this.”  After several months of additional vetting, Qualmet was formed and Jim was named CEO.

CEO in legaltech may sound glamorous, but in reality it’s just more stress, a pay cut,  a chaotic mix of product, marketing, and sales, 6 am flights, bad airport food, and guilt over how your career decision is affecting your family. But if you think this is your big opportunity to make a difference, you’re willing to pay that price.


Disclosure: Through NextLaw Lab, I gave input to Qualmet during its formation, including sitting on its Board. Qualmet also became a client of Lawyer Metrics, where I served as Chief Strategy Officer.   When I left Lawyer Metrics in late 2016, and before I started Legal Evolution, I resigned from Qualmet’s Board, as I viewed fiduciary obligations to any legal industry business as incompatible with my role as editor. In addition, I have no financial or investment interest in Qualmet or any legal industry company.


We’re entering the management age for lawyers

Leadership and management are not part of the legal education canon.  Yet, that is bound to change as more lawyers stumble forward into these disciplines to cope with the relentless growth in complexity we face on a daily basis. In the meantime, however, we are at risk for misinterpreting the tides of change.

For example, many lawyers and law firms (and initially this professor) are quick to conclude that the goal of scorecards is to save money.  Yet, in most cases, the motivation is scarcity of internal bandwidth. An important task done well and efficiently frees up time and mental energy to tackle other strategic priorities. Saving money, or getting more value per dollar spent, is a by-product of a more disciplined approach to one’s job as lawyer-manager.

The first step in this more disciplined approach is formulating the evaluation criteria.  Initially at Safelite and DHL, Mark Smolik focused on seven criteria:  (1) understands our objectives / expectations, (2) expertise, (3) responsiveness / communications, (4) efficiency / process management, (5) cost / budgeting skill, (6) results delivered / execution, and (7) compatibility with company values.  Each criteria, in turn, is defined by a set of specific behaviors.

What managing law firms looks like

For ideas like scorecards, lawyers need examples rather than abstract descriptions. In 2016, I ran some focus groups for what would later become Qualmet. Below are some of the graphics from those sessions (credit: Evan Parker from LawyerMetrix).

These data reflect the performance of actual law firms, including the AmLaw 200 firm of Conroy & Alexander (a pseudonym). The scores for each criterion are averages of in-house lawyers who used the firm. Obviously, between 2011 and 2015, things moved in the right direction. Conroy & Alexander now exceeds expectations on six of seven criteria and has a clear priority on where it needs to improve.

Below is the trendline of Conroy & Alexander’s average annual performance. This is the ROI that flows back to the in-house lawyers who are providing the feedback — they’re expending less time and attention to get better results.

Below is a picture of how the top seven firms are doing. Conroy & Alexander is firm E.

One takeaway is that expertise — which lawyers routinely fall back on to sell themselves, are table stakes.  Another takeaway is that no firm really stands out on efficiency / process management. Thus, perhaps this is an area where a firm could seek to differentiate itself over the next one to two years. A third takeaway is that firm F is in trouble.  During our focus groups, several leaders of AmLaw 200 firms said they would like this data as a management tool for partners who are all-too-ready to blame the client.

These scorecard graphics above are basic management tools applied to the work of lawyers.

Progress will require leadership

As a profession, have we accepted the premise that working within a well-designed management system would make our work more valuable to clients?

Few of us would debate the general premise, particularly in front of our clients. Yet, we struggle to accept it because, in our own little zones, we fear losing control.  As a profession, we need a handful of lawyers in positions of authority who will make the decision for us.  They will be subject to a lot of blowback and pleas for special treatments.  However, in the long-run they will win our trust and respect.  We will view them as leaders.

I came to this conclusion in December of 2017 during a design workshop in Chicago.  After more than a year in business, the Qualmet team is coming to grips with a common innovator mistake: they had confused why they loved their product with why a client might buy it.  Cf. Post 008 (“[The innovator is] often deeply immersed in the technical workings of the project … [and thus] at grave risk of falling in love with features that are of little practical value to the target end user.”). Fortunately, the Qualmet team includes professionals with expertise in marketing and design thinking. I secured them meeting space at Northwestern Law.  In exchange, I got to observe the workshop.

The key goal of the daylong session was to work backwards from the daily lives of legal department professionals.  A wide variety of legal professionals–not just general counsel–were invited in for 60- to 90-minute conversations.  The Qualmet team wanted to know how they spent their time, their biggest frustrations, what they wanted most out of their jobs, etc.  Yet, very rarely were these questions asked directly. Instead, they were asked for their reactions to a series of crude prototypes (the vast majority that had nothing to do with outside counsel scorecards).

For me, the most surprising revelation was that in legal departments with several lawyers, the general counsel spends less than half of his or her time managing the department.  Instead, they are focused on being a fully contributing member of a C-suite management team.  One GC of a publicly traded company put the percentage at 70%, with less than 15% that touched on anything related to outside counsel.  Among the department professionals, the common theme was lack of time and budget to operate at a strategic level.

Indeed, I did not realize it until later, but Qualmet was running the design work shop to test their thesis that scorecards were a tool to put the general counsel into alignment with the CEO, as the performance data could be used to show how decisions regarding outside counsel were being made. The use of quantified performance puts the GC in more of a business place than a “legal place.”

One question to a general counsel that I especially enjoyed was, “Do you want to be a CEO some day?” Reply, “yes.”

Follow-up, “What about your general counsel friends — do they want to be get promoted?” Reply, “Probably. Otherwise, why do this job? Once you become a general counsel, you are more a manager and leader than a practicing lawyer. Thus, you have to develop those skills to excel at your job. Why not embrace the career path?”

We need to talk more about leadership

Leadership in legal departments is different than leadership in law firms.  Unlike a law firm leader, a general counsel can make an unpopular but necessary decision and not worry about losing revenue and triggering a proverbial run on the bank.  This reality is what is driving the consolidation of law firms into global giants. The hope is that global reach and the support services that a large firm can afford — technology, project management, process improvement, data analytics, etc — will wed the client to the firm.

I would like to see more general counsel collaborate with law firm leaders. Scorecards are just the start.  The goal should be to bring out the best in the lawyers and legal professionals they lead and manage.

What’s next?  See Confusing conversations about clients (048)