Walk This Way — DoD IG Reviews DCMA Contracting Officer Business Systems Deficiencies

The sufficiency and effectiveness of business systems is an essential element in the project management ecosystem.  Far beyond performance measurement of the actual effort, the sufficiency of the business systems to support the effort are essential in its success.  If the systems in place do not properly track and record the transactions behind the work being performed, the credibility of the data is called into question.  Furthermore, support and logistical systems, such as procurement, supply, and material management, contribute in a very real way, to work accomplishment.  If that spare part isn’t in-house on time, the work stops.

In catching up on reading this month, I found that the DoD Inspector General issued a report on October 1 showing that of 21 audits demonstrating business system deficiencies, contracting officer timeliness in meeting DFARS deadlines at various milestones existed in every case.  For example, in 17 of those cases Contracting Officers did not issue final determination letters within 30 days of the report as required by the DFARS.  In eight cases required withholds were not assessed.

For those of you who are unfamiliar with the six business systems assessed under DoD contractor project management, they consist of accounting, estimating, material management, purchasing, earned value management, and government property.  The greater the credibility and fidelity of these systems, the greater level of confidence that the government can have in ensuring that the data received in reporting on execution of public funds under these contracts.

To a certain extent the deadlines under the DFARS are so tightly scheduled that they fail to take into account normal delays in operations.  Forbid that the Contracting Officer may be on leave when the audit is received or is engaged in other detailed negotiations.  In recent years the contracting specialty within the government, like government in general, has been seriously understaffed, underfunded, and unsupported.  Given that oftentimes the best and the brightest soon leave government service for greener pastures in the private sector, what is often left are inexperienced and overworked (though mostly dedicated) personnel who do not have the skills or the time to engage in systems thinking in approaching noted deficiencies in these systems.

This pressure for staff reduction, even in areas that have been decimated by austerity politics, is significant.  In the report I could not help but shake my head when an Excel spreadsheet was identified as the “Contractor Business System Determination Timeline Tracking Tool.”  This reminds me of my initial assignment as a young Navy officer and my first assignment as a contract negotiator where I also performed collateral duties in building simple automated tools.  (This led to me being assigned later as the program manager of the first Navy contract and purchase order management system.) That very first system that I built, however, was tracking contract milestone deadlines.  It was done in VisiCalc and the year was 1984.

That a major procurement agency of the U.S. Department of Defense is still using a simple and ineffective spreadsheet tracking “tool” more than 30 years after my own experience is both depressing and alarming.  There is a long and winding history on why they would find themselves in this condition, but some additional training, which was the agency’s response to the IG, is not going to solve the problem.  In fact, such an approach is so ineffective it’s not even a Band-Aid.  It’s a bureaucratic function of answering the mail.

The reason why it won’t solve the problem is because there is no magic wand to get those additional contract negotiators and contracting officers in place.  The large intern program of recruiting young people from colleges to grow talent and provide people with a promising career track is long gone.  Interdisciplinary and cross-domain expertise required in today’s world to reflect the new realities when procuring products and services are not in the works.  In places where they are being attempted, outmoded personnel classification systems based on older concepts of division of labor stand in the way.

The list of systemic causes could go on, but in the end it’s not in the DCMA response because no one cares, and if they do care, they can’t do anything about it.  It’s not as if “BEST TALENT LEAVES DUE TO PUBLIC HOSTILITY TO PUBLIC SERVICE”  was a headline of any significance.  The Post under Bezos is not going to run that one anytime soon, though we’ve been living under it since 1981.  The old “thank you for your service” line for veterans has become a joke.  Those who use this line might as well say what that really means, which is: “I’m glad it was you and not me.”

The only realistic way to augment an organization in this state in order the break the cycle is to automate the system–and to do it in a way as to tie together the entire system.  When I run into my consulting friends and colleagues and they repeat the mantra: “software doesn’t matter, it’s all based on systems” I can only shake my head.  I have learned to be more tactful.

In today’s world software matters.  Try doing today what we used to do with slide rules, scientific calculators, and process charts absent software.  Compare organizations that use the old division-of-labor, “best of breed” tool concept against those who have integrated their systems and use data across domains effectively.  Now tell me again why “software doesn’t matter.”  Not only does it matter but “software” isn’t all the same.  Some “software” consists of individual apps that do one thing.  Some “software” is designed to address enterprise challenges.  Some “software” is designed not only to enterprise challenges, but also to address the maximization of value in enterprise data.

In the case of procurement and business systems assessment, the only path forward for the agency will be to apply data-driven measures to the underlying systems and tie those assessments into a systemic solution that includes the contracting officers, negotiators, administrators, contracting officer representatives, the auditors, analysts, and management.  One can see, just in writing one line, how much more complex are the requirements for the automated panacea to replace “Contractor Business System Determination Timeline Tracking Tool.”  Is there any question why the “tool” is ineffective?

If this were the 1990s, though the practice still persists, we would sit down, perform systems analysis, outline the systems and subsystem solutions, and then through various stages of project management, design the software system to reflect the actual system in place as if organizational change did not exist.  This is the process that has a 90% failure rate across government and industry.  The level of denial to this figure is so great that I run into IT managers and CIOs every day that fail to know it or, if they do, believe that it will apply to them–and these are brilliant people.  It is selection bias and optimism, with a little (or a lot) of narcissism, run amok.  The physics and math on this are so well documented that you might as well take your organization’s money and go to Vegas with it.  Your local bookie could give you better odds.

The key is risk handling (not the weasel word “management,” not “mitigation” since some risks must simply be accepted, and certainly not the unrealistic term “avoidance”), and the deployment of technology that provides at least a partial solution to the entire problem, augmented by incremental changes to incorporate each system into the overall solution. For example, DeLong and Froomkin’s seminal paper on what they called “The Next Economy” holds true today.  The lack of transparency in software technologies requires a process whereby the market is surveyed, vendors must go through a series of assessments and demonstration tests, and where the selected technology then goes through stage gates: proof-of-concept, pilot, and, eventually deployment.  Success at each level gets rewarded with proceeding to the next step.

Thus, ideally the process includes introducing into the underlying functionality the specific functionality required by the organization through Agile processes where releasable versions of the solution are delivered at the end of each sprint.  One need not be an Agile Cultist to do this.  In my previous post I referred to Neil Killick’s simple checklist for whether you are engaged in Agile.  It is the best and most succinct distillation of both the process and value inherent in Agile that I have found to date, with all of the “woo-woo” taken out.  For an agency as Byzantine as DCMA, this is really the only realistic and effective approach.

DCMA is an essential agency in DoD acquisition management, but it cannot do what it once did under a more favorable funding environment.  To be frank, it didn’t even do its job all that well when a more favorable condition was in place, though things were better.  But this is also a factor in why it finds itself in its current state.  It was punished for its transgressions, perhaps too much.  Several waves of personnel cuts, staff reductions, and domain and corporate knowledge loss on top of the general trend has created an agency in a condition of siege.  As with any organization under siege, backbiting and careerism for those few remaining is rewarded.  Iconoclasts and thought leaders stay for a while before being driven away.  They are seen as being too risky.

This does not create a condition for an agency ready to accept or quickly execute change through new technology.  What it does do is allow portions of the agency to engage in cargo cult change management.  That is, it has the appearance of change but keeps self-interest comfortable and change in its place.  Over time–several years–with the few remaining resources committed to this process, they will work the “change.”  Eventually, they may even get something tangible, though suboptimized to conform to rice bowls; preferably after management has their retirement plans secured.

Still, the reality is that DCMA must be made to do it’s job because it is in the best interests of the U.S. Department of Defense.  The panacea will not be found through “collaboration” with industry, which consists of the companies which DCMA is tasked with overseeing and regulating.  We all know how well deregulation and collaboration has worked in the financial derivatives, banking, mortgage, and stock markets.  Nor will it come from organic efforts within an understaffed and under-resourced agency that will be unable to leverage the best and latest technology solutions under the unforgiving math of organic IT failure rates.  Nor will deploying the long outmoded approach of deploying suboptimized “tools” to address a particular problem.  The proper solution is to leverage effective COTS solutions that facilitate the challenge of systems integration and thinking.

 

 

Family Affair — Part II — The Micro and Managerial Economics of Projects under Public Monopsony

In my last post I summarized by the macroeconomic environment in which we operate and delved into some discussion of microeconomic foundations.  The response was positive if lukewarm overall, but ego-boosting is not why I started a blog.  One of my readers once asked why I don’t take on some hot button issues.  Well that’s not my role or area of expertise.  I’m not a politician or a social commentator.  The community I inhabit has a large impact but is relatively small and mostly consists of engineers, scientists, mathematicians, some policy-makers, thought leaders, and other technically-focused professionals.  I’m not trying to stir up emotions.  I’m out to stimulate discussion and thought.  I’m relieved that I don’t get trolls when posting factual information that goes against popular misconceptions.  They are a waste of time.

So for me this blog serves two purposes.  First, it is a public discussion of sorts on topics both familiar and unfamiliar, but which I consider interesting.  I do a lot of background research for each post and usually learn something new.  That’s why I don’t post every day.  I give things some thought and research what I write about.  I think it useful to share these discoveries and insights.  The ones that relate to my professional development and expertise in software and project management get posted to my company’s website.

Secondly, I think we live in interesting times.  This is meant both positively and ironically.  I think it useful to record the human condition as we find it in our daily lives during the period of human history we inhabit, and to record many of the intellectual and cultural issues that are topical.  I always find it interesting to return to a subject years later through the writings of others as well as my own to see how they stack up against the perspective of time.  Dr. Roger Spiller of the Army’s Combat Studies Institute, one of my mentors for my graduate degree in history, once told me that if I can look back at anything I’ve written and not be embarrassed by something in those writings would make me a very lucky man.  I’m not that lucky.  But taking the chance to be wrong is part of the price of intellectual curiosity.  Recognizing and admitting one’s wrongness is part of intellectual honesty and maturity–and we are nothing if not thinking.  Our intellect is the most significant feature that we possess that distinguishes us from the other animals.  It is in the cliche’, the ideology, the spin, the doctrine–types of non-thought–where evil finds comfort.

So in continuing from my last post; in understanding the basis of the macroeconomic environment in which we operate, how these systems behave, and how the microeconomics under the macroeconomic environment are affected by the framing of the macro rules of behavior allow us to then flesh out the microeconomics and managerial economics of project management.

As I stated in my last post on the topic, markets are really good at establishing price and pretty bad mechanism for anything else.  Everyone who has taken basic economics understands the basic supply and demand curve.  Here is an example for housing*:

 

So when we make decisions for projects within an organization or firm regarding price, which then allows us to determine the resources we will have to do business given a set of assumptions on possible sales volume, it is useful to understand the nature of the market in which it inhabits, and the competitive environment of that market.  Some examples follow.

Public Monopsony

I have a great deal of experience in operating in this type of market from my perspectives as a business operator and owner and, previously, as a government Contracting Officer and acquisition professional.  Monopsony exists where there is one dominant buyer of the supplies and services from that market.  There are both public and private monopsony (and some are forced by unfair competitive practices such as exclusivity agreements by dominant market entities due to their monopolistic or oligopolistic ambitions or position in a market as sellers).

The traditional supply and demand curve does not apply in the way that classical economics recognizes it under these conditions.

In government monopsony, such as the market for items for the Department of Defense and other specialized government agencies, the chances are that only a portion of the available commercial products in the market can be adapted to the requirement.  Very few commercial products need to survive missile impacts, evade guidance and radar systems, or survive through high G escape velocities and then perform in the vacuum of space, to name only some capabilities often desired.  Oftentimes commercial technologies that can be applied must be modified or “hardened” in order survive in the expected environments.

Governmental or public monopsony power cuts both ways.  As it is practiced in the United States under republican institutions, it behaves mostly in a benevolent manner.  The companies that inhabit this space in large part would not exist and achieve profitability if not for the specialized skills and products required.  They are, for all intents and purposes, semi-public institutions.  It is the irony of our times that free market fundamentalists will simultaneously criticize this type of governmental power while acknowledging the need for the end items that are only possible under this arrangement, especially in regard to national defense, but also for any measure of infrastructural, health, and other items required by a functioning nation.

In terms of microeconomics, there are a number of mechanisms that exist to balance out the asymmetrical relationship between the parties, while at the same time certain peculiarities in which the sovereign (the government) maintains its position.  For example, in contracting, the government invites an offer.  The methods of acquisition are requests for quote, requests for proposals, requests for information, etc.  The private or semi-private entity is always the offeror and, therefore, it is assumes freely engages in the activity being contracted.  In addition, only those offerors deemed both responsible and responsive can enter into a contract.  Responsibility includes a host of technical measures but, simply, it means that the firm offering the supplies and services has both the means and ability to perform the work.

The balancing mechanisms that apply in this market are many of the same institutions that provide checks and balances in competition with the Executive Branch: the Courts and the Congress.  The press operating as the Fourth Estate also provides a check in this area.  In addition, economic organizations from industry can petition the government through both direct lobbying and lobbying organizations, and influence the development of policy and standards through membership in professional organizations where certain competencies are shared.

Thus, because of these interrelationships and the nature of the market, competition is oftentimes limited to a few firms possessing expertise that is highly specialized.  Price competition, when it does occur, is oftentimes marginal (or should be) and employs a number of strategies summarized by the phrase “priced to win.”  These strategies can result in market distortions known as “buying-in” to a contractual arrangement.  There may be compelling reasons on the part of the producer/supplier to “buy-in”–denying market share to a competitor, to protect an area of expertise or a skillset or, alternatively, to develop one;  to ensure employment of internal competencies that would otherwise drive up overhead costs due to unutilized labor, apart from the motivation to win business.  For example, on the issue unutilized labor, one can reasonably ask how much it costs to develop an engineer familiar with the airframe of, say, an F-16 and, if lost, how can this expertise ever be reacquired so as to be available when it is needed?  Thus, in government acquisition, it falls upon the Contracting Officer to weigh these issues and prevent outright buying-in, though their expertise and skill in identifying and preventing this type of behavior is certainly not uniform.

Where there is an overlap for supplies ands services across both private and public sectors, there is an opportunity for some competition among firms that provide items based on commercial-off-the-shelf-pricing that responds to a certain extent to the supply and demand pricing mechanism.  For example, in project management, these are usually firms devoted to consulting and to software companies with sharply targeted functionality.  But even here, the expertise required to fulfill some of the needs of the market are unique and, as a result, prices tend to be sticky or inelastic; resisting wholesale competition that would drive a race to the bottom based solely on price.

Furthermore, since acquisition is an Executive Branch responsibility subject to acquisition law, rules, and regulations, their interpretation and implementation is oftentimes influenced not only by operational, but also political considerations.  Since the imposition of sequestration, for example, project managers and contracting officers have been under a great deal of pressure to reduce both costs and prices.  This can often result in government agencies acquiring an inferior or deficient product–or fewer units than needed based on operational requirements–where cost and price pressure is the overriding consideration.  The tenor of looking for cost reduction has been a constant since the early 1980s.  Thus, over the years, a number of “acquisition reform” methods have been employed to counteract the perceived and real inefficiencies in acquiring the latest technology at the most reasonable cost.

Where cost and price pressure is seen to undermine quality, the supply and demand curve in setting price is modified by agencies to require that an assessment of value be determined, and that the item providing the best value, even if not the lowest cost, be selected.  Even in an expansive open market with many competitors there will be a range of similar products offered under range of prices, where the consumer will view several of the products as falling within an acceptable range of value.  This perception of value can be influenced by the asymmetrical relationship between the parties regarding information, or influenced by other psychological factors such as fashion and marketing.  Government monopsony counteracts the asymmetrical relationship of information and psychological factors that tend to distort good market decisions through specialized requirements on offerors–Truth in Negotiations (TINA), representations and certifications of full disclosure, socio-economic and non-discriminatory status, in sensitive areas restrictions on the use of foreign nationals and foreign influence, adherence to U.S. federal labor laws, among other requirements.  For highly complex cost-reimbursable efforts, the offeror must provide cost accounting data and procedures, and ensure that business systems adhere to certain minimum standards prior to award.  Contracting officers can also open discussions and negotiations at will to determine the true cost or value of the supplies and services being acquired–compelling the offeror to provide the necessary information.

Value analysis also acts as a break to downward price pressure.  For example, in my own area of software technology, while it is true that general expertise in areas of programming that 10 years ago were fairly rare–and commanded high salaries–is no longer the case due to policies that promoted globalization, there are some very highly specialized skillsets that cannot be outsourced, at least not yet.  Finding someone who understands not only how to code, but how that code needs to operate in the environment for which it is designed, is a skill that is highly influenced by culture.  The culture can be one of a nation, a people, a market, or a specialty.  In the area of public project management in the United States, it may not be sufficient for someone to come forward with general programming skills without an understanding of the managerial economics that influence the environment.  Instead, they may be called upon to know or be able to learn very quickly the security protocol required for the data being processed, the structure of the organizations in the market, and the manner in which information is consumed and analyzed, as well as issues of cost management, schedule management, risk management, and technical achievement.  Individuals with these skillsets exist but they are few and far between, and command salaries commensurate with their talents and expertise.  From the microeconomic perspective, when there is no longer a demand for this expertise the value will no longer be there to sustain the price established, but there isn’t going to be a lot of price competition while there is demand, so pricing tends to be inelastic.

In public monopsony, the government is the consumer.  As such, this differs from private monopsony such as that recently described by The New Republic regarding Amazon’s impact on the publishing industry, where the dominant market entities are part of the supply chain between producers and consumers.

The management economics of project management under public monopsony, then, leaves no room for pricing adjustments other than what is provided by the contracts that govern the acquisition of the products and services.  Where commercial products can be utilized, pricing is flexible enough in making a difference in terms of project cost reduction for those niches, assuming that they do not require a great deal of specialization or configuration to meet the special needs of the public marketplace.  This creates an environment of both certainty (and hence stability until, at least, instability is introduced by the political system) and a series of constraints on both managerial action and economic flexibility.

As such, there is no room for lack of estimating, scheduling, risk assessments, or performance management as has been pointed out numerous times, but most recently by Glen Alleman in his excellent “Herding Cats” blog.  There is no room for “exploring” because “we don’t know what we need until we build it.”  Recently I attended a meeting with both public and private industry officials discussing how Agile methods can be reconciled with the more structured environment of public project management.  Well, I guess if we forget about budgets and contracts we can all get to that day when developers don’t have to be accountable and we all can pursue imaginary cost avoidance in providing unmeasurable value under the rubric of cults built on catchphrases.  (And a sad day that would be).

In the meantime, for a firm to survive and its products to be sustainable so that it continues to win a share in this market, inelastic pricing that must be established by strong estimating skills in determining what the market entities will accept, an active regulatory regime, and a structured contracting environment–which provide both advantages and constraints–are the overriding factors in managerial economics as they apply to project management under public monopsony.

I will be dealing with private monopsony in a post next week.

*From “Comparative Statics: Changes in the Price of Housing”, section 19.2 from the book Theory and Applications of Economics (v. 1.0).  The chart can also be found here.