Weapons Acquisition Reform

Actions Needed to Address Systems Engineering and Developmental Testing Challenges

GAO-11-806, Sep 19, 2011

Additional Materials:

Contact:

Michael J. Sullivan
(937) 258-7915
contact@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

For the past 2 years, the Department of Defense (DOD) has been implementing the Weapon Systems Acquisition Reform Act (Reform Act) requirements for systems engineering and developmental testing. These activities are important to DOD's ability to control acquisition costs, which increased by $135 billion over the past 2 years for 98 major defense acquisition programs. GAO was asked to determine (1) DOD's progress in implementing the Reform Act's requirements and (2) whether there are challenges at the military service level that could affect their systems engineering and developmental testing activities. To do this, GAO analyzed implementation status documents, discussed developmental testing office concerns with current and former DOD officials, and analyzed military service workforce growth plans and test range funding data..

The new offices for systems engineering and developmental test and evaluation are continuing to make progress implementing Reform Act requirements. Since GAO's 2010 report on this topic, the Deputy Assistant Secretaries for Systems Engineering and Developmental Test and Evaluation have issued additional policies and guidance, assisted more weapons acquisition programs in the development of acquisition plans, and provided input to senior leaders at Defense Acquisition Board meetings. DOD also designated the Deputy Assistant Secretary for Developmental Test and Evaluation for concurrent service as the Director of the Test Resource Management Center. This was an optional Reform Act provision, which places oversight of testing resources and acquisition program developmental testing activities under one official. Despite these steps, the developmental test and evaluation office reports having difficulty covering its portfolio of about 250 defense acquisition programs with its current authorized staff of 63 people. Current and former testing officials believe the office needs more influence and resources to be effective, but they said thorough analysis has not been done to determine the appropriate office size. Further, according to the Deputy Assistant Secretary for Developmental Test and Evaluation, a statutory provision that designates the Test Resource Management Center as a field activity may limit his ability to achieve management and reporting efficiencies that could be obtained by combining or shifting resources between the two organizations. GAO has a matter for Congressional consideration to allow shifting resources between the Test Resource Management Center and the developmental test and evaluation office. The military services are facing workforce challenges that could curb systems engineering and developmental testing efforts, if not properly addressed. The services planned to increase their systems engineering and test and evaluation career fields by about 5,000 people (14 percent) and about 300 people (4 percent), respectively, between fiscal years 2009 and 2015 through hiring actions and converting contractor positions to government positions. The services have increased the systems engineering career field by about half of its projections and exceeded its planned growth for the test and evaluation career field through the end of fiscal year 2010. However, future growth may be difficult because of budget cuts and a clarification in DOD's insourcing approach, which may make civilian hiring more difficult. For example, the services now plan to hire about 800 fewer systems engineers by 2015 than they originally projected. Further, cuts to development test ranges' fiscal year 2012 budgets of nearly $1.2 billion (17 percent) over the next 5 years could offset some of the workforce gains already achieved. Currently, the services lack metrics that could be used to justify funding levels, effectively allocate funding cuts, make workforce decisions, or make difficult decisions related to mothballing, closing, or consolidating test capabilities, if future budget cuts are necessary. To the extent DOD cannot provide adequate systems engineering and developmental testing support to its weapon systems portfolio, the risks of executing the portfolio within cost and schedule are increased. GAO recommends that DOD assess the resources needed by the developmental test and evaluation office, develop a plan to implement the assessment, develop metrics to aid funding decisions, and report the effect budget cuts are having on the services' ability to meet program office needs. GAO also has a matter for congressional consideration. DOD concurred with two recommendations, and offered clarifying language, which GAO incorporated, on the other two recommendations for which DOD partially concurred.

Status Legend:

More Info

Status will change from "In process" to "Open," "Closed - implemented," or "Closed - not implemented" based on our follow up work.

  • In Process
  • Open
  • Closed - implemented
  • Closed - not implemented

Recommendations for Executive Action

Recommendation: The Secretary of Defense should assess the resources and influence needed by the developmental test and evaluation office to assist and oversee defense acquisition programs, including (1) the number of defense acquisition programs that can be supported by different developmental test and evaluation office staffing levels, including specifying the total number of personnel, the mix of government and contractor employees, and the number of senior executive service personnel needed for each of these staffing levels; (2) whether the Test Resource Management Center and the office of the Deputy Assistant Secretary for Developmental Test and Evaluation should be combined or resources shifted between organizations to more effectively support the activities of both organizations and if so, identify for Congress any statutory revisions that would be necessary; and (3) the proper reporting channel, taking into account the decision on whether or not to combine the organizations, the statutory oversight requirements, and the level of influence needed to oversee and assess program office developmental testing and service budgeting activities.

Agency Affected: Department of Defense

Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Defense should develop a plan to implement the results of the assessment.

Agency Affected: Department of Defense

Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Defense, with input from the military services, should develop metrics to assess the Major Range and Test Facility Base (MRTFB) test capabilities (expanding to DOD non-MRTFB, and non-DOD government test facilities once an approved set of metrics are in place supporting the MRTFB), justify funding, and assist in making decisions on the right-sizing of personnel, how best to allocate funding, or make future decisions on whether to mothball, shut down, or consolidate test facilities. These efforts should be coordinated with the Test Resource Management Center.

Agency Affected: Department of Defense

Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Defense, with input from the military services, should report the impact budget cuts reflected in the fiscal year 2012 budget, as well as the insourcing policy clarification, will have on their (1) total workforce (civilians, military, and contractors) that support both of these activities and (2) ability to meet program office systems engineering and developmental test and evaluation needs.

Agency Affected: Department of Defense

Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendations for Congressional Consideration

Recommendation: Contingent upon the results of DOD's assessment, the Congress may wish to consider revising any applicable statutory provisions necessary to allow for DOD to combine or shift resources between the Test Resource Management Center and the office of the Deputy Assistant Secretary for Developmental Test and Evaluation.

Agency Affected: Congress

Status: Open

Comments: When we determine what steps the Congress has taken, we will provide updated information.