Carnegie Mellon Process Maturity Profile CMMI v1.1 SCAMPI SM v1.1 Class A Appraisal Results 2006 Mid-Year Update September 2006 We could not produce this report without the support of the organizations and lead appraisers who reported their appraisal results to the SEI SM. Our many thanks for their continuing cooperation with our data collection and analysis efforts. CMMI Appraisal Program The is a federally funded research and development center sponsored by the U.S. Department of Def ense and operated by Carnegie Mellon University CMMI Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon University SM SCAMPI and SEI are service marks of Carnegie Mellon University September 2006 Process Maturity Profile - Page 1
Report Documentation Page Form Approved OMB No. 0704-0188 Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. 1. REPORT DATE SEP 2006 2. REPORT TYPE 3. DATES COVERED 00-00-2006 to 00-00-2006 4. TITLE AND SUBTITLE Process Maturity Profile: CMMI v1.1 SCAMPISM v1.1 Class A Appraisal Results 2006 Mid-Year Update 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) 5d. PROJECT NUMBER 5e. TASK NUMBER 5f. WORK UNIT NUMBER 7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) Carnegie Mellon University, (SEI),Pittsburgh,PA,15213 8. PERFORMING ORGANIZATION REPORT NUMBER 9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR S ACRONYM(S) 12. DISTRIBUTION/AVAILABILITY STATEMENT Approved for public release; distribution unlimited 13. SUPPLEMENTARY NOTES 14. ABSTRACT 11. SPONSOR/MONITOR S REPORT NUMBER(S) 15. SUBJECT TERMS 16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF ABSTRACT a. REPORT unclassified b. ABSTRACT unclassified c. THIS PAGE unclassified Same as Report (SAR) 18. NUMBER OF PAGES 21 19a. NAME OF RESPONSIBLE PERSON Standard Form 298 (Rev. 8-98) Prescribed by ANSI Std Z39-18
Outline Introduction Current Status Summary Terms used in this Briefing How to Report your Appraisal Results to the SEI This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes. The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes lead appraisers and team leaders to conduct appraisals. Neither the SEI nor any other organization is a certifying authority of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only. Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on appraisal methods and for a directory of authorized lead appraisers who can perform them, visit: http://www.sei.cmu.edu/appraisal-program/ September 2006 Process Maturity Profile - Page 2
Introduction: Purpose Characterize the adoption of CMMI Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPI SM ) v1.1 Class A appraisals using Capability Maturity Model Integration (CMMI) v1.1 * Encourage continued reporting of results * Organizations previously appraised against CMMI v1.0 and which have not reappraised against v 1.1 are not included in this report Please visit: http://www.sei.cmu.edu/appraisal-program/profile/about.html for additional information or questions you may have about this briefing before contacting the SEI directly September 2006 Process Maturity Profile - Page 3
Section 1. Current Status SCAMPI v1.1 Class A appraisals conducted from its April 2002 release through June 2006 and reported to the SEI by July 2006 1,581 appraisals 1,377 organizations 840 participating companies 169 reappraised organizations 6,001 projects 63.8% Non-USA organizations Please refer to: Terms Used in this Report on page 19 Additional charts providing different views and break down of this information will be added to this briefing as more appraisal data is reported to the SEI over time. September 2006 Process Maturity Profile - Page 4
650 Carnegie Mellon Process Maturity Profile by All Reporting Organizations 600 550 Number Of Organizations 500 450 400 350 300 250 33.3% 33.8% 18.2% 200 150 8.4% 100 50 1.9% 4.4% 0 Not Given Initial Managed Defined Quantitatively Managed Based on most recent appraisal of 1,377organizations Optimizing September 2006 Process Maturity Profile - Page 5
Reporting Organizational Categories Commercial/In-house 67.6% Contractor for Military/Government 28.8% Military/Government Agency 3.6% 0 200 400 600 800 1000 1200 Number of Organizations Based on 1,377 organizations September 2006 Process Maturity Profile - Page 6
Process Maturity Profile by Reporting Organization Categories 100% 90% 80% Commercial/In-house = 931 Contractor for Military/Government = 396 Military/Government Agency = 50 % Of Organizations 70% 60% 50% 40% 38.0% 32.1% 33.8% 52.0% 35.9% 34.5% 30% 20% 19.9% 15.7% 10% 0% 6.7% 8.8% 1.6% 2.8% Not Given Initial Managed Defined Quantitatively Managed Based on most recent appraisal of 1,377 organizations 4.0% 5.3% 3.0% 6.0% Optimizing September 2006 Process Maturity Profile - Page 7
Organization Type Based on Primary Standard Industrial Classification (SIC) Code Mining 0.2% Retail Trade 0.4% Wholesale Trade 1.0% Transportation, Communication, Electric, Gas and Sanitary Services 3.2% Finance, Insurance and Real Estate 5.9% Public Administration (Including Defense) 10.1% Business Services 40.8% Services 55.4% Manufacturing 23.8% Fabricated Metal Products 0.4% Primary Metal Industries 1.0% Industrial Machinery And Equipment 2.2% Electronic & Other Electric Equipment 5.1% Engineering & Management Services 13.3% Other Services 0.8% Health Services 0.6% Instruments And Related Products 5.9% Transportation Equipment 9.1% Based on 505 organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html September 2006 Process Maturity Profile - Page 8
Organization Size Based on the total number of employees within the area of the organization that was appraised 501 to 1000 8.2% 1001 to 2000 5.6% 2000+ 2.8% 25 or fewer 9.8% 301 to 500 9.5% 201 to 2000+ 37.0% 1 to 100 43.0% 26 to 50 13.4% 201 to 300 10.9% 101 to 200 20.0% 51 to 75 11.2% 76 to 100 8.7% Based on 1,348 organizations reporting size data September 2006 Process Maturity Profile - Page 9
100% Carnegie Mellon Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised 90% 80% % of Organizations 70% 60% 50% 40% 30% 20% 10% 0% 6.8% 3.8% 68.2% 18.9% 0.8% 1.5% 10.0% 1.7% 48.3% 35.6% 4.4% 7.9% 2.0% 38.4% 40.4% 2.0% 9.3% 9.4% 1.7% 29.9% 38.5% 6.0% 14.5% 8.9% 1.5% 30.5% 36.1% 5.6% 17.5% 8.8% 2.0% 29.9% 38.1% 4.8% 16.3% 5.5% 0.8% 23.4% 35.2% 7.0% 28.1% 7.3% 1.8% 12.7% 25.5% 11.8% 40.9% 9.2% 2.6% 6.6% 31.6% 2.6% 47.4% 5.3% 5.3% 36.8% 5.3% 47.4% 25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+ Not Given Initial Managed Defined Quantitatively Managed Optimizing Based on 1,348 organizations reporting size data September 2006 Process Maturity Profile - Page 10
1000 Disciplines Selected for Appraisals 900 800 700 50.7% SE = System Engineering SW = Software Engineering IPPD = Integrated Product and Process Development SS 46.5% = Supplier Sourcing Number of Appraisals 600 500 400 300 200 36.2% 100 3.9% 3.5% 2.2% 1.5% 0.9% 0.8% 0.2% 0.1% 0.1% 0 SW/IPPD/SS SE/IPPD/SS SE/SS SW/SS SW/IPPD SE/SW/IPPD SE SE/SW/IPPD/SS SE/SW/SS SW SE/SW Based on 1,581 appraisals For more information about Allowable Models & Combinations, visit: http://www.sei.cmu.edu/cmmi/background/aspec.html September 2006 Process Maturity Profile - Page 11
Countries where Appraisals have been Performed and Reported to the SEI Argentina Australia Austria Bahrain Belarus Belgium Brazil Canada Chile China Colombia Czech RepublicDenmark Dominican Republic Egypt Finland France Germany Hong Kong India Indonesia Ireland Israel Italy Japan Korea, Republic oflatvia Malaysia Mauritius Mexico Morocco Netherlands New Zealand Pakistan Philippines Portugal Russia Singapore Slovakia South Africa Spain Sweden Switzerland Taiwan Thailand Turkey Ukraine United Kingdom United States Vietnam Red country name: New additions with this reporting September 2006 Process Maturity Profile - Page 12
USA and Non-USA Reporting Organization Categories Commercial/In-house 144 787 Contractor for Military/Government 91 305 Military/Government Agency 49 USA: 100% = 498 Non-USA: 100% = 879 1 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% % of Organizations Based on 498 USA organizations and 879 Non-USA organizations September 2006 Process Maturity Profile - Page 13
Maturity Profile by All Reporting USA and Non-USA Organizations 100% 90% USA: 100 % = 498 80% Non-USA: 100 % = 879 % of Organizations 70% 60% 50% 40% 30% 20% 74 188 271 149 316 66 184 10% 0% 42 12 14 Not Given Initial Managed Defined Quantitatively Managed 9 52 Optimizing Based on 498 USA organizations and 879 Non-USA organizations September 2006 Process Maturity Profile - Page 14
Number of Appraisals and Maturity Levels Reported to the SEI by Country Country Number of Appraisals Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Maturity Level 5 Reported Country Number of Appraisals Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Argentina 15 No Yes Yes Yes Yes Korea, Republic of56 Yes Yes Yes Yes Yes Australia 23 Yes Yes Yes Yes Yes Latvia 10 or fewer Austria 10 or fewer Malaysia 15 No No Yes No Yes Bahrain 10 or fewer Mauritius 10 or fewer Belarus 10 or fewer Mexico 10 or fewer Belgium 10 or fewer Morocco 10 or fewer Brazil 39 No Yes Yes Yes Yes Netherlands 10 or fewer Canada 18 No Yes Yes No Yes New Zealand 10 or fewer Chile 10 or fewer Pakistan 10 or fewer China 158 Yes Yes Yes Yes Yes Philippines 14 No Yes Yes No Yes Colombia 10 or fewer Portugal 10 or fewer Czech Republic 10 or fewer Russia 10 or fewer Denmark 10 or fewer Singapore 10 or fewer Dominican Republic 10 or fewer Slovakia 10 or fewer Egypt 10 South Africa 10 or fewer Finland 10 or fewer Spain 25 No Yes Yes No Yes France 65 Yes Yes Yes Yes Yes Sweden 10 or fewer Germany 28 Yes Yes Yes Yes Yes Switzerland 10 or fewer Hong Kong 10 or fewer Taiwan 31 No Yes Yes No No India 177 No Yes Yes Yes Yes Thailand 10 or fewer Indonesia 10 or fewer Turkey 10 or fewer Ireland 10 or fewer Ukraine 10 or fewer Israel 10 or fewer United Kingdom 42 Yes Yes Yes Yes No Italy 10 or fewer United States 598 Yes Yes Yes Yes Yes Japan 155 Yes Yes Yes Yes Yes Vietnam 10 or fewer Maturity Level 5 Reported September 2006 Process Maturity Profile - Page 15
Process Area Profiles - 1 Organizations Appraised at Maturity Level 1 Optimizing Quantitatively Managed Defined Managed CAR OID QPM OPP DAR ISM RSKM IPM OT OPD OPF Val Ver PI TS RD CM PPQA MA SAM PMC PP REQM Fully Satisfied Rated 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Based on 49 appraisals reporting a maturity level 1 rating % of Appraisals September 2006 Process Maturity Profile - Page 16
Process Area Profiles - 2 Organizations Appraised at Maturity Level 2 Quantitatively Managed QPM OEI DAR Fully Satisfied Rated ISM IT RSKM IPM OT OPD OPF Val Ver PI Defined TS RD 0% 5% 10% 15% 20% Based on 516 appraisals reporting a maturity level 2 rating % of Appraisals September 2006 Process Maturity Profile - Page 17
Summary 1,581 appraisals have been reported to the SEI in 52 months Both Commercial/In-House organizations, Government/Military and Government/Military Contractors reporting appraisals are increasing at a stable and consistent rate The highest percentage of Commercial/In-House organizations reporting appraisals is from outside the USA The highest percentage of Government/Military Contractors reporting appraisals is from the USA Comparing early reports of the SW-CMM maturity profile with early CMMI data reflects a more mature CMMI profile Additional information and charts will be added to this briefing as more appraisals are reported and more data is available to support the breakdowns September 2006 Process Maturity Profile - Page 18
Terms Used in this Report Company - Parent of the appraised entity A company can be a commercial or non-commercial firm, for-profit or not for-profit business, a research and development unit, a higher education unit, a government agency, or branch of service, etc. Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc. Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States. September 2006 Process Maturity Profile - Page 19
Report your Appraisal Results to the SEI The briefing is only possible due to the cooperation of organizations and individuals sending in their appraisal results to the SEI In order to provide this information and service in the future, it will depend on this continued cooperation Please visit: http://www.sei.cmu.edu/appraisal-program/profile/about.html for forms, information, and instructions on how to report appraisals to the SEI September 2006 Process Maturity Profile - Page 20
Contact Information Please visit: http://www.sei.cmu.edu/appraisal-program/profile/about.html and review the information provided before contacting: SEI Customer Relations (412) 268-5800 SEI FAX number (412) 268-5758 Internet Address customer-relations@sei.cmu.edu Mailing Address Customer Relations Carnegie Mellon University Pittsburgh, PA 15213-3890 September 2006 Process Maturity Profile - Page 21