Carnegie Mellon Process Maturity Profile CMMI SCAMPI SM Class A Appraisal Results 2007 Mid-Year Update September 2007 We could not produce this report without the support of the organizations and lead appraisers who reported their appraisal results to the SEI SM. Our many thanks for their continuing cooperation with our data collection and analysis efforts. CMMI Appraisal Program The is a federally funded research and development center sponsored by the U.S. Department of Def ense and operated by Carnegie Mellon University CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon University SM SCAMPI and SEI are service marks of Carnegie Mellon University September 2007 Process Maturity Profile - Page 1
Outline Introduction Current Status Summary Terms used in this Briefing How to Report your Appraisal Results to the SEI This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes. The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes lead appraisers, team leaders and certified high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a certifying authority of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only. Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on appraisal methods and for a directory of authorized lead appraisers who can perform them, visit: http://www.sei.cmu.edu/appraisal-program/ September 2007 Process Maturity Profile - Page 2
Introduction: Purpose Characterize the adoption of CMMI Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPI SM ) v1.1/v1.2 Class A appraisals using Capability Maturity Model Integration (CMMI) v1.1 /v1.2 * Encourage continued reporting of results * Organizations previously appraised against CMMI v1.0 and which have not reappraised against v 1.1 are not included in this report Please visit: http://www.sei.cmu.edu/appraisal-program/profile/index.html for additional information or questions you may have about this briefing before contacting the SEI directly September 2007 Process Maturity Profile - Page 3
Current Status SCAMPI v1.1/v1.2 Class A appraisals conducted from the SCAMPI V 1.1 April 2002 release through June 2007 and reported to the SEI byjuly 2007 2,464 appraisals 2,140 organizations 1,417 participating companies 273 reappraised organizations 10,338 projects 67.1% Non-USA organizations Please refer to: Terms Used in this Report on page 20 Additional charts providing different views and break down of this information will be added to this briefing as more appraisal data is reported to the SEI over time. September 2007 Process Maturity Profile - Page 4
Number Of Organizations 1000 950 900 850 800 750 700 650 600 550 500 450 400 350 300 250 200 150 100 50 0 Carnegie Mellon Process Maturity Profile by All Reporting Organizations 8.8% 1.6% 33.4% 38.1% 4.2% Not Given Initial Managed Defined Quantitatively Managed 13.9% Optimizing Based on most recent appraisal of 2140 organizations September 2007 Process Maturity Profile - Page 5
80 Carnegie Mellon Process Maturity Profile (V1.2) by All Reporting Organizations 70 Number Of Organizations 60 50 40 30 40.0% 37.0% 20 10 0 11.0% 2.0% 1.0% Not Given Initial Managed Defined Quantitatively Managed 9.0% Optimizing Based on most recent appraisal of 100organizations September 2007 Process Maturity Profile - Page 6
Reporting Organization Categories Commercial/In-house 70.7% Contractor for Military/Government 24.5% Military/Government Agency 4.4% 0 200 400 600 800 1000 1200 1400 1600 1800 Number of Organizations Based on 2131 organizations reporting an organization category September 2007 Process Maturity Profile - Page 7
100% Carnegie Mellon Process Maturity Profile by Reporting Organization Categories 90% Commercial/In-house = 1512 % Of Organizations Within Category 80% 70% 60% 50% 40% 30% 20% 10% 0% 10.1% 6.9% 28.4% 1.3% 2.5% 2.1% Contractor for Military/Government = 524 Military/Government Agency = 95 33.1% 32.6% 45.3% 39.6% 38.0% 16.8% Not Given Initial Managed Defined Quantitatively Managed 4.8% 2.9% 1.1% 14.4% 13.9% 6.3% Optimizing Based on most recent appraisal of 2131 organizations reporting an organization category September 2007 Process Maturity Profile - Page 8
Organization Type Based on Primary Standard Industrial Classification (SIC) Code Mining 0.1% Retail Trade 0.3% Wholesale Trade 0.3% Transportation, Communication, Electric, Gas and Sanitary Services 3.0% Finance, Insurance and Real Estate 6.3% Public Administration (Including Defense) 6.1% Business Services 34.1% Fabricated Metal Products 0.3% Primary Metal Industries 0.8% Services 62.8% Industrial Machinery And Equipment 2.0% Manufacturing 21.0% Electronic & Other Electric Equipment 9.5% Instruments And Related Products 2.8% Engineering & Management Services 20.2% Other Services 6.8% Health Services 1.7% Transportation Equipment 5.1% Other Manufacturing Industries 0.6% Based on 1190 organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html September 2007 Process Maturity Profile - Page 9
Organization Size Based on the total number of employees within the area of the organization that was appraised 501 to 1000 7.2% 1001 to 2000 4.1% 2000+ 2.2% 301 to 500 8.5% 25 or fewer 12.0% 201 to 300 9.5% 201 to 2000+ 31.5% 1 to 100 48.3% 26 to 50 14.7% 101 to 200 20.2% 51 to 75 12.5% Based on 2106 organizations reporting size data 76 to 100 9.0% September 2007 Process Maturity Profile - Page 10
100% Carnegie Mellon Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised 90% % of Organizations by Size 80% 70% 60% 50% 40% 30% 20% 10% 0% 8.3% 70.8% 17.0% 9.0% 42.6% 43.2% 2.0% 0.8% 1.2% 1.0% 1.3% 2.9% 6.1% 1.5% 38.3% 42.8% 3.8% 7.6% 10.5% 0.5% 25.8% 48.4% 4.2% 10.5% 10.4% 1.4% 27.8% 41.4% 4.9% 14.1% 8.5% 3.5% 27.0% 40.0% 6.0% 15.0% 5.6% 1.1% 22.3% 41.9% 6.7% 22.3% 8.6% 1.3% 15.9% 29.8% 9.3% 35.1% 11.5% 3.4% 4.6% 33.3% 3.4% 43.7% 8.5% 4.3% 40.4% 4.3% 42.6% 25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+ Not Given Initial Managed Defined Quantitatively Managed Optimizing Based on 2106 organizations reporting size data September 2007 Process Maturity Profile - Page 11
1400 1300 Disciplines Selected for Appraisals (V1.1) 1200 1100 1000 900 50.9% 37.4% SE = System Engineering SW = Software Engineering IPPD = Integrated Product and Process Development SS 46.5% = Supplier Sourcing Number of Appraisals 800 700 600 500 400 300 200 100 3.4% 3.3% 2.0% 1.3% 0.9% 0.7% 0.2% 0.1% 0.1% 0 SE/IPPD/SS SW/IPPD/SS SE/SS SW/IPPD SW/SS SE/SW/IPPD SE SE/SW/IPPD/SS SE/SW/SS SW SE/SW Based on 2,364 appraisals reporting discipline data For more information about Allowable Models & Combinations, visit: http://www.sei.cmu.edu/cmmi/background/aspec.html September 2007 Process Maturity Profile - Page 12
Countries where Appraisals have been Performed and Reported to the SEI Argentina Australia Austria Bahrain Belarus Belgium Brazil Bulgaria Canada Chile China Colombia Costa Rica Czech Republic Denmark Dominican Republic Egypt Finland France Germany Hong Kong India Indonesia Ireland Israel Italy Japan Korea, Republic Of Latvia Malaysia Mauritius Mexico Morocco Netherlands New Zealand Pakistan Peru Philippines Poland Portugal Romania Russia Singapore Slovakia South Africa Spain Sweden Switzerland Taiwan Thailand Turkey United Kingdom Ukraine United Arab Emirates United States Uruguay Viet Nam Red country name: New additions with this reporting September 2007 Process Maturity Profile - Page 13
USA and Non-USA Reporting Organization Categories Commercial/In-house 223 12 1289 Contractor for Military/Government 114 410 USA: 100% = 704 Military/Government Agency 24 71 Non-USA: 100% = 1427 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% % of Organizations Based on 704 USA organizations and 1427 Non-USA organizations reporting an organization category September 2007 Process Maturity Profile - Page 14
Maturity Profile by All Reporting USA and Non-USA Organizations 100% 90% USA: 100 % = 704 80% Non-USA: 100 % = 1436 % of Organizations 70% 60% 50% 40% 30% 257 458 236 580 20% 10% 0% 109 79 14 20 Not Given Initial Managed Defined Quantitatively Managed 10 80 78 219 Optimizing Based on 704 USA organizations and 1436 Non-USA organizations September 2007 Process Maturity Profile - Page 15
Country Carnegie Mellon Number of Appraisals and Maturity Levels Reported to the SEI by Country Number of Appraisals Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Maturity Level 5 Reported Country Number of Appraisals Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Argentina 26 No Yes Yes Yes Yes Malaysia 29 No Yes Yes No Yes Australia 26 Yes Yes Yes Yes Yes Mauritius 10 or fewer Austria 10 or fewer Mexico 29 Yes Yes Yes Yes Yes Bahrain 10 or fewer Morocco 10 or fewer Belarus 10 or fewer Netherlands 10 or fewer Belgium 10 or fewer New Zealand 10 or fewer Brazil 58 No Yes Yes Yes Yes Pakistan 10 or fewer Bulgaria 10 or fewer Peru 10 or fewer Canada 38 No Yes Yes Yes Yes Philippines 17 No Yes Yes No Yes Chile 17 No Yes Yes No Yes Poland 10 or fewer China 321 Yes Yes Yes Yes Yes Portugal 10 or fewer Colombia 16 No Yes Yes Yes Yes Romania 10 or fewer Costa Rica 10 or fewer Russia 10 or fewer Czech Republic 10 or fewer Singapore 10 Denmark 10 or fewer Slovakia 10 or fewer Dominican Republic 10 or fewer South Africa 10 or fewer Egypt 25 No Yes Yes Yes Yes Spain 55 No Yes Yes Yes Yes Finland 10 or fewer Sweden 10 or fewer France 94 Yes Yes Yes Yes Yes Switzerland 10 or fewer Germany 41 Yes Yes Yes Yes Yes Taiwan 71 No Yes Yes No Yes Hong Kong 10 Thailand 10 or fewer India 256 No Yes Yes Yes Yes Turkey 10 or fewer Indonesia 10 or fewer Ukraine 10 or fewer Ireland 10 or fewer United Arab Emir10 or fewer Israel 12 No Yes Yes No Yes United Kingdom 57 Yes Yes Yes Yes Yes Italy 12 No Yes Yes No No United States 859 Yes Yes Yes Yes Yes Japan 197 Yes Yes Yes Yes Yes Uruguay 10 or fewer Korea, Republic Of 87 Yes Yes Yes Yes Yes Viet Nam 10 or fewer Latvia 10 or fewer Maturity Level 5 Reported September 2007 Process Maturity Profile - Page 16
Process Area Profiles - 1 Organizations Appraised at Maturity Level 1 Optimizing Quantitatively Managed Defined Managed CAR OID QPM OPP DAR ISM RSKM IPM OT OPD OPF VAL VER PI TS RD CM PPQA MA SAM PMC PP REQM Fully Satisfied Rated 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Based on 59 appraisals reporting a maturity level 1 rating % of Appraisals September 2007 Process Maturity Profile - Page 17
Process Area Profiles - 2 Organizations Appraised at Maturity Level 2 Quantitatively Managed OPP QPM OEI DAR Fully Satisfied Rated ISM IT RSKM IPM OT OPD OPF Val Ver PI Defined TS RD 0% 5% 10% 15% 20% Based on 822 appraisals reporting a maturity level 2 rating % of Appraisals September 2007 Process Maturity Profile - Page 18
Summary 2464 appraisals have been reported to the SEI in 64 months Organization Category Commercial/In-house reports most of the appraisals The highest percentage of Commercial/In-house reporting appraisals is from outside the USA The highest percentage of Military/Government Agency /reporting appraisals is from the USA Outside the USA: China, India, Spain, France and Malaysia reporting appraisals are increasing at a rapid rate Additional information and charts will be added to this briefing as more appraisals are reported and more data is available to support the breakdowns September 2007 Process Maturity Profile - Page 19
Terms Used in this Report Company - Parent of the appraised entity A company can be a commercial or non-commercial firm, for-profit or not for-profit business, a research and development unit, a higher education unit, a government agency, or branch of service, etc. Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc. Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States. September 2007 Process Maturity Profile - Page 20
Report your Appraisal Results to the SEI The briefing is only possible due to the cooperation of organizations and individuals sending in their appraisal results to the SEI In order to provide this information and service in the future, it will depend on this continued cooperation Please visit: http://www.sei.cmu.edu/appraisal-program/profile/index.html for forms, information, and instructions on how to report appraisals to the SEI September 2007 Process Maturity Profile - Page 21
Contact Information Please visit: http://www.sei.cmu.edu/appraisal-program/profile/index.html and review the information provided before contacting: SEI Customer Relations (412) 268-5800 SEI FAX number (412) 268-5758 Internet Address customer-relations@sei.cmu.edu Mailing Address Customer Relations Carnegie Mellon University Pittsburgh, PA 15213-3890 September 2007 Process Maturity Profile - Page 22