1/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Effectively Managing Process Compliance
Systems Engineering in the Face of
Multiple Models, Standards and Best Practices.
Joseph Morin, Integrated System Diagnostics
[jfmorin@isd-inc.com]
Erich Meier, Method Park
2/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Agenda
Current Challenges
Goals
Proposed Solution
Tool Support and Interfaces
Benefits
3/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Current Challenges
Heavy time and cost pressure affects product quality
Frequent audits or appraisals
Up to 25% of work hours for audit preparation and
performance
Assure compliance with specific models or standards for
safety, security, quality, reliability, etc. in parallel
4/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Goals
Allow organizations to focus on the definition and
implementation of processes
Provide automated support to facilitate enactment of the
processes
Provide support for continuously monitoring adherence to
the processes
Support appraisal preparation and performance by
automating evidence collection
Effectively collect, manage and track non-conformances to
closure in order to improve processes and secure future
audit success
5/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Key Idea
Actively use the
development processes
in projects, i.e. by
creating work products in
projects
Link the actively used
development processes
to the models or
standards that need to
be fulfilled (e.g. CMMI,
ISO)
Continuously perform
PPQA activities
Result: evidence data
will automatically be
collected in the
background
Perform Organizational
and Project Processes
Assure Process Quality
and Control Compliance
against Reference Models
Process
Selection
Process
Tailoring
Process
Customization
Process
Measurement
Process
Improvement
QA & Appraisal
Preparation
Appraisal
Performance
Improvement
Findings
Process
Execution
6/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Multi-model Support
Multiple reference
models can be linked
into multi-models
Multimodel links are
weighted
Multimodels are
specific to organization
(i.e. dependent on
type of business)
CMMI-DEV
CMMI Cross-Constellations
CMMI-SVC CMMI-ACQ
AS 9100, ISO 14000, DoD 5000.01 & 02, …
Business and Engineering Processes
Baldrige / EFQM
ISO9001
CobiT
CMMI-Dev
People CMM
ISO20000-1
eSCM / CMMI-Acq
PEOPLE SERVICES & RISKS SOLUTIONS & VALUE
QA Audit and Appraisasl Demonstration
7
© 2008 Integrated System Diagnostics, Inc.
Establish and maintain Organization Standard Process model(s) in
Model Wizard or Stages or tooling with similar capability.
Create or import a model of your enterprise processes that incorporates the
desired best practices of applicable standards and model(s). Update when
needed.
This step is performed once for each level at which the process is tailored
within the enterprise.
(e.g. Enterprise, Division, Department, Product Line)
Ultimately it is tailored to a particular project . At that point it becomes a
representation of the Project’s Defined Process.
It can then be used as the basis for identifying and analyzing information
and evidence supporting:
Project QA activity and monitoring,
Internal compliance audits, and
External benchmarking appraisals or compliance audits.
Process Composition and Definition
8
® 2005, Appraisal Wizard,
ISF for Excellence - All rights reserved ISD Inc.
Relationship
Enterprise Architecture, Best Practices, Process Improvement
Business Architecture
Activity A Missing Process
ISF CPP X Objective Z
ISO Clause X
PCCM Practice Y
Best Practices
Process Improvement
Implementation Guidance
Activity B Needs Process Improvement
ISF CPP X Objective Z
ISO Clause B
CMMI Practice SP #.#
Market &
Competitors
Leadership,
Culture, Strategic
Alignment
Infrastructure &
Technology
Measurement,
Innovation and
Improvement
Human
Capital
Organizational
Market
Customers
P&S ExecutionP&S Sustentation Customers
Support
Management
Results (performance)
Customers
(pre-contract)
Customers
(post-contract)
Products & ServicesSuppliers
Suppliers
9
® 2005, Appraisal Wizard,
ISF for Excellence - All rights reserved ISD Inc.
Relationships:
Process Architecture,
Best Practices, Audits
CMMI
COBIT
ISO20000
eSCM
ISO90
01
Baldrige
Market &
Competitors
Leadership,
Culture, Strategic
Alignment
Infrastructure &
Technology
Measurement,
Innovation and
Improvement
Human
Capital
Organizational
Market
Customers
P&S Execution P&S Sustentation Customers
Support
Management
Results (performance)
Customers
(pre-contract)
Customers
(post-contract)
Products & Services Suppliers
Suppliers
Best Practices
ISF for Excellence
PPQA / Audit / Appraisal Findings
Customer Process Architecture
Integration / System
Diagnostic Tools
Enterprise Appraisal
Process Definition
Process Compliance
10/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
ISF for Excellence Systemic View Integration Framework
Market &
Competitors
Leadership,
Culture, Strategic
Alignment
Infrastructure &
Technology
Measurement,
Innovation and
Improvement
Human
Capital
Organizational
Market
Customers
P&S Develop. P&S Sustaining Customers
Support
Management
Results (performance)
Customers
(pre-contract)
Customers
(post-contract)
Products & Services
Suppliers
Suppliers
11/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Solution Details
Reference models are
broken into different
model requirements
Process elements are
linked with model
requirements
Model requirements
are mapped to
evidences
Evidence data maps
can be generated
Process Execution
QA & Appraisal Preparation
Work
Product
Work
Product
Evidence
Work
Product
Process
Step
Process
Step
Evidence
Evidence
Evidence
Reference Model
Model
Requirement
Model
Requirement
Model
Requirement
12/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Example: Process Lifecycle
13/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Example: Process Compliance Mapping
14/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Example: Compliance Gap Analysis
15/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Example: Evidence Data Generation
Use Appraisal Wizard (AW) to setup Appraisal Wizard
Audit Template(s) for each type of Audit you want to
perform (e.g. setup unique record types, status values,
and document types, etc.)
Create Audit Question records to build
audit checklist for set of audit
checkpoints.
Use the Record Documents tab and
the document list to identify the
expected objective evidence for each
audit question.
Use the AW tool during the audit to document
the audit finding(s) (e.g. “Compliance, “Non-
Compliance (N/C)”, “Information Needed”
record types).
Write up N/C Action Item records
Determine compliance ratings
Use Model Mapper to map QA Reference model to a standard or model (e.g. CMMI) for use in appraisals.
Import new “Mapped Model” into AW to use audit results and organization's existing data to support
Readiness Reviews and Appraisals.
Audits and Appraisal Process
3
Use the AW tool to build various reports of the
audit finding(s) (e.g. Reports of % compliant/%
non-compliant findings; List N/C Action Items;
etc.) to prepare for follow-on audits.
4
2
Use Model Wizard to create or import a
model that represents your Organizational
Standard Model and/or the desired QA
Reference Model.
1
5
© 2008 Integrated System Diagnostics, Inc.
16
QA Audit and Appraisasl Demonstration
QA Audit and Appraisasl Demonstration
17
© 2008 Integrated System Diagnostics, Inc.
QA Reference Model in Model Wizard
QA Audit and Appraisasl Demonstration
18
© 2008 Integrated System Diagnostics, Inc.
Setup Audit Templates Using QA Reference Model
QA Audit and Appraisasl Demonstration
19
© 2008 Integrated System Diagnostics, Inc.
Audit Spreadsheet Generate and Re-import
QA Audit and Appraisasl Demonstration
20
© 2008 Integrated System Diagnostics, Inc.
Determine Status of Records/Documents
QA Audit and Appraisasl Demonstration
21
© 2008 Integrated System Diagnostics, Inc.
Determine Element Compliance Ratings
QA Audit and Appraisasl Demonstration
22
© 2008 Integrated System Diagnostics, Inc.
Audit Results and organization's existing data supports appraisals and ties to
other standards/ models
QA Audit and Appraisasl Demonstration
23
© 2008 Integrated System Diagnostics, Inc.
CMMI-DEV 1.2 Mapped to QA Reference Model
© 2008 Integ
QA Audit and Appraisasl Demonstration 24
Generate Reports
25/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Benefits
Reduce complexity
Process descriptions become consistent and lean
No „CMMI or ISO speak“
Fulfill multiple standards in parallel
Reduce efforts and costs
Companies reported up to 60% less efforts
for audit preparations
No interruption of operational work because
of audit preparations
Concentrate on process improvement,
not process administration
26/V1.12
© 2010 www.methodpark.de
www.isd-inc.com
Thank you
for your interest.
Visit websites http://www.isd-inc.com and
http://stages.methodpark.com
Download whitepaper from
http://www.methodpark.com/en/resources/
Register for product trials at
http://www.stagesAsAService.com
Request additional information at
info@isd-inc.com
or info@methodpark.com