Scoring Analysis of Organization's Quality Management System

Scoring Analysis
  • 1 to 20 points - quality system is immature, requires lots of work and employee training
  • 21 to 35 points - an ISO system requiring improvement and then transition to TS 16949
  • 36 to 50 points - organization to conduct full system analysis to verify status and Identify ISO/TS 16949 training and implementation needs.

    As a guide, answers can be grouped to more easily identify ISO/TS 16949 Readiness. This guide can be used by organizations to identify areas requiring work and training.

    Core Tools --- Question 2 - score of 3 or higher indicates this area is good and may require minor work.
    Quality Management System --- Question 1 & 2 ö individual scores need to be 3 or higher to indicate the transition to TS is appropriate, otherwise, focus should be achieving ISO 9001 first then address TS components and the Core Tools.
    Internal Auditing Program --- Questions 8 & 9 - combined score of 6 or higher with an ISO/TS 16949 internal auditor course required; a lower score might indicate more training to improve auditing skills.
    Organizational Performance --- Questions 1, 3, 4, 5, 6 & 10 combined, (total possible score = 30)

    If Question 1 is scored at 3 or higher and all other questions score at the 4 level, transitioning to TS should be fairly easy (23 points). This indicates the organization has an implemented quality system and is using the Core Tools. Training needs might be a review of the ISO/TS 16949 specification, introduction to customer-oriented processes, Stage 1 and Stage 2 registration review and an ISO/TS 16949 internal audit course. Any combined score on these questions in the high teens (17 plus) with not more than one or two answers at a level three indicates a working quality management system.

    If Questions 1, 6 and 10 have a combined score of less than 9, the organization may have performance issues which could require specialized training such as Root Cause Analysis, FMEA (Failure Mode Effects Analysis) and other improvement courses to eliminate negative situations. Address these issues before moving to an ISO 9000 quality management system and then to TS.


    Assessment Completed?

    1.

    To what extent is your quality management system registered?

    Score  
    1

    Not Registered

    2

    Almost Registered

    3

    ISO 9001 Registered

    4

    ISO Registered & Core Tools Being Used

    5

    ISO/TS 16949 Registered


    2.

    How well are the Core Tools effectively implemented (FMEA, APQP, PPAP, MSA, SPC)?

    Score  
    1

    No AIAG manuals

    2

    Have Manuals Not Using Them

    3

    Using Some of the Processes, but not doing MSA or FMEA

    4

    Good Implementation of Most

    5

    All Manuals are Well Implemented


    3.

    We are measuring our processes and using the data for continual improvement?

    Score  
    1

    Processes and Metrics are not defined

    2

    Process Maps Available, No Metrics

    3

    Process Maps and Metrics Established

    4

    Process Metrics are in Place

    5

    Continual Improvement is Being Derived from Use of the Process Metrics



    4.

    We are fully aware of our customers requirements & using their web site to ensure conformance (i.e., Caterpillar, Volvo, Wabash, others)

    Score  
    1

    Do not have customer supplier quality requirements available

    2

    Have Some to All Manuals Available

    3

    Have All Manuals Available

    4

    Engineering includes Customer Requirements on all Jobs as appropriate

    5

    Good Implementation and Internal Auditors using Customer Requirements



    5.

    Our customers scorecards and customer satisfaction ratings are being managed at a good level?

    Score  
    1

    We are on probation by one of our customers

    2

    More than one customer scorecard is less than satisfactory

    3

    Most customer scorecards are OK

    4

    We are best in class category with most suppliers

    5

    We are best in class and have won at least one Supplier of the Year award in the last two (2) years



    6.

    Our on-time deliver for the past year has been above X?

    Score  
    1

    80%

    2

    85%

    3

    88%

    4

    95%

    5

    100%



    7.

    Our organization has implemented a continual improvement program such as Lean Manufacturing, 6 Sigma, Kaizen?

    Score  
    1

    No formal program

    2

    Some improvement results but not a system

    3

    System in place with results in progress

    4

    Good system for improvement with many teams and results

    5

    System in place has enhanced business and world class competitiveness



    8.

    Our internal auditing program is effective with good corrective action follow-up?

    Score  
    1

    No formal internal audit program

    2

    We are doing internal audits just ahead of customer or registrar

    3

    Auditing is a regular activity

    4

    Audits are regular and viewed as a business improvement tool



    9.

    Our process mapping is extensive and used in the internal audit program?

    Score  
    1

    Only have one process map

    2

    Have a good number of maps but not used for auditing

    3

    Have identified all customer oriented processes & using them in internal auditing process

    4

    We are meeting planned results and if a measurable drops below the goal an aggressive action plan is in place



    10.

    Company has 5 or 6 measurable's most important to the organization?

    Score  
    1

    Not regularly using data at management level

    2

    Some metrics in place

    3

    Some metrics in place

    4

    We are meeting/exceeding our planned results

    5

    Meeting and if one measurable is below goal an aggressive action plan in place



    Please total your scores to determine your training needs.


    <font size="5"><b>ISO/TS 16949 Gap Analysis</b></font>
    Quality Management System - General Questions Review


    Available Learning Offerings
    C - Customized; P - Public; O - Onsite; E - eLearning (live or recorded)
    Name of Course Learning Option Available
    Transition to an ISO/TS 16949 QMS O; C; E
    ISO/TS 16949 Internal Auditor O; C; E
    ISO/TS 16949 Management Briefing O; C; E
    Lead Auditor with ISO/TS 16949 - Registered Course O; P
    Design FMEA - A Core Tool O; E
    Process FMEA - A Core Tool O; E
    APQP/PPAP - A Core Tool O; E
    MSA/SPC - A Core Tool O; E
    Auditing the Core Tools O; E
    ISO 9001 - A Business Improvement Tool O; C; E
    Develop/Implement an ISO 9001 QMS O; C; E
    ISO 9001 Internal AUditor O; C; E
    ISO 9001 Lead Auditor - Registered Course O; P
    ISO 14001 Lead Auditor - Registered Course O; P
    ISO 14001 Internal Auditor O; C; E
    Develop/Implement ISO 14001 EMS O; C; E
    Root Course Analysis O
    Preventive Maintenance & Problem Solving O
    Develop Communication & Leadership Skills O
    Leadership to Support Lean Activity C
    CQI-9 Special Process: Heat Treat System Assessment O; E
    OHSAS 18001 Worker Safety O
    ISO 17025:2005 System Development for Laboratories O
    ISO 17025:2005 Internal Auditing for Laboratories O

    If you have questions, or would like more information about these learning opportunities please contact:
      Frank Gibson
      Alber Enterprise Center at The Ohio State University Marion, Ohio
      Phone: 740-725-6348
      E-mail: gibson.363@osu.edu