Empirical validation of the strengthened Australian Qualifications Framework using item response theory [final technical report]

This study set out to empirically examine the revised architectural design of the Strengthened Australian Qualifications Framework (AQF) (Version 6). Through the use of survey methods and Item Response Theory, the study was able to: estimate the complexity of each Levels Criteria, and, for each set, compare the average estimates against the proposed 10 levels structure; examine the ordered nature of the Levels Criteria according to the Knowledge, Skills and Application dimensions; estimate the complexity of each Qualification Type Descriptor for each of the 14 Qualification Types;...  [+] Show more

This study set out to empirically examine the revised architectural design of the Strengthened Australian Qualifications Framework (AQF) (Version 6). Through the use of survey methods and Item Response Theory, the study was able to: estimate the complexity of each Levels Criteria, and, for each set, compare the average estimates against the proposed 10 levels structure; examine the ordered nature of the Levels Criteria according to the Knowledge, Skills and Application dimensions; estimate the complexity of each Qualification Type Descriptor for each of the 14 Qualification Types; directly estimate the complexity of each Qualification Type by aggregating respondent results; determine the overall complexity estimate of each of the 14 Qualification Types; identify any potentially redundant and non-discriminating Levels Criteria and/or Qualification Type Descriptors; empirically calibrate the Qualification Type Descriptors and the Levels Criteria on the same scale; determine where each Qualification Type was typically positioned within the proposed 10 levels structure; investigate the perceived appropriateness of the assigned notional duration of student learning for each Qualification Type.

Excerpt from publication.

This two volume report on the research was prepared for consideration by the AQF Council in June 2010.