INSTRUCTIONS Length of Benchmark Exploring Reliability and Validity Assignment: 600-900 words (not including the title page and reference page) Format of Benchmark Exploring Reliability and Validity Assignment: APA for font (Times New Roman, 12 pt.), title page, margins, and section headings Number of citations: 2+ (must include the VMQ technical manual) Acceptable sources: scholarly articles/texts published within the last five years TEMPLATE 1. Types of Reliability and Validity. Explain the types of reliability and validity used. The authors of the VMQ explain general principles of norming, two types of reliability, and two types of validity on pages 9-10. But when they present the specific information about reliability is on page 10, they specifically state that they are using one type of reliability and where this data can be found. This is the reliability that you will describe. The same applies to validity; find the specific information provided by the authors on the VMQ. 2. Reliability: Cronbach Alpha Coefficients. Look at each of the constructs (scales) the test purports to measure and identify the proper category of low, acceptable, and high ranges of the Cronbach’s alpha coefficients for each scale. Use the chart provided in the “What Makes a Good Test” handout, which explains how to read reliability and validity coefficients. Match them to what is in the manual. Report the reliability category for all scales. Look at the number/percent of the scales with problematic versus acceptable internal consistency alpha values. 3. Sample Size and Nature of the Population. a. Validity: Look at the population used for the VMQ and the populations for the tests used to evaluate the VMQ’s validity. Do you believe that the populations of the other tests are comparable to the population used in the VMQ? Does this raise an issue with the validity? b. VMQ Norming Population: Is it representative of the population you want to use it for? How about gender and cultural representation? Is there demographic information and is it sufficient to draw conclusions? Do you believe that the results of the group taking the VMQ are broad enough to generalize to other populations? Did they sample enough people to believe that this sample captures the traits of the population? The answers to these questions will help you to evaluate potential issues with both validity and generalizability. COUC 521 Page 2 of 2 4. Your Opinion of the VMQ. Summarize the psychometric properties you reported. Look at your evaluation of reliability, validity, and population. Based on your findings, do you believe that the VMQ’s authors sufficiently establish the reliability and validity of the VMQ? Note any concerns. Be sure to view this in terms of the sample size and the makeup of the populations used to norm the instruments. This adds important meaning to the reliability and validity coefficients. To access and download the VMQ Technical Manual, see the Benchmark Exploring Reliability and Validity Resources. Be sure to review the criteria on the Benchmark Exploring Reliability and Validity Resources Grading Rubric before beginning this Benchmark Exploring Reliability and Validity Resources Assignment.
