Educational Assessment: Concepts, Validity, and Techniques
Understanding Evaluation: Core Concepts
Rating: A complex process involving obtaining useful information about various items, enabling us to make judgments and decisions about the matter.
Types of Evaluation
- Home?
- Summative (Final): Assesses the final result.
- Formative (Process): Values and enables the evaluation process to improve.
Stake’s Evaluation Model (Assesses Learning Programs)
- The Background (Contextual Experience)
- Transactions of Instruction: Encounters between individuals (students, professors, parents, peers, etc.)
- Results
Information Units Classified Under Four Headings
- Intentions
- Observations
- Standards (Commonly Adopted Criteria)
- Trials (Perceived Program Elements)
Two Types of Evaluation Analysis
- Consistency: Verifies if intentions have been met.
- Contingency: Determines if achievements are primarily due to background or activities.
Measurement vs. Evaluation
Measurement: Provides quantifiable data.
Evaluation: Compares these data with established criteria.
Normotypes for Comparison
Normotype: A point of reference for comparison.
- Statistical Norm: Depends on the group being compared.
- Criterion-Referenced: Compared with a target or standard.
- Individualized: Compares with other results obtained by the same individual on the same test.
Reliability of Measurements
Reliability: Refers to the degree of permanence and stability of measurements.
- Test-Retest Reliability: Repeating the same test.
- Parallel Forms Reliability: Correlating equivalent tests.
- Split-Half Reliability: Correlating scores of the two halves of a test.
Validity of Assessment Instruments
Validity: Refers to the degree of precision with which an instrument measures what it intends to measure.
- Face Validity: Apparent or overall impression.
- Content Validity: Based on streamlining processes, bibliographical references, and expert experience.
- Construct Validity: Taking two groups with different characteristics, the results should be significantly different.
- Consistent Validity: Compares results with another standardized instrument using the same criteria.
- Concurrent Validity: Compares results with different, simultaneously measured criteria.
- Predictive Validity: Requires considerable time to verify the accuracy of predictions.
Objectivity in Evaluation
Objectivity: When results are independent of the evaluator’s attitude or personal assessment. Achieved when the same group obtains similar results with different evaluators.
Key Evaluation Techniques
Evaluation Techniques: Tools, situations, resources, or procedures used to obtain information on process progress.
Observation and Recording Methods
Observation (Commentary): Involves selecting (identifying, assessing, and defining what, when, and how to observe). This also implies choosing a registration form based on assumptions or purposes.
- Anecdotal Records: Episodically collect highlights. Only describe events or actions without emitting value judgments.
- Journals and Reports: Narrative and reflective. They may include reviews, thoughts, and reflections for program improvement and future action.
- Checklists: Lists of phrases expressing behaviors, habits, or sequences of actions. The observer indicates whether these are manifested. They require proper observer preparation, strong observational skills, and time. Not open to qualitative interpretation. Can be used for individual and group assessment.
- Rating Scales: Similar to checklists, but include clarifications regarding the degree or extent.
Event Recording (Payroll or Grids)
Records events occurring in real situations. Parameters are set to refer to specific events or behaviors to be evaluated.
- Event Recording: Records behavior each time it appears.
- Time Sampling: In a short, fixed time, the observer checks whether the defined behavior occurs.
- Interval Recording: Similar to time sampling, but it is sufficient for the behavior to occur once during the period to be recorded.
- Duration Recording (Timing): Measures the time a teacher or student spends on an activity.
Performance and Standardized Tests
- Performance Tests: Performing any motor task to demonstrate learning effectiveness. Requires the use of checklists and evaluative scales.
- Standardized Tests: A standardized experimental situation evaluating an individual’s behavior through statistical comparisons with others who have undergone the same situation.
- Test Batteries: A set of tests to assess various aspects or the overall personality of a subject.
Sociometric Techniques
Sociometric Techniques: Evaluate personal or group situations related to issues like participation, leadership, acceptance, and rejection. Focuses on three fields: affinity, efficacy, and affect.