Evaluate effectiveness of educational programs
Most of the output can be produced by software today.
Software can pull the data, run the comparison and write up what it found. The accuracy depends almost entirely on whether it is wired into the real system of record rather than a stale copy, which is the problem the tools and auth layer exists to solve.
| How automatable | Mostly automatable |
|---|---|
| Kind of work | Analysis and evaluation work |
| Jobs that do it | 38 occupations |
| Tool categories that apply | Builders, Tools and auth |
| O*NET activity | Judging the Qualities of Objects, Services, or People (4.A.2.a.1) |
What this looks like on the job
Not our paraphrase. These are real task statements recorded against this activity, spread across the 38 occupations that perform it.
- Plan, evaluate, and revise curricula, course content, and course materials and methods of instruction.
- Plan, evaluate, and revise curricula, course content, course materials, and methods of instruction.
- Review adapted physical education programs or practices to ensure compliance with government or other regulations.
- Review instructional content, methods, and student evaluations to assess strengths and weaknesses, and to develop recommendations for course revision, development, or elimination.
- Research, evaluate, and prepare recommendations on curricula, instructional methods, and materials for school systems.
- Analyze performance data to determine effectiveness of instructional systems, courses, or instructional materials.
- Assess effectiveness and efficiency of instruction according to ease of instructional technology use and student learning, knowledge transfer, and satisfaction.
- Develop measurement tools to evaluate the effectiveness of instruction or training interventions.
- Research and evaluate emerging instructional technologies or methods.
What we would actually use
One recommendation rather than a shortlist, because a shortlist is just your problem handed back. This is what we would buy for analysis and evaluation work, and what it costs.
Start in the assistant with an export of the real data, because the accuracy problem here is a stale copy rather than a weak model. Make, at $9 a month, is the cheapest way to put the pull on a schedule once the analysis is worth repeating.
Chosen for the cheapest thing that does the job, not the best funded. Nothing on this site is sponsored, and the full landscape is there when you want to disagree with us.
The rest of the category
Context, not alternatives to weigh up. We name the layer rather than promise a named product does your specific task.
Matched from the kind of work, not from vendor marketing. Check any of them can reach the system your records actually live in — that connection, not the model, is where these projects stall.
How people actually do it
No workflow names this activity yet, but these automate the same kind of work, with the prompts to paste and what to keep for yourself.
Who does this work
38 occupations in the O*NET database perform this activity. Each one has a full breakdown of its other tasks.
- Adapted Physical Education Specialists
- Adult Basic Education, Adult Secondary Education, and English as a Second Language Instructors
- Agricultural Sciences Teachers, Postsecondary
- Anthropology and Archeology Teachers, Postsecondary
- Architecture Teachers, Postsecondary
- Area, Ethnic, and Cultural Studies Teachers, Postsecondary
- Art, Drama, and Music Teachers, Postsecondary
- Atmospheric, Earth, Marine, and Space Sciences Teachers, Postsecondary
- Biological Science Teachers, Postsecondary
- Business Teachers, Postsecondary
- Chemistry Teachers, Postsecondary
- Communications Teachers, Postsecondary
- Computer Science Teachers, Postsecondary
- Criminal Justice and Law Enforcement Teachers, Postsecondary
- Economics Teachers, Postsecondary
- Education Teachers, Postsecondary
- Engineering Teachers, Postsecondary
- English Language and Literature Teachers, Postsecondary
- Environmental Science Teachers, Postsecondary
- Family and Consumer Sciences Teachers, Postsecondary
- Foreign Language and Literature Teachers, Postsecondary
- Forestry and Conservation Science Teachers, Postsecondary
- Geography Teachers, Postsecondary
- Health Specialties Teachers, Postsecondary
- History Teachers, Postsecondary
- Instructional Coordinators
- Law Teachers, Postsecondary
- Library Science Teachers, Postsecondary
- Mathematical Science Teachers, Postsecondary
- Nursing Instructors and Teachers, Postsecondary
- Philosophy and Religion Teachers, Postsecondary
- Physics Teachers, Postsecondary
- Political Science Teachers, Postsecondary
- Psychology Teachers, Postsecondary
- Recreation and Fitness Studies Teachers, Postsecondary
- Self-Enrichment Teachers
- Social Work Teachers, Postsecondary
- Sociology Teachers, Postsecondary
Work that goes with it
O*NET groups these under “Evaluate programs, practices, or processes”. In practice they tend to be done by the same person, in the same sitting.
Method. The activity, its taxonomy placement and the occupations that perform it come straight from the public-domain O*NET 30.3 database. The automatability band is ours: we map each of O*NET’s 41 generalized work activities to how much of its output current software can produce, assuming a person still reviews and owns the result. It is a coarse three-way judgment on purpose. A precise-looking percentage here would be invented.