What We're Actually Measuring

Overview

AI skill isn't a single thing. It's a constellation of capabilities:

• Task selection: Knowing which tasks are appropriate for AI
• Prompt quality: Asking AI questions that generate useful output
• Verification: Checking AI output effectively
• Integration: Using AI efficiently in your workflow
• Judgment: Knowing when to use AI and when not to
• Adaptation: Learning from experience and adjusting

We measure these dimensions, not just "how good are you at AI."

Content

Use this framework to assess your current skill level on each dimension:

Dimension 1: Task Selection

Level 1 (Novice): You're unsure which tasks are appropriate for AI. You try to use AI for tasks where it struggles, or you avoid using it where it would help.

Level 2 (Developing): You're becoming aware of task types. You know AI is good at summarization but struggle with policy nuance. You're still learning the boundaries.

Level 3 (Proficient): You clearly understand which tasks are AI-appropriate and which aren't. You make deliberate decisions based on risk and context, not default patterns.

Level 4 (Advanced): You understand subtle variations. You know when AI can help with parts of a complex task even if it can't handle the whole thing. You're sophisticated in your selectivity.

Assessment questions:

• Can you describe five tasks where AI helps and five where it doesn't?
• When you choose to use AI, can you articulate why?
• Do you sometimes catch yourself about to use AI inappropriately?
• How often do you correctly predict whether AI will be helpful for a new task?

Dimension 2: Prompt Quality

Level 1 (Novice): You give AI vague prompts. "Write a response" or "Help me with this." AI generates generic output.

Level 2 (Developing): You're learning to provide context. You include some relevant information. Output is better but sometimes still misses the mark.

Level 3 (Proficient): You frame prompts clearly. You provide necessary context. You specify tone and expectations. AI output usually matches what you need.

Level 4 (Advanced): You craft sophisticated prompts. You anticipate what context AI needs. You know how to frame requests to get specific output types. You get consistently good results.

Assessment questions:

• Can you describe how you frame a prompt?
• Do you often revise prompts to get better output?
• Can you explain what makes a prompt generate good output vs. vague output?
• How often do you get what you want on the first try?

Dimension 3: Verification

Level 1 (Novice): You read AI output but aren't systematic about what you check. You might miss problems.

Level 2 (Developing): You have a basic verification process. You check facts, maybe tone. You catch obvious errors.

Level 3 (Proficient): You have systematic verification process. You check accuracy, completeness, tone, context appropriateness. You catch most errors.

Level 4 (Advanced): You verify efficiently based on risk. You know what needs careful checking and what doesn't. You catch subtle problems. Your verification is fast because you're focused.

Assessment questions:

• Can you describe your verification process?
• What types of errors do you catch most reliably?
• What types of problems do you sometimes miss?
• How much time does verification take you?

Dimension 4: Integration

Level 1 (Novice): Using AI feels effortful. Every use requires conscious thought. Your workflow hasn't changed much.

Level 2 (Developing): You're using AI regularly. It's becoming part of your routine. You think about it less but it's not automatic yet.

Level 3 (Proficient): AI is integrated into your workflow. You reach for it naturally when appropriate. It's part of how you work.

Level 4 (Advanced): AI use is seamless. You don't think about it; you just use it. Your workflow has fundamentally changed to leverage AI where it helps.

Assessment questions:

• Do you have to consciously remind yourself to consider AI, or does it come naturally?
• Has your workflow changed to accommodate AI use?
• How much faster do you get work done compared to before using AI?
• Do you use AI for the majority of situations where it's appropriate?

Dimension 5: Judgment

Level 1 (Novice): Your judgment is inconsistent. Sometimes you use AI appropriately, sometimes you don't. It depends partly on your mood.

Level 2 (Developing): Your judgment is improving. You catch yourself about to make mistakes. You're learning patterns.

Level 3 (Proficient): Your judgment is generally sound. You make appropriate calls most of the time. You recognize boundary cases and handle them correctly.

Level 4 (Advanced): Your judgment is sophisticated. You navigate complex situations where using AI partly but not entirely is the right call. You recognize subtleties others miss.

Assessment questions:

• When you face a situation, do you automatically know whether to use AI?
• Can you explain your reasoning for decisions you make about AI use?
• Do colleagues seek your advice about when to use AI?
• How often do you regret decisions about AI use after the fact?

Self-Assessment Framework

Level 1 (Novice): You do things the same way each time. You don't adjust based on what you learn.

Level 2 (Developing): You're noticing when things don't work as expected. You're trying different approaches.

Level 3 (Proficient): You regularly adjust your approach based on what you learn. You modify prompts. You change verification focus. You learn from experience.

Level 4 (Advanced): You're continuously improving. You experiment intentionally. You document what works. You apply learning systematically.

Assessment questions:

• Can you describe ways your approach has changed since you started using AI?
• Do you intentionally try new approaches to see what works?
• Do you document what works and what doesn't?
• How often do you successfully adapt to new situations based on past learning?

Creating Your Skill Development Map

Overview

Map where you are and where you want to be:

Step 1: Self-Assess Current State

For each dimension, rate yourself Level 1-4. Be honest. This is for you, not anyone else.

Step 2: Identify Your Strengths

Which dimensions are you strong in? Why? What habits or practices created that strength?

Step 3: Identify Development Areas

Which dimensions need growth? Why? What would improve them?

Step 4: Pick Your Next Focus

Choose ONE dimension to develop next. Not everything. One.

Step 5: Design Your Development

What specific practices will help you develop this dimension?

Examples:

• If developing task selection, practice identifying five tasks and discussing with colleague
• If developing prompt quality, experiment with different prompt structures
• If developing judgment, review past decisions and reflect on your reasoning
• If developing adaptation, document one learning per week

Step 6: Create Checkpoints

When will you reassess? Monthly? Every six weeks?

Anti-Pattern 1: Not Measuring at All

You assume you're improving but have no actual evidence. Months pass and you're not sure if you've grown.

Better approach: Regularly assess where you are. It takes 10 minutes and provides clarity.

Anti-Pattern 2: Only Looking at Overall Skill

You measure "how good am I at AI" as a single thing. This is too broad to be useful.

Better approach: Assess specific dimensions. You might be strong at task selection but weak at prompt quality. This detail guides development.

Anti-Pattern 3: Comparing Yourself to Others

You compare your pace of development to colleagues who are further along. You get discouraged.

Better approach: Measure against your own past self. How have you grown since last month?

Anti-Pattern 4: Setting Unrealistic Goals

You assess yourself at Level 1 and want to reach Level 4 in a month. This is unrealistic and creates frustration.

Better approach: Move one level at a time. Level 1 to Level 2 is meaningful progress.

Anti-Patterns: Measurement Failures

You measure and assess but don't create a development plan. Knowledge without action doesn't create change.

Better approach: Measurement informs action. Pick development goals and practices.

Practice Prompts

Prompt 1: Complete Self-Assessment

Use the framework above. Assess yourself on each dimension. Be honest about where you are.

Prompt 2: Identify Your Strengths

Which dimensions are you already strong in? What practices or habits created that strength? How could you apply those success patterns to weaker dimensions?

Prompt 3: Design Your Development

Pick one dimension to develop. What specific practices will help? How will you practice? How will you know you're improving?

Prompt 4: Create Checkpoints

When will you reassess? What milestones would represent progress?

Key Takeaways

One. AI skill is multidimensional, not a single overall capability.

Two. Self-assess regularly on: task selection, prompt quality, verification, integration, judgment, and adaptation.

Three. You can map where you are and create a development path.

Four. Focus on one dimension at a time. One gives you clarity and manageable growth.

Five. Measurement creates visibility. You notice progress that would otherwise be invisible.

Six. Progress from one level to the next is meaningful. Don't expect to jump from Level 1 to Level 4.

Seven. Measurement without action doesn't create change. Use assessment to inform development.

Glossary

Self-Assessment: Evaluating your own skill level honestly.

Skill Dimension: A specific aspect of capability (task selection, prompt quality, etc.).

Development Goal: A specific skill improvement you're targeting.

Checkpoint: A scheduled time to reassess progress.

Level Progression: Moving from novice (Level 1) toward advanced (Level 4).

Cumulative Development: Building skill over weeks and months through consistent practice.

Reflection Exercise

Reflect on this: Where do you honestly see yourself on each dimension? Which dimension feels most important to develop? What would change if you focused on that dimension?

Celebrating Progress

As you develop your skills, celebrate incremental progress. These milestones matter:

First successful AI-assisted task: You used AI and it worked. That's progress.

First time you caught an AI error: You verified and found a mistake. That's verification working.

First time you made a good judgment call: You recognized an AI-inappropriate situation and handled it right.

First time you taught someone else: You shared what you learned.

First time you helped someone improve: You gave feedback that helped a colleague.

These moments aren't dramatic, but they're real progress. Recognize them.

From Individual to Team

As your skill develops, you move from focusing on your own development to helping others develop.

Early stage: "How do I get better at this?"

Later stage: "How do I help my team get better at this?"

This is natural progression. As you develop, you become a resource for others. You become someone people look to for guidance on how to use AI responsibly.

This isn't a title. It's a natural role that emerges as your capability grows.

Closing Remarks

Measuring your progress isn't vanity. It's clarity. It's motivation. It's direction.

As you track your development, you'll notice something: you're getting better. You're building capability. You're becoming the professional who uses AI skillfully and responsibly. And increasingly, you're helping others do the same.

In our next lesson, we'll explore transitioning to independent AI use.

AI for Customer Support Certification

Level 2: Assisted Use | Progress and Self-Assessment | Lesson 2.5.4

A SkillsClinic initiative.

Duration: ~26 minutes | Word Count: ~3,350

Key Takeaways

One. AI skill is multidimensional, not a single overall capability.

Two. Self-assess regularly on: task selection, prompt quality, verification, integration, judgment, and adaptation.

Three. You can map where you are and create a development path.

Four. Focus on one dimension at a time. One gives you clarity and manageable growth.

Five. Measurement creates visibility. You notice progress that would otherwise be invisible.

Six. Progress from one level to the next is meaningful. Don't expect to jump from Level 1 to Level 4.

Seven. Measurement without action doesn't create change. Use assessment to inform development.

Glossary

Self-Assessment: Evaluating your own skill level honestly.

Skill Dimension: A specific aspect of capability (task selection, prompt quality, etc.).

Development Goal: A specific skill improvement you're targeting.

Checkpoint: A scheduled time to reassess progress.

Level Progression: Moving from novice (Level 1) toward advanced (Level 4).

Cumulative Development: Building skill over weeks and months through consistent practice.

Reflection Exercise

Reflect on this: Where do you honestly see yourself on each dimension? Which dimension feels most important to develop? What would change if you focused on that dimension?

Celebrating Progress

As you develop your skills, celebrate incremental progress. These milestones matter:

First successful AI-assisted task: You used AI and it worked. That's progress.

First time you caught an AI error: You verified and found a mistake. That's verification working.

First time you made a good judgment call: You recognized an AI-inappropriate situation and handled it right.

First time you taught someone else: You shared what you learned.

First time you helped someone improve: You gave feedback that helped a colleague.

These moments aren't dramatic, but they're real progress. Recognize them.

From Individual to Team

As your skill develops, you move from focusing on your own development to helping others develop.

Early stage: "How do I get better at this?"

Later stage: "How do I help my team get better at this?"

This is natural progression. As you develop, you become a resource for others. You become someone people look to for guidance on how to use AI responsibly.

This isn't a title. It's a natural role that emerges as your capability grows.

Closing Remarks

Measuring your progress isn't vanity. It's clarity. It's motivation. It's direction.

As you track your development, you'll notice something: you're getting better. You're building capability. You're becoming the professional who uses AI skillfully and responsibly. And increasingly, you're helping others do the same.

In our next lesson, we'll explore transitioning to independent AI use.

AI for Customer Support Certification

Level 2: Assisted Use | Progress and Self-Assessment | Lesson 2.5.4

A SkillsClinic initiative.

Duration: ~26 minutes | Word Count: ~3,350