BCBA® task I.7 · Area I
I.7 Data-based decisions about supervision
3 min read · BCBA® Test Content Outline, 6th edition
What it means
Whether supervision is working is judged by measured supervisee performance, such as treatment integrity or accuracy of data collection, and by client outcomes, not by how satisfied people feel or how much supervision was delivered. Judging a change requires a baseline and repeated measurement of the same person, graphed and examined through visual analysis, just like client data. If the data show no improvement, the supervisor revises the supervisory practice instead of concluding that the supervisee is the problem. If they show improvement, maintenance is checked as support is faded, because performance that holds only while the supervisor is in the room has not yet been maintained. Social validity ratings from supervisees add information about acceptability; they supplement performance and outcome data and do not replace them.
Everyday example
A supervisor graphs a technician’s integrity on a prompting procedure: about 60% across four baseline observations, then about 90% after two weeks of BST with feedback after every session. She switches to weekly feedback and keeps scoring; integrity stays above 85% for a month, and the technician’s ratings say the feedback was useful and not stressful.
Common confusion
High satisfaction ratings, plenty of supervision hours or a plan followed to the letter do not show that supervision changed performance. A single before-and-after comparison without a baseline is weak evidence. And when performance does not improve, the first question is what the supervisor should do differently.
Key points
- The efficacy of supervision is judged by measured supervisee performance (such as treatment integrity) and client outcomes, not by satisfaction or by the amount of supervision delivered.
- Judging a change requires a baseline and repeated measurement, graphed and examined with visual analysis.
- When data show no improvement, the supervisor revises the supervisory practice rather than attributing the failure to the supervisee; when they show improvement, maintenance is checked as support is faded.
- Social validity ratings from supervisees supplement, and do not replace, performance and outcome data.
Examples from practice
Example 1
A daycare director judges a new coaching model by teachers' scored use of a transition routine and by how often children make transitions on time.
Example 2
A BCBA reviews two months of scored integrity data on a prompting procedure for each RBT she coaches before deciding whether her coaching is working.
Non-example
An agency reports that its supervisors logged 400 supervision hours this quarter and that staff rated supervision 4.8 out of 5. Neither number shows whether staff performance changed.
Check yourself
One question from the course lesson on this task. Choose an answer to see why it is right or wrong.
A regional manager wants to know whether a new peer-coaching format for pharmacy technicians is working. Which measure is most appropriate?
-
Not quite. Liking the format is satisfaction, which can be high while performance stays the same.
-
Not quite. Sessions held measure how much coaching was delivered, not what it changed.
-
Not quite. An impression is not a measure of what the technicians do.
-
Correct. Repeated measures of the technicians' work show whether their performance changed.
Show the answer and the explanations
Answer: D. Scored accuracy of the prescriptions they fill, over time
- a. Liking the format is satisfaction, which can be high while performance stays the same.
- b. Sessions held measure how much coaching was delivered, not what it changed.
- c. An impression is not a measure of what the technicians do.
- d. Correct. Repeated measures of the technicians' work show whether their performance changed.
The full lesson is in the course
The course lesson on this task goes further, with more sections, more examples and more practice questions, and keeps a record of what you have mastered.
Try a sample free, without an account
Key terms
Each term opens its definition in the ABA glossary.
All tasks in area I All 104 tasks ABA glossary: every term in one page
Independent study resource. INTERLAZA is not affiliated with or endorsed by the BACB. The explanations and examples are original, are not official exam content and do not reproduce any exam item.