corner
Healthy Skepticism
Join us to help reduce harm from misleading health information.
Increase font size   Decrease font size   Print-friendly view   Print
Register Log in

Healthy Skepticism Library item: 20272

Warning: This library includes all items relevant to health product marketing that we are aware of regardless of quality. Often we do not agree with all or part of the contents.

 

Publication type: Journal Article

Eva KW, Regehr G.
Knowing when to look it up: a new conception of self-assessment ability.
Acad Med 2007; 82:(10):
http://www.ncbi.nlm.nih.gov/pubmed/17895699


Abstract:

BACKGROUND:

Although self-assessment is widely acknowledged as a vital skill for members of self-regulating professions, a ubiquitous finding in the research literature is that self-ratings are quite poor when compared with externally generated measures of ability. Many researchers have identified this as a serious problem for the concept of self-regulation in the professions. However, we question the sufficiency of the operational definitions of self-assessment on which the previous research is based. This study examines the validity of a new conceptualization of self-assessment in practice and evaluates a series of measures for capturing self-assessment ability as defined by this new conceptualization.
METHOD:

Using a computer-delivered free-response test, the authors generated three measures intended to capture situational awareness: (1) response times to questions, (2) the ability to avoid responding to questions for which the respondent is less likely to be correct, and (3) the ability to select questions from content areas in which respondents have greater ability. In addition, the traditional measures of self-assessment (e.g., predictions of how many questions one would answer correctly) were administered.
RESULTS:

Participants showed behavioral indications of being aware of the limits of their ability. They took longer to respond when their eventual answer was incorrect relative to when it was correct, they were able to avoid answering questions on which they were likely to be incorrect, and they selected content-based domains in an appropriate order given their accuracy.
DISCUSSION:

These results provide evidence in favor of this new framework that should reorient the way in which self-assessment “skills” are conceptualized, taught, and evaluated in medical school and beyond.

Keywords:
Clinical Competence/standards* Education, Medical, Undergraduate/standards* Educational Measurement/methods* Humans Psychology/education* Questionnaires Self-Assessment* Students, Medical*

 

  Healthy Skepticism on RSS   Healthy Skepticism on Facebook   Healthy Skepticism on Twitter

Please
Click to Register

(read more)

then
Click to Log in
for free access to more features of this website.

Forgot your username or password?

You are invited to
apply for membership
of Healthy Skepticism,
if you support our aims.

Pay a subscription

Support our work with a donation

Buy Healthy Skepticism T Shirts


If there is something you don't like, please tell us. If you like our work, please tell others.

Email a Friend








Cases of wilful misrepresentation are a rarity in medical advertising. For every advertisement in which nonexistent doctors are called on to testify or deliberately irrelevant references are bunched up in [fine print], you will find a hundred or more whose greatest offenses are unquestioning enthusiasm and the skill to communicate it.

The best defence the physician can muster against this kind of advertising is a healthy skepticism and a willingness, not always apparent in the past, to do his homework. He must cultivate a flair for spotting the logical loophole, the invalid clinical trial, the unreliable or meaningless testimonial, the unneeded improvement and the unlikely claim. Above all, he must develop greater resistance to the lure of the fashionable and the new.
- Pierre R. Garai (advertising executive) 1963