IF WE KNOW WHAT IT WAS THAT WE WERE DOING, IT WOULD NOT BE CALLED RESEARCH,WOULD IT ?

Albert Einstein

Research is what everybody has seen and to think what nobody else has thought Albert Einstein

Research Critique
Mrs.Jasmin Anand Professor, med-surg Nrsg.

Defining Critique

An objective, critical and balanced appraisal of a research reports various dimensions

Every study appears to have its flaws because each researcher addresses the same or similar problem with different decisions on how the study is to be done

Why a Critique ?

Purpose of Research critique

Advance a particular area of knowledge Assess students methodologic & analylitical skills Seasoned researcher to help journal editions For use in journal clubs Written critique is a guide to researchers

General guidelines
Comment on strengths and weakness Give specific examples Avoid vague generalizations of praise and fault finding

General guidelines (contd)

Evaluate-substantive, ethical Methodologic , interpretative presentational & stylistic dimensions . Suggest alternatives

Initial critique
What type of study was conducted What was the setting Were the steps clearly identified Was there a logical flow

Introduction and Significance of the Problem

Relevance to nursing Benefits to nursing Lead to practical applications Have theoretical relevance Challenge untested assumptions Will it help to alter nursing practice or policies Is it too big /complex for a single study

Significance of the Problem

Introduction and Significance of the Problem

Challenge untested assumptions Will it help to alter nursing practice or policies Is it too big /complex for a single study Are the limits and scope of the study mentioned

Problem Statement and Researchability

Clearly & concisely stated
Precise information about the variables

Feasibility

Literature Review
Relevant studies identified & described Are references current Does the development of the idea come clear Is review organized or just a summary Is there a brief synopsis

Study framework
Does it fit naturally Does it relate well with the variables Would an alternate framework be appropriate Have the deduction been logical

Objectives & Hypothesis

Are they formally stated Does the hypothesis express a predicted relationship between the variables Is the hypothesis linked to a theoretical framework Are the hypotheses testable

Theory is Wrong

Theoretical Dimension
Own disciplinary orientation should not interfere in objective evaluation Avoid unnecessary repetition of study/ replication sometimes is exactly needed Congruence between the study & the methods a. Quantitative b. Qualitative

Design Issues/Theoretical Dimension

Was the type of design identified Did it link to the objectives, questions or hypotheses (If) was the treatment clearly described and implemented

Design Issues (contd)

Were extraneous variables identified & controlled Was a pilot study performed prior to this study What were the threats to design validity in this study

Sampling Issues
Was sample criteria identified Were the characteristics of the sample described Was Sampling method identified Was the sample size adequate Is there a bias

Data Collection Procedure

Was the data collection process clearly described Was data collection conducted in a consistent way Were the research controls maintained If data collectors were used, were they adequately trained

Measurement Methodology
Measurement methodologies clearly identified & described What level of measurement was achieved by each instrument Was the reliability adequate Was the validity adequate

Measurement methodology(contd)
If physiological instruments were used, were they accurate & precise

If observers were used, is evidence of inter-observer reliability given

Critique of quantitative methodology

Reality cannot be defined objectively, it is interpreted social interaction Quantification can result in meanings that are closer to the beliefs of the researcher than the respondents Hypotheses determines the course of the study Methods become overridingly important The quantitative model is the natural sciences, this model may not be relevant for the social sciences

Ethical dimensions

How Ethical is your Study ?

Ethical Dimensions
Were the subjects informed about the research/Human rights Was the consent obtained from the subjects Was the study approved by an institutional board

Ethical Dimensions

Two main types of ethical transgressions - inadvertent actions or activities - express it as minor

Statistical analysis

Statistical Analysis
What statistics were used to describe the characteristics of the sample Are the data analysis procedures described Did the statistics address the purpose of the study

Statistical Analysis (contd)

Did the statistics address the objectives, questions & hypothesis

Were the statistics appropriate of the level of measurement of each variable

Interpretative dimensions

Interpretative Dimensions
Are important results clearly discussed and are interpretations consistent with the results Are findings clinically significant To what population were findings generalized

Interpretative Dimensions (contd)

Were study limitations identified Are alternative explanations for the findings mentioned Are any warranted interpretations of casualty made

Interpretative Dimensions(contd)
Is there evidence of bias in the interpretation Were the implications of the findings discussed Were suggestions made for further research

Interpretative Dimensions(contd)
Is there evidence of bias in the interpretation Were the implications of the findings for nursing discussed Were suggestions made for further research

Presentation & Stylistic Dimension

Information communication Writing style

Summary points
Research critique is a careful, critical appraisal of strengths and limitations Consider five major dimensions of the study: substantive, theoretical, methodological, ethical, interpretive, and stylistic dimensions

Summary (contd)
Focus primarily on the methodologic dimensions Methodologic decisions affect the quality and integrity of the research. Determine how much faith can be placed on the results

Thank you