Sei sulla pagina 1di 20

CHAPTER 28

Conducting Interpretive Research in


Engineering Education Using Qualitative
and Ethnographic Methods

Aditya Johri

Introduction to avoid overwhelming the target audience;


this chapter is not intended as a compre-
This chapter provides an overview of con- hensive review of interpretive research or of
ducting interpretive research using qualita- qualitative and ethnographic methods.
tive and ethnographic methods. The chap-
ter complements Chapters 27 by Case and
Light and 26 by Moskal, Reed-Rhoades, and
Strong in this volume, which respectively Interpretive Research in the Human
provide an overview of the different qualita- Sciences
tive and mixed method approaches to engi-
neering education research. The primary Social scientists currently distinguish inter-
purpose of this chapter is to provide entry- pretive research from other research tradi-
level researchers with background infor- tions in that the researcher is taken to be
mation on how to conduct interpretive a critical part of the process. The primary
research. Because every researcher has his goal of the research is to understand partic-
or her own “tricks of the trade,” this chap- ipants’ meaning-making, with less emphasis
ter necessarily presents methods and ap- on the typical flow of the scientific method
proaches found useful by this author, and followed in other research methodologies.
represents an individual perspective on This type of research requires an investiga-
interpretive research. The number of ref- tor to include his or her own perceptions,
erences has been limited to around fifty1 becoming more of a sense-maker than an
objective reporter: Interpretive research is
an umbrella term used to describe studies
I will like to thank students in my Ethnographic and that endeavor to understand a community in
Qualitative Research Methods course and students
from Foundations of Engineering Education (Fall 2012)
terms of the actions and interaction of the
for their feedback, in particular John Sangster, Vaishali participants, from their own perspectives”
Nandy, Bushra Chowdhury, and Stephanie Kusano. (Tobin, 1999, p. 487).

551
Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
552 cambridge handbook of engineering education research

Although interpretive methods are par- study. Snowball sampling is one example of
ticularly well suited to sociocultural or sit- an approach that lends itself well to inter-
uated approaches to learning and educa- pretive research. The second area of devi-
tion (see Chapter 2 by Newstetter and ation between the types of research comes
Svinicki, or Chapter 3 by Johri, Olds, and in the design phase of a research project.
O’Connor in this volume), they are appro- Highly quantitative approaches devote
priate in all cases when a researcher wishes significant effort to specifying and articu-
to account for participants’ perspectives in lating the hypotheses and propositions of
understanding an issue. The interpretive the study and to ensuring that the data col-
approach requires researchers to construct lected are able to address the issues identi-
meaning from the data; there is a “per- fied. In interpretive research initial questions
spective” aspect inherent to the process. are often open ended, requiring less engage-
Interpretive research sacrifices an element ment with and analysis of the data during
of objectivity in order to obtain situated the active portion of the study. Rather than
meaning-making; the researchers and par- a linear, or a strict cyclical scientific model
ticipants form a partnership in the develop- of research, interpretive research processes
ment of understanding. Although interpre- tend to include more fluidity. The third
tive research is by its nature subjective, there area of deviation between interpretive and
are standards of practice followed to ensure quantitative research approaches is that the
the quality of information within the field. results are dependent on the frame of ref-
An interpretive researcher “seeks to learn erence of the researcher. It is important for
through systematic activity” (Tobin, 1999, the researcher to not only signal their world-
p. 488) and builds an understanding through view, but also consciously to use this view-
a skeptical search for evidence. Put another point in interpreting, acknowledging, and
way, “the knowledge gained from research documenting this activity. Researchers can
is put to test so that there is a close link be “invisible” in quantitative methodologies,
between what is learned and the evidence but they are an integral part of interpretive
used to support claims made from a study” research activities.
(Tobin, 1999, p. 488). The effort to understand meaning-
This idea of an investigator’s perspec- making and expressing or representing can
tive in interpretive research is in direct con- be fraught with complexity. One of the ear-
flict with the positivist approach toward liest and strongest proponents of the inter-
research, in which settings are defined and pretive tradition, Clifford Geertz (1973),
described using external categories. There argued that an intepretivist’s task is to clar-
are three areas in which the interpre- ify the intersubjective meanings that form
tive approach deviates from a positivist the foundation of social reality, as expressed
approach. The first area of deviation involves in the everyday life experiences of peo-
the focus on large trends and central ten- ple. Becker (1998) argues that just express-
dencies often used by positivist and other ing the meanings is not enough, that we
approaches that are primarily quantitative need to go beyond reproducing what we
in nature; the interpretive approach deliber- observe, to abstract the information that
ately seeks a sample including a high degree can help answer questions. Becker (1998)
of diversity, or variability. In interpretive takes issue with Geertz’s notion of “thick
research, the decisions on who can or should description” and related argument that the
participate in the study can be made while intrepretivist’s job is to provide or artic-
the study is ongoing, as new data are col- ulate meaning-making among participants.
lected and new participants are approached. Nelson Goodman (1978) argues that
So long as the investigators’ understanding researchers are bound to have a perspec-
of an issue is advanced, corroborated, or con- tive, a frame, a way of seeing or worldmak-
tradicted, participants may be added to the ing that is unique to them, raising questions

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 553

about the ability of any researcher to faith- Wagenaar further prescribes two ways of
fully represent what is being observed. Any understanding meaning that go beyond or
researcher is bound to relate “affectively” or overcome the problematic aspects of inter-
emotionally with experiences of data col- pretivist approach outlined in the preceding
lection regardless of their actual disposi- text. The discursive approach to meaning is
tion. As a consequence, the meaning-making thoroughly perspectivist, in the sense that
in any social phenomenon being observed it takes for granted that all human knowl-
is inevitably linked with the meaning the edge is a “conditioned point of view”; it
researcher brings to the situation. The myth implies that there can be no veracity of our
of objective observation is also questionable knowledge of the social work. In the dia-
given that observation and meaning-making logic approach, meaning emerges only in
are interconnected. This process, according relation to an interpreter and meanings may
to Wagenaar (2011), is actually that of recon- change depending on the interpretation. As
structing the aggregated collective under- a result it is essential for an interpretive
standing of a social phenomenon by taking researcher not only to capture and expres-
into account the individual subjective mean- sion of intersubjective meaning-making, but
ings of participants. This sense-making by also to articulate this insight in the service
researchers is dependent on our ability to sit- of a research question.
uate a particular human action into a larger To make interpretive research more
context; the act of interpretation involves an acceptable and mainstream, Yanow (2006)
understanding at multiple levels – individu- argues that researchers need to make their
als, groups, and larger organizational or insti- methods more explicit, as well as elaborating
tutional levels. Wagenaar (2011) argues that on the advantages of interpretive research.
there are three problems with this process Researchers using an interpretive method-
creating epistemological and methodologi- ology should avoid using the word “qualita-
cal issues. The first is that investigators may tive” to describe their research; interpretive
hold misconceptions about their own beliefs research extends beyond qualitative meth-
and intentions. The second is that investiga- ods and is more precisely characterized as
tors may or may not have access to objec- uncovering participant’s meaning-making.
tive meanings, rules, concepts, and norms Qualitative methods can be, and often are,
that are implicit in practice (which may not used for positivist research without any
be explicitly stated). The last is that inves- interpretive component; any research with
tigators may lack an understanding of spe- a hypothesis is well served by qualitative
cific aspects of a social organization that are methods. Overall, Yanow (2006) argues that
tacit and embodied, requiring actual partic- interpretive methodology has become an
ipation to observe. In reviewing the work umbrella term subsuming several different
of other interpretive researchers, Wagenaar schools of thought, including those drawing,
(2011) argues that: explicitly or implicitly, on phenomenology,
hermeneutics, some Frankfurt School criti-
With important nuances and differences, they cal theory, symbolic interaction, and ethno-
all agree that (1) explicit understanding can methodology, among others. Many of these
only be partial, (2) meaning resides not in
ideas dovetail with late-nineteenth to early-
the individual experiences of actors but in
larger social configurations of which the actor
twentieth century pragmatism and later-
is an integral part, (3) meaning emerges twentieth century feminist epistemology
from acting upon concrete situations, and (4) research methods and science studies (p. 7).
meaning, in the sense of our actions exhibit- In spite of the differences between inter-
ing sensefulness, is created dynamically in pretive researcher methodology and the
an ongoing interaction among actions and traditional positivist framework, there are
between actors and larger social configura- there any similarities. Yanow (2006) argues
tions. (p. 51) that:

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
554 cambridge handbook of engineering education research

Despite disagreements on ontological and Why Interpretive Engineering


epistemological matters, scientists working Education Research?
out of interpretive presuppositions, speaking
broadly, share in common with those work-
Empirical issues in furthering engineering
ing out of positivist ones the two central
attributes of scientific practice (what it means education are similar to those in all other
to “do” science or to “be” scientific) named human or social sciences. Educators, stu-
above: an attitude of doubt, and a procedu- dents, and others who are involved with
ral systematicity. Where they differ is how engineering education are embedded within
these are enacted. Interpretive scientists share the same socioeconomic webs as others. The
the appreciation for the possible fallibility of problems they face in teaching or in learn-
human judgment . . . They also have a differ- ing often have the same root causes as bar-
ent understanding of what it means to prose- riers to furthering education, or other activ-
cute “rigor” in research[ . . . ]; yet interpretive ity, in other settings. Therefore, positive
research, following its own canons of prac-
change can be accomplished only by under-
tice, is not less systematic than positivist-
taking research that provides an interpre-
informed research, which renders the work
“methodical” in different ways from that pre- tive understanding of issues at hand – by
scribed in the steps of the ‘scientific method.’ trying to understand matters from the per-
(p. 9) spective of those involved it might be pos-
sible to bring about change. This does not
Another important distinction Yanow mean, of course, that structural change is not
makes is that the social world cannot be possible or desired and is often attempted.
understood by interpretivists in the same For instance, accreditation agencies such as
fashion that the natural world can be under- ABET Inc. often play a significant role in
stood and documented by positivists. This forcing structural change within engineer-
has specific consequences for engineering ing education. An interpretive investigation,
education researchers, particularly in disci- though, can alert us to the actual impact
plinary engineering research. Yanow (2006) of these proposed and attempted changes
argues that there is an essential between the as opposed to the intentioned change. For
natural and social worlds: instance, what does it mean to implement a
certain criterion? Does it result in a change
Unlike (to the best of our present knowledge) in learning or are changes made in curricu-
rocks, animals, and atoms, humans make, lum to align with a criterion without any
communicate, interpret, share and contest meaningful learning gains? If change does
meaning. We act: we have intentions about happen over time, how does that take place?
our actions; we interpret others’ actions; we These questions are important questions and
(attempt to) make sense of the world: We are are raised frequently by authors of the hand-
meaning-making creatures. Our institutions, book chapters. Although numeric and quan-
our policies, our language, our ceremonies are
titative data is extremely helpful to docu-
human creations, not objects independent of
us. And so a human (or social) science needs
ment issues at a larger scale, an in-depth
to be able to address what is meaningful to interpretive examination is equally impor-
people in the social situation under study. It tant in meaningfully understanding the issue
is this focus on meaning, the implications of at hand.
that focus, that the various interpretive meth- Even though interpretive research is
ods share. (p. 9) exceptionally useful, there are several barri-
ers to conducting interpretive research and
Now that we have discussed interpretive it is prudent to discuss these. First, inter-
research briefly and have some conception pretive research, particularly using qualita-
of what it is, let us explore why engineer- tive and ethnographic methods, can be very
ing educators should care about it and how time consuming. All research, when done
they can go about conducting interpretive rigorously, takes time interpretive research
research. owing to the exhaustive data collection

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 555

needs and the need for triangulation often collected and in the interpretive skills of the
needs more time. Sense-making is involved researcher that often develop over time, I
at every step of the research process as emphasize data collection above everything
each step can be uncertain. Second, inter- else. With a weak data set, interpretation is
pretive research often requires significant tricky if not impossible.
manpower resources and training for con-
ducting research can often take longer than
many other positivist approaches. Further, Starting Out – First Days in the Field
unlike other approaches that can utilize sec-
ondary data, interpretive research, owing to Every act of investigation begins with some
its localized settings and localized informa- uncertain moments. In interpretive re-
tion needed for interpretation, has to rely search, especially when qualitative and
overwhelmingly on primary data. Secondary ethnographic methods are being employed,
data, even if they are available, have to be the first few days in the field are often the
used sparingly and judiciously although it most worrisome for researchers. It is in these
can often play a central role in triangulation. initial moments that rapport has to be estab-
Finally, interpretive research requires signif- lished, the purpose of research explained to
icant post-processing effort in terms of out- participants, and “first impressions” formed
lining a convincing case. In many positivist and projected. This is the time period when
traditions the basic structure of research out- the “learning” is the highest for any research.
put – how findings and results are to be The lack of familiarity with a setting opens
presented – is standardized. An interpretive up our senses and we notice and absorb more
research project depends as much on its pre- information than at any other time during
sentation for making a convincing argument the research study. Therefore, it is crucial
as it does on data collection and analysis. to take meticulous and detailed notes dur-
Given these seemingly significant barriers to ing this time period. The first few days also
interpretive research for many researchers provide the researcher the opportunity to
the benefits far outweigh its disadvantages. set the terms of the data collection. When
If the purpose of research is to truly under- and what kinds of data will be collected?
stand an issue with the intent of effecting What affordances does the setting actually
useful change, some form of interpretive provide as compared to the idealized vision
research is essential. in the research plan? Are there some partic-
In the rest of this chapter I provide a ipants who are likely to become key infor-
“methods” guide that can help researchers mants and can help interpret what is going
conduct interpretive research.2 The guide is on? Do I maintain a distance or do I create an
necessarily my own interpretation of how informal relationship with all participants?
to do this research but can be useful to All these are important questions that any
beginning researchers who are getting their researcher has to address during the initial
feet wet. As with any research, researchers days. Some other issues that come up are
over time find their preferred data collec- how to take observations notes. Although
tion procedures, protocols, and coding pro- many young researchers are content to take
cedures. The intent of the rest of the chap- mental notes, there is no substitute for writ-
ter is to show one way forward. Given the ten notes, and in any setting the note-taking
many excellent texts available on the design procedure has to be established as soon as
of research studies (see Table 28.1 for a selec- possible. Will you use a computer? Will you
tion) I do not discuss that aspect here. I take short breaks and finish up your notes
assume that the researcher wants to con- in another location? Finally, what kind of
duct interpretive research and is looking for note-taking do you plan to do? Detailed,
tools to help collect the data and analyze extremely details, cues to things you would
and write it up. Because analysis and writing remember. All these norms have to be
depend significantly on the quality of data established from inception and make the

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
556 cambridge handbook of engineering education research

Table 28.1. Overview of Introductory Texts on Design of Research Studies


Text Brief Overview of the Text
Eisner: Qualitative Inquiry in Education A text about different “ways of seeing” the world around
us; the importance of having non-numerical
representations to think about critical subjects; focused
primarily on education; the critical use of a sample of
one to make sense.
Glesne: Becoming Qualitative Researchers A great introductory text for first time qualitative
researchers; earlier editions were co-written with Alan
“Buddy” Peshkin; Briefly covers all aspects of the
research process; in the tradition of qualitative inquiry;
covers different traditions of qualitative inquiry and
differences with the positivist tradition.
Marshall & Rossman: Designing Classic text for understanding the design of qualitative
Qualitative Research research studies; covers the idea of having a
“conceptual framework”; uses several examples from
actual studies; great chapter on the “how” of field
study.
Patton: Qualitative Research and A “handbook” of sort; covers almost all topics related to
Evaluation Methods qualitative research; a great reference; discusses the
conceptual issues, design and data collection, and
analysis and reporting; many examples from actual
studies including codebook samples.
Taylor & Bogdan: Introduction to The subtitle says it all: “The search of meanings”; this text
Qualitative Research Methods goes to the core of qualitative inquiry – we want to
understand how our informants make meaning and
then we use the data to make meaning on our own;
two comprehensive sections – How to conduct the
research and How to write it up.
LeCompte & Schensul: Designing & Several books and a whole series of seven books on how
Conducting Ethnographic Research to conduct ethnographic research (Ethnographer’s
Toolkit); their field notes book in the toolkit is one of
the few books that discuss it in depth; they talk a great
deal about quantitative data as well. These are good
reference books but keep in mind that they are not
uniquely about interpretive research.
Rossman & Rallis: Learning in the Field Does a great job of talking about the issues that arise in
the field through actual studies of three of their
students; lots of useful examples and samples; covers
almost all topics.

first days in the field critical to the overall opportunity to observe any setting at any
success of the project.3 given time does not repeat. Therefore, the
ability to capture action in the field accu-
rately is indispensable. Of course, any inter-
Observing Others in Action pretive researcher will take issue with the
term “accurately” in the preceding sentence
Observations are one of the most crucial as any act of capturing data through obser-
components of any field study. Although vations is an interpretive act as well. What
observations form the backbone of any to look at and what to note down are all
research, including positivist experimental interpretive act; even the placing of a video
research, they are critical in interpretive camera to record a setting is an interpre-
studies conducted in the field because the tive act. Therefore, when I say accurately I

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 557

Table 28.2. How to Conduct Observations


Text Brief Overview
Lofland & Lofland: Analyzing Situation and strategies. Situations: encounters, roles, groups,
Social Settings organizations. Strategies: manner, identity, place timing;
strategies of avoidance; pay attention to action within context
by specific people.
Rossman and Rallis: Learning in Why observe?: Context, tacit patterns, see patterns not
the Field communicated in interviews, direct experience; What to
observe? Social system – formal/informal, events, longitudinal
changes, rituals, ceremonies, interaction patterns, unplanned
activities, artifacts in use.
Brandt: Studying Behavior in Different ways of studying behavior in varied settings through
Natural Settings instruments such as observations, surveys, interviews; narrative
data: anecdotes, specimen records (a specific person is chosen),
field notes, ecological descriptions; examples of activity
recording sheets and other devices to capture observational
records systematically; timeline-based data collection.
Schatzman & Strauss: Field A practical guide with a lot of strategies; strategy for entering,
Research getting organized, watching, listening, recording, analyzing,
communicating the research; angle of observation – it is a
relative activity.

mean in the context of the research question redundant4 but it is good practice, initially
and the purposes of the research study. The as well as later in the study, to capture as
observers’ perception has to be aligned with much as possible. In addition to being com-
the goal of the observation and the observer prehensive, field notes have to be retroac-
has to ensure that his or her bias does not tively useful and therefore they need to cap-
shape the observations. The texts reviewed ture critical information such as time, place,
in Table 28.2 provide further detailed guid- and participants. It is a good habit to start
ance on conducting field observations. The each field note session by first making a note
key to good observations is being rigorous of the date and the time. There are many
and steady – observe all the time and observe formats that can be used to facilitate better
as much as you can. note taking, and the texts reviewed in Table
28.3 provide an assortment of such tools.
Taking Observation Field Notes

One of the most critical skills one needs to Conducting Interviews


develop as an interpretive researcher is the
ability to take good field notes. The defini- Learning from participants about their
tion of what comprises good field notes is worldview and their settings is one of the
hard to pin down but there are a few char- cornerstones of good interpretive work. But
acteristics that distinguish them from field learning from others is much more difficult
notes that are inept. First, field notes have to than it appears. It starts with developing
be comprehensive. The data that need to be good listening skills, which is often difficult
captured will vary based on the purpose of for researchers, particularly academics, who
the research study but it is important to note are prone to advocating their knowledge.
different aspects of the site, the participants, Yet, the importance of being a patient and
and the activities that occur. Over time, and sincere learner cannot be underestimated
with experience, a researcher develops some in interpretive research. Listening comes in
tricks to keep track of all the happenings and many forms. Some of it has to do with
is able to filter out information that might be avoiding interrupting your participants but

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
558 cambridge handbook of engineering education research

Table 28.3. How to Write Observations Field Notes


Text Brief Overview
Emerson, Fretz, & Shaw: Writing Discusses the importance of field notes and then lays out the
Ethnographic Fieldnotes different issues involved when you are in the field, then
writing up the fieldnotes afterward, and then processing
them; mnemonic devices and jottings in the field; creating
scenes from the notes, writing commentaries and memos;
trying to understand informants’ meanings from the
write-up; scenes involve description and dialogues
(and characterization); sketches, episodes, tales.
Lofland & Lofland: Analyzing Social Chapter 5: Logging data; words and action; mental notes,
Settings jotted notes, full fieldnotes – write promptly, content and
style; start thinking about the unit.

it also has to do with giving them time then be asked to read this list or the inter-
to reflect and respecting silence. Often less viewer can collect and use them as prompts.
experienced interviewers rush to fill in any
empty space within a dialogue but that can
be a mistake. Participants can take time to Analyzing Field Study Data
articulate an answer, or sometime hearing
their own voice forces them to reflect and Data analysis forms the most complicated
reform their response. These moments have but the most rewarding part of the inter-
to be respected within any interview. Table pretive research process as the fundamen-
28.4 lists some classic texts on interviewing, tal argument for the approach relies on the
Table 28.5 presents a list of useful questions ability to provide an analysis that accounts
culled from a couple of texts, and Table 28.6 for the meaning-making of the study partic-
presents a sample interview protocol. ipants. Therefore, in addition to reporting
Interviews are often done on an individual the activities observed and the researcher’s
basis but sometime the opportunity arises interpretation of them, an interpretive anal-
to interview more than one person, and this ysis provides a meta-analysis from the par-
can change the dynamics of the interviewing ticipants’ perspective. The analysis process
process. In some cases, focus group inter- varies across researchers and research groups
views with more than two participants can and many researchers prefer to immerse
be undertaken and these have their own themselves in the data for a long period
dynamics. Although they were developed as of time and emerge with an overall con-
a technique by mass media researchers to ception or argument. Many researchers fol-
find out the opinion of participants, they can low the traditional approach of coding the
be used by interpretive researchers to delin- data based on broad categories or themes
eate nuances and differences among partic- and use these to triangulate the data. The
ipants. To do so, it is important to manage codes in interpretive research are induc-
the group dynamics to ensure that each par- tive; they emerge from the data. Coding
ticipant gets the opportunity to advance techniques vary by researcher and project,
their viewpoint and that “loud” members but certain steps are common. The first step
do not take over and lead to groupthink. involves going through the data and docu-
One technique for avoiding this, as noted in menting common themes that emerge. This
the sample protocol in Table 28.7, is to ask process is usually called “free” coding as
participants to first jot down ideas in writ- the intent is to capture all the major ideas
ing on a piece of paper to ensure that their that are present in the data. The codes gen-
views are represented in some form before erated through this process are termed in
the group discussion. The participants can vivo codes as they emerge from the data.

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 559

Table 28.4. How to Conduct Interviews


Text Brief Overview of the Text and Its Main Message
Spradley: The Ethnographic Interview The “classic” text about ethnographic interviewing; “what do
my informants know about their culture that I can
discover?”; elements of the interview; kinds of descriptive
questions (grand tour); structural questions (examples of
something); contrast questions (alike, different);
relationship between different kinds of questions and their
placement within the interview is critical; domain analysis;
cultural themes.
Merton, Fiske, & Kendall: Focused A contrast to the ethnographic interview; the style that led to
Interview focus groups; comes out of media effects research. The
criteria: range (of situations and responses), specificity
(highly specific aspects), depth (different meanings and
degree of involvement), and personal context (informants’
own distinctive meanings). This method is good for asking
different informants about the same situation or event; can
be carried out with a group of informants.
McCracken: The Long Interview Deliberately more focused and efficient than the
ethnographic interview; makes use of open-ended
questions but in a focused and intensive interviewing
process; good if interview is the sole data collection
methods being used; literature review is considered part of
the “long interview” process; examining the self is part of
the process; questionnaire construction is an essential step;
a scheme for data analysis based on the prior stages of the
process.
Seidman: Interviewing as Qualitative “Understanding the experience of other people and the
Research meaning they make of that experience.” Three-interview
series: focused life history (everything in light of the
current topic); details of experience (reconstructed);
reflection on the meaning (what sense does this make to
you?); each interview lasts around 90 minutes. Listen
more, talk less; avoid leading questions, ask open-ended
questions; keep participants focused and ask for concrete
details; storytelling.
Kvale: InterViews Phenomenological aspect of qualitative interviewing;
informants’ life-world; working through ambiguity; use of
artifacts in the interviewing process – reflecting on
artifacts; interaction with artifacts; hermeneutical aspects
of interviewing (interpretation of texts).
Weiss: Learning from Strangers Good introductory text with lots of examples and practical
know-how of the interview process; The importance and
design of an interview guide; analysis of transcriptions with
comments; issues with interviewing; difference between
survey and qualitative interviewing; also talks about
analysis and writing.
Gubrium, J. F., & Holstein, J. A. Contains chapters by a lot of experts that focus on specific
(Eds.): Handbook of Interview issues related to interviewing; covers survey and
Research journalistic interviews; chapters by Charmaz on grounded
theory and by Adler & Alder on the “reluctant respondent”
are particularly useful.

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
560 cambridge handbook of engineering education research

Table 28.5. Interviewing Tips


Spradley (1979)
Tips for building rapport in early interviews (pp. 81–82)
Make repeated explanations of why “As I said earlier, I’m interested in . . . ”
you’re interviewing them.
Restate what informants say – but don’t Reinterpreting is when you state in different words what the
reinterpret what they say. interviewee has said; restating is using the same words –
selecting key phrases and words and restating them.
Don’t ask for meaning, ask for use – is a Instead of “What do you mean by that?” or “Why would you
feature of ethnographic interviews. do that” ask questions like “Could you tell me what you
would say to the . . . ” or “What kinds of things would I
hear you saying?”
Tips for discovering questions (pp. 84–85)
Record questions you hear people asking
during the course of everyday life.
Ask directly about the kinds of questions “What is an interesting question about . . . .?”
used by informants and others. “What is a question to which the answer is . . . ?”
Create a hypothetical situation and then “If I listened to waitresses talking among themselves at the
ask for questions. beginning of an evening, what questions would I hear
them ask each other?”
Tips on descriptive questions/types of descriptive questions (pp. 85–90)
Make the question longer – you will get Instead of “Could you tell me what jail is like?” try “I’ve
a longer response. never been inside the jail before, so I don’t have much of
an idea what it’s like. Could you kind of take me through
the jail and tell me what it’s like, what I would see if I
went into the jail . . . ?”
Phrasing questions personally or Might elicit different information or be differently sensitive
culturally for informant.
Persona: “Can you describe a typical evening for you at
Brady’s Bar?”
Cultural: “Can you describe a typical evening for most
cocktail waitresses at Brady’s Bar?” or “How would most
tramps refer to the jail?”
Grand tour questions “Can you describe all the different tools and other
equipment you use in farming?”
“What are all the things that you do during the initiation
ceremony for new members who join the fraternity?”
Typical grand tour questions “Could you describe a typical day at the office?”
Specific grand tour questions Take the most recent event or space most familiar to the
respondent to help him or her remember: “Tell me about
the last time you made a . . . ”
“Could you describe what happened at Brady’s Bar last
night . . . ?”
Guided grand tour questions Make them actually walk you around.
Task-related grand tour question Get them to perform tasks and talk aloud while doing them.
“Could you play a game of backgammon and explain what
you are doing?” [Similar to think-aloud method]
Mini-tour questions Same as grand tour, but about smaller aspects of experience.
Example questions More specific. “Can you give me an example of someone
giving you a hard time?”
Experience questions Asks for experiences in actual settings – tend to elicit atypical
events.
“You’ve probably had some interesting experiences in jail;
can you recall any of them?”
Native-language questions “How would you refer to the jail?”
“How would you talk about . . . ?”

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 561

Spradley (1979)
Hypothetical interaction questions Makes informants less likely to translate for your sake.
“If I were to sit in the back of your classroom, what kinds of
things would I hear kids saying to each other?”
Typical-sentence question “What are some sentences that use the term . . . ?”
Glesne and Peshkin (1992)
Don’t say final goodbyes to
respondents – leave door open for a
return (p. 64).
Keep questions free of words, syntax,
or idioms respondents won’t
understand (p. 67).
Don’t make questions loaded or No “Don’t you suspect . . . ” or “Isn’t it the case that . . . ”
leading (p. 67).
Pilot interview questions with
member of actual group you’re
studying (p. 68).
Don’t ask questions about “hot topics”
before establishing rapport (p. 69).
Keep questions from getting too “I’d like to have you go back to a time in your. . . . ”
vague. Provide mood and props to
help interviewees recall previous
times/events (p. 69).
Use quotations from another source Allows you to attribute to someone else ideas that are
(p. 69). provocative, but that you don’t want them to think reflect
your opinion.
“Soliciting Advice” Questions – gets “I’d like you to put yourself in the position of my adviser. I’m a
more idealized answers than direct brand new teaching, never taught here before . . . What
“what do you do” questions (p. 70). advice would you give me . . . ?”
Vary the voice or subject of “Do you . . . ” vs. “Do teachers like you . . . ” vs. “Do teachers in
questions; gets you different your school . . . ” vs. “Do teachers in general . . . ?”
information (p. 70).
Use language that respondents “Before we go on to other questions, I’d like to be sure what
understand (pp. 70–71). word or words you use to describe the different kinds of
kids . . . ”
Put questions that are easy to answer Gets interviewees talking and reassures them that your
at the beginning (p. 71). questions are manageable.
Watch for interaction effects of You’ll need to keep some questions far apart, because one
questions (p.71). would influence the answer to another.
“Magic wand” questions (p. 72). “If you could change anything at Riverview High School in any
way you wanted, what, if anything, would you change?”
Get the interviewee to help you fill “What else should we have asked that we haven’t asked?”
out the picture (p. 72). “What have we overlooked?”
“Have we underemphasized important things?”
“Have we overemphasized unimportant things?’
Try to promote regularity of “Same time and place next week?”
interviews (p. 73).
Give respondents an idea of how “At least two times, and maybe more, certainly no more than is
often you’ll want to interview them comfortable for you. And you may – without providing any
(p. 73) [if you are conducting a explanation – stop and particular session or all further
multiple interview study] sessions.”
Take notes on interviews, in addition Account of an interview should include “old questions requiring
to tapes [recording] (p. 75). elaboration; questions already covered; where to begin next
time; special circumstances that you feel affected the quality
of the interview; reminders about anything that might
prepare you for subsequent interviews; and identification
data.”
(continued )

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
562 cambridge handbook of engineering education research

Table 28.5 (continued )


Glesne and Peshkin (1992)
Watch for body language (p. 77).
Useful culminating statements (p. 78). “Here is the ground we covered today. I was pleased to
learn about . . . Would it be okay for next time if we
went back to this and that point . . . ?”
Stick to the time frame you laid out going in
(p. 78).
Although being “naı̈ve” is good, watch out for
asking “What do you mean” too often; it can
sound like you are second guessing (p. 80).
Communicate that you are listening, without “That must have hurt” and “Mm hmmm,” not “I’m with
expressing your own opinion (p. 84). you” or probably not “A-freakin’-men!” either
Don’t rush (p. 85). If you communicate your satisfaction with your
respondents’ short-shrift replies, then you teach them
how little it takes to satisfy you. Say “Tell me more,”
and your interviewees will learn to respond
accordingly.
Silence is one way to probe (pp. 85–86). But don’t stretch it too long so it gets awkward.
“Uh huh, uh huh” and “yes, yes” are also
probes because they encourage talking
(p. 86).
Longer, more direct probes (p. 86). “I’m not sure I got that straight. Would you please run
by again what . . . ?”
Summary statement followed by . . . “Did I understand
you correctly?”
Summary statement followed by . . . “Is there anything
more you’d like to add?”
Take responsibility for all questions not
understood; reframe/recast the questions,
but if still not understood, move on instead
of pushing it and making respondent feel
stupid (p. 88).
The too-talkative interviewee – set it up
ahead of time that you might stop the talk
from time to time, “in the interest of
getting things straight” (p. 90).
Do not point out contradictions during the
interview (p. 90).
To deal with contradicting statements, in a “I heard some people say . . . I’ve heard other people
subsequent interview, you can take the two say . . . What is your thinking on these two
statements and put them in the mouths of positions? . . . Is it possible that both are right? Is there
other people and ask interviewee to a third or even fourth position?”
respond (p. 90).
Leave time at the end to just chat and thank
the interviewee formally (p. 91).

As a next step, codes are grouped together together the disparate part of the study
based on commonalities and tested exten- to provide coherence to the overall study.
sively against the entire data or a specific cor- Initial coding often leads to viewing the
pus of data. This step is often called focused data from too many different perspectives,
coding. In some cases, categories are related and axial coding is a mechanism to pro-
to subcategories and relationship between vide an overarching analytical framework
codes is examined. This step is termed axial that groups things together. In interpretive
coding and its usefulness lies in bringing research one has to be open to changing the

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 563

Table 28.6. Sample Interview Guide and Protocol


Date and Time: ___________________________ Location: ________________
Respondent: ______________________________ Title: ____________________
Interviewer: ______________________________
Guidelines for Introduction (5–10 minutes)
1. Thank informant for interview and explain project. The goal of this project is to understand how
instructors teach, their thoughts about improving teaching, if any, and challenges instructors face in
improving their teaching. We want to learn about your experiences. We’ll be interviewing you and
if possible conducting an observation of your teaching.
2. Reinforce confidentiality: the identity of the informants will be kept confidential. In addition, the
findings of the study will be reported in a way that preserves the confidentiality of any private
information provided.
3. The interview will be pretty open-ended and generally takes about an hour. (Ask interviewees if
they have any “hard” constraints on time.)
4. Ask informant if he/she has any questions for you before starting.
5. Recording: “I usually transcribe all the interviews. Do you mind if I record our conversation? It will
help me focus on the interview and keeps me from having to write everything down verbatim”
(turn on the recorder).
6. Give them the consent form, explaining that it describes their rights as a study participant. As
them to sign it as long as they feel comfortable participating. Also, ask them to initial that audio
recording is okay.
Sample questions and probes from an interview protocol developed for understanding engineering
work practices
1. Please describe your work.
Alternatively or additionally, ask
Tell me about your day last [Tuesday, Wednesday . . . choose a recent day].
Probes:
If teaching (or research) named predominantly, probe about the other [“you mentioned . . . , what
about . . . ”]:
r Can you tell me about the <teaching> or <research>?
r Can you tell me about the relationship between the two?
Additional probes:
r Tell me about your day last [Tuesday, Wednesday . . . choose a random, recent day].
2. Since you’ve been on this job/position, what kinds of changes have you seen?
Probes:
r How has your work changed?
r Has the relationship between research and teaching changed? How?
r Describe any critical events.
3. Can you describe a time when these differences between the X’s and the Y’s are most apparent?
r Can you give me an example?
r Do you think that the distinction affects how you work? In what way?
r If you could change something, what would you change?
4. One of the advantages of working in academia is the relative freedom to make changes. What have
changes have you made in your work?
Probes:
r Changes in teaching
r Changes in research
r Frequency of changes
r Incentives for changes
r Describe any critical events.
(continued )

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
564 cambridge handbook of engineering education research

Table 28.6 (continued)


5. Did you teach before joining your present position? If yes, what, if anything, did you learn that
helped you when you joined this position?
6. If you could make some changes in your work or its situation, what would they be? We could talk
about this in two ways: changes that are feasible and changes that would require magic, that reflect
how things would be in an ideal world.
Probe: For example, one of the goals of this study is to identify changes in technology that might
more effectively facilitate teaching. Are there any technical tools or functionality that you think
would be helpful?
Before the end of interview, ask once again if informants have any questions for you. Thank them.
Encourage them to send you observations that they subsequently have about their teaching or
anything they think is interesting about their teaching.
General probes:
r Can you give me an example of (or tell me a story about) that?
r What was your experience of that?

categories – either by eliminating them or categories, and their instances can be an


collapsing them. Often a category will have important preliminary step; they have to
to be divided into more subcategories to be followed by meaning-making by the
capture all the nuances. Ultimately, what researcher. The purpose of this is to find not
an interpretive article does not do is imply some hidden “truth” but the most illustra-
enumerate the categories and their instances tive reasoning. Table 28.8 lists some texts
within the data and report them. Although that contain information on how to analyze
the instances of occurrence of a category field study – observation and interview –
are important, their significance for the data. As with other examples, these texts are
participants is a more important element from the qualitative or ethnographic tradi-
in interpretive research. Therefore coding, tions but their insights are equally applicable

Table 28.7. Focus Group Protocol


r Turn on the recorder.
r Pass informed consent forms.
r Take introductions as ice breakers.
Discussion starter question: Take a few minutes to write down what comes to your mind when you
think of this course, your role, your design, collaboration, etc. (list some positives and some
negatives).
Start group discussion.
Let’s hear from each of you [give everyone the opportunity to participate and ask about their
motivation for . . . ]
[If you fail to hear a topic or if there is a common topic you want to explore]
One thing I heard several people mentions is . . . . . . . . . . . . .
One thing I am surprised no one mentioned is . . . . . . . . . . . . .
Other useful questions:
When you think about __________ what comes to mind?
Can you describe your project/artifact?
What kinds of things have made ____________ easier/harder for you?
One of the things we are especially interested in is ____________? What can you tell us about that?
That’s something we’re definitely interested in hearing more about. What can you tell us about it?
What will they improve? What can be removed or avoided? What did they learn?

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 565

Table 28.8. How to Analyze Field Study Data


What Does it Entail? Examples When to Use
Charmaz: Grounded Theory Coding: initial (line-by-line); focused, axial, theoretical; memo
writing – raising codes to a conceptual level; theoretical sampling
and saturation (earlier version: constant comparative method,
sorting through data).
Becker: Tricks of the Trade The idea of a concept: What is it that we are talking about? We
define them and the definitions are shaped by our collection of
cases; tricks to figure out the concepts you are dealing with.
Strauss: Qualitative Analysis A slightly different treatment of grounded theory; examples of
for Social Scientists coding – open, selective; memos and memo writing; illustrations
and examples of working with data; integrative diagrams
(frameworks); presentation and writing.
Miles & Huberman: Great reference resource with chapters on doing the analysis and
Qualitative Data Analysis visual presentation of data; how to use tables, diagrams, figures to
Sourcebook make meaning of the data and also to present it to the reader.
Strauss & Corbin: Basics of Coding
Qualitative Research

to interpretive research. Two texts that pro- is the attempt to make sense through the
vide extensive and substantial discussions of eyes of the participants. Interpretive writing
the coding process are Charmaz (2006) and also balances researcher interpretation, data
Strauss and Corbin (1998). snippets, and often theoretical arguments
in equal proportion. There are some com-
mon caveats in these writings where authors
Writing Up Interpretive Research often make the leap from observing behav-
ior to reporting it as participants’ inter-
As with any research process, the final writ- pretation. The link between what is seen
ing and publication, or presentation, of the and what it means is hard to establish and
research is the usual culmination of the pro- often missing. This is a common criticism of
cess. Although the publication and presenta- interpretive research – do we ever really
tion of any research, even scientific research know what others think? This is also a
in the natural sciences, is a process of “social challenge not only to establish but also to
construction,” in interpretive research it is present in the form of written interpreta-
often hard to separate the writing from the tion. Authors often take the support of other
research – it is an integral part of the process. forms of representations such as analytical
Whether it is to be consumed as a research figures, illustrations, pictures, and if possi-
article, a monograph, or a full-length book, ble, video data. Table 28.9 provides some
writing up interpretive research is an often references to texts that can aid in writing and
difficult and time-consuming process. One that describe different ways of writing that
of the difficulties of writing is the lack might be applicable to interpretive research.
of standard models. Interpretive researchers
follow different styles and the final writ-
ing can take on many forms. Even if one Conclusion
eliminates such forms as “autoethnographic”
texts from the canon of regular interpre- This chapter provides a guide on conduct-
tive writing, the variation among research ing interpretive research using ethnographic
papers and books is immense. Yet, there and qualitative methods. This approach is
are some commonalities underlying all inter- becoming increasingly common in engi-
pretive writings and the most prominent neering education research and can benefit

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
566 cambridge handbook of engineering education research

Table 28.9. How to Write Up Interpretive Research


Text Brief Description of the Text
Wolcott: Writing Up The most useful book on writing up qualitative research that I have
Qualitative Research encountered; Wolcott is a great writer himself and most of his
books on qualitative research are worth reading (and some of them
have been quite controversial).
Becker: Writing for Social Not a book about qualitative writing per se but still a great book to
Scientists think about how to write any social science topic; talks about the
importance of editing; great complement to Tricks of the Trade.
Golden-Biddle & They take examples of great qualitative journal articles, and through
Locke:Composing conversation with authors and documents of the reviewing process
Qualitative Research reconstruct how the arguments in the paper were constructed; the
articles focus on organizational research but the process of
constructing an argument, especially in the space offered by a
journal article, is very well explained.
Van Mannen: Tales of the A “classic” text about writing about ethnographic studies; the author
Field outlines three different kinds of tales: realist (dispassionate,
third-person voice), confessional (narrated through self), and
impressionist (striking stories); the book starts with a great review
of the “cultural” turn and where this piece fits in; gives examples
from his own writing (and rewritings).
Goodall: Writing the New Represents the movement toward “auto-ethnography” and the
Ethnography engagement of self with the narrative; the trials and tribulations of
an ethnographer who does not fit in the mainstream; issues of
representation, voice, reflexivity.
Wolf: A Thrice-Told Tale Anthropological critique of the “cultural” (and postmodern) turn;
consists of three different texts that showcase the same set of
events: a fictional short story, unanalyzed fieldnotes from
observations and interviews, and a journal piece that appeared in
American Ethnologist.

the coverall research agenda of the field by Finally, Table 28.11 recaps many of the
providing a more ecological valid look at issues that have to be considered in field
why and how students persist in engineer- study driven interpretive research. The list
ing, learning engineering, and institutional is broken down into four different sections:
issues that shape engineering education. “Before the Field,” “In the Field,” “After the
Interpretive research can use many dif- Field,” and “Rest/All the Time.” These are
ferent approaches for data collection and ideas based on my personal experiences, and
analysis; Table 28.10 provides some exam- the list can be useful if personalized by each
ples of this diversity. researcher to meet his or her needs.

Table 28.10. Methods Appropriate for Interpretive Research


Linguistics Heath: Language and social structure, linguistic analysis
Cognitive anthropology Hutchins: Distributed cognition approach, learning in network of artifacts
and people
Network analysis Wasserman & Faust, Scott & Carrington: Network data, in combination
with observations and interviews
Conversation analysis Sacks & Silverman: Analysis of talk
Unobtrusive measures Webb et al: Documents and other artifacts that are available in the setting
Interaction analysis Jordon & Henderson: Journal of Learning Sciences
Ethnomethodology Garfinkel, Sommerville et al.: Ethnography and system design

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 567

Table 28.11. Field Study Checklist


Before entering the field
Institutional Review Board application and consent form: Ensure you have the proper permissions and
documentations to conduct the research and enough copies of the consent form for your participants.
Research questions: Ensure that the purpose of the study, in terms of research questions, is well
articulated and is helpful in framing the data collection.
Access: Ensure you have access to the research site and have worked out details of entry and other
logistics.
Site: Make sure you have done background research on the site and know its specifics – where it is,
how to reach it, etc.
Logistics: Related to the site, prepare for logistical issues such as where to conduct the interview.
Proposals: If your research requires funding or support in some form and make sure you have done
that background work.
Working hypothesis: Although interpretive research requires an open mind, it is often critical to have
some working hypothesis to frame your work to support but more likely refute it.
Ethics: Think through the ethical implications of your work, especially how your presence in the field
might impact them, particularly those who might be in a less powerful position.
Familiarity with site/Subjectivity: Do background research to build some form of familiarity with the
site to be aid interpretation.
Technology (batteries): If you plan on using any technologies such as computers or recorders make sure
they are in working condition and you have spare machines and batteries.
Interview/Observation protocol: Prepare the protocols and take copies of them with you to the field.
Make a checklist: Make your own checklist that you can use to quickly prepare before any trip to the
field.
Format for filenames: Make a proper coding system/scheme for storing data.

In the field
Ethics/Subjectivity: Ethical issues become increasingly salient in the field given the numerous occasions
that arise where ethics are tested. Any interaction with a participant or any opportunity to enter and
observe an event or activity has potential ethical implications. Do you tell the people present who
you are? How and when do you do that? How much information about your project do you divulge?
If you tell them you are not going to record any information, do you completely stop data collection?
Does your experience not even count towards your interpretation? Can it even be completely wiped
out from your experience? These questions arise routinely and often the ethical implications come to
individual subjectivity and doing what is right. When there is no IRB or another researcher to
monitor, your own sense of ethics will take precedence and therefore to undertake ethical research
more than rules, regulations, and training, one has to develop a self-sense of ethical doing.
First days: As discussed in this chapter in detail, navigating the first days in the field is often tricky and
your impressions as a researcher can play a significant role in subsequent data collection. Therefore, it
is important to map out the first days in the field as well as be extra vigilant in note taking.
Introductions, including who you are and what you are doing at the site, are two important questions
for which you must be prepared with credible and honest answers.
Memos: Memos are a useful mechanism to keep track of the field study as well as reflect on the data
collection. Memos taken during the field study can also be important resources in data interpretation
in later stages.
Observations: Obvious, but observing the right thing in the right amount is crucial for good quality
data and even though “right,” often can be assessed only post hoc; it helps to have a plan.
(continued )

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
568 cambridge handbook of engineering education research

Table 28.11 (continued)


Interviews: With interviews, it is important to remind yourself that the critical thing is using
open-ended questions and respecting silences.
Unobtrusive methods/Archival data: Often, a research site will provide the opportunity to collect data
through unobtrusive means, often archival data, and one has to be prepared to collect this data as well
as make efforts to gain this data if possible. These data can be extremely useful in triangulating.
Rapport: Building rapport with informants is important and it requires building a safe environment
and developing trust. The important thing to keep in mind is to not be devious but honest.
Field notes/Recording of data: Ensure data are being recorded in a reliable manner. Complete all field
notes by the end of the day, especially if what you have from the field are rough jottings. Memory
fails us often.
Discussion with colleagues: Sometimes, especially in large projects with multiple data collectors, it can
be helpful to discuss your data collection with your colleagues. Of course, it is important to maintain
participant privacy.

Rest/All of the time


Planning: Plans are helpful although things do and will change as the field study goes on. Before
entering the field and even while you are in the field it is important to plan your data collection
efforts with the goal of obtaining good and adequate data in mind.
Reading: Often, it helps to read other studies related to your current field study or research methods
texts to keep your data collection fresh. You get new ideas and can often come with new ways to
triangulating your data and interpretations.
Practice: Practicing your observation and interviewing skills is very important. Practice helps you
smoothen out the rough edges but also lets you try out different ways of asking the same question.
Thinking: Thinking and reflecting about the data collection are important to ensure an in-depth
analysis.
The politics: Every field sites has its politics and it is almost impossible to stay neutral but that should
always be the first goal. Never pick sides. If in a difficult position of agreeing or disagreeing with
someone, be honest, be consistent, and explain your stance.

After the field


Subjectivity: Interpretive research is subjective research and therefore your stance and framing of the
problem and research should be laid out in your text.
Validity: The validity of your research, of any research, comes from doing a thorough job of the field
study and being able to support your findings and arguments with proper evidence from your data.
Transcription: Using a professional transcriptionist or transcribing on your own often depends on the
resources available and often on personal taste. The level of transcription also depends on the research
question but verbatim transcriptions should be preferable to summaries.
Inductive/Deductive/Grounded theory/Cross-comparative: During analysis the process to follow
depends on the objective but different options can include grounded theory or cross-comparative
analysis and following an inductive approach overall.
Software: Which software to use for analysis, and whether or not to use software, is an important
decision and the choice depends on several factors such as the team involved in analysis, the nature of
data – interview transcripts and observations notes or other media, and cost considerations. Several
popular options include NVivoTM , InqScribeTM , AtlastiTM , and others.
Writing: Writing considerations involve how much to write, how to pace the writing, how to balance
analysis and writing. During writing, tying data with theory is very important. Representing data in
different ways to help with analysis and making findings accessible to others are other issues to
consider.

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
conducting interpretive research in engineering education 569

Footnotes Eisner, E. W. (1991). The enlightened eye: Qualita-


tive inquiry and the enhancement of educational
1. One of the most comprehensive online practice. New York, NY: Macmillan.
resources for qualitative research methods is Eisner, E. W., & Peshkin, A. (1990). Qual-
the bibliography maintained by the University itative inquiry in education: The continuing
of Georgia, Athens, GA, which contains list debate. New York, NY: Teachers College
of references for almost all approaches to Press.
qualitative and ethnographic research: http:// Emerson, R. M., Fretz, R. I., & Shaw, L. L.
www.coe.uga.edu/leap/academic-programs/ (1995). Writing ethnographic fieldnotes. Chicago,
qualitative-research/qualitative-research- IL: University of Chicago Press.
resources/bibliography/ Emerson, R. M., Fretz, R. I., & Shaw, L. L. (2001).
2. I often use the term “ethnographically infor- Participant observation and fieldnotes. In P.
med” to describe my data collection approach Atkinson, A. Coffey, S. Delamont, J. Lofland,
as it captures best the close involvement with & L. Lofland (Eds.), Handbook of ethnography
the research site but is not an ethnogra- (pp. 352–368). London: SAGE.
phy in the true sense of the word because Geertz, C. (1973). The interpretation of cultures:
the ethnographic tradition requires long-term Selected essays. New York, NY: Basic Books.
engagement with the research site – extending
several years. The ethnographically informed Glaser, B., & Strauss, A. (1967). The discov-
approach still follows many of principles and ery of grounded theory: Strategies for quali-
traditions outlined by ethnographers – in terms tative research. New York, NY: Aldine De
of the structure of interviews, the interpretive Gruyter.
nature of the work, and so on – but deviates in Glesne, C., & Peshkin, A. (1992). Becom-
other ways. ing qualitative researchers. White Plains, NY:
3. A useful reference is B. Geer, “First Days in Longman.
the Field,” in P. Hammond (Ed.), Sociologists Golden-Biddle, K & Locke, K. (2006). Composing
at Work (New York, NY: Basic Books, 1964), qualitative research: Crafting theoretical points
pp. 322–344. from qualitative research (2nd ed.). Thousand
4. This is always problematic as researcher bias Oaks, CA: SAGE.
might be at play and what the researcher might Goodall, H. (2000). Writing the new ethnography.
not think is important may prove so later on. Lanham, MD: AltaMira Press.
Goodman, N. (1978). Ways of worldmaking. Cam-
bridge, MA: Hackett.
References Garfinkel, H. (1967). Studies in ethnomethodology.
NJ: Englewood Cliffs.
Bailey, C. (1996/2006). A guide to field research. Gubrium, J. F., & Holstein, J. A. (Eds.). (2002).
Pine Forge Press. Handbook of interview research: Context and
Becker, H. (1988). Writing for social scientists. method. Sage Publications.
Chicago, IL: University of Chicago Press. Heath, S. B. (1983). Ways with words: Language,
Becker H. (1998). Tricks of the trade: How to life and work in communities and classrooms.
think about your research while you’re doing it. Cambridge University Press.
Chicago, IL: University of Chicago Press. Heath, S. B. (1986). Sociocultural contexts of lan-
Brandt, R. M. (1972). Studying behavior in natural guage development. Beyond language: Social
settings. New York: Holt, Rinehart and Win- and cultural factors in schooling language
ston. minority students, 143–186.
Charmaz, K. (2006). Constructing grounded the- Hutchins, E. (1995). Cognition in the wild. Cam-
ory. London: SAGE. bridge, MA: MIT press.
Creswell, J. W. (1998). Qualitative inquiry and Jordan, B., & Henderson, A. (1995). Interaction
research design: Choosing among five traditions. analysis: Foundations and practice. The Journal
Thousand Oaks, CA: SAGE. of the Learning Sciences, 4(1), 39–103.
Denzin, N., & Lincoln, Y. (2000). Handbook Kvale, S. (1996). InterViews: An introduction
of qualitative research. Thousand Oaks, CA: to qualitative research interviewing. Thousand
SAGE. Oaks, CA: SAGE.

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035
570 cambridge handbook of engineering education research

LeCompte, M. D., & Schensul, J. J. (2010). Spradley, J. (1979). The ethnographic interview.
Designing & conducting ethnographic research: Fort Worth, TX: Harcourt Brace Jovanovich.
An introduction (2nd ed.). Lanham, MD: Spradley, J. P. (1980). Participant observation.
AltaMira Press. New York, NY: Holt, Rinehart & Winston.
Lofland, J., & Lofland, L. (2006). Analyzing social Stake, R. E. (1995). The art of case study research:
settings. Belmont, CA: Wadsworth. Perspectives on practice. Thousand Oaks, CA:
Martin, D., & Sommerville, I. (2004). Pat- SAGE.
terns of cooperative interaction: Linking eth- Strauss, A. (1987). Qualitative analysis for social
nomethodology and design. ACM Transactions scientists. New York, NY: Cambridge Univer-
on Computer-Human Interaction (TOCHI), sity Press.
11(1), 59–89.
Strauss, A., & Corbin, J. (1998). Basics of quali-
Marshall, C., & Rossman, G. B. (1999). Designing tative research: Grounded theory procedures and
qualitative research (3rd ed.). Thousand Oaks, techniques (2nd ed.). London: SAGE.
CA: SAGE.
Taylor, S. J., & Bogdan, R. (1984). Introduction
McCracken, G. (1988). The long interview. New- to qualitative research methods. New York, NY:
bury Park, CA: SAGE. John Wiley & Sons.
Merton, R. K., Fiske, M., & Kendall, P. L. (1990).
Tobin, K. (1999). Interpretive research in science
Focused interview: A manual of problems and
education. In A. E. Kelly & R. Lesh (Eds.),
procedures (2nd ed.). New York, NY: The Free
Handbook of research design in mathematics and
Press.
science education (pp. 487–512). Mahwah, NJ:
Miles, M. B., & Huberman, A. M. (1994). Lawrence Erlbaum.
Qualitative data analysis: An expanded
Wasserman, S., & Faust, K. (1994). Social network
sourcebook (2nd ed.). Thousand Oaks, CA:
analysis: Methods and applications. Cambridge
SAGE.
University Press.
Morgan, D. L. (1997). Focus group as qualitative
Webb, E. J., Campbell, D. T., Schwartz, R. D.,
research. Newbury Park, CA: SAGE.
& Sechrest, L. (2000). Unobtrusive measures
Patton, M. Q. (2001). Qualitative research & eval- (Rev. ed.). Thousand Oaks, CA: SAGE.
uation methods (3rd ed.). Thousand Oaks, CA:
Wagenaar, H. (2011). Meaning in action: Interpre-
SAGE.
tation and dialogue in policy analysis. Armonk,
Rossman, G. B., & Rallis, S. F. (2003). Learn- NY: M. E. Sharpe.
ing in the field (2nd ed.). Thousand Oaks, CA:
Weiss, R. S. (1994). Learning from strangers: The
SAGE.
art and method of qualitative interview studies.
Rubin, H. J., & Rubin, I. S. (1998). Qualitative New York: The Free Press.
interviewing: The act of hearing data. Thousand
Wolcott, H. F. (1995). The art of fieldwork. Walnut
Oaks, CA: SAGE.
Creek, CA: Altamire Press.
Sacks, H. (1984). Notes on methodology. Struc-
Wolcott, H. (2001). Writing up qualitative research
tures of social action: Studies in conversation
(2nd ed.). Thousand Oaks, CA: SAGE.
analysis, 21–27.
Wolf, M. (1992). A thrice-told tale: Feminism,
Scott, J., & Carrington, P. J. (Eds.). (2011). The
postmodernism, and ethnographic responsibility.
SAGE handbook of social network analysis.
Stanford, CA: Stanford University Press.
SAGE publications.
Van Maanen, J. (1988). Tales of the field: On
Schatzman, L., & Strauss, A. L. (1972). Field
writing ethnography. Chicago, IL: University of
research: Strategies for a natural sociology. Upper
Chicago Press.
Saddle River, NJ: Pearson.
Seidman, I. (2006). Interviewing as qualitative Yanow, D. (2006). Thinking interpretively. In D.
research: A guide for researchers in education and Yanow & P. Schwartz-Shea (Eds.), Interpreta-
the social sciences (3rd ed.). New York, NY and tion and method: Empirical research methods and
London: Teachers College Press. the interpretive turn (pp. 5–27). Armonk, NY:
M. E. Sharpe.
Silverman, D. (1998). Harvey Sacks: Social science
and conversation analysis. Oxford University Yin, R. K. (1994). Case study research: Design and
Press. methods. Thousand Oaks, CA: SAGE.

Downloaded from https://www.cambridge.org/core. University of Warwick, on 21 Oct 2018 at 04:29:01, subject to the Cambridge Core terms of use, available at
https://www.cambridge.org/core/terms. https://doi.org/10.1017/CBO9781139013451.035

Potrebbero piacerti anche