Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
RESEARCH
PROBLEM
IDENTIFICATION
R K JAIN
PRINCIPAL
ADIT, NEW V V NAGAR
ADIT 24.04.2009 1
BASIC STEP OF RESEARCH WORK
1. Read , read, read
and read
To know what is
going on not only
around you but
around whole
world
ADIT 24.04.2009 2
O
2. Classify the
T
reading and
priorities as H
per your E
interest and R
capabilities W
I
S
E
ADIT 24.04.2009 3
3. Write down salient
points you have
read as work done
4. Note down
research need
stated by the
researcher if any
5. Discuss with the
people in that field
ADIT 24.04.2009 4
6. Judge them against
infrastructure
facility available
and time frame
available with you
ADIT 24.04.2009 5
ASK FOLLOWING QUESTIONS
What is to be done?
Why it is to be done?
How it is to be done?
Who will be beneficiary?
When he will be beneficiary?
ADIT 24.04.2009 6
If you can identify the research problem
MAKE HYPOTHESIS
ADIT 24.04.2009 7
SESSION II
RESEARCH DESIGN:
A METHODOLOGICAL BACKGROUND FOR SCIENTIFIC WORK
By
Dr. Jitesh Thakkar
17
Design research process
knowledge
flows + operation and goal knowledge
circumscription
process
steps
Awareness of
Suggestion Development Evaluation Conclusion
problem
logical
formalism
abduction deduction
[Takeda,1990]
Research Paradigm
Research Process
Research Process
1. Formulating a research problem
2. Research design: It includes selection of research approach, design of
sampling plan, design of experiment and design of questionnaire.
3. Constructing an instrument for data collection: Methods and tools of data
collection.
4. Selecting a sample: Sampling theory and designs
5. Writing a research proposal: It includes Problem definition, objectives,
methodology, data and data sources and scope of the study
6. Collecting data from various sources: Primary data and secondary data
7. Data Analysis: Data processing using different statistical methods
8. Interpretation of results: by inferring the solutions
9. Validation of results: to ensure the credibility of the results.
10.Writing a research report
Milestone 1: Stating the Research
Problem
Stating the Research Problem
• Once you’ve identified a research problem:
– State that problem clearly and completely.
– Determine the feasibility of the research.
• Identify subproblems:
– Completely researchable units.
– Small in number.
– Add up to the total problem.
– Must be clearly tied to the interpretation of the
data.
Defining the Research Problem
1. There must be some objectives to be attained at. If one
wants nothing, one cannot have problem.
2. There must be alternative means (or the courses of
action) for obtaining the objective(s) one wishes to
attain. There must be at least two means available to a
researcher for if he has no choice of means, he cannot
have a problem.
3. There must remain some doubt in the mind of a
researcher with regard to the selection of alternatives
(efficiency of the possible alternatives).
Research Problem: An Illustration
• A hypothesis is a
claim (assumption) I claim the mean CGPA of this
• Secondary Data
– Not original
– Use of already published material such as government
reports, tables, work of other researcher.
Levels of Data Measurement
44
• Ordinal
• Interval
• Ratio — Highest level of measurement
Usage Potential of Various Levels of Data
Ratio
45
Interval
Ordinal
Nominal
Data Level, Operations,
and Statistical Methods
Data Statistical
Meaningful Operations
Level Methods
46
Nominal Classifying and Counting Nonparametric
u Non-sampling Errors
• Response errors occur when people so not know, will not say, or
overstate in their answers
Sampling Distribution of
x
Proper analysis and interpretation of a
sample statistic requires knowledge of its
distribution.
Calculate x
to estimate
Population Sample
Process of x
Inferential Statistics
(parameter ) (statistic)
Select a
random sample
Two Basic Rules about Sample Size
1. About thirty (30) individuals are required in
order to provide a pool large enough for
even simple kinds of analysis.
Normal
Population n=2 n=5 n = 30
Milestone 5:
Data Analysis & Interpretation
Data Analysis
• The data that were gathered in the previous
step are analyzed as a first step in ascertaining
their meaning.
• As before, the analysis of the data does not
constitute research.
– This is basic number crunching.
General Steps in Hypothesis Testing
e.g.: Test the assumption that the true mean number of TV
sets in U.S. homes is three ( Known)
1. State the H0 H0 : 3
2. State the H1 H1 : 3
3. Choose =.05
4. Choose n n 100
5. Choose Test Z test
General Steps in Hypothesis Testing
(continued)
6. Set up critical value(s) Reject H0
Z
-1.645
100 households surveyed
7. Collect data Computed test stat =-2,
p-value = .0228
8. Compute test statistic
and p-value Reject null hypothesis
The true mean number of TV sets is
9. Make statistical decision less than 3
10. Express conclusion
Parametric vs Nonparametric Statistics
67
R&D
• The phrase research and development
(also R and D or, more often, R&D),
according to the Organization for
Economic Co-operation and
Development, refers to :
– "creative work undertaken on a systematic basis in
order to increase the stock of knowledge, including
knowledge of man, culture and society, and the use
of this stock of knowledge to devise new
applications”
technology is ……..
the application of scientific and other knowledge to practical tasks by
organizations that involve people and machines.
Exploitation
technology Patents etc
e.g. product
plans Protection
Acquisition
e.g. strategy
e.g. R&D
practice
partners internal
Selection Identification
capabilities customers
Science base
70
competitors Prof. Jagdish Hirani
How to plan
Goals
Plan
Resources
Direction
Actions
Values
Competences
Objectives
• Patents
• Copyright
• Embedding Technology
• None
Identifying or
Defining a Problem ACTION PLANNING
• Pilot
• Administration
– Postal survey
– email
Variables
• Something that varies
A B C D NF
1 1 1 1 1 1 y0
2 2 1 1 1 1 yA
3 1 2 1 1 1 yB
4 1 1 2 1 1 yC
5 1 1 1 2 1 yD
NTC 1 1 1 1 2 yNF
Orthogonal Arrays
• If there are N options or factors, the full
optimization space contains 2N combinations.
• This space is called a full factorial design.
• A fractional factorial design is a subset of the full
factorial design.
• An Orthogonal Array (OA) or Taguchi design is a
well-known approach to fractional factorial designs.
An OA allows us to determine the effect of a factor
in the presence of other factors using a reduced
space.
OA Selection Rules
Taguchi developed OAs to identify factors
influence without loss of accuracy.
For 2- levels
No. of factors OA
2 to 3 L4
4 to 7 L8
8 to 11 L12
12 to 15 L16
Selection Rules … contd..
For 3- levels
No. of factors OA
2 to 4 L9
5 to 7 L27
Approach 5: Simulation
SUMMARY
• System Analysis
• Simulation
• Requirement of Simulation
• Models
• Simulation Languages
• Validation
• Common Mistakes
• Example
4/25/2009 V N Singh, Mech Dept ,ADIT 125
SYSTEM
• A part/process /entity under consideration
Experiment Experiment
with the with a model
actual system of the system
Mathematical Physical
model model
Analytical
SIMULATION
solution
Time
Time Tuesdays and
Thursdays
Time Time
output output
input input
By:
Dr. Bharat Ramani
Contents…..
• Motivation/Inspiration…
• Organization/Structure of thesis…
• Check-list
• Typical shortcomings
• Conclusion…
“The difference
between the right
word and the almost
right word is the
difference between
lightning and
lighting.”
The Bad News
• Writing a thesis is
hard, painful work
– You’ve already done
the fun part (the
research)
• Entertainment or
humour
– Joke footnote
Common problems
• It’s never possible to
cover all issues
– So you will never
finish?
– It’s sometimes enough
to identify the issues
– Examiners greatly
appreciate finding a
few mistakes
Common problems
Je n'ai fait celle-ci plus longue que parce que je n'ai pas eu le loisir de
la faire plus courte. Blaise Pascal, 1657
Common problems
• At some point, your
brain will surely
become toast
– Take a break
– Eat properly, exercise,
sleep …
• Maintain regularity.
4/25/2009 170
Outline
• Select misconceptions
• Scientific writing and components
• Research paper writing – Manuscript
preparation
• Manuscript submission
• Review process
• Addressing review comments
• Review frameworks
• Select learning
4/25/2009 171
Why
bother?
4/25/2009 172
I‟ll write when it‟s time to write
Write a paper,
and give a talk, about
any idea,
no matter how weedy and insignificant it
may seem to you
4/25/2009 175
Writing papers: model 1
4/25/2009 176
Writing papers: model 2
4/25/2009 178
Organization of a Research Paper
Main sections…
Title • Introduction
• Method
• Participants
• Apparatus
Abstract • Procedure
• Design
• Results and Discussion
• Conclusions
Body
4/25/2009 179
Paper Writing: Design
• Abstract –summarizes the research contributions, not
the paper (i.e., it shouldn’t be an outline of the paper)
• Introduction/motivation – what you’ve done and
why the reader should care, plus an outline of the paper
• Technical sections – one or more sections summarizing
180
the research ideas you’ve developed
• Experiments/results/analysis – one or more sections presenting
experimental results and/or supporting proofs
• Future work – summary of where you’re headed next and open
questions still to be answered
• Related work – sometimes comes after introduction, sometimes
before conclusions (depends to some extent on whether you’re
building on previous research, or dismissing it as irrelevant)
• Conclusions – reminder of what you’ve said and why it’s
important
4/25/2009
What Is Scientific Writing?
“State your facts as simply as possible, even boldly. No one
wants flowers of eloquence or literary ornaments in a research
article” – R.B. McKerrow
4/25/2009 181
Before starting to write
• Put together structure of the paper:
– Title, authors, addresses, possibly key words, etc.
– Abstract
– 1. Introduction
– 2. Methods & Materials
– 3. Results
– 4. Discussion & Conclusions
– Acknowledgements
– References
• IMRaD is a typical structure (AIMRaDAR). In some cases
other structures may be more appropriate.
• Divide long sections into subsections
4/25/2009 182
Logic of IMRAD:
What question (problem) was studied?
The answer is the Introduction.
How was the problem studied?
The answer is Methods.
What were the findings?
The answer is the Results.
What do these findings mean?
The answer is Discussion.
4/25/2009 183
How To Prepare the Title
First impressions are strong impressions; a title
ought therefore to be well studied and to
give, so far as its limits permit, a definite and
concise indication of what is to come.
4/25/2009 184
How to Prepare Title
• The title often decides if the paper is looked at by colleagues: So
many papers, so little time!
– I first check the title (and/or authors). If interesting I look at
the abstract. If I’m still interested I look at the figures and
only then do I read through the text.
• What is a good title? – The fewest possible words that
adequately describe the contents of the paper
• Avoid waste words - “Studies on”, “Investigation on”, and
“Observation on”.
• It should not promise too much.
• Tell the complete story but keep it short!
• Focus on YOUR study!
• Don’t be ambiguous…tell what you found!
4/25/2009 185
4/25/2009
How to Prepare Title
• An opening A, An or The is also a “waste” word.
• Example: “Action of Antibiotics on Bacteria”
• It is short and carries no excess baggage
• Alternation 1: “Preliminary observations on the effect of certain
antibiotics on various species of Bacteria”
• Alteration 2: “Action of Streptomycin on Mycobacterium tuberculosis”
• If the “Action of” can be defined easily, the meaning might be clearer”
• Alteration 3: “Inhibition of Growth of Mycobacterium tuberculosis by
Streptomycin”.
• Most of the indexing and abstracting services are geared to “key word”
systems, generating either KWIC (Key Word In Context) or KWOC (Key
Word Out of Context).
186
Authorship
• Who should be an author?
– Anyone who contributed significantly to the conceptual
development or writing of the paper
– Not necessarily people who provided feedback,
187
implemented code, or ran experiments
• What order should the authors be listed in?
– If some authors contributed more of the
conceptual development and/or did most/all of the writing, they
should be listed first
– If the contribution was equal or the authors worked as a team, the
authors should be listed in alphabetical order
– Sometimes the note “The authors are listed in alphabetical order”
is explicitly included
4/25/2009
Authorship
• An example – Suppose that Scientist A designs a series of
experiments that might result in important new
knowledge, and then Scientist A tells Technicians B
exactly how to perform the experiments. If the
experiments work out and a manuscript results, Scientist
A should be the sole author, even though Technician B
did all the work. (Of course, the assistance of Technician
B should be recognized in the Acknowledgment).
• The preferred designation normally is first name,
middle initial, last name.
4/25/2009 188
How to Prepare the Abstract
I have the strong impression that scientific
communication is being seriously
hindered by poor quality abstracts
written in jargon ridden mumbo-jumbo
– Sheila M. McNab
4/25/2009 189
Questions an Abstract Answers
Why did you do this study or project?
What did you do, and how?
What did you find?
What do your findings mean?
If the paper is about a new method or
apparatus the last two questions might
be changed to:
What are the advantages (of the method or apparatus)?
How well does it work?
4/25/2009 190
Rule of Thumb
1. Write 1-2 introduction sentences that explain topic,
purpose, and research question(s).
2. Write 1-2 sentences describing your research
methods (this may also include the type of data
analysis you used).
3. Write 1-2 sentences describing the results /
findings.
4. Write 1-2 sentences containing your conclusions
and recommendations.
4/25/2009 191
“Don’ts”
Do not commence with "this paper…”,
"this report…" or similar.
4/25/2009 192
Use of Key Words
Titles and abstracts are filed electronically
4/25/2009 193
How to Write Introduction
A bad beginning makes a bad ending - Euripides
4/25/2009 194
How to Write Introduction
• If you do not have a clear purpose in mind, you might go
writing off in six directions at once!
• The Introduction should also provide the rationale for the
present study.
• Choose references carefully to provide the most important
background information.
• It should generally be written in the present tense, because you
will be referring primarily to your problem and the established
knowledge relating to it at the start of your work.
In the Introduction you should have a “hook” to gain the reader’s
attention. Why did you choose that subject, and why is it
important?
4/25/2009 195
INTRODUCTION
The first paragraph is crucial for catching the attention of the
audience and for conveying to them the importance of the
questions that you have addressed in the paper.
4/25/2009 196
The last paragraph of the Introduction should be a short
summary of what you set out to do and what you have
achieved.
e,g
“In this paper, we have studied the …… by using a
novel technique in which
……. This approach has allowed us to directly
compare A and B, and to
distinguish between alternative possibilities for their
functions. We
conclude that ….. and provide a model to reconcile
our findings and
those of others”
4/25/2009 197
Rules of Thumb
1. The Introduction should present first, with all possible
clarity, the nature and scope of the problem
investigated.
2. It should review the pertinent literature to orient the
reader.
3. It should state the method of the investigation and
reasons for the choice of a particular method should
be stated.
4. It should state the principal results of the
investigation.
5. It should state the principal conclusion(s) suggested
by the results.
4/25/2009 198
No related work yet
I feel
stupid
• Problem 1: the reader knows
nothing about the problem yet; so
your (carefully trimmed) description
of various technical tradeoffs is
absolutely incomprehensible
• Problem 2: describing alternative
approaches gets between the
reader and your idea I feel
tired
4/25/2009 199
Caution
• Your introduction makes claims
• The body of the paper provides evidence to
support each claim
• Check each claim in the introduction,
identify the evidence, and forward-reference
it from the claim
• Evidence can be: analysis and comparison,
theorems, measurements, case studies
4/25/2009 200
How to write Literature
Review?
4/25/2009 201
Literature Review
• Motivation for literature searches:
– full grasp of subject (large picture)
– show originality of own work
– list of references for your own paper
– ideas for new research
• Every day more than 1000 papers are published in
electrical engineering, thus you must carefully select
what you read
• The amount of papers is doubled every ten years
• Literature review is a written summary of the state of the art in
your area (should be the second chapter in your doctoral thesis)
– a review is written for experts in the field (a tutorial is
written for students)
– papers collected in your files are not a review!
4/25/2009 202
Writing a literature review
4/25/2009 203
How to Write the Materials and
Methods Section
The greatest invention of the nineteenth
century was the invention of the method of
invention
- A.N. Whitehead
4/25/2009 204
How to Write the Materials and Methods Section
• The purpose is to describe the experimental design and then
provide enough detail so that a competent worker can repeat the
experiments.
• Use past tense.
• Critically important because the cornerstone of the scientific
method requires that your results, to be of scientific merit, must
be reproducible.
• If there is serious doubt that your experiments could be
repeated, the reviewer will recommend rejection of your
manuscript no matter how inspiring your results.
• Questions such as “how” and “how much” should be precisely
answered by the author and not left for the reviewer or the reader
to puzzle over.
4/25/2009 205
Methods and Materials
• Rule of thumb:
– New method, new instrument, new type of
data Describe in detail, since required
for reproducibility.
– Known method or instrument, previously
used and described in other paper(s)
Often a reference is sufficient.
• Often a figure can illustrate & clarify the
method
4/25/2009 206
How to Write the Results
4/25/2009 207
How to Write Results
Usually two ingredients of the Results section.
First, you should give some kind of overall description of the
experiments, providing the “big picture”, without, however, repeating
the experimental details previously provided in Materials and
Methods.
Second, you should present the data.
Results should be presented in past tense.
If statistics are used to describe the results, they should be meaningful
statics.
Do not be verbose in citing figures and tables. For example, Do not say
“It is clearly shown in Table 1 that nocillin inhibited the growth of N.
gonorrhoeae”. Say “Nocilling inhibited the growth of N. gonorrhoeae
(Table 1)”
The compulsion to include everything, leaving nothing out, does not
prove that one has unlimited information; it proves that one lacks
4/25/2009 discrimination!
208
Results
• Be concise! Pre-select the results (i.e. identify the
important and new results) before writing about them in
the results section.
Keep in mind:
The fool collects facts, the wise man selects
them!
(John W. Powell)
(don’t be too wise: first collect the facts, then select them)
4/25/2009 209
How to Write the Discussion
• The true meaning of the data may be completely obscured
by the interpretation presented in the Discussion, again
resulting in rejection.
• The primary purpose of the Discussion is to show the
relationships among observed facts.
• Discussion sections are too long and verbose. Occasionally,
“the author is doubtful about his facts or his reasoning and
retreats behind a protective cloud of ink”
• If the reader of a paper finds himself or herself asking “So
What?” after reading the Discussion, the chances are that
the author became so engrossed with trees (the data) that
he or she didn’t really notice how much sunshine had
appeared in the forest.
4/25/2009 210
Essential Features of A Good Discussion
• Point out any exception of any lack of correlation
and define unsettled points.
• Show how your results and interpretations agree (or
contrast) with previously published work.
• Don’t be shy; discuss the theoretical implications of
your work, as well as any possible practical
applications.
• State your conclusions as clearly as possible.
• Summarize your evidences for each conclusion.
4/25/2009 211
Conclusions and further work
• Be brief.
4/25/2009 212
Acknowledgements
• The acknowledgements are placed between the
end of the regular text and the references.
• People who have contributed to the paper, but not
by a sufficient amount to be included in the author
list, should be thanked in the acknowledgements.
• Discuss with your supervisor, which people should
be acknowledged.
4/25/2009 213
References
• First and most important rule: Check the style
manual of the journal to which you are submitting
the paper. Different journals have different styles for
the references.
• Example: Emerald Pattern
• Atkinson, A.A., Waterhouse, J.H. and Wells, R.B.
(1997), “A stakeholder’s approach to strategic
performance measurement”, Sloan Management
Review, Vol. 1 No. 1, pp. 31-43.
• Brown, M.G. (2000), Winning Score: How to Design
and Implement Organizational Scorecards,
Productivity Press, Cambridge, MA.
4/25/2009 214
References
• References are a place where a lot of errors are
propagated.
– Make sure that the references are correct!
– Check if all papers cited in the text are also
present in the references and vice versa
– Check if dates, authors etc. agree between text
& reference list; e.g. a paper that appeared in
1995a is also listed as such in the references.
4/25/2009 215
Appendices
• Material that may be of interest for some
readers, but not for most (e.g. lengthy tables,
derivations of equations) can be put into an
appendix or into multiple appendices.
• Most papers do not have an appendix.
• An appendix must be referred to in the main
paper. E.g., “The derivation of Eq. (15) is given
in Appendix B.”
4/25/2009 216
Where to Publish
• Workshops vs. conferences vs. journals
– Length of decision cycle
– Quantity vs. quality
217
– Aim high! (or at least appropriately)
– Acceptance rate vs. time to prepare/publish
4/25/2009
Which Journal?
• Criteria for choice of journal:
– The journal should cover your field and
should be read by colleagues
– The journal should have a good reputation.
– Monetary considerations: page charges (if
any), cost of printing in colour, free reprints
provided?
4/25/2009 218
WHAT DO REVIEWERS EXPECT? – SHARING
EXPERIENCES AS A RESEARCHER &
REVIEWER
4/25/2009 219
Purpose of a Review
• Evaluate the paper’s scientific merit
– Check the validity of the paper’s claims and
evidence
220
– Judge the paper’s relevance and significance
• Provide constructive feedback to the author
4/25/2009
Listening to your reviewers
Treat every review like gold dust
Be (truly) grateful for criticism as well
as praise
4/25/2009 221
Journal Reviewing
• Executive editor Area editor Board members or
reviewers
• Longer decision cycle
222
• Typically higher quality, longer, and deeper reviews
• Decision options:
– Accept as is
– Accept with minor changes
– Accept with major changes (subject to re-review)
– Reject with encouragement to resubmit
– Reject out of hand
4/25/2009
Rejected!! Now What?
• Fix the paper!
– Read the reviews, rail and complain, berate the
reviewer
223
– Calm down
– Read them again with an open mind
– Do more experiments, revise the paper, …
– Go back to the reviews again – have you addressed
all the points?
– Have people read the revision critically
– Do more experiments, revise the paper, …
– Repeat until the next deadline
4/25/2009
Most common reasons for rejection of a
manuscript
MOST COMMON REASONS FOR REJECTING ARTICLE MANUSCRIPTS
(Cited by 85 Editors of Scientific and Technical Journals)
Number of
Reason Respondents
Subject
Not suitable for journal 63
Not timely 4
Coverage
Questionable significance 55
Questionable validity 39
Too shallow 39
Too exhaustive 8
Length
Too long 26
Too short 4
Presentation
Bad organization 35
Ineffective expression 33
Ineffective or unusable illustrations 11
Failure to follow style guide
4/25/2009 224 4
Know the Review Criteria
Scientific content and merit
Relevance of problem
Rigor of hypotheses
4/25/2009 225
Learn to Interpret & Digest Rejections
• “Unacceptable” or “Unacceptable in its present
form”; seldom is the harsh word “reject” used
• Before you begin to weep, do two things.
• First, remind yourself that you have a lot of company;
most of the good journals have reject rates
approximately (or exceeding) 50%.
• Second, read the reject letter carefully because, like
modify letters, there are different types of rejections.
4/25/2009 226
Problems Encountered by Researchers in India
The lack of a scientific training in the methodology of research –
Most of the work, which goes in the name of research is not
methodologically sound
There is insufficient interaction between the university research
departments on one side and business establishments, government
departments and research institutions on the other side
Most of the business units in our country do not have the confidence
that the material supplied by them to researchers will not be
misused
Library management and functioning is not satisfactory at many
places and much of the time and energy of researchers are spent in
tracing out the books, journals, reports etc. rather than in tracing out
relevant material from them.
There is also the difficulty of timely availability of published data
from various government and other agencies.
The problem of conceptualization and also problems relating to the
process of data collection and related things.
4/25/2009 227
Good Luck!