RELIABILITY & VALIDITY

The most common sampling methods are as follows:

1.2 15almondRandom Sampling – Any sort of sampling where, in advance of the
selection of the sample, each member of the population has a calculable and non-
zero chance of selection
2. 3Simple Random Sampling – The same as the above but with additional
constraints: 1. Each member of the population has the same chance of selection,
and 2. The relative chance of selection of any two members of the population is
not affected by knowledge of whether a third member has or has not been
selected. In practice, this essentially means drawing names out of a hat or some
other random method.
3. 6almond.Stratified Sampling – The population is divided into non-overlapping
groups, or strata. Samples are drawn from each stratum separately and results
pooled.
• Group the sample, based on their characteristics.

Simple Random Sampling

4. Multi-stage Sampling – In a two-stage sample, the population is divided into a
number of non-overlapping “first stage units”. A sample of this “fsu” is drawn, and
then in the second and final stage individuals are taken from within the “fsu’s. This
can be repeated for three stages or four-stage sampling.
5. 6.7 almondSystematic Sampling – this simply involves, e.g., asking every third
person who happens to come along, or calling at every fifth house, etc
6. 5. Cluster Sampling – a special case of multi-stage sampling. It may be that say a
certain geographical area can be described as largely middle-class, another as
largely working-class. In this case, cluster may be selected from each such area,
and as many people as possible included in the sample.
 Types of Sampling Techniques
1. Non-probability - is a sampling technique in which the researcher
selects samples based on the subjective judgment of the researcher
rather than random selection. In non-probability sampling, not all
members of the population have a chance of participating in the study
unlike probability sampling, where each member of the population has
a known chance of being selected.
A. Convenience Sampling
B. Judgmental Sampling
D. Snowball Sampling
E. Quota Sampling
2. 7.8almondProbability Sampling - is a sampling technique in which sample from
a larger population are chosen using a method based on the theory of
probability. For a participant to be considered as a probability sample, he/she
must be selected using a random selection. The most important requirement of
probability sampling is that everyone in your population has a known and an
equal chance of getting selected. For example, if you have a population of 100
people every person would have odds of 1 in 100 for getting selected. Probability
sampling gives you the best chance to create a sample that is truly representative
of the population. Probability sampling uses statistical theory to select randomly,
a small group of people (sample) from an existing large population and then
predict that all their responses together will match the overall population.
A. Simple Random Sampling
B. Systematic Sampling
C. Cluster Sampling
D. Stratified Random Sampling
 What is the difference between them?
a. 8.10.Survey Research Design – is a systematic collection of data from a sample
to make a generalization about the population.
b. 10.9almondMeasurements Instruments – is a tool that can be used to collect
data from a sample. (consistent data from all participants)
• The measurement instrument either questionnaire, test, interview, observation
schedule or rating scale must be described on how it is being designed and used
by the researcher. Each part of the instrument must be clearly stated and
discussed.
• Outline the instruments you use. A pilot study is nearly essential.
• c. 9.Questionnaire – is an example of a measurement instruments. Specific, fixed
format a measurement might have.
• All questionnaires are instruments
• Some instruments are Not questionnaires
• Fixed set of Instructions, Items, Response Options
 Validity and reliability in quantitative studies
1. Reliability – the degree to which a research instrument produces consistent
results
Example of Reliability:

= The scale is not RELIABLE

 FIRST TIME SECOND TIME THIRD TIME

= The scale is RELIABLE

= Because there is a consistent results of the
weighing scale which is 108
 “Validity”
• For example if you measure your IQ level but you used the weighing scale it
means it is totally a low validity.
• Because Validity means the extent to which a measurement tool measures what
is supposed to measure
• It means weighing scale is
Not appropriate tool to
Measure an IQ Level
 Reliability and Validity
• for example we are playing DARTS our aim or goal of measurement is to hit the
bullseye or the center of the target.
• There are three possible outcomes
1. We are faraway from a target
2. Our darts are spread on the board, thus it implicates that we are not valid nor
reliable. We are not throwing reliability at the same time we are not hit the center
that made it as invalid.
3. Our dart is clustered near at the center of the target. This is the ideal situation.
We have a high reliability and a high validity because we hit our target or our
measurement.
= In order to be
Valid, a measure
Has to be reliable
 Types of Reliability
1. 13almondTest-retest – when the same instrument is given to a group of people
at two different times. The results from time #1 are compared to results from
time #2 in order to determine how well the instrument consistently gets the
same results.
2. Parallel-forms – when a group of people complete two similar versions of an
instrument. Each version of the instrument is trying to measure the same thing.
Then, the results from the two versions are compared in order to determine the
consistency of the results between the similar versions of an instrument.
3. Internal consistency – when different instrument (items – is the question you
make) that are trying to measure the same construct are compared to see how
they produce similar results.
4. Inter-rater – when the decision is from different raters are compared to each
other to see how consistent the rater’s decisions are.
11.almondRaters – researchers who rate or judge a variable in the research
study.
2. Validity - means the extent to which a measurement tool measures what is
supposed to be measure. How accurate an instrument is at measuring what it is
trying to measure.
Types of Validity
1. 12almondFace validity – this is when researchers simply look at the items on
the research instrument and give their opinion if the items appear to accurately
measure what they are trying to measure. It is the least scientific of all measures
of validity.
2. Construct validity – when we are able to generalize about our construct of
interest because we are accurately measuring that construct. Think of construct
validity as being truthful in how we are labeling our construct.
3. 14almond Criterion-related validity – when the results from the instrument
accurately relates/predicts some kind of external variable.
4. Content validity – how well an instrument covers the range of meanings
included within a concept that is being measured.
Identify the following:
1. It is the extent to which a measurement tool measures what is supposed to
measure.
2.It is a degree to which a research instrument produces consistent results
(3-6) Enumerate and define the 4 Types of reliability.
(7-10) Enumerate and define the 4 Types of validity.
(11-15) Essay (10 sentences, 1 paragraph). How does a questionnaire become
reliable and valid? Give a concrete example based on your own research study.