Sei sulla pagina 1di 18

11.05.

2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Thissiteusescookies.MoreinfoCloseBycontinuingtobrowsethesiteyouareagreeingtoouruseof
cookies.FindoutmorehereClose
CCBYNCOpenaccess

Research

Differentcombinedoralcontraceptivesandthe
riskofvenousthrombosis:systematicreviewand
networkmetaanalysis
BMJ2013347doi:http://dx.doi.org/10.1136/bmj.f5298(Published12September2013)Citethisas:BMJ
2013347:f5298
Article
Relatedcontent
Metrics
Responses
Peerreview

BernardineHStegeman,researchassociate13,MarcosdeBastos,researchfellow2,FritsR
Rosendaal,professorofclinicalepidemiology3,AvanHylckamaVlieg,researchfellow4,FransM
Helmerhorst,professorofclinicalepidemiologyoffertility25,TheoStijnen,professorofmedical
statistics6,OlafMDekkers,researchfellow7

Authoraffiliations
Correspondenceto:OMDekkerso.m.dekkers@lumc.nl
Accepted12August2013

Abstract
ObjectiveToprovideacomprehensiveoverviewoftheriskofvenousthrombosisinwomenusingdifferent
combinedoralcontraceptives.
DesignSystematicreviewandnetworkmetaanalysis.
DatasourcesPubMed,Embase,WebofScience,Cochrane,CumulativeIndextoNursingandAllied
HealthLiterature,AcademicSearchPremier,andScienceDirectupto22April2013.
ReviewmethodsObservationalstudiesthatassessedtheeffectofcombinedoralcontraceptiveson
venousthrombosisinhealthywomen.Theprimaryoutcomeofinterestwasafatalornonfatalfirsteventof
venousthrombosiswiththemainfocusondeepvenousthrombosisorpulmonaryembolism.Publications
withatleast10eventsintotalwereeligible.Thenetworkmetaanalysiswasperformedusinganextension
offrequentistrandomeffectsmodelsformixedmultipletreatmentcomparisons.Unadjustedrelativerisks
with95%confidenceintervalswerereported.Therequirementforcrudenumbersdidnotallowadjustment
forpotentialconfoundingvariables.
http://www.bmj.com/content/347/bmj.f5298

1/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Results3110publicationswereretrievedthroughasearchstrategy25publicationsreportingon26
studieswereincluded.Incidenceofvenousthrombosisinnonusersfromtwoincludedcohortswas1.9and
3.7per10000womanyears,inlinewithpreviouslyreportedincidencesof16per10000womanyears.
Useofcombinedoralcontraceptivesincreasedtheriskofvenousthrombosiscomparedwithnonuse
(relativerisk3.5,95%confidenceinterval2.9to4.3).Therelativeriskofvenousthrombosisforcombined
oralcontraceptiveswith3035gethinylestradiolandgestodene,desogestrel,cyproteroneacetate,or
drospirenoneweresimilarandabout5080%higherthanforcombinedoralcontraceptiveswith
levonorgestrel.Adoserelatedeffectofethinylestradiolwasobservedforgestodene,desogestrel,and
levonorgestrel,withhigherdosesbeingassociatedwithhigherthrombosisrisk.
ConclusionAllcombinedoralcontraceptivesinvestigatedinthisanalysiswereassociatedwithan
increasedriskofvenousthrombosis.Theeffectsizedependedbothontheprogestogenusedandthe
doseofethinylestradiol.

Introduction
Shortlyaftertheintroductionofthefirstcombinedoralcontraceptive(containinganoestrogenanda
progestogen),acaseofvenousthrombosisassociatedwithcontraceptiveusewasreported.1Sincethen,
manyobservationalstudieshaveshownthatcombinedoralcontraceptivesareassociatedwithatwofoldto
sixfoldincreasedriskofvenousthrombosis.2345Despitethelowincidenceofvenousthrombosisabout
threeper10000womanyearsamongwomenofreproductiveage,6theeffectofcombinedoral
contraceptivesonvenousthrombosisislarge,owingtothefactthatmanywomenuseoralcontraceptives.
Becausetheoestrogencompound(ethinylestradiol)incombinedoralcontraceptiveswasthoughttocause
theincreasedriskinthrombosis,thedoseofethinylestradiolwasloweredfrom150100gintheearliest
brandsto50ginthe1960s,andto3035gand20ginthe1970s.789Thereduceddoseof
ethinylestradiolincontraceptiveswasindeedassociatedwithareductionintheriskofvenous
thrombosis.1011121314Apartfromadjustmentsinthedoseofethinylestradiol,theprogestogen
compoundwasalsochangedinanefforttoreducesideeffects.Afterthefirstgenerationprogestogens
(thatis,norethisteroneandlynestrol),newprogestogensweredeveloped.Thesenewcompoundswere
calledsecondgeneration(thatis,levonorgestrel)andthirdgenerationprogestogens(thatis,gestodene,
desogestrel,norgestimate).15However,usersofcombinedoralcontraceptiveswiththirdgeneration
progestogenshaveahigherriskofvenousthrombosisthanthoseusingsecondgeneration
progestogens.16171819Otherprogestogenshavebeendevelopedaftertheintroductionofthird
generationprogestogensthatis,drospirenone(introducedin2001).Thethrombosisriskfor
contraceptiveswithdrospirenonewasfoundtobehigherthanforcombinedoralcontraceptiveswith
secondgenerationprogestogens.2021
Thepresentnetworkmetaanalysisaimedtoprovideanoverviewoftheriskofvenousthrombosisper
combinedoralcontraceptiveinhealthywomen,andassesstheeffectofthegenerationofprogestogen
used.Weperformedanetworkmetaanalysisbecausecombinedoralcontraceptivesaremostlycompared
withnonuseorwithacontraceptivecontaininglevonorgestrelwith30gethinylestradiol.These
comparisonsresultedingapsindirectevidence,becausenoteverycombinedoralcontraceptivewas
directlycomparedwithotherpossiblecombinedoralcontraceptives.Anetworkmetaanalysisallows
evidencefromdirectandindirectcomparisonstobesummarisedinaweightedaverageforallpossible
http://www.bmj.com/content/347/bmj.f5298

2/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

comparisons.

Methods
Searchstrategyandselectioncriteria
Publicationsofinterestwereobservationalstudies(cohortor(nested)casecontrolstudies)thatincluded
healthywomenusingcombinedoralcontraceptives.Theprimaryoutcomeofinterestwasafatalornon
fatalfirsteventofvenousthrombosiswiththemainfocusondeepvenousthrombosisorpulmonary
embolism.Publicationswithaminimumof10eventsintotalwereeligible.
Thefollowingdatabasesweresearched:PubMed(984articlesretrieved),Embase(1339),WebofScience
(306),Cochrane(57),CumulativeIndextoNursingandAlliedHealthLiterature(122),AcademicSearch
Premier(197),andScienceDirect(105).OursearchtermsconsistedofMeSHheadingsandsubheadings,
textwords,andwordvariationsforcombinedoralcontraceptive,estrogens,progestogens,and
venousthromboembolism.Thissearchstrategywasamendedforeachdatabase.Wesearchedeach
databasefrominceptionuntil22April2013(dateoffinalsearch).Nolanguagerestrictionwasapplied.In
additiontodatabasesearches,wecheckedreferencesofpotentialinterestingpublications.
Astandardformwasusedtoselectpublications.Twoinvestigators(BHS,MdB)independentlyassessed
publicationsforeligibility.Titlesandabstractswerescreenedandifdeemedpotentiallyrelevant,fulltext
articleswereretrieved.Anydisagreementsbetweentheinvestigatorswerediscussedandifnecessary,a
thirdreviewer(OMD)wasaskedtoresolvedisagreements.Incaseofmultiplepublicationsfromthesame
study,thepublicationwiththemostupdatedorthemostinclusivedatawasincluded.Webappendix1
showsdetailsofthesearchstrategy.

Datacollection
Twoinvestigators(BHSandMdB)independentlyextracteddatausingastandardform.Datawere
extractedontypeofcombinedoralcontraceptive(doseandtypeofoestrogenandprogestogen),crude
numbersforexposureandoutcome,crudeandadjustedriskestimates,andvariablesadjustedforinthe
analysis.Incaseofincompletedatafordoseortypeofoestrogenorprogestogen,authorswere
approachedforextrainformation.Intotal,10authorsweresentanemailon25July2012andifnecessary,
areminderon20August2012.Oftheseauthors,80%repliedtoouremails.Ifprovided,dataforthe
absolutethrombosisriskinnonuserswereextractedfromthecohortstudies.Forsensitivityanalyses,data
forthefundingsourceandfirsttimeusewereabstracted.
Riskofbiasassessmentwasbasedondesignfeaturesthatcouldpotentiallybiastheassociationbetween
exposureandoutcome.Weassessedadequacyofexposure(oralcontraceptive)andoutcome(venous
thrombosis)measurement,losstofollowup(cohortstudies),andadequacyofcontrolselection(case
controlstudies).Womenaremorelikelytorememberthattheyusedoralcontraceptivesthanwhatspecific
preparationtheyused.2223Therefore,assessmentofthetypeofcombinedoralcontraceptivethroughan
intervieworquestionnairewasclassifiedashighriskofbias,andinformationfromaprescriptiondatabase
aslowrisk.Only2533%ofpatientspresentingwithclinicalsymptomssuggestiveofvenousthrombosis
areobjectivelydiagnosedwithvenousthrombosis.24Therefore,studieswithobjectiveconfirmationinall
patientswerejudgedaslowriskofbias.Venousthrombosiswasconsideredobjectivelyconfirmedwhena
deepvenousthrombosiswasdiagnosedbyplethysmography,ultrasoundexamination,computed
http://www.bmj.com/content/347/bmj.f5298

3/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

tomography,orvenographyorwhenpulmonaryembolismwasdiagnosedbyventilationperfusion
scanning,spiralcomputedtomography,orpulmonaryangiography.2526Lessthan10%losstofollowup
wasconsideredtorepresentalowriskofbias.Forcasecontrolstudies,controlsselectedfromhospital
populationswasconsideredtoconferahighriskofbias.27

Classificationoftypeofcombinedoralcontraceptive
Thereisnogenerallyacceptedwaytoclassifycombinedoralcontraceptivesaccordingtogenerationsof
progestogens.Inthisanalysis,themostcommonclassificationsystemwasused,whichisinlinewith
biologicalpropertiespergroupandisreflectedintheireffectsonlevelsofsexhormonebindingglobulin.28
29Fortheaimofthepresentnetworkmetaanalysispergenerationofprogestogen,thefollowing
progestogenswereclassifiedasfirstgenerationlynestrenolandnorethisterone.Norgestreland
levonorgestrelwerecategorisedassecondgenerationprogestogensanddesogestrel,gestodene,and
norgestimatewereclassifiedasthirdgenerationprogestogens.15Thisclassificationwasirrespectiveof
ethinylestradioldose.Publicationsreportingongenerationsaccordingtoanotherclassificationwere
included.Toassesstheinfluenceofcombiningdifferentclassifications,weperformedananalysisrestricted
tostudiesusingtheabovedescribedclassification.
Manydifferentcombinedoralcontraceptivesareavailable.Weselected10frequentlyprescribedoral
contraceptivesforthenetworkmetaanalysis:
20gethinylestradiolwithlevonorgestrel(20LNG)
30gethinylestradiolwithlevonorgestrel(30LNG)
50gethinylestradiolwithlevonorgestrel(50LNG)
20gethinylestradiolwithgestodene(20GSD)
30gethinylestradiolwithgestodene(30GSD)
20gethinylestradiolwithdesogestrel(20DSG)
30gethinylestradiolwithdesogestrel(30DSG)
35gethinylestradiolwithnorgestimate(35NRG)
35gethinylestradiolwithcyproteroneacetate(35CPA)
30gethinylestradiolwithdrospirenone(30DRSP)
Wecategorised20LNG,30LNG,and50LNGassecondgenerationprogestogens,and20GSD,30GSD,
20DSG,30DSG,and35NRGasthirdgenerationprogestogens.35CPAand30DRSPwerenotusedinthis
classificationbygenerations.

Statisticalanalysis
Anetworkmetaanalysiswasconductedpergenerationofprogestogeninacombinedoralcontraceptive
andperselectedoralcontraceptivepreparation.Weusedanextensionoffrequentistrandomeffects
http://www.bmj.com/content/347/bmj.f5298

4/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

modelsformixedmultipletreatmentcomparisons.Thenetworkmetaanalysiswasperformedwiththe
mvmetacommandforStata,asdescribedbyWhiteandcolleagues.30Weusedcrudedatafroma22
tableintheanalysis.Oddsratios,riskratios,orrateratiosandappropriatevarianceswerecomputedand
combinedintheanalysisleadingtoanoverallrelativerisk.Forpublicationswithzeroeventsinonecellofa
22table,allcellsofthat22tablewereinflatedbyadding0.5.Ifmorethanonestudyprovideddatafor
thesamestratum(thatis,dataforgenerationsofprogestogenoronspecificcontraceptivepreparations),
wecheckedconsistencyoftheresults.Aninteractiontermwasaddedtothemodeltoestimatethe
differenceinresultsfromdirectandindirectevidence.Allpotentialinteractionsweretestedinanoverall
testtodeterminewhethertherewereanyinconsistenciesinournetworkmetaanalysis.
Thefollowingsensitivityanalyseswereplanned:perstudydesign,perfundingsource(whetherindustry
sponsoredornot),withinfirsttimeusers,andaccordingtoriskofbias.Allstatisticalanalyseswere
performedwithStata,version12.0(StatacorpLP).

Results
Characteristicsofincludedstudies
Of3110publicationsretrievedthroughelectronicandreferencessearches,2144wereexcludedafter
screeningthetitleandabstractand81wereexcludedafterdetailedassessmentofthefulltext(fig1web
table1providesreasonsforexclusion).Overall,26studiesreportedin25articleswereincluded(one
article10presentedtwostudies).Twopublicationsprovidedimportantadditionalinformationtostudies
includedinthemetaanalysis(informationonfirsttimeuse)datafromthesepublicationswereaddedto
therespectivestudiesalreadyincluded.Table1showsdetailsofincludedstudies.Ninecohortstudies,
threenestedcasecontrolstudies,and14casecontrolstudieswereincluded.

http://www.bmj.com/content/347/bmj.f5298

5/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Fig1Flowdiagramofincludedandexcludedpublications

Downloadfigure
Openinnewtab
Downloadpowerpoint

Table1
Characteristicsofincludedstudies

Viewthistable:
Viewpopup
Viewinline

Twostudiesreportedtheabsoluteriskofvenousthrombosisinnonusers:
1.9and3.7per10000womanyears.Basedondatafrom15studiesthat
includedanonusergroup,useofcombinedoralcontraceptiveswasfound
toincreasetheriskofvenousthrombosisfourfold(relativerisk3.5,95%
confidenceinterval2.9to4.3).

Riskofbias
Eightstudiesassessedcombinedoralcontraceptiveusethroughanintervieworquestionnaire(webtable
2).Onlyfivestudiesobjectivelyconfirmedvenousthrombosisinallpatients,whereas14studiesobjectively
confirmedvenousthrombosisinaproportionofthepopulationorsubjectivelyconfirmedvenous
thrombosis.Fivecasecontrolstudiesselectedcontrolsfromapopulationinhospitalcare.Ofthenine
http://www.bmj.com/content/347/bmj.f5298

6/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

cohortstudies,noneprovidedinformationaboutlosstofollowup.

Networkmetaanalysiscomparinggenerationsofprogestogens
Atotalof23studieswereincludedfortheanalysisstratifiedpergenerationofprogestogen.Threestudies
reportedsolelyontheriskofvenousthrombosisindrospirenone,whichisnotclassifiedasagenerationof
progestogen.Webtable3providesdetailsofthenumberofeventsandtotalnumberofwomenortotal
followuptimepergeneration,andwebtable4providesthestudyspecificadjustedriskestimates.
Table2showsresultsofthenetworkmetaanalysisaccordingtogenerationsofprogestogen.Compared
withnonusers,theriskofvenousthrombosisinusersoforalcontraceptiveswithafirstgeneration
progestogenincreased3.2fold(95%confidenceinterval2.0to5.1),2.8fold(2.0to4.1)forsecond
generationprogestogens,and3.8fold(2.7to5.4)forthirdgenerationprogestogens.Theriskofvenous
thrombosisinsecondgenerationprogestogenuserswassimilartotheriskinfirstgenerationusers
(relativerisk0.9,0.6to1.4).Thirdgenerationusershadaslightlyhigherriskthansecondgenerationusers
(1.3,1.0to1.8).Restrictedtostudieswithanidenticalclassificationofgenerations(seemethodssection
forclassificationused),theresultsofeachgenerationcomparedwithnonuseremainedthesame(first
generationrelativerisk3.2,95%confidenceinterval1.6to6.4secondgeneration2.6,1.5to4.7third
2

generation3.5,2.0to6.1).Aformalinteractiontestdidnotshowinconsistenciesinthenetwork( =2.97,
P=0.71).
Table2
Networkmetaanalysis,bygenerationofprogestogenusedincombinedoral
contraceptives

Viewthistable:
Viewpopup
Viewinline

Networkmetaanalysiscomparingdifferentcombinedoral
contraceptives
Of14studiesprovidingdatapertypeoforalcontraceptive(webtables5and
6),atleastonepreparationwascomparedwithnonuseortwotypeswere
compareddirectly.Table3showsresultsoftheanalysis.Allpreparations
wereassociatedwithamorethantwofoldincreasedriskofvenous

thrombosiscomparedwithnonuse(fig2).Therelativeriskestimatewashighestin50LNGusersand
lowestin20LNGand20GSDusers.Adoserelatedeffectwasobservedforgestodene,desogestrel,and
levonorgestrel,withhigherdosesbeingassociatedwithhigherthrombosisrisk.Theriskofvenous
thrombosisfor35CPAand30DRSPwassimilartotheriskfor30DSG(relativerisk0.9,95%confidence
interval0.6to1.3and0.9,0.7to1.3,respectively,comparedwith30DSG).Aformalinteractiontestcould
notbeperformedbecauseonlytwoof14studiesprovideddataforexactlythesamecontraceptives.

http://www.bmj.com/content/347/bmj.f5298

7/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Fig2Networkmetaanalysis,percontraceptiveplottedonalogarithmicscale.20LNG=20g
ethinylestradiolwithlevonorgestrel30LNG=30gethinylestradiolwithlevonorgestrel50LNG=50
gethinylestradiolwithlevonorgestrel20GSD=20gethinylestradiolwithgestodene30GSD=30
gethinylestradiolwithgestodene20DSG=20gethinylestradiolwithdesogestrel30DSG=30g
ethinylestradiolwithdesogestrel35NRG=35gethinylestradiolwithnorgestimate35CPA=35g
ethinylestradiolwithcyproteroneacetate30DRSP=30gethinylestradiolwithdrospirenonedots
(lines)=overallrelativerisk(95%confidenceinterval)ofvenousthrombosisnonuse=reference
group

Downloadfigure
Openinnewtab
Downloadpowerpoint

Table3
Networkmetaanalysis,bycombinedoralcontraceptivepill

Viewthistable:
Viewpopup
Viewinline

Sensitivityanalyses
Weperformedsensitivityanalysesaccordingtofundingsource,study
design,andmethodofdiagnosisconfirmation(objectivevsubjective
confirmationofvenousthrombosis).Table4showssensitivityanalyses

performedaccordingtogenerationofprogestogen.Resultsfromthe
sensitivityanalysisstratifiedbyfundingsourceshowedthattheriskestimateforthirdgenerationusers
(comparedwithnonusers)waslowerinindustrysponsoredstudiesthaninnonindustrysponsoredstudies
(relativerisk1.9v5.2).Incohortstudies,theriskestimateforthirdgenerationusers(comparedwithnon
users)waslowerthantheriskforthirdgenerationusersincasecontrolstudies(2.0v4.2).Allrisk
estimateswerehigherinstudieswithobjectivelyconfirmedvenousthrombosis,ofwhichnonewere
industrysponsored.

http://www.bmj.com/content/347/bmj.f5298

8/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Table4
Sensitivityanalyses

Viewthistable:
Viewpopup
Viewinline

Discussion
Weperformedanetworkmetaanalysisbasedon26studies.Overall,combinedoralcontraceptiveuse
increasedtheriskofvenousthrombosisfourfold.Thereportedincidenceofvenousthrombosisinnon
userswasinlinewiththeliterature.Weobservedthatallgenerationsofprogestogenswereassociated
withanincreasedriskofvenousthrombosisandthatthirdgenerationusershadaslightincreasedrisk
comparedwithsecondgenerationusers.Allindividualtypesofcombinedoralcontraceptivesincreased
thrombosisriskcomparedwithnonusemorethantwofold.Thehighestriskofvenousthrombosiswas
foundamong50LNGusers,andtheriskwassimilarin30DRSP,35CPA,and30DSGusers.Usersof
30LNG,20LNG,and20GSDhadthelowestthrombosisrisk.

Strengthsandlimitations
Anetworkmetaanalysissummarisesdatafromdirectandindirectcomparisonsinaweightedaverage.In
thepresentstudy,thisresultedinacomprehensiveoverviewoftheriskofvenousthrombosisinfrequently
prescribedcombinedoralcontraceptives.Theinternalvalidityofthenetworkmetaanalysiswasassessed
throughinteractionanalysismodellingpotentialinconsistenciesinthenetwork.30Ourresultsofthe
analysisbasedongenerationsofprogestogensindicatedthatpotentialinconsistenciesarelikelytheresult
ofchance.
Alimitationofournetworkmetaanalysiswasthatpublicationshadtoprovidethecrudenumberofusers
andnumberofeventspertypeofcombinedoralcontraceptive.Atotalof15studiesprovidedinformation
oncombinedoralcontraceptiveuseandthrombosisriskwithoutspecificationofwhichcontraceptive
preparationswereused.Thesestudiescouldthereforenotbeincluded.Becauseoftheneedforcrude
numbersinthenetworkmetaanalysis,adjustedriskestimateswerenotusedforpoolingthedata.
Confoundingcouldhaveinfluencedourresults.Ageisapotentialconfounderfortheassociationbetween
contraceptiveuseandvenousthrombosis.Womenusingsecondgenerationcontraceptivesaregenerally
olderthanusersofthirdgenerationcontraceptives.Ifananalysisisnotadjustedforage,therelativerisk
willthenunderestimatetheriskofvenousthrombosisinusersofthirdgenerationcontraceptivescompared
withusersofsecondgenerationcontraceptives.Thisimpliesthattheriskofthirdgenerationusersmaybe
higherthanreportedhere.However,agewasoftendealtwithinthedesignofthestudies.Bodymass
indexisonlyweaklyassociatedwithcombinedoralcontraceptiveuse,andanalysesunadjustedforbody
massindexareprobablynotconfounded.
Thereisnogenerallyacceptedwaytoclassifyoralcontraceptivesaccordingtogenerationsof
progestogens.Forinstance,norgestimatecanbecategorisedasasecondorathirdgeneration
progestogen.Asaconsequence,theclassificationofthesegenerationswasnotthesameinevery
http://www.bmj.com/content/347/bmj.f5298

9/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

publication.However,theresultsdidnotmateriallychangewhenrestrictedtostudieswithanidentical
classificationofgenerationsasdescribedinthemethodsnorwhencontraceptiveswithdesogestrelor
gestodenewerecomparedwithlevonorgestrel(thatis,norgestimatewasnottakenintoaccountwhen
classifyingcontraceptivesintogenerations)(datanotshown).
Intheclassificationofprogestogengenerationsusedinthismetaanalysis,thedoseofethinylestradiolwas
nottakenintoaccount.Theobservedincreasedriskinthirdgenerationcontraceptives,comparedwith
secondgenerationcontraceptives,cannotbeexplainedbyadifferenceinethinylestradioldosebecausea
higherdoseofethinylestradiol(50g)canbepresentinasecondgenerationcontraceptivebutnotina
thirdgenerationcontraceptive.
Inonlyafewincludedstudies,venousthrombosiswasobjectivelyconfirmedinallpatients.Onlyabout30%
ofpatientswithclinicalsymptomsofthrombosisarediagnosedwithvenousthrombosis.24Including
patientswithoutobjectivelyconfirmedvenousthrombosiswouldleadtooverestimatingtheassociation
whenoralcontraceptivesusersweremorelikelytobediagnosedthannonusers(diagnosticsuspicion
bias).However,twostudiesshowedthatthisbiaswasindependentoftypeoforalcontraceptive.1852In
studieswithoutobjectiveconfirmation,womenweremisclassifiedirrespectiveoftheircontraceptiveuse,
leadingtonondifferentialmisclassification.Therefore,resultsofsuchstudiesmayunderestimatethetrue
association,whichwasconfirmedbyoursensitivityanalysiswheretheriskestimateswerehigherinstudies
withobjectivelyconfirmedvenousthrombosisthaninthosewithoutanobjectiveconfirmation.
Twoothermetaanalyses1853haveevaluatedtheriskofvenousthrombosiscomparingthirdgeneration
contraceptiveuserswithsecondgenerationusers.Bothstudiesfoundanincreasedriskinthirdgeneration
users(relativerisk1.5,95%confidenceinterval1.2to1.8181.57,1.24to1.9853),whichareinlinewith
ourresults.Themajorityofincludedstudiesfrombothmetaanalyseswereincludedinouranalysis.

Clinicalimplicationsofthestudy
Althoughweobservedthattheriskofvenousthrombosisincreasedwiththedoseofethinylestradiol,this
seemedtodependontheprogestogenprovided.Therewasnodifferenceinthevenousthrombosisrisk
between20LNGand30LNG,whereasadifferenceintheriskwasobservedbetween20DSGand30DSG,
forexample.Itisunclearwhythedoseeffectofethinylestradiolmightdependontheprogestogen.A
possibilityisthatthereisadifferenceininhibitoryeffectsoftheprogestogenontheprocoagulanteffectof
ethinylestradiol.OralcontraceptiveuseincreasesthelevelsoffactorsII,VII,VIII,proteinC,anddecreases
thelevelsofantithrombin,tissuefactorpathwayinhibitor,andproteinS.Clinicalstudieshaveshowedthat
thiseffectoncoagulationfactorswasmorepronouncedindesogestrelusersthaninlevonorgestrelusers,
andlimitedtocombinedoralcontraceptives.5455
Combiningdifferentpreparationsoforalcontraceptiveintogenerationsofprogestogensmaynotbean
appropriatewaytopresenttheriskofthrombosis,becausetheriskdependsonthedoseofethinylestradiol
aswellasontheprogestogenprovided.Wesuggestabstainingfromanyclassificationofcontraceptives,
buttocomparetheriskofvenousthrombosisperoralcontraceptivepreparation.
Itshouldbekeptinmindthatallcombinedoralcontraceptivesincreasetheriskofvenousthrombosis,
whichisnotthecaseforthelevonorgestrelintrauterinedevice.56However,ifawomanprefersusing
combinedoralcontraceptives,onlycontraceptiveswiththelowestriskofvenousthrombosisandgood
http://www.bmj.com/content/347/bmj.f5298

10/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

complianceshouldbeprescribed,suchaslevonorgestrelwith30gethinylestradiol.Currentpracticeisto
increasethedoseofethinylestradiolincaseofdisruptionsinbleedingpatterns.57Ourresultsindicatethat
prescribing50LNGincaseofspottingduringtheuseof30LNGmightcarryaseriousriskforvenous
thrombosis.

Whatisalreadyknownonthistopic
Combinedoralcontraceptiveuseincreasestheriskofvenousthrombosis
Despitethelowincidenceofvenousthrombosis,theriskinwomenusingcombinedoral
contraceptivesisarealconcernbecauseofthewidespreaduseofthesecontraceptives

Whatthispaperadds
Riskofvenousthrombosisforcombinedoralcontraceptiveswith3035gethinylestradioland
gestodene,desogestrel,cyproteroneacetateanddrospirenoneweresimilar,andabout5080%
higherthanwithlevonorgestrel
Thecombinedoralcontraceptivewiththelowestpossibledoseofethinylestradiolandgood
complianceshouldbeprescribedthatis,30gethinylestradiolwithlevonorgestrel

Notes
Citethisas:BMJ2013347:f5298

Footnotes
Contributors:BHS,MdB,FMH,andOMDdevelopedthestudydesign.BHSandMdBindependently
selectedthepublicationsandextracteddata.BHS,TS,andOMDperformedthestatisticalanalysis.
Allauthorsinterpretedthedataandcriticallyrevieweddraftsofthemanuscript.BHSisguarantor.
Funding:Thisstudyreceivednospecificfunding.BHSwassupportedbygrant40008129807045
fromtheNetherlandsOrganizationforScientificResearch.MdBwassupportedbygrantfromCapes
Nuffic,Brazil.Thefundingagencieshadnoroleinthestudydesign,implementation,orpreparationof
results.
Competinginterests:AllauthorshavecompletedtheICMJEuniformdisclosureformat
www.icmje.org/coi_disclosure.pdfanddeclare:nosupportfromanyorganisationforthesubmitted
workBHSwassupportedbytheNetherlandsOrganizationforScientificResearchMdBwas
supportedbyagrantfromCapesNuffic,Brazilnootherrelationshipsoractivitiesthatcouldappear
tohaveinfluencedthesubmittedwork.
Ethicalapproval:Notrequired.

http://www.bmj.com/content/347/bmj.f5298

11/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Datasharing:Noadditionaldataavailable.
ThisisanOpenAccessarticledistributedinaccordancewiththeCreativeCommonsAttributionNon
Commercial(CCBYNC3.0)license,whichpermitsotherstodistribute,remix,adapt,builduponthiswork
noncommercially,andlicensetheirderivativeworksondifferentterms,providedtheoriginalworkis
properlycitedandtheuseisnoncommercial.See:http://creativecommons.org/licenses/bync/3.0/.

References
1. JordanW.Pulmonaryembolism.Lancet 1961278:11467.
2. Oralcontraceptionandthromboembolicdisease.JRCollGenPract 196713:26779. Medline
3. InmanWH,VesseyMP.Investigationofdeathsfrompulmonary,coronary,andcerebralthrombosisand
embolisminwomenofchildbearingage.BMJ19682:1939. FREEFullText
4. SartwellPE,MasiAT,ArthesFG,GreeneGR,SmithHE.Thromboembolismandoralcontraceptives:an
epidemiologiccasecontrolstudy.AmJEpidemiol 196990:36580. Abstract/FREEFullText
5. VesseyMP,DollR.Investigationofrelationbetweenuseoforalcontraceptivesandthromboembolicdisease.A
furtherreport.BMJ19692:6517. Abstract/FREEFullText
6. NaessIA,ChristiansenSC,RomundstadP,CannegieterSC,RosendaalFR,HammerstromJ.Incidenceand
mortalityofvenousthrombosis:apopulationbasedstudy.JThrombHaemost 20075:6929. CrossRef Medline
WebofScience

7. ThorogoodM,VillardMackintoshL.Combinedoralcontraceptives:risksandbenefits.BrMedBull 199349:124
39. Abstract/FREEFullText
8. WhartonC,BlackburnR.Lowerdosepills.PopulationRep198816:131.
9. StolleyPD,TonasciaJA,TockmanMS,SartwellPE,RutledgeAH,JacobsMP.Thrombosiswithlowestrogen
oralcontraceptives.AmJEpidemiol 1975102:197208. Abstract/FREEFullText
10. Venousthromboembolicdiseaseandcombinedoralcontraceptives:resultsofinternationalmulticentrecase
controlstudy.WorldHealthOrganizationCollaborativeStudyofCardiovascularDiseaseandSteroidHormone
Contraception.Lancet 1995346:157582. CrossRef Medline WebofScience
11. InmanWH,VesseyMP,WesterholmB,EngelundA.Thromboembolicdiseaseandthesteroidalcontentoforal
contraceptives.AreporttotheCommitteeonSafetyofDrugs.BMJ19702:2039. Abstract/FREEFullText
12. VesseyM,MantD,SmithA,YeatesD.Oralcontraceptivesandvenousthromboembolism:findingsinalarge
prospectivestudy.BrMedJ(ClinResEd)1986292:526. FREEFullText
13. LidegaardO,EdstromB,KreinerS.Oralcontraceptivesandvenousthromboembolism:afiveyearnational
casecontrolstudy.Contraception200265:18796. CrossRef Medline WebofScience
14. MeadeTW,GreenbergG,ThompsonSG.Progestogensandcardiovascularreactionsassociatedwithoral
contraceptivesandacomparisonofthesafetyof50and30microgramoestrogenpreparations.
BMJ1980280:115761. Abstract/FREEFullText
15. HenzlMR,EdwardsJA.Pharmacologyofprogestins:17alphahydroxyprogesteronederivativesandprogestinsof
thefirstandsecondgeneration.In:SitrukWareRL,MishellDRJr,eds.Progestinsandantiprogestinsinclinical
practice.MarcelDekker,2000:10132.
16. LidegaardO,LokkegaardE,SvendsenAL,AggerC.Hormonalcontraceptionandriskofvenous
http://www.bmj.com/content/347/bmj.f5298

12/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

thromboembolism:nationalfollowupstudy.BMJ2009339:b2890. Abstract/FREEFullText
17. vanHylckamaVliegA,HelmerhorstFM,VandenbrouckeJP,DoggenCJ,RosendaalFR.Thevenousthrombotic
riskoforalcontraceptives,effectsofoestrogendoseandprogestogentype:resultsoftheMEGAcasecontrol
study.BMJ2009339:b2921. Abstract/FREEFullText
18. KemmerenJM,AlgraA,GrobbeeDE.Thirdgenerationoralcontraceptivesandriskofvenousthrombosis:meta
analysis.BMJ2001323:1314. Abstract/FREEFullText
19. VandenbrouckeJP,RosingJ,BloemenkampKW,MiddeldorpS,HelmerhorstFM,BoumaBN,etal.Oral
contraceptivesandtheriskofvenousthrombosis.NEnglJMed2001344:152735. CrossRef Medline
WebofScience

20. JickSS,HernandezRK.Riskofnonfatalvenousthromboembolisminwomenusingoralcontraceptives
containingdrospirenonecomparedwithwomenusingoralcontraceptivescontaininglevonorgestrel:casecontrol
studyusingUnitedStatesclaimsdata.BMJ2011342:d2151. Abstract/FREEFullText
21. ParkinL,SharplesK,HernandezRK,JickSS.Riskofvenousthromboembolisminusersoforalcontraceptives
containingdrospirenoneorlevonorgestrel:nestedcasecontrolstudybasedonUKGeneralPracticeResearch
Database.BMJ2011342:d2139. Abstract/FREEFullText
22. NischanP,EbelingK,ThomasDB,HirschU.Comparisonofrecalledandvalidatedoralcontraceptivehistories.
AmJEpidemiol 1993138:697703. Abstract/FREEFullText
23. NorellSE,BoethiusG,PerssonI.Oralcontraceptiveuse:interviewdataversuspharmacyrecords.IntJ
Epidemiol 199827:10337. Abstract/FREEFullText
24. WellsPS,HirshJ,AndersonDR,LensingAW,FosterG,KearonC,etal.Accuracyofclinicalassessmentof
deepveinthrombosis.Lancet 1995345:132630. CrossRef Medline WebofScience
25. GoodacreS,SampsonF,StevensonM,WailooA,SuttonA,ThomasS,etal.Measurementoftheclinicaland
costeffectivenessofnoninvasivediagnostictestingstrategiesfordeepveinthrombosis.HealthTechnol
Assess200610:1168. Medline WebofScience
26. QaseemA,SnowV,BarryP,HornbakeER,RodnickJE,TobolicT,etal.Currentdiagnosisofvenous
thromboembolisminprimarycare:aclinicalpracticeguidelinefromtheAmericanAcademyofFamilyPhysicians
andtheAmericanCollegeofPhysicians.AnnFamMed20075:5762. Abstract/FREEFullText
27. GrimesDA,SchulzKF.Comparedtowhat?Findingcontrolsforcasecontrolstudies.Lancet 2005365:142933.
CrossRef Medline WebofScience

28. RapsM,HelmerhorstF,FleischerK,ThomassenS,RosendaalF,RosingJ,etal.Sexhormonebindingglobulin
asamarkerforthethromboticriskofhormonalcontraceptives.JThrombHaemost 201210:9927. CrossRef
Medline

29. vanVlietHA,FrolichM,ChristellaM,ThomassenLG,DoggenCJ,RosendaalFR,etal.Associationbetween
sexhormonebindingglobulinlevelsandactivatedproteinCresistanceinexplainingtheriskofthrombosisin
usersoforalcontraceptivescontainingdifferentprogestogens.HumReprod200520:5638. Abstract/FREEFullText
30. WhiteIR,BarrettJK,JacksonD,HigginsJPT.Consistencyandinconsistencyinnetworkmetaanalysis:model
estimationusingmultivariatemetaregression.ResearchSynthesisMethods20123:11125. CrossRef
31. BirdST,DelaneyJA,EtminanM,BrophyJM,HartzemaAG.Drospirenoneandnonfatalvenous
thromboembolism:isthereariskdifferencebydosageofethinylestradiol?JThrombHaemost 201311:105968.
CrossRef Medline

32. GronichN,LaviI,RennertG.Higherriskofvenousthrombosisassociatedwithdrospirenonecontainingoral
http://www.bmj.com/content/347/bmj.f5298

13/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

contraceptives:apopulationbasedcohortstudy.CMAJ2011183:E131925. Abstract/FREEFullText
33. LidegaardO,NielsenLH,SkovlundCW,SkjeldestadFE,LokkegaardE.Riskofvenousthromboembolismfrom
useoforalcontraceptivescontainingdifferentprogestogensandoestrogendoses:Danishcohortstudy,20019.
BMJ2011343:d6423. Abstract/FREEFullText
34. HeinemannLA,DingerJC,AssmannA,MinhTD.Useoforalcontraceptivescontaininggestodeneandriskof
venousthromboembolism:outlook10yearsafterthethirdgenerationpillscare.Contraception201081:4017.
CrossRef Medline WebofScience

35. JickSS,KayeJA,RussmannS,JickH.Riskofnonfatalvenousthromboembolismwithoralcontraceptives
containingnorgestimateordesogestrelcomparedwithoralcontraceptivescontaininglevonorgestrel.
Contraception200673:56670. CrossRef Medline WebofScience
36. SamuelssonE,HaggS.IncidenceofvenousthromboembolisminyoungSwedishwomenandpossiblypreventable
casesamongcombinedoralcontraceptiveusers.ActaObstetGynecolScand200483:67481. CrossRef Medline
WebofScience

37. HedenmalmK,SamuelssonE,SpigsetO.Pulmonaryembolismassociatedwithcombinedoralcontraceptives:
reportingincidencesandpotentialriskfactorsforafataloutcome.ActaObstetGynecolScand200483:57685.
Medline

38. HeinemannLA,LewisMA,AssmannA,ThielC.Casecontrolstudiesonvenousthromboembolism:biasdueto
design?Amethodologicalstudyonvenousthromboembolismandsteroidhormoneuse.
Contraception200265:20714. CrossRef Medline WebofScience
39. LidegaardO,EdstromB,KreinerS.Oralcontraceptivesandvenousthromboembolism:afiveyearnationalcase
controlstudy.Contraception200265:18796. CrossRef Medline WebofScience
40. ParkinL,SkeggDC,WilsonM,HerbisonGP,PaulC.Oralcontraceptivesandfatalpulmonaryembolism.
Lancet 2000355:21334. CrossRef Medline WebofScience
41. FarmerRD,LawrensonRA,ToddJC,WilliamsTJ,MacRaeKD,TyrerF,etal.Acomparisonoftherisksof
venousthromboembolicdiseaseinassociationwithdifferentcombinedoralcontraceptives.BrJClin
Pharmacol 200049:58090. CrossRef Medline WebofScience
42. HeringsRM,UrquhartJ,LeufkensHG.Venousthromboembolismamongnewusersofdifferentoral
contraceptives.Lancet 1999354:1278. CrossRef Medline WebofScience
43. ToddJ,LawrensonR,FarmerRD,WilliamsTJ,LeydonGM.Venousthromboembolicdiseaseandcombinedoral
contraceptives:areanalysisoftheMediPlusdatabase.HumReprod199914:15005. Abstract/FREEFullText
44. MartinelliI,TaioliE,BucciarelliP,AkhavanS,MannucciPM.InteractionbetweentheG20210Amutationofthe
prothrombingeneandoralcontraceptiveuseindeepveinthrombosis.ArteriosclerThrombVascBiol 199919:700
3. Abstract/FREEFullText
45. BloemenkampKW,RosendaalFR,BullerHR,HelmerhorstFM,CollyLP,VandenbrouckeJP.Riskofvenous
thrombosiswithuseofcurrentlowdoseoralcontraceptivesisnotexplainedbydiagnosticsuspicionandreferral
bias.ArchInternMed1999159:6570. CrossRef Medline WebofScience
46. FarmerRD,ToddJC,LewisMA,MacRaeKD,WilliamsTJ.Therisksofvenousthromboembolicdiseaseamong
Germanwomenusingoralcontraceptives:adatabasestudy.Contraception199857:6770. CrossRef Medline
WebofScience

47. AndersenBS,OlsenJ,NielsenGL,SteffensenFH,SorensenHT,BaechJ,etal.Thirdgenerationoral
contraceptivesandheritablethrombophiliaasriskfactorsofnonfatalvenousthromboembolism.Thromb
Haemost 199879:2831. Medline WebofScience
http://www.bmj.com/content/347/bmj.f5298

14/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

48. LewisMA,HeinemannLA,MacRaeKD,BruppacherR,SpitzerWO.Theincreasedriskofvenous
thromboembolismandtheuseofthirdgenerationprogestagens:roleofbiasinobservationalresearch.The
TransnationalResearchGrouponOralContraceptivesandtheHealthofYoungWomen.
Contraception199654:513. CrossRef Medline WebofScience
49. FarmerR.Safetyofmodernoralcontraceptives.Lancet 1996347:259. Medline
50. BloemenkampKW,RosendaalFR,HelmerhorstFM,BullerHR,VandenbrouckeJP.EnhancementbyfactorV
Leidenmutationofriskofdeepveinthrombosisassociatedwithoralcontraceptivescontainingathirdgeneration
progestagen.Lancet 1995346:15936. CrossRef Medline WebofScience
51. Effectofdifferentprogestagensinlowoestrogenoralcontraceptivesonvenousthromboembolicdisease.World
HealthOrganizationCollaborativeStudyofCardiovascularDiseaseandSteroidHormoneContraception.
Lancet 1995346:15828. CrossRef Medline WebofScience
52. VandenbrouckeJP,HelmerhorstFM,BloemenkampKW,RosendaalFR.Thirdgenerationoralcontraceptiveand
deepvenousthrombosis:fromepidemiologiccontroversytonewinsightincoagulation.AmJObstet
Gynecol 1997177:88791. CrossRef Medline WebofScience
53. ManzoliL,DeVitoC,MarzuilloC,BocciaA,VillariP.Oralcontraceptivesandvenousthromboembolism:a
systematicreviewandmetaanalysis.DrugSaf 201235:191205. Medline WebofScience
54. KemmerenJM,AlgraA,MeijersJC,BoumaBN,GrobbeeDE.Effectsofsecondandthirdgenerationoral
contraceptivesandtheirrespectiveprogestagensonthecoagulationsystemintheabsenceorpresenceofthe
factorVLeidenmutation.ThrombHaemost 200287:199205. Medline WebofScience
55. KemmerenJM,AlgraA,MeijersJC,TansG,BoumaBN,CurversJ,etal.Effectofsecondandthirdgeneration
oralcontraceptivesontheproteinCsystemintheabsenceorpresenceofthefactorVLeidenmutation:a
randomizedtrial.Blood2004103:92733. Abstract/FREEFullText
56. vanHylckamaVlieg,A,HelmerhorstFM,RosendaalFR.Theriskofdeepvenousthrombosisassociatedwith
injectabledepotmedroxyprogesteroneacetatecontraceptivesoralevonorgestrelintrauterinedevice.Arterioscler
ThrombVascBiol 201030:2297300. Abstract/FREEFullText
57. GalloMF,NandaK,GrimesDA,LopezLM,SchulzKF.20microgversus>20microgestrogencombinedoral
contraceptivesforcontraception.CochraneDatabaseSystRev20088:CD003989.

ViewAbstract
Tweet
Like

80
223

Articletools
PDF3responses
Respondtothisarticle
Datasupplement
Print
Alerts&updates

http://www.bmj.com/content/347/bmj.f5298

15/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Articlealerts
Pleasenote:youremailaddressisprovidedtothejournal,whichmayusethisinformationfor
marketingpurposes.

Loginorregister:
Username*
Password*
Login

Registerforalerts
Ifyouhaveregisteredforalerts,youshoulduseyourregisteredemailaddressasyourusername
Citationtools

Downloadthisarticletocitationmanager
StegemanBernardineH,deBastosMarcos,RosendaalFritsR,vanHylckamaVliegA,Helmerhorst
FransM,StijnenTheoetal.Differentcombinedoralcontraceptivesandtheriskofvenous
thrombosis:systematicreviewandnetworkmetaanalysisBMJ2013347:f5298
BibTeX(win&mac)
EndNote(tagged)
EndNote8(xml)
RefWorksTagged(win&mac)
RIS(winonly)
Medlars

Download
Download
Download
Download
Download
Download

Help
Ifyouareunabletoimportcitations,pleasecontacttechnicalsupportforyourproductdirectly(links
gotoexternalsites):
EndNote
ProCite
ReferenceManager
RefWorks
Zotero
Requestpermissions
Authorcitation
ArticlesbyBernardineHStegeman
AddarticletoBMJPortfolio
ArticlesbyMarcosdeBastos
ArticlesbyFritsRRosendaal
Emailtoafriend
ArticlesbyAvanHylckamaVlieg
ArticlesbyFransMHelmerhorst
ArticlesbyTheoStijnen
Forwardthispage
ArticlesbyOlafMDekkers
http://www.bmj.com/content/347/bmj.f5298

16/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

ThankyouforyourinterestinspreadingthewordaboutTheBMJ.
NOTE:Weonlyrequestyouremailaddresssothatthepersonyouarerecommendingthepagetoknows
thatyouwantedthemtoseeit,andthatitisnotjunkmail.Wedonotcaptureanyemailaddress.
Username*
YourEmail*
SendTo*

YouaregoingtoemailthefollowingDifferentcombinedoralcontraceptivesandtheriskofvenous
thrombosis:systematicreviewandnetworkmetaanalysis
YourPersonalMessage

Send

Topics
Reproductivemedicine
Contraception
Drugs:obstetricsandgynaecology
Internet
Pulmonaryembolism

Whoistalkingaboutthisarticle?
Tweetedby139
On13Facebookpages
Referencedin2Wikipediapages
Mentionedin1Google+posts
Highlightedby1platforms
38readersonMendeley
1readersonCiteULike

Seemoredetails

UKjobs
Internationaljobs
NHSForthValley:ConsultantinGeneralAdultPsychiatry
HomertonUniversityHospitalNHSFoundationTrust:ConsultantHaematologistwithspecialinterestinAnti
coagulationandthrombosis
HomertonUniversityHospitalNHSFoundationTrust:ConsultantHaematologistwithspecialinterestin
http://www.bmj.com/content/347/bmj.f5298

17/18

11.05.2015

Differentcombinedoralcontraceptivesandtheriskofvenousthrombosis:systematicreviewandnetworkmetaanalysis|TheBMJ

Haematooncology(10PAs+1additionalPA)
Dr.SulaimanAlHabibMedicalGroup:JobopportunitiesinSaudiArabia
NHSEngland:NationalClinicalReferenceGroupCCGMembers&ampSenateAreaMembers
Viewmore
Backtotop

http://www.bmj.com/content/347/bmj.f5298

18/18

Potrebbero piacerti anche