Literature DB >> 20976098

Information from pharmaceutical companies and the quality, quantity, and cost of physicians' prescribing: a systematic review.

Geoffrey K Spurling1, Peter R Mansfield, Brett D Montgomery, Joel Lexchin, Jenny Doust, Noordin Othman, Agnes I Vitry.   

Abstract

BACKGROUND: Pharmaceutical companies spent $57.5 billion on pharmaceutical promotion in the United States in 2004. The industry claims that promotion provides scientific and educational information to physicians. While some evidence indicates that promotion may adversely influence prescribing, physicians hold a wide range of views about pharmaceutical promotion. The objective of this review is to examine the relationship between exposure to information from pharmaceutical companies and the quality, quantity, and cost of physicians' prescribing. METHODS AND
FINDINGS: We searched for studies of physicians with prescribing rights who were exposed to information from pharmaceutical companies (promotional or otherwise). Exposures included pharmaceutical sales representative visits, journal advertisements, attendance at pharmaceutical sponsored meetings, mailed information, prescribing software, and participation in sponsored clinical trials. The outcomes measured were quality, quantity, and cost of physicians' prescribing. We searched Medline (1966 to February 2008), International Pharmaceutical Abstracts (1970 to February 2008), Embase (1997 to February 2008), Current Contents (2001 to 2008), and Central (The Cochrane Library Issue 3, 2007) using the search terms developed with an expert librarian. Additionally, we reviewed reference lists and contacted experts and pharmaceutical companies for information. Randomized and observational studies evaluating information from pharmaceutical companies and measures of physicians' prescribing were independently appraised for methodological quality by two authors. Studies were excluded where insufficient study information precluded appraisal. The full text of 255 articles was retrieved from electronic databases (7,185 studies) and other sources (138 studies). Articles were then excluded because they did not fulfil inclusion criteria (179) or quality appraisal criteria (18), leaving 58 included studies with 87 distinct analyses. Data were extracted independently by two authors and a narrative synthesis performed following the MOOSE guidelines. Of the set of studies examining prescribing quality outcomes, five found associations between exposure to pharmaceutical company information and lower quality prescribing, four did not detect an association, and one found associations with lower and higher quality prescribing. 38 included studies found associations between exposure and higher frequency of prescribing and 13 did not detect an association. Five included studies found evidence for association with higher costs, four found no association, and one found an association with lower costs. The narrative synthesis finding of variable results was supported by a meta-analysis of studies of prescribing frequency that found significant heterogeneity. The observational nature of most included studies is the main limitation of this review.
CONCLUSIONS: With rare exceptions, studies of exposure to information provided directly by pharmaceutical companies have found associations with higher prescribing frequency, higher costs, or lower prescribing quality or have not found significant associations. We did not find evidence of net improvements in prescribing, but the available literature does not exclude the possibility that prescribing may sometimes be improved. Still, we recommend that practitioners follow the precautionary principle and thus avoid exposure to information from pharmaceutical companies. Please see later in the article for the Editors' Summary.

Entities:  

Mesh:

Year:  2010        PMID: 20976098      PMCID: PMC2957394          DOI: 10.1371/journal.pmed.1000352

Source DB:  PubMed          Journal:  PLoS Med        ISSN: 1549-1277            Impact factor:   11.069


Introduction

Pharmaceutical companies in the United States spent about US$57.5 billion, or 24.4% of their revenue, on promotion in 2004 [1]. One estimate of total promotional expenditure in France for 2004 is €2,908 million (12.2% of revenue). However, another estimate is that pharmaceutical detailing cost €3,300 million and accounted for 75% of the overall cost of promotion in that year making promotion 17.3% of revenue [2]. Expenditure on promotion is aimed at maximizing returns for the corporation and shareholders [3]. The industry claims that promotion also provides scientific and educational information to healthcare professionals: “Appropriate marketing of medicines ensures that patients have access to the products they need and that the products are used correctly for maximum patient benefit. Our relationships with healthcare professionals are critical to achieving these goals because they enable us to – inform healthcare professionals about the benefits and risks of our products to help advance appropriate patient use, provide scientific and educational information, support medical research and education” [4]. There is a wide range of views amongst health professionals about pharmaceutical promotion. Qualitative studies suggest that many perceive pharmaceutical promotion to be a useful and convenient source of information [5]–[7]. Some doctors deny that they are influenced by pharmaceutical company promotion or claim that it influences others but not themselves [8]–[10]. Nonetheless, many of these physicians are willing to give significant amounts of time to engaging in promotional activities [11]. By contrast, several professional organisations have called for more control of promotional activities [12],[13] because of evidence that promotion may be misleading [14]–[17]. The evidence base illuminating these conflicting views is growing. In 2000, Wazana identified eight studies linking pharmaceutical promotion to increased prescribing, “nonrational prescribing,” and increased prescribing costs [18]. A 2005 review concluded that promotion influences the prescribing by physicians in training [19], and a second review in the same year concluded that sales representatives influence prescribing [20]. Those previous reviews are now out of date, narrowly focused, or only partially assessed the relationship between information (promotional or otherwise) from pharmaceutical companies and prescribing costs and quality. The objective of this review is to examine the relationship between exposure to information directly provided by pharmaceutical companies and the quality, quantity, and cost of physicians' prescribing.

Methods

Criteria for Including Studies

Randomized controlled trials, time series analyses, before–after studies, cohort studies, case-control studies, ecological studies, and cross-sectional studies were eligible for inclusion. Studies were included if they had both a measure of exposure to any type of information directly provided by pharmaceutical companies and a measure of physicians' prescribing. We excluded studies that looked at the indirect provision of information, for example, through continuing medical education courses that were funded by unrestricted grants from pharmaceutical companies. Case series, case reports, abstracts, news items, and short reports were excluded. Exposure to information directly provided by pharmaceutical companies was defined as including pharmaceutical sales representative visits, advertisements in journals or prescribing software, presentations from pharmaceutical companies to groups, meetings sponsored by pharmaceutical companies, mailed information including advertisements, and participation in sponsored clinical trials. We did not include studies of other forms of promotion such as gifts or samples or studies of indirect forms of information provision such as sponsored education. The outcome measures were the quality, frequency, and costs of prescribing.

Search Methods for Identification of Studies

We searched Medline (1966 to February 2008), International Pharmaceutical Abstracts (1970 to February 2008), Embase (1997 to February 2008), Current Contents (2001 to 2008), and Central (The Cochrane Library Issue 3, 2007). The search strategy below was devised for Medline by an expert librarian at the University of Queensland and adapted for the other databases: (exp Drug Industry OR exp Advertising OR exp Gift Giving OR exp “Conflict of Interest”) AND (exp Prescriptions, Drug/OR (prescribing or prescription$).mp.)) We looked for additional articles in the references of each retrieved article including review articles in an iterative, exhaustive process. Efforts to find additional studies included placement of messages on email drug discussion groups, contacting experts in the field, and asking Australian subsidiaries of international pharmaceutical companies for information. All languages were considered.

Selection of Studies

The title and abstract, if available, of all articles detected by the database searches were reviewed by two authors. Articles that possibly met the inclusion criteria were retrieved and subjected to a formal inclusion process independently by two different authors. Differences of opinion were resolved by consensus and if necessary a third author was involved.

Quality Appraisal

Articles meeting inclusion criteria were appraised for methodological quality independently by two authors. Randomized studies were assessed for adequacy of randomization method, allocation concealment, blinding, follow-up, and use of intention to treat analyses [21]. Controlled cohort and case-control studies were assessed using the Newcastle-Ottawa scales [22]. For other nonrandomized studies, quality appraisal included assessment of sources of bias, for example presence of a control group, selection methods, control of confounding, response rate (>80%), and use of appropriate statistical tests [23]. Studies were only excluded from the review if two authors found there was insufficient information to appraise their quality. Disagreements were resolved by discussion with a third author.

Data Extraction

For included studies, two authors independently extracted data on study site, dates of data collection or publication, types of participants (primary care providers, specialists, and residents), study medication(s), exposure to information from pharmaceutical companies, and prescribing outcomes.

Reporting of Results

For quality of prescribing we accepted the original authors' definitions of what constituted more (or less) appropriate prescribing. We divided studies into two groups on the basis of whether the information was delivered with or without conventional promotional techniques. This distinction was made because information delivered with versus without conventional promotion may produce different effects on prescribing. Conventional promotional techniques were defined as advertisements (in journals and software), representatives' visits, attendance at pharmaceutical sponsored meetings, and mailed information from pharmaceutical companies. In addition, we included in this group studies looking at total promotional investment/summated scores of commercial information use/general use of commercial sources. The other group of studies included warning letters, participation in company sponsored trials, and representatives' visits for nonpromotional purposes. A narrative synthesis of results was undertaken following the MOOSE guidelines and meta-analysis performed where appropriate data were available (Text S1) [24]. The unit of analysis was defined as the combination of exposure to a type of information from a pharmaceutical company (for example pharmaceutical sales representative visits or journal advertisements) and a type of prescribing outcome (quality, frequency, and cost of prescribing). Thus studies were treated as a single unit of analysis if they measured the same type of exposure and the same type of outcome regardless of the number of drugs covered in each study. We classified each analysis as positive or negative rather than no association detected if the p value was less than 5% (p<0.05) regardless of the magnitude of the effect. We reported standardized effect measures (Pearson correlation coefficients, odds ratios [ORs], or beta coefficients) where study reports provided them or the data needed to calculate them. For econometric studies, we also reported t statistics where they were reported or it was possible to calculate them. Meta-analysis was not appropriate for the outcomes of quality of prescribing and cost of prescribing because in both cases the studies examined different exposures or outcome measures and/or lacked control groups. We undertook a meta-analysis for one component—studies of frequency of prescribing with identifiable control groups where the information exposure was delivered with conventional promotional techniques. We used ORs for change in prescribing frequency as the outcome measure. Where studies had suitable designs for inclusion in the meta-analysis but ORs and standard errors were not published we contacted corresponding authors. Out of ten studies [25]–[34], we received four replies of which three provided the information we required [29]–[31]. Heterogeneity was assessed using the tau squared test with a sensitivity analysis to investigate likely sources of heterogeneity. Factors identified a priori as possible explanations for heterogeneity were study design, study quality indicators, year of publication, type of exposure to pharmaceutical company information (active versus passive), and physician characteristics (level of experience and also primary care provider versus specialist). We defined active exposure as information presented to physicians at meetings or during pharmaceutical sales representatives' visits. We defined passive exposure as journal advertisements, mailed information, advertisements on clinical software, and participation in sponsored clinical trials. Studies reporting more than one unit of analysis were subjected to sensitivity analysis. Meta-analysis was performed using RevMan (version 5.0.24) with further analysis conducted using Stata version 10.0 (Stata Corporation).

Results

Search Results

Our search found 7,185 studies from electronic databases and 138 studies were retrieved from reference lists, experts in the field and email lists. The full text of 255 articles was retrieved. 18 studies were excluded, all because inadequate reporting precluded quality assessment. Quality appraisal results for included studies are presented in Tables 1– 5. Following application of inclusion/exclusion criteria and quality appraisal, 58 studies were included in the review (52 published in journals [25]–[33],[35]–[77], three reports [78]–[80], one dissertation [34], one conference presentation [81], and one conference poster [82] (Figure 1). Of these 58, 29 studies came from database searches [25]–[31],[33],[35]–[38],[41],[44],[55],[56],[59]–[62],[66]–[68],[70]–[72],[74],[76],[77], 22 studies came from reference lists [32],[39],[40],[46]–[54],[58],[63]–[65],[69],[73],[75],[78],[79], five studies came from experts in the field [34],[43],[57],[81],[82], and two from email lists [45],[80]. These 58 studies included 87 units of analysis. Pharmaceutical companies provided 62 citations; two of these met our inclusion criteria and had already been identified through Medline searches [27],[35]. Five of the studies located through the e-mail lists and experts were not indexed in the databases we searched [34],[43],[80]–[82]. For one study [78], additional data were obtained from the authors [83].
Table 1

Quality appraisal of included studies: randomised controlled trials.

Randomised Controlled Study (First Author Name)Satisfactory RandomizationAllocation ConcealmentBlindingAdequate Follow-upAppropriate Statistical Measures
Freemantle [35] Appropriate cluster randomizationNoNoYesYes
Dolovich [36] a Appropriate cluster randomizationNoNoYesYes

Received research funding from a pharmaceutical company.

Table 2

Quality appraisal of included studies: controlled cohort and case-control studies.

Study TypeStudy (First Author Name)Prospective DesignComparability of Cases and ControlsSelection Bias MinimizedResponse Rate >80%Confounders ControlledAppropriate Statistical MeasuresAdequate Follow-Up
Controlled CohortAndersen [37] a NoYesYesYesYesYesYes
Case-ControlSpingarn [39] NoYesNoYes (100%)YesYesYes
Chren [38] NoYesYesYes (88%)YesYesYes

Received research funding from a pharmaceutical company.

Table 3

Quality appraisal of included studies: time-series analyses.

Time-Series AnalysisStudy (First Author Name)Prospective DesignControl GroupConfounders ControlledSelection Bias MinimizedAppropriate Statistical Measures
Econometric Ching [78] NoNoYesYesYes
Venkataraman [40] NoNoYesYesYes
Windmeijer [41] NoNoYesYesYes
Chintagunta [42] NoNoYesYesYes
Narayanan [43] NoNoYesYesYes
Donohue [44] NoNoYesYesYes
Mizik [45] NoNoYesYesYes
Manchanda [46] NoNoYesYesYes
Manchanda and Chintagunta [47] NoNoYesYesYes
Berndt [48] NoNoYesYesYes
Rosenthal [79] NoNoYesNoYes
Azoulay [49] NoNoYesYesYes
Rizzo [50] NoNoYesNoYes
Hurwitz [51] NoNoYesYesYes
Mackowiak [52] NoNoNoYesYes
Leffler [53] NoNoYesYesYes
Telser [54] NoNoYesYesYes
Other Spurling [55] YesNoNoNoYes
Stafford [56] YesNoNoYesNo
Charbit [34] NoNoNoYesNo
Auvray [57] NoNoNoNoNo
Cleary [26] YesYesYesNoYes
Soumerai [58] NoYesNoYesNo
Table 4

Quality appraisal of included studies: before–after studies.

Before–After Study (First Author Name)Prospective DesignControl GroupResponse Rate >80%Confounders ControlledSelection Bias Minimized
Hemminki [25] NoYesNo (68%)NoYes
Schwartz [27] NoYesUnsureNoUnsure
Kazmierczak [59] NoNoNANoYes
Orlowski [28] NoNoYes (100%)YesNo
Bowman [60] YesNoNo (43%–77%)NoNo
Table 5

Quality appraisal of included studies: cross-sectional studies (no control group).

Cross-Sectional Study (First Author Name)Prospective DesignResponse Rate >80%Confounders ControlledSelection Bias MinimizedAppropriate Statistical Measures
Henderson [29] a NoYesYesYesYes
Greving [30] NoYes (96%)YesYesYes
Kreyenbuhl [31] YesNo (58%)NoYesYes
de Bakker [61] NoUnsureYesYesYes
Steinman [62] NoYesYesNoYes
Canli [32] YesNo (79%)NoYesYes
Verdoux [63] YesNo (24%)YesNoYes
Muijrers [64] YesNo (71%)YesYesYes
Huang [65] NoNANoNoYes
Watkins [66] YesNo (64%)YesYesYes
Prosser [67] YesNo (73%)NoYesNo
Caamano [68] YesNo (75%)YesYesYes
Gonul [69] YesNAYesUnsureYes
Mansfield [82] YesNo (6%)NoNoYes
Jones [70] YesNANoNoNo
Caudill [71] YesNo (28%)YesYesYes
Berings [72] YesNo (28%)YesNoYes
Lurie [73] YesNo (75–78%)YesYesYes
Health Care Communications 1989a [80] NoUnsureNoNoNo
Peay [33] NoNo (52%–70%)YesYesYes
Blondeel [81] YesNo (30%)YesYesYes
Haayer [74] YesYes (90%)YesNoYes
Walton [75] YesUnsureNoYesYes
Dajda [76] NoNANoYesYes
Becker [77] YesYes (84%)YesYesYes

Received research funding from a pharmaceutical company.

Figure 1

Study flow diagram.

Received research funding from a pharmaceutical company. Received research funding from a pharmaceutical company. Received research funding from a pharmaceutical company.

General Characteristics of Studies

The most common study design was cross-sectional (24/58 studies, 41%). There were also two cluster randomized controlled trials, one controlled-cohort study, two case-control studies, 24 time-series analyses, and five before–after studies. Over half (55%) of the studies were conducted in the United States. Characteristics of included studies are outlined in Table 6.
Table 6

Characteristics of included studies (by study design, year of publication, then sample size).

Study DesignStudy (First Author Name)Study Site, YearParticipants (n)MedicationIntervention/ExposureOutcome Measure(s)
RCT Freemantle [35] a UK 2000PCPs (79: 40 intervention, 39 control)Lansoprazole versus omeprazolePSR visits: PSRs instructed by local health authority (one visit); controls: normal detailingSwitch from omeprazole to less costly lansoprazole
Dolovich [36] a Canada 1999PCPs and pediatric specialists (641 in intervention group and 574 in control group)Antibiotics for otitis mediaPSR visits, PSRs trained in evidence-based education by academic department of a university; Control group: no detailingMarket share of antibiotics for otitis media
Controlled cohort studies Andersen [37] b Denmark 1999–2003297 PCPs (26 intevention/271 controls)Asthma medicationsParticipation in a RCT funded by a pharmaceutical companyPrescribing trial drug; Adherence to prescribing guidelines
Case-control Studies Spingarn [39] US° 1990Hospital residents (75)Medications for Lyme diseaseIntervention: presentation by academic who was also a pharmaceutical executive; Controls: did not attendAppropriateness of intention to prescribe for mild versus severe Lyme disease
Chren [38] US 1989–1990Physicians (40 cases, 80 controls)Addition to hospital formularyPSR visits; cases added to formulary, controls did notAddition of detailed drug to hospital formulary
Time series analyses (econometric) Ching [78] c Canada 1993–1999Physician's prescribing antihypertensives in CanadaAntihypertensive medications (angiotensin converting enzyme inhibitors and diuretics)PSR visits (n minutes)Market share; Elasticity of demand
Venkataraman [40] b Not stated 2002–2003Physicians (2,774)Statins, coagulation drugs, erectile dysfunction drugs, gastrointestinal drugs, placeboPSR visits (total number); attendance at pharmaceutical; sponsored meetings; (total number attended) n prescriptions
Windmeijer [41] c Netherlands 1995–1999PCPs and psychiatristsd 11 therapeutic markets (over 50% of the Dutch drug market)PSR visits (expenditure); Journal advertisements (expenditure); Mail (expenditure) n prescriptions; Cost of prescriptions
Chintagunta [42] c US, UK, Germany, France, Italy 1989–1999Prescribers of antidepressant medicationsFluoxetine, sertraline, paroxetinePSR visits (expenditure)Market share (sales)
Narayanan [43] e US 1993–2001All prescribers of antihistamines in USd 2nd generation antihistamines: loratidine cetirizine, fexofenadinePSR visits (total expenditure)New prescriptions per month
Donohue [44] c US 1997–200011,000 office and hospital physiciansFirst prescriptions of 6 antidepressantsMonthly spending on PSR detailingNew prescriptions
Mizik [45] b US 2004Physicians (74,075)3 unknown drugsPSR visits n new prescriptions for the three study drugs
Manchanda [46] b US 1999–2001Physicians (1,000), 18.5% specialists (for study drug), 60.1% PCPs, 21.4% other specialists, controls (1,000)Drug unknownPSR visitsNumbers of prescriptions
Manchanda and Chintagunta [47] b US 1996–1998Physicians (1,000), 11% specialists (for study drug), 59% PCPs, 30% other specialistsDrug unknownPSR visits n prescriptions; Prescriptions of specialists versus primary care physicians versus other specialists; Prescriptions by male and female physicians
Berndt [48] c US 1977–1993All US physiciansH2 antagonist antiulcer drugs (cimetidine, ranitidine, famotidine, nizatidine)PSR visits (min)Sales volume (units of average daily dose) and market share; Elasticity of demand
Rosenthal [79] c US 1996–1999Large sample of office and hospital physiciansd Medications prescribed in primary carePSR visits (expenditure)Sales of detailed medications per month
Azoulay [49] c US 1977–1993All prescribing physiciansH2 antagonist antiulcer drugs (cimetidine, ranitidine, famotidine, nizatidine)PSR visits; Journal advertisementsMarket share for the four H2 antagonists (patient days of therapy)
Gonul [69] c US 1989–1994Physiciansd One medication for a particular indication “relatively more common among the elderly”PSR visits (min) n prescriptions; Cost of Prescriptions
Rizzo [50] c US 1988–1993All prescribers of antihypertensives in the USd Antihypertensive medicationsPSR visits (expenditure)Sales of detailed medication; Price elasticity; Quadratic term for sales
Hurwitz [51] c US 1978–1983Specialists and PCPs prescribing promoted drugsd Brand and generic drugsTotal promotional investment in PSR visits, journal advertising, direct mail advertisingMarket share held by original brand; Market share held by generic competitors (measured in n pills sold)
Mackowiak [52] c US 1977–1981Office based physicians across the USd Benzodiazepines for anxiety; Diuretics for hypertensionPSR visits (expenditure); Journal advertisements (expenditure)Expenditure on prescriptions; Market size and market share
Leffler [53] c US 1968–1977Not statedd 51 new productsTotal promotional outlay (PSR visits, journal advertising)Market share 2 y after market entry; Market share in 1977 for drugs introduced since 1968 expressed
Telser [54] c US 1963–1972All prescribing physiciansd Prescription medications in: the hospital market and drugstore marketPromotional intensity: ratio of total promotional outlays/total sales (includes PSR visits, journal advertising, direct mail)Proportion of sales for entrant drugs
Time series analyses (other) Spurling [55] Australia 2004–2005PCPs (7)Medications prescribed in primary carePSR visits; Promotional items in PCP surgeriesGeneric prescribing (% of total)
Stafford [56] c US 1996–2002Physicians (3,500)Alpha-blockersPSR visits (expenditure)Prescriptions
Charbit [34] France 1991–2001Prescribing physicians in Franced 6 classes of antihypertensive medicationsJournal advertising (n pages)Drug sales for each of the six classes of antihypertensive medications
Auvray [57] e France 1992–1998PCPs, ear nose throat surgeons, chest physicians, psychiatrists-1,600Macrolide antibiotics and psychoanaleptic antidepressantsTotal promotional investment n prescriptions
Cleary [26] US 1988Physicians prescribing 3rd generation cephalosporinsd Ceftazidime, cefriaxone, cefotaximePSR visitsNew prescriptions; n doses
Soumerai [58] e US 1974–1983All propoxyphene prescribers in USAd PropoxyphenePSR visits (to warn about risks of propoxyphene)Sales of propoxyphene; No-refill rates of prescriptions
Before–after Studies Hemminki [25] e Estonia 2000Gynecologists and PCPs (342)Hormone replacement therapyJournal advertisements; Pharmaceutical company-sponsored medical educationProbability of detailed drug being prescribed
Schwartz [27] US 1999–2000Psychiatry residentsd Psychiatric medicationsPSR detailing (12 wk period when residents were detailed versus 12 wk with no detailing)New prescriptions
Kazmierczak [59] US 1996Physicians (60)TramadolDrug company letter to physicians warning about tramadol seizure riskPrescriptions for tramadol in high risk patients
Orlowski [28] US 1992Hospital physicians (20)Intravenous hospital medications called A (antibiotic) and B (cardiovascular drug)Attendance at pharmaceutical sponsored meetings (all expenses paid trips to vacation site) n prescriptions before and after the sponsored meetings
Bowman [60] US date not statedPhysicians (374)Calcium channel blockers and beta-blockersPSR sponsored continuing medical education courseSelf-reported new prescriptions
Cross-sectional studies Henderson [29] Australia 2003–2005PCPs (1,336)7 advertised pharmaceutical productsAdvertising on clinical software n prescriptions
Kreyenbuhl [31] US 2003–2004Psychiatristsd Antipsychotic medicationPSR visits; Attendance at pharmaceutical sponsored meetingsUse of “switch” or “add” strategies in treatment of refractory schizophrenia
de Bakker [61] Netherlands 2001PCPs (138)Medications prescribed in primary carePSR visits; Reliance on commercial sources of information n prescriptions
Steinman [62] US 1995–1990Physicians (97)GabapentinPSR visitsIntention to prescribe gabapentin
Greving [30] Netherlands 2003PCPs (70)Angiotensin II receptor blockersPSR visits; Journal advertisements; Attendance at pharmaceutical sponsored meetingsNew prescriptions of this drug
Canli [32] Turkey 2001PCPs (316)Antibiotics for acute tonsillopharyngitisPSR visitsIntention to prescribe antibiotics
Verdoux [63] France 2004PCPs (848)Antipsychotic medicationPSR visitsInitiation of antipsychotic medication in a 1-mo period
Muijrers [64] Netherlands 2000–2001PCPs (1,434)Medications prescribed in primary carePSR visitsQuality of prescribing (determined by panel of experts)
Huang [65] US 2001–2003Resident physiciansd AntidepressantsSponsorship of resident conferencesPrescription of antidepressants from sponsoring companies
Watkins [66] UK 1995–1996PCPs (1,714)Medications prescribed in primary carePSR visits (at least once per week); Journal advertisements; Reading written material from pharmaceutical companiesCost of prescriptions
Prosser [67] UK 1999–2000PCPs (107)New medications prescribed in primary carePSR visits; Journal advertisements/mailings (considered together)New drug prescriptions (high/medium/low prescribers)
Caamano [68] e Spain 1993Physicians (234)All prescribingPSR visits n prescriptions ; Cost of prescriptions
Mansfield [82] Australia 1999PCPs (1,174)Medications used in primary carePSR visits (self-report); Attendance at pharmaceutical sponsored meetings (self-report)Quality use of medicine score
Jones [70] UK 1995–1997PCPsd Nine new drugsJournal advertisementsPrescribing data for the advertised drugs
Caudill [71] US 1996PCPs (446)Medications for acute bronchitis, hypertension and urinary tract infectionPSR visits (frequency of use)Cost of prescribing
Berings [72] Belgium date not statedPCPs (128)BenzodiazepinesPSR visits (n visits in last 4 wk)Prescription of benzodiazepines
Lurie [73] US 1987–1988Hospital physicians (240 faculty staff and 131 residents)Hospital medicationsPSR visits (<5 min and >5 min)Change in prescribing habit Addition to hospital formulary
Healthcare Communications [80] US 1987–1988Physicians (1184)Newly promoted medicationsJournal advertisements (awareness of)Market share
Peay [33] Australia 1981PCPs (74) and specialists (50)TemazepamPSR visits (contact versus no contact); Direct mailing; Attendance at PSR-sponsored functionTemazepam prescription
Blondeel [81] Belgium 1987PCPs (358)Medications prescribed by PCPsPSR visitsResponse to 8 simulated patients where prescribing was not advisable. Quality index compiled based on GP medication choices by expert panel (range 1–100) Proneness to prescribe (proxy for prescribing frequency)
Haayer [74] Netherlands 1979PCPs (116)Medications that would result from 8 case-histories devised by a panelPSR visits; Journal advertisements; Companies' mailingsPrescribing rationality based on a composite scale (drug choice, duration, dose and use of combination products)
Walton [75] US 1976–77PCPs (29%) and specialists (71%) (1,000 total)186 different medicationsJournal advertisementsPrescriptions of advertised drugs (intention to prescribe)
Dajda [76] UK 1975PCPs in UKd Branded advertised drugs in the UKMailed advertisements (number in 1 y) n prescriptions
Becker [77] US 1970PCPs (29), internists (3). osteopathic physicians (5)Chloramphenicol, equagesic, vitamin B12, methylphenidate, oral contraceptivesUse of journal advertisements PSR visits (frequency)Proportion of chloramphenicol scripts. Physicians' self-reported prescribing behaviour.

Experimental partnerships between pharmaceutical company and health authority or academic department.

Data from pharmaceutical company.

Information from a market research company.

Total number unknown.

Using national prescribing data.

PCP, primary care provider; RCT, randomized controlled trial.

Experimental partnerships between pharmaceutical company and health authority or academic department. Data from pharmaceutical company. Information from a market research company. Total number unknown. Using national prescribing data. PCP, primary care provider; RCT, randomized controlled trial.

Pharmaceutical Company Information and Prescribing Quality

Prescribing quality was measured by ten studies with 14 units of analysis [37],[39],[58],[59],[61],[64],[74],[77],[81],[82] (Table 7). Quality was assessed in four distinct ways: quality scoring of prescribing decisions, guideline adherence, prescribing appropriateness of an individual drug class, and prescribing range. Three studies used quality scores calculated by coding physicians' drug choices in responses to clinical vignettes [74],[81],[82]. One of these used an expert panel to derive a quality index (1–100) judging primary care providers' prescribing in response to both their actual prescribing and clinical vignettes [81]. In the latter study learning about the drug first from pharmaceutical sales representatives was associated with lower quality of actual prescribing but the number of pharmaceutical sales representatives' visits was not. There was no significant association between primary care providers seeing more pharmaceutical sales representatives or first learning about the drug from pharmaceutical sales representatives and lower quality responses to case vignettes [81]. Another study combined scales examining indication, effectiveness, safety, dosage, duration, and polypharmacy to produce a seven-point scale measuring rationality of prescribing [74]. Primary care providers' self-reported reliance on pharmaceutical companies for information was associated with lower quality scores [74]. A third study used a quality score for a hypertension scenario where thiazides were considered very appropriate and all other drug groups were considered very inappropriate [82]. Self-reported rates of attendance at pharmaceutical company-sponsored meetings were associated with slightly lower quality scores, but self-reported rates of pharmaceutical sales representative visits had no significant association [82].
Table 7

Relationship between exposure to information from drug companies and prescribing quality (by year of publication and then study design/size).

Exposure to Information from Drug CompanyStudy (First Author Name)Result in Exposed Group Versus Controls (Where Applicable)Change in Prescribing Quality Result
Effect of PSR visits de Bakker [61] Wider prescribing range was associated with more visits from PSRs in the last 4 wkBeta coefficient +0.18 (p<0.05)a
Muijrers [64] More frequent visits from PSRs was associated with less adherence to prescription guidelinesMultiple linear regression:
Beta −0.23 (95% CI −0.32 to −0.15) p<0.05
Mansfield [82] Frequency of visits from PSRs was not associated with a difference in quality scorePearson coefficient of 0.0363; p = 0.247
Blondeel [81] Based on responses to 8 case histories:Multivariate regression analysis:
First contact with a drug from the pharmaceutical industry was not associated with quality index; p>0.1
n PSRs received was associated with poorer quality index; p>0.05
Based on prescriptions for actual patients: First contact with a drug from the pharmaceutical industry was associated with reduced quality of prescribing; p<0.01
n PSRs received was not associated with poorer quality index p>0.1
Becker [77] Fewer visits from PSRs/month were not associated with a change in the appropriateness of prescribingGamma statistic; 0.04, not statistically significant
Attendance at pharmaceutical sponsored meeting Mansfield [82] Attendance at pharmaceutical sponsored meetings was associated with lower quality scoresPearson correlation coefficient of 0.0635; p = 0.043
Spingarn [39] Attendees at a sponsored talk about Lyme disease were less likely to choose appropriate oral antibiotics for mild Lyme disease than nonattendees0% of attendees (n = 22) chose appropriate antibiotics compared to 21% (n = 53) of nonattendees; Fisher exact test: p = 0.027
For attendees and nonattendees of a sponsored talk about Lyme disease there was no difference in choice of acceptable treatment for Lyme disease with central nervous system signsOR = 3.2 (95% CI 0.8–19.2)
Attendees of a sponsored talk about Lyme disease were more likely to appropriately choose the sponsoring company's treatment for Lyme disease complicated by 2nd degree heart blockOR = 7.9 (95% CI 2.4–29.3)
Journal advertisements Becker [77] Infrequent use of journal ads as a source of prescribing information by doctors was not associated with a change in the appropriateness of prescribingGamma statistic 0.373, not statistically significant
Total promotional investment/summated scores of commercial information use/general use of commercial sources de Bakker [61] There was a positive correlation for how frequently doctors used the pharmaceutical industry as a source of information and the range of drugs they prescribedBeta coefficient +0.15 (p<0.05)a
Haayer [74] Frequency of use of information from the pharmaceutical industry was associated with less rational prescribingBeta coefficient +0.134 ; p<0.001
Information delivered without conventional promotion Andersen [37] Participation in a randomized controlled trial was not associated with a change in guideline adherence at 2 y for trial sponsor's medicationOR 1.00 (95% CI 0.84–1.19)
Kazmierczak [59] Mailed warning letters regarding tramadol for those with a seizure risk were not associated with a change in prescription rates for tramadol9 (10%) prescriptions before and 7 (9%) after warning letters were sent out no association detected
Soumerai [58] PSR visits: Propoxyphene use continued a preexisting decline of about 8% a year during the time when warnings from the manufacturing pharmaceutical company were conveyed by PSRs after which time this decline halted, however a statistical association was not shown. Refill rates and rates of overdose did not change following the warningsNo association detected
Mailed Information: Propoxyphene use continued a preexisting decline of about 8% a year during the time when warnings from the manufacturing pharmaceutical company were expressed by PSRs after which time this decline halted, however a statistical association was not shown. Refill rates and rates of overdose did not change following the warningsNo association detected

Assumes a wide prescribing range is lower quality prescribing than a narrow prescribing range.

Assumes a wide prescribing range is lower quality prescribing than a narrow prescribing range. Residents attending a sponsored meeting were more likely than nonattending residents at the same hospital to prescribe the sponsoring company's medication, both when it was appropriate according to the authors and when it was not [39]. Primary care providers who saw more pharmaceutical sales representatives and those who used the pharmaceutical industry in general as a source of information prescribed a wider range of drugs [61]. The authors suggested that this was a sign of lower prescribing quality in the context of recommendations that primary care providers use a limited list of drugs they know well [61]. Two studies measured guideline adherence. One found less adherence by primary care providers who received more frequent visits from pharmaceutical sales representatives [64], while the other found no change in adherence by primary care providers participating in a clinical trial sponsored by a pharmaceutical company [37]. One study of warnings conveyed by pharmaceutical sales representatives and mailed information [58], one of mailed warnings alone [59], and one of representatives' visits and advertisements [77] found that there was no alteration in overall rates of prescriptions judged to be inappropriate.

Pharmaceutical Company Information and Prescribing Frequency

51 studies [25]–[54],[56]–[60],[62],[63],[65],[67]–[70],[72],[73],[75]–[81] measured prescribing frequency as market share, intention to prescribe, prescription sales, formulary requests, as well as number of prescriptions (63 units of analysis) (Table 8). Below we report separately the results of studies of information delivered with versus without conventional promotion. Within both groups there was one unit of analysis per study.
Table 8

Relationship between exposure to information from drug companies and prescribing frequency (by year of publication and then study design/size).

Exposure to Information from Drug CompanyStudy (First Author Name)ResultsChange in Prescribing Frequency Results
Effect of PSR visits Ching [78] Higher levels of detailing for enalapril/hydrochlorothiazide and lisinopril/hydrochlorothiazide was associated with higher levels of demand (prescriptions)Detailing elasticity 0.1–0.27 (p<0.05)
Kreyenbuhl [31] Meeting PSRs >4 times in the preceding month was not associated with the “add” rather than “switch” strategy for antipsychotic medication prescribingOR 1.22 (95% CI 0.68–2.20)
Steinman [8] PSR visits of ≤5 min versus >5 min were not associated with intention to prescribeNo association detected
PSR visits to doctors in a small group were associated with increase in more frequent intention to prescribea OR 12.9 (95% CI 1.2–138.8)b
PSR visits were associated with increased gabapentin prescribing if physician's previous gabapentin prescribing was nila OR 15.1 (95% CI 3.9–58.2)b reference group - medium prescribers of gabapentin
PSR visits were associated with increased gabapentin prescribing if physician's previous gabapentin prescribing was lowa OR 8.6 (95% CI 2.4–31.4)b reference group, medium prescribers of gabapentin
Venkataraman [40] PSR visits were associated with increased n prescriptionsBeta coefficient: +0.944 (significant with a 95% CI)
Canli [32] PSR visits were associated with increased antibiotic prescribinga p = 0.0001*
Chintagunta [42] Higher levels of detailing were associated with higher market share for that brand in the three of the countries studied and no significant difference in two othersDetailing related change in market share; US; beta coefficient +0.06; t statistic 3 (p<0.05); Germany; beta coefficient +0.73; t statistic 3.6 (p<0.05); France; beta coefficient +4.17; t statistic 7.87 (p<0.05); Italy; beta coefficient +0.24; t statistic 0.96 (p>0.05); UK; beta coefficient +0.29; t statistic 1.61 (p>0.05)
Narayanan [43] PSR visits were associated with an increase in market share1% increase in expenditure on detailing was associated with increases in market shares for promoted drugs ranging from 0.11% to 0.14% (p<0.05)
Verdoux [63] PSR visits were associated with general practitioners initiating a newer antipsychotic medicationOR 2.80 (95% CI 2.09–3.76); p = 0.0001
Mizik [45] PSR visits were associated with increased prescribing of Drugs A, B. and CDrug A: 1 PSR visit generates 1.56 new prescriptions (95% CI 0.8–2.23) or 0.64 visits to induce one prescription
Drug B: 1 PSR visit generates 0.32 new prescriptions (95% CI 0.22–0.43) or 3.11 visits to induce one prescription
Drug C: 1 PSR visit generates 0.153 new prescriptions (95% CI 0.11–0.2) or 6.54 visits to induce one prescription
Donohue [44] Expenditure on PSR visits is associated with higher probability that the detailed antidepressant is prescribedBeta coefficient +0.703 (p<0.001)
Stafford [56] Decreasing promotional expenditure was associated with a decrease in prescribing for alpha blockersc Decreased with decreased promotion
Manchanda [46] PSR visits were associated with more new prescriptions1.8 detailing visits results in 5 new prescriptions (average result)b
Manchanda and Chintagunta [47] PSR visits were not associated with a significant change in mean prescriptionsBeta coefficient +0.83 detailing t statistic 0.675 (p>0.05)
More frequent PSR visits were associated with diminishing increases in prescribingQuadratic term for PSR visits: −0.49; t statistic −0.49 (p>0.05)
Berndt [48] PSR detailing were associated with increased cumulative days of therapyBeta coefficient +0.7414; t statistic 43.12 (p<0.01)
Rosenthal [79] PSR visits were associated with increased frequency of prescriptionBeta coefficient +0.017; t statistic 4.25 (p<0.05)
Prosser [67] PSR visits were more likely to be cited as a prescribing influence by high prescribers than by low prescribersOR 7.32 (95% 1.64–32.61); Fisher exact test; p = 0.002
Azoulay [49] PSR detailing is associated with diffusion of product information and performance on the product market with marketing activities having a more pronounced effect than scientific information in the form of clinical trial reportsc Beta coefficient +0.654; t statistic 10.17 (p<0.05)
Gonul [69] PSR visits in minutes were a positive predictor of medication prescriptionBeta coefficient +0.1085; t statistic 5.32 (p<0.001)
Caamano [68] PSR visits were not associated with the n prescriptionsAdjusted regression coefficient −0.490.001; p = 0.998
Schwartz [27] PSR visits to residents were associated with increased initiation of prescriptions for 12 drugsa p<0.05 for all*
PSR visits were not associated with increased prescription of one medication however for this medication unlike the others there had been more PSR visits in the control groupNo association detected (p>0.05)*
Rizzo [50] PSR visits were associated with increased prescription salesBeta coefficient +0.28; t statistic 4.19 (p<0.01)
PSR visits may result in diminishing returns given the quadratic beta coefficient is statistically significant and negativeQuadratic sales coefficient for PSR visits: −0.490.01 (p>0.05)
Chren [38] PSR meetings were associated with a formulary requestMultivariate result: OR = 3.4 (95% CI 1.8–6.6); p<0.001
Berings [72] PSR visits were not significantly associated with benzodiazepine prescribinga Linear regression analysis: beta 0.16 (p = 0.05 to 0.1)
Cleary [26] PSR visits were associated with an increase in prescribing of promoted medications; prescribing of them decreased when they were not promotedCeftriaxone 24.2% and 27.8% increase in promoted periods; p<0.05
Cefotaxime 14.6% and 26.2% increase in promoted periods; p<0.05
Ceftazidime (promoted in period I but not promoted in period II): 27.7% decrease when not promoted in period II (p<0.05) and 10% increase in period III after being promoted again; p<0.05
Lurie [73] PSR visits for faculty staff for less than 5 min were associated with more prescribingLogistic regression coefficient 0.016; p = 0.03
PSR visits for faculty staff for more than 5 min were not associated with a change in prescribing p>0.10 (coefficient not presented where result not significant)
PSR visits for faculty staff for less than 5 min were not associated with an addition to the hospital formularyLogistic regression coefficient 0.014; p = 0.06
PSR visits for faculty staff for more than 5 min were not associated with an addition to the hospital formulary p>0.10 (coefficient not presented where result not significant)
PSR visits for residents for less than 5 min were associated with more prescribingLogistic regression coefficient 0.049; p = 0.003
PSR visits for residents for more than 5 min were not associated with a change in prescribing p>0.10 (coefficient not presented where result not significant)
PSR visits for residents for less than 5 min were not associated with an addition to the hospital formulary p>0.10 (coefficient not presented where result not significant)
PSR visits for residents for more than 5 min were not associated with an addition to the hospital formulary p>0.10 (coefficient not presented where result not significant)
Peay [33] PSR visits were associated with temazepam prescriptionMultivariate regression: −0.35 (p<0.002)
Blondeel [81] Based on responses to 8 case-histories:Multivariate regression:
First contact with a drug from the pharmaceutical industry was not associated with proneness to prescribe p = 0.05–0.1
Number of PSRs received was not associated with proneness to prescribe p>0.1
Based on prescriptions for actual patients:
First contact with a drug from the pharmaceutical industry was not associated with proneness to prescribe p>0.1
Number of PSRs received was associated with proneness to prescribe p<0.05
Mackowiak [52] PSR visit expenditure was not associated with a change market size nor market share for benzodiazepines or diureticsNo association detected
Becker [77] PSR visits per month were not associated with chloramphenicol prescribingGamma statistic 0.236; not significant
Journal advertisements Hemminki [25] Journal advertisements were associated with a trend for increased hormone replacement therapy (HRT) prescribing in EstoniaIncreased prescriptions
Charbit [34] Journal advertising was associated with increased prescriptions of ARA. When journal advertisements for ACE inhibitors and CCB decreased, their market share also decreased10.5% decrease in mean annual advertising of ACE inhibitors associated with 19.3% decrease in market share 11% decrease in mean annual advertising for CCBs associated with 19.3% decrease in market share. 20.5% increase in mean annual advertising rate for ARAs associated with 22.9% increase in market share
Prosser [67] Journal advertisements were no more likely to be cited as a prescribing influence by high prescribers than by low prescribers9% high prescribers versus 0% of low prescribers; Fisher exact test; p = 0.18
Azoulay [49] Journal advertisements were associated with diffusion of product information and performance on the product market with marketing activities having a more pronounced effect than scientific information in the form of clinical trial reportsc Beta coefficient +0.112; t statistic 4.753 (p<0.05)
Jones [70] Journal advertisements were not associated with PCP prescribingNo association detected
Healthcare Communications [80] Journal advertisement recognition was associated with increased market share for the advertised medication14.5% difference in market share between those physicians not recognising advertisements (19.6%) and those associating the advertisement message with the product (34.1%)
Walton [75] Journal advertisement recognition was associated with medication prescriptionOR 1.68 (95% CI 1.21–2.35)b
Becker [77] Infrequent use of journal advertisement use was not associated with chloramphenicol prescribingGamma statistic −0.186 not statistically significant
Infrequent use of journal advertisements to learn about the usefulness of new medications was associated with reduced chloramphicol prescribinga Gamma statistic +0.51; p<0.05
Attendance at pharmaceutical company-sponsored meeting Kreyenbuhl [31] Attendance at pharmaceutical sponsored CME meetings more than once in the preceding month was associated with the “add” rather than “switch” strategy for antipsychotic medication prescribinga OR 2.32 (95% CI 1.29–4.18); p = 0.005*
Venkataraman [40] Attendance at pharmaceutical sponsored meetings was not significantly associated with prescriptions for 7 out of 12 brandsBeta coefficient −0.659 (significant with a 90% CI)
Narayanan [43] Attendance at pharmaceutical company-sponsored meetings was associated with an increase in promoted medication market shareA 1% increase in expenditure on “other marketing activities” (including meetings) was associated with increases in market shares for promoted drugs ranging from 0.02% to 0.04% (p<0.05)
Huang [65] Attendance at pharmaceutical sponsored conferences was associated with more prescriptions of the corresponding sponsored antidepressanta Pearson correlation coefficient; 2001–2002: 0.87; p<0.01, 2002–2003: 0.73; p<0.01
Spingarn [39] Attendance at a pharmaceutical sponsored meeting was not associated with the intention to prescribe the promoted medication where it was indicatedOR 2.51 (95% CI 0.91–6.95)
Orlowski [28] Attendance at pharmaceutical sponsored meeting was associated with more prescriptions of medications being discussedDrug A: 81 (±44) prescriptions before, 272 (±117) prescriptions after; p<0.001 (Wilcoxon rank sum)
Drug B: 34 (±30) prescriptions before, 87 (±24) prescriptions after; p<0.001 (Wilcoxon rank sum)
Bowman [60] Attendance at pharmaceutical sponsored courses was associated with more prescriptions of medication made by sponsoring companyBefore and 6 mo after 3 sponsored course involving sponsoring company's drugs:
Course I: Nifedipine, increase in prescriptions 5.6%; p<0.05*
Course II: Metoprolol, increase in prescriptions 12.4%; p<0.05*
Course III: Diltiazem, increase in prescriptions 18.7%; p<0.05*
Peay [33] Attendance at pharmaceutical sponsored meeting was not associated with prescription of temazepamNo association detected
Mailed information from pharmaceutical companies Prosser [67] Mailed information was no more likely to be cited as an influence by high prescribers than low prescribersa 9% for high prescribers, 0% for low prescribers; Fisher exact test; p = 0.18
Peay [33] Mailed information was not associated with a change in temazepam prescribing frequencyNo association detected
Dajda [76] Mailed advertisements to general practitioners was associated with an increase in prescriptionsCorrelation coefficient 0.08
Advertising on clinical software Henderson [29] Advertisements on clinical software were not associated with a difference in prescribing for all advertised medications combinedAdjusted OR 0.96 (95% CI 0.87–1.06); p = 0.42
Total promotional investment/summated scores of commercial information use/general use of commercial sources Greving [30] Commercial information sources of information were associated with an increase in rates of prescribing of angiotensin receptor blocking medicationsOR 2.0 (95% CI 1.5–2.6)
Commercial information sources of information were not associated with an increase in the n doctors prescribing angiotensin receptor blocking medicationsOR 12.8 (95% CI 0.20–816.58)
Windmeijer [41] Expenditure on pharmaceutical promotion was associated with more prescribingBeta coefficient +0.0137; t statistic 2.98 (p<0.01)
Auvray [57] Total promotional investment was associated with an increase in the n prescriptionsNo statistical measures presented
Peay [33] Commercial information sources were associated with a preference for temazepam prescribinga p<0.036 (t test)
Commercial information sources were associated with earlier temazepam prescribinga p<0.045 (t test)
Hurwitz [51] Promotion of the branded leading drug was associated with increased market share especially for acute or sporadic conditionsBeta coefficient +0.295; t statistic 4.34 (p<0.01)
Promotion of “following generic drugs” was associated with reduced the market share for the leading drugBeta coefficient −0.150; t statistic 2.14 (p<0.05)
Mackowiak [52] Expenditure on PSRs and journal advertisements was not associated with a change in market size nor market share for benzodiazepines or diureticsNo association detected
Leffler [53] The promotional intensity for new products was not associated with increased market share for the entrant product 2 y post introductionBeta coefficient +0.88; t statistic 1.89, p>0.05
The promotional intensity for new products introduced over a 9-y period was associated with increased market share for the entrant productsBeta coefficient +1.25; t statistic 2.35, p<0.05
Telser [54] Overall promotional intensity was associated with the market share of entrant drugs in the hospital and drug store market in the period 1964–1968Drug store: beta coefficient +1.28; t statistic +2.20 (p<0.05)
Hospital: beta coefficient +1.45; t statistic +2.61 (p<0.05)
Overall promotional intensity was not associated with the market share of entrant drugs in the hospital and drug market in the period 1968–1972Drug store: beta coefficient +1.19; t statistic +0.60 (p>0.05)
Hospital: beta coefficient +0.608; t statistic +1.20 (p>0.05)
Information delivered without conventional promotion Andersen [37] Participation in pharmaceutical funded research was associated with increase in the sponsoring company's share of asthma drug in practices conducting the trial compared to control practices6.7% increase (95% CI 3.0%–11.7%)b
Freemantle [35] PSR visits were not associated with an increase in the prescription of the detailed medicationOR = 1.04 (95% CI 0.83–1.31); p = 0.73
Dolovich [36] PSR visits were not associated with a change in the market share of amoxicillinIntervention group: +0.63% market share, control group: −0.72% market share; p = 0.15
Kazmierczak [59] Mailed warning letters regarding tramadol for those with a seizure risk were not associated with a change in prescription rates for tramadola Before mailing: 10% prescribing rate, after mailing 9% prescribing rate.
Soumerai [58] PSR visits: Propoxyphene use continued a preexisting decline of about 8% a year during the time when warnings from the manufacturing pharmaceutical company were expressed by PSRs after which time this decline halted, however a statistical association was not shown. Refill rates and rates of overdose did not change following the warningsa No association detected
Mailed information: Propoxyphene use continued a preexisting decline of about 8% a year during the time when warnings from the manufacturing pharmaceutical company were expressed by PSRs after which time this decline halted, however a statistical association was not shown. Refill rates and rates of overdose did not change following theNo association detected

Study authors reported that exposure to information from drug companies was associated with decreased quality of prescribing.

Reported by study authors as statistically significant.

Study authors reported that exposure to information from drug companies was associated with increased quality of prescribing.

*Chi-squared statistic.

ACE, angiotensin converting enzyme; ARA, angiotensin receptor antagonist; CCB, calcium channel blocker; CME, continuing medical education.

Study authors reported that exposure to information from drug companies was associated with decreased quality of prescribing. Reported by study authors as statistically significant. Study authors reported that exposure to information from drug companies was associated with increased quality of prescribing. *Chi-squared statistic. ACE, angiotensin converting enzyme; ARA, angiotensin receptor antagonist; CCB, calcium channel blocker; CME, continuing medical education.

Conventional Promotional Techniques

Pharmaceutical sales representative visits

Of the 29 studies of pharmaceutical sales representative visits, 17 found only an association with increased prescribing of the promoted drug [26],[32],[33],[38],[40],[43]–[50],[63],[67],[78],[79]. None found less frequent prescribing. Of the remaining 11, six studies had mixed results: finding a significant association with more frequent prescribing for some measures but no significant association for others [27],[42],[62],[69],[73],[81]. Five did not detect any significant relationship [31],[52],[68],[72],[77]. One study did not use statistical tests for associations. It found that during the time that spending by pharmaceutical companies on promotion of a medication dropped to zero, there was also a significant drop in prescribing of that medication. However most of the decreases in promotion and prescribing occurred after the publication of evidence of problems with that medication [56]. Nine of these studies with either positive or mixed results provided insights into features of pharmaceutical sales representative visits that modified the impact of these visits on prescribing [40],[46],[49],[62],[67],[69],[73],[78]. An association with more frequent prescribing was more likely when pharmaceutical sales representatives visited groups of physicians, when physicians had lower baseline prescribing of the promoted drug [62], and when physicians had larger prescribing volumes overall [67]. Longer pharmaceutical sales representative visits to physicians and residents were also more likely to be associated with increased prescribing [69],[73]. More frequent pharmaceutical sales representative visits were associated with diminishing returns [46],[50],[69]. In addition to increasing the promoted drug's market share, pharmaceutical sales representative visits were associated with a decrease in the market share of competitor products [78]. Pharmaceutical sales representative visits were more likely to be associated with more frequent prescriptions for drugs judged more effective and also for drugs with more side effects [40]. However the authors of that study did not attempt to measure whether higher levels of use represented a change in prescribing quality. Another study found that pharmaceutical sales representative visits were associated with a greater increase in market share for new entrants into a therapeutic field than was positive scientific information [49].

Journal advertisements

Four out of the eight studies measuring the effects of journal advertisements presented data but did not include statistical tests [25],[34],[70],[80]. One of these noted use of a medication class increased after pharmaceutical advertising commenced in a country where the medication class was previously available but was not promoted [25]. One study visually compared graphs of the monthly number of advertisements and prescriptions for a group of nine drugs and found no clear relationship between the extent of the advertising of a drug and the amount of prescribing by general practitioners [70]. One study found that the market share of a medication was higher amongst physicians who recognised the advertisement for that medication compared to those who did not [80]. The last study observed decreased prescribing of two drug classes at the same time that advertising decreased [34]. Of the four studies that included statistical tests, one found that journal advertisements have a more pronounced effect on market share for the advertised drug than does positive scientific information published in medical journals [49]. A cross-sectional study found contradictory results. Self-reported infrequent use of journal advertisements by physicians to learn about new medications was not associated with frequency of prescribing. However, infrequent use of journal advertisements was associated with less chloramphenicol prescribing [77]. One cross-sectional study found that physicians who recalled advertisements became prescribers of the advertised products in consistently larger proportions than those who did not recall advertisements [75]. Another study found that 9% of high prescribers of new drugs cited advertisements as an influence on their prescribing compared to 0% for low prescribers; however, this was not a statistically significant association [67].

Attendance at pharmaceutical company-sponsored meetings

There were eight studies of pharmaceutical company-sponsored meetings. Five found positive associations with prescribing frequency [28],[31],[43],[60],[65]. Three studies did not detect a significant association [33],[39],[40].

Mailed information from pharmaceutical companies

One of the three studies of mailed promotional material found an association with increased prescribing [76]. The others found no association [33],[67].

Advertising in clinical software

A single study examined the effect of advertising in clinical practice software and found no association with prescribing frequency for six medications and less prescribing of one medication [29]. The overall result was no association between advertising and prescribing frequency.

Total promotional investment

Eight studies combined the outcome measures for various exposures to pharmaceutical company information or measured overall promotional investment, a proxy for the amount of exposure to information from pharmaceutical companies. Three studies found that total promotional investment was positively associated with prescribing frequency [30],[33],[51]. Two studies found both positive results and no association [53],[54]. One study did not detect an association [52].

Meta-analysis of promotional information and prescribing frequency

We pooled results from a total of seven studies using a random effects model to examine whether exposure to promotion was associated with prescribing of the promoted medication. The seven study results included in the meta-analysis showed significant heterogeneity (I 2 = 91% [95% confidence interval (CI) 84%–95%], tau2 = 0.35), and therefore we have presented the forest plot without the pooled outcome (Figure 2) [29],[30],[31],[38],[39],[63],[75]. Using sensitivity analysis we found that study design, quality factors, year of publication, and type of physician did not explain this heterogeneity. One study provided two units of analysis with outcomes amenable to meta-analysis: a significant association for attendance at sponsored meetings and a nonsignificant result for pharmaceutical sales representative (PSR) visits [31]. We included only that nonsignificant result in the forest plot (Figure 2). When meta-analysis was conducted using the significantly positive result for attendance at a pharmaceutical company-sponsored meeting, the summary result and level of heterogeneity did not differ greatly. The largest difference detected was between exposure to active promotional information (OR 2.34, 95% CI 1.50–3.65), (I 2 = 59%, 95% CI 0%–86%, tau squared = 0.11) [31],[38],[39],[63] and passive promotional information (OR 1.24, 95% CI 0.72–2.15) (I2 = 89.5%, tau squared = 0.14) [29],[75].
Figure 2

Forest plot displaying the effect of promotional information on physicians' prescribing of the promoted medication.

Information Delivered Without Conventional Promotion Techniques

Five studies looked for associations between information delivered without conventional promotion techniques and the frequency of physicians' prescribing [35],[36],[37],[58],[59]. One randomized controlled trial partnered a local health authority and a pharmaceutical company with the aim of promoting a less expensive drug [35], and the other randomized controlled trial aimed to promote rational prescribing through evidence-based detailing by a pharmaceutical company in partnership with an academic institution [36]. Neither found an association with physicians' prescribing. A single controlled-cohort study of a pharmaceutical company-funded randomized controlled trial found that physicians' participation in recruiting subjects was associated with an increase in the number of prescriptions of the sponsoring company's drug [37]. One time-series analysis found no change in the rate of decline in the prescribing of a medication when the main manufacturer was required by a regulatory agency to deliver an educational program warning about problems with the drug via mailed information and pharmaceutical sales representative visits [58]. A cross-sectional study found no change in prescription rates following warning letters regarding drug side effects [59].

Pharmaceutical Company Information and Prescribing Costs

Eight studies (Table 9) [35],[41],[50],[55],[66],[68],[69],[71] measured prescribing costs as costs per physician, price elasticity, and changes in generic prescribing (ten units of analysis). In the United States, one econometric time-series analysis found that pharmaceutical sales representative visits were associated with increased price sensitivity among physicians prescribing in one therapeutic class [69], and another found the opposite effect for hypertension [50]. A third, more recent, econometric study found that promotional outlay (the total for pharmaceutical sales representative visits, journal advertisements, and direct mail) was associated with reduced price sensitivity for primary care providers and psychiatrists in 11 therapeutic classes consisting of more than 50% of the Dutch drug market [41]. Of three cross-sectional studies, two detected an association between pharmaceutical sales representative visits and higher prescribing costs [66],[71], but one did not detect an association [68]. One study also found that low cost prescribers were more likely to have rarely or never read promotional mail or journal advertisements from pharmaceutical companies than high cost prescribers [66]. One time-series analysis found that reduced exposure to pharmaceutical sales representative visits and promotional material was associated with an increase in generic prescribing [55]. A randomized controlled trial of pharmaceutical sales representative visits in a noncommercial partnership between a pharmaceutical company and a local health authority measured physicians' prescribing costs for the target drug class and found no effect [35].
Table 9

Relationship between exposure to information from drug companies and prescribing costs (by year of publication and then study design/size).

Exposure to Information from Drug CompanyStudy (First Author Name)ResultsChange in Prescribing Costs
Effect of PSR visits Watkins [66] High cost prescribers were more likely to see PSRs at least once a week than low cost prescribersOR 3.11 (95% CI 2.48–3.89); p<0.01a
Caamano [68] There was no association between PSR visits and the cost of prescriptionsAdjusted regression coefficient: 21.0; p = 0.962
Gonul [69] PSR visits were associated with increased physicians' price sensitivityMaximum likelihood estimate, 0.0012; t statistic 3 (p<0.001)
Rizzo [50] PSR visits were associated with reduced price elasticity for the promoted drugSales estimate +0.14; t statistic 2.97 (p<0.01)
Caudill [71] Frequency of PSR visits was associated with higher prescribing costsMultivariate regression beta +0.155; p = 0.01
Journal advertisements Watkins [66] High cost prescribers were less likely to “rarely or never” read journal advertisements than low cost prescribersOR 0.79 (95% CI 0.64–0.98); p = 0.02a
Mailed information from pharmaceutical companies High cost prescribers were less likely to “rarely or never” read mailed information than low cost prescribersOR 0.49 (95% CI 0.38–0.64); p<0.01a
Total promotional investment/summated scores of commercial information use/general use of commercial sources Spurling [55] Reduced n PSR visits and volume of promotional material were associated with an increased generic prescribing at 3 and 9 mo3 mo: OR 2.28 (95% CI 1.31–3.86); p = 0.0027a
9 mo: OR 2.07 (95% CI 1.13–3.82); p = 0.016a
Windmeijer [41] Promotional outlay (PSR visits, journal advertisements, direct mail) was associated with reduced price elasticity for promoted drugsln regression coefficient −0.0102 (se 0.0055) p<0.05
Information delivered without conventional promotion Freemantle [35] There was no significant difference in costs between the group that was detailed by PSRs instructed by a local health authority and the control groupMean difference: £122.32 (95% CI −£94.91 to £342.91)

Chi-squared statistic.

Chi-squared statistic.

Discussion

Overview

We found that the reported relationship between exposure to information provided directly by pharmaceutical companies and the quality, frequency, and cost of prescribing varied from case to case. However, with only one exception [39], the included studies reported that exposure to information from pharmaceutical companies was associated with either lower prescribing quality or no association was detected. Similarly, exposure to information from pharmaceutical companies was associated with either an increase in prescribing frequency or no association was detected. Three studies found that exposure was associated with increased drug sales up to a point of diminishing returns beyond which more promotion was increasingly less effective [46],[50],[69]. Finally, with only one exception [69], exposure to information from pharmaceutical companies was associated with an increase in prescribing costs or no association was detected. This review has supported, updated, and extended the findings of previous reviews regarding the effects of exposure to information from pharmaceutical companies. 38 of the 58 included studies (66%) were not included in previous systematic reviews on this topic [25],[29]–[32],[34],[35],[40]–[42],[44],[48],[49],[51]–[59],[61]–[68],[70],[72],[75],[76],[78]–[82], including seven of the ten studies of prescribing quality [37],[58],[59],[61],[64],[81],[82] and four of the seven studies of prescribing costs [35],[55],[66],[68]. Most of the included studies measured the frequency of prescribing. Amongst these, the studies of informational exposure where physicians are active participants, such as representatives' visits, sponsored meetings, or sponsored trials, more consistently found associations with higher prescribing frequency than studies of more passive exposures, such as journal advertisements and mailed information. Poor study quality precludes confident conclusions about journal advertising. However, one higher quality econometric analysis found that advertisements in journals were associated with a more pronounced effect on market share than positive scientific findings published in journals [49]. Also there are claims in the marketing literature that the relatively low cost of passive methods and their ability to synergistically increase the effectiveness of active methods makes them cost effective components of sales campaigns [84].

Limitations of Included Studies

All of the included studies had design limitations (Tables 1– 5). We found only two randomized controlled trials [35],[36]. Both lacked adequate reporting of allocation concealment and blinding. These two trials did not examine standard promotional practice but instead assessed novel partnerships of government or academia with industry aiming for less expensive, higher quality prescribing. On the basis of these two negative randomized controlled trials, it seems unlikely that similar partnerships will have beneficial effects on prescribing. No definite conclusions can be extrapolated from these studies to standard promotional practice. All other included studies were observational and thus able to measure associations but not prove causation. There is a risk that reported associations may be false positives, and that statistically significant findings may not necessarily be clinically significant. One example is the study by Mizik et al. that reports only a small increase in prescriptions associated with visits from pharmaceutical sales representatives [45]. Associations may also arise from confounding, bias, or chance. False negatives or inaccurate estimation of effect sizes may result from small sample sizes, measurement errors, overly complex models, or “contamination” when prescribers who are thought to be unexposed are actually influenced by other methods. For example in a study of promotional meetings, nonattenders may be influenced by sales representatives thus reducing the difference from attenders in their prescribing. Another possible source of contamination is indirect influence by colleagues who have been influenced directly. To the extent that the measured associations are real, causality may be bidirectional. The influence of information from pharmaceutical companies on prescribing is a likely explanation for the associations given that the major purpose of pharmaceutical promotion is to influence prescribing [3]. However, it is also possible that physicians who prescribe larger quantities, more expensively or less appropriately may allow themselves to be exposed to, or attract, more promotional information. Some studies found no association between exposure to information from pharmaceutical companies and prescribing outcomes or small effect sizes that seem unlikely to be clinically significant. Some of these may be false negatives or underestimations caused by study flaws, but it is likely that information from companies sometimes has little or no effect, especially when the information is not designed to increase sales, e.g., letters warning about safety problems. Most of the studies included in this review examined single components of promotional campaigns that may have little or no effect alone but have a synergistic effect in combination with other components. Promotion may be less effective if it is used beyond the point of diminishing returns or is up against similarly effective promotion for another similar product. Given the controversial nature of this topic, there are many reasons why the studies could be biased overall in either direction. Authors may have produced results consistent with their ideological bias. Also reciprocal obligation to funders who preferred certain results may have lead to bias with or without conscious awareness. Publication and outcome reporting bias may have led to underrepresentation of negative, positive, uninteresting, or unwanted findings.

Strengths and Weaknesses

The strengths of this review include use of a comprehensive search strategy over multiple databases without any language exclusions. We consulted widely with experts in the field and we used validated instruments to assess quality of the studies. However, only one of the included studies was conducted in a low-income economy, as defined by the World Bank, so the effects of promotion there are less certain [33]. This study found a positive association between pharmaceutical promotion and prescribing frequency. Promotion may be more influential in these countries given the relative paucity of independent sources of information [85],[86]. Our efforts to access data that was not in the databases we searched had mixed results. Messages on e-mail discussion groups and contact with experts yielded five additional studies subsequent to the initial search [34],[43],[80]–[82] whose results were consistent with the entire review. By contrast, pharmaceutical companies did not provide us with any information that was not already in the public domain. However five studies included in this review analyzed confidential data from pharmaceutical companies and their results were also consistent with the review as a whole [33],[35],[37],[40],[46]. Given the wide range of knowledge and experience among the sources that we consulted and the expertise in our group, we are confident that we exhausted all reasonable avenues in our attempt to obtain additional literature.

Data Interpretation

Of the 58 studies included in this review, 38 studies reported a single unit of analysis with 25 (66%) finding significant associations between exposure to information from pharmaceutical companies and the quality, frequency, and cost of prescribing and eight (21%) finding no associations. The remaining five (13%) had multiple measures and found significant associations on some measures but not on others. The 20 studies with more than one unit of analysis reported 49 units of analysis of which 21 (43%) found significant associations, 24 (49%) found no associations, and four (8%) found mixed results. The difference between the results of the single versus multiple unit of analysis studies is significant (p<0.05 Freeman-Halton extension of the Fisher exact test). This difference may have been caused by publication bias against publication of single unit of analysis studies when no association was found. We believe the pattern of results suggests that there was little or no reporting bias for the multiple unit of analysis studies. Because the multiple unit of analysis studies found no association more often than the single unit of analysis studies, multiple mentions of the former studies in our narrative synthesis will not exaggerate the frequency of findings of significant associations. Interpretation of our meta-analysis requires caution because many studies included in the narrative synthesis could not be included in the meta-analysis. Where a sufficient number of studies could be combined, there was significant heterogeneity. The summary result has not been presented because it is unlikely to accurately reflect the true effect size of most promotional campaigns for two main reasons. First, effect sizes varied widely so it is likely that promotional campaigns often have effect sizes far from average. Second, single promotional techniques are likely to be less effective individually than campaigns employing multiple promotional methods. A sensitivity analysis found the difference between passive and active promotion is one possible cause of heterogeneity. Other possible explanations for variation in the effectiveness of promotion include variation from campaign to campaign in the relative benefits of the drug being promoted, the promoter's skills and budget, and the target group's level of resistance to promotion.

Conclusions

The limitations of studies reported in the literature mentioned above mean that we are unable to reach any definitive conclusions about the degree to which information from pharmaceutical companies increases, decreases, or has no effect on the frequency, cost, or quality of prescribing. In theory, advertising may be beneficial in several ways: by distributing information and thus improving the quality of prescribing [20],[78], by reducing costs through increasing price-elasticity [69], by increasing prescribing of drugs that provide better health outcomes, or by improving the cost-effective use of healthcare resources. Because of the limitations of both the included studies and this review we have not disproved those theories but we have found little evidence to support them and have found some evidence of increased costs and decreased quality of prescribing. Any conclusions about harm or benefit for patients are speculative because none of the studies that we found examined clinical outcomes. One clear conclusion from this review is that we did not find evidence of net improvements in prescribing associated with exposure to information from pharmaceutical companies. Some argue that prescribers have an ethical duty to avoid exposure to pharmaceutical promotion [13],[87]–[89]. Even ineffective promotional information may be harmful if it wastes prescribers' time or if the money spent on promotion increases the cost of medicines [90]; this is of concern given the large expenditure involved [1],[2]. In the absence of evidence of net improvement in prescribing from exposure to promotional information, we recommend that practitioners follow the precautionary principle and thus avoid exposure to information from pharmaceutical companies unless evidence of net benefit emerges. Malaysian translation of the abstract by NO. (0.04 MB DOC) Click here for additional data file. French translation of the abstract by AIV. (0.05 MB DOC) Click here for additional data file. Spanish translation of the abstract by Diana L. Matallana. (0.05 MB DOC) Click here for additional data file. MOOSE checklist. (1.72 MB PDF) Click here for additional data file.
  57 in total

1.  A survey of the advertising of nine new drugs in the general practice literature.

Authors:  M Jones; S Greenfield; C Bradley
Journal:  J Clin Pharm Ther       Date:  1999-12       Impact factor: 2.512

2.  Sleeping with the enemy? A randomized controlled trial of a collaborative health authority/industry intervention to influence prescribing practice.

Authors:  N Freemantle; R Johnson; J Dennis; A Kennedy; M Marchment
Journal:  Br J Clin Pharmacol       Date:  2000-02       Impact factor: 4.335

3.  Physicians and the pharmaceutical industry: is a gift ever just a gift?

Authors:  A Wazana
Journal:  JAMA       Date:  2000-01-19       Impact factor: 56.272

4.  Of principles and pens: attitudes and practices of medicine housestaff toward pharmaceutical industry promotions.

Authors:  M A Steinman; M G Shlipak; S J McPhee
Journal:  Am J Med       Date:  2001-05       Impact factor: 4.965

5.  Influence of commercial information on prescription quantity in primary care.

Authors:  Francisco Caamaño; Adolfo Figueiras; Juan Jesus Gestal-Otero
Journal:  Eur J Public Health       Date:  2002-09       Impact factor: 3.367

6.  Changes in drug prescribing patterns related to commercial company funding of continuing medical education.

Authors:  M A Bowman; D L Pearle
Journal:  J Contin Educ Health Prof       Date:  1988       Impact factor: 1.355

7.  Impact of pharmaceutical sales representatives on physician antibiotic prescribing.

Authors:  J D Cleary
Journal:  J Pharm Technol       Date:  1992 Jan-Feb

8.  Newly admitted psychiatric patient prescriptions and pharmaceutical sales visits.

Authors:  T L Schwartz; D J Kuhles; M Wade; P S Masand
Journal:  Ann Clin Psychiatry       Date:  2001-09       Impact factor: 1.567

Review 9.  Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group.

Authors:  D F Stroup; J A Berlin; S C Morton; I Olkin; G D Williamson; D Rennie; D Moher; B J Becker; T A Sipe; S B Thacker
Journal:  JAMA       Date:  2000-04-19       Impact factor: 56.272

10.  Attitudes and behaviour of general practitioners and their prescribing costs: a national cross sectional survey.

Authors:  C Watkins; I Harvey; P Carthy; L Moore; E Robinson; R Brawn
Journal:  Qual Saf Health Care       Date:  2003-02
View more
  142 in total

1.  Pharmacists' Perceptions of the Influence of Interactions with the Pharmaceutical Industry on Clinical Decision-Making.

Authors:  Aaron M Tejani; Peter Loewen; Richard Bachand; Curtis K Harder
Journal:  Can J Hosp Pharm       Date:  2015 Sep-Oct

2.  Medical Schools' Industry Interaction Policies Not Associated With Trainees' Self-Reported Behavior as Residents: Results of a National Survey.

Authors:  James S Yeh; Kirsten E Austad; Jessica M Franklin; Susan Chimonas; Eric G Campbell; Jerry Avorn; Aaron S Kesselheim
Journal:  J Grad Med Educ       Date:  2015-12

3.  Effect of Direct-to-Consumer Advertising on Asthma Medication Sales and Healthcare Use.

Authors:  Matthew Daubresse; Susan Hutfless; Yoonsang Kim; Rachel Kornfield; Dima M Qato; Jidong Huang; Kay Miller; Sherry L Emery; G Caleb Alexander
Journal:  Am J Respir Crit Care Med       Date:  2015-07-01       Impact factor: 21.405

Review 4.  Association between physicians' interaction with pharmaceutical companies and their clinical practices: A systematic review and meta-analysis.

Authors:  Hneine Brax; Racha Fadlallah; Lina Al-Khaled; Lara A Kahale; Hala Nas; Fadi El-Jardali; Elie A Akl
Journal:  PLoS One       Date:  2017-04-13       Impact factor: 3.240

5.  Pharmaceutical sales representatives and patient safety.

Authors:  Donald W Light
Journal:  J Gen Intern Med       Date:  2013-11       Impact factor: 5.128

6.  Medical students' attitudes to and contact with the pharmaceutical industry: a survey at eight German university hospitals.

Authors:  Klaus Lieb; Cora Koch
Journal:  Dtsch Arztebl Int       Date:  2013-09-02       Impact factor: 5.594

7.  Physician-Industry Interactions and Anti-Vascular Endothelial Growth Factor Use Among US Ophthalmologists.

Authors:  Stanford C Taylor; Julia B Huecker; Mae O Gordon; David E Vollman; Rajendra S Apte
Journal:  JAMA Ophthalmol       Date:  2016-08-01       Impact factor: 7.389

8.  Increasing consumption of MRSA-active drugs without increasing MRSA in German ICUs.

Authors:  Elisabeth Meyer; Frank Schwab; Barbara Schroeren-Boersch; Petra Gastmeier
Journal:  Intensive Care Med       Date:  2011-08-20       Impact factor: 17.440

9.  The association between a journal's source of revenue and the drug recommendations made in the articles it publishes.

Authors:  Annette Becker; Fatma Dörter; Kirsten Eckhardt; Annika Viniol; Erika Baum; Michael M Kochen; Joel Lexchin; Karl Wegscheider; Norbert Donner-Banzhoff
Journal:  CMAJ       Date:  2011-02-28       Impact factor: 8.262

10.  Antipsychotic prescribing: do conflict of interest policies make a difference?

Authors:  Timothy S Anderson; Haiden A Huskamp; Andrew J Epstein; Colleen L Barry; Aiju Men; Ernst R Berndt; Marcela Horvitz-Lennon; Sharon-Lise Normand; Julie M Donohue
Journal:  Med Care       Date:  2015-04       Impact factor: 2.983

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.