This is an archived version of the Handbook. For the current version, please go to or search for this chapter here.

10.6  References

Abbasi 2004  
Abbasi K. Compulsory registration of clinical trials. BMJ 2004; 329: 637-638.

Abbot 1998  
Abbot NC, Ernst E. Publication bias: direction of outcome is less important than scientific quality. Perfusion 1998; 11: 182-182.

Anonymous 1991  
Anonymous. Subjectivity in data analysis. The Lancet 1991; 337: 401-402.

Bailey 2002  
Bailey BJ. Duplicate publication in the field of otolaryngology-head and neck surgery.
Archives of Otolaryngology 2002; 126: 211-216.

Barden 2003  
Barden J, Edwards JE, McQuay HJ, Moore RA. Oral valdecoxib and injected parecoxib for acute postoperative pain: a quantitative systematic review. BMC Anesthesiology 2003; 3: 1.

Bardy 1998  
Bardy AH. Bias in reporting clinical trials. British Journal of Clinical Pharmacology 1998; 46: 147-150.

Becker 2005  
Becker BJ. Failsafe N or file-drawer number. In: Rothstein HR, Sutton AJ, Borenstein M (editors). Publication Bias in Meta-Analysis (1). Chichester (UK): John Wiley & Sons, 2005.

Begg 1988  
Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society Series A 1988; 151: 419-463.

Begg 1994  
Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50: 1088-1101.

Bhandari 2004  
Bhandari M, Busse JW, Jackowski D, Montori VM, Schünemann H, Sprague S, Mears D, Schemitsch EH, Heels-Ansdell D, Devereaux PJ. Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials. Canadian Medical Association Journal 2004; 170: 477-480.

Blumenthal 1997  
Blumenthal D, Campbell EG, Anderson MS, Causino N, Louis KS. Withholding research results in academic life science. Evidence from a national survey of faculty. JAMA 1997; 277: 1224-1228.

Brooks 1985  
Brooks TA. Private acts and public objects: an investigation of citer motivations. Journal of the American Society for Information Science 1985; 36: 223-229.

Burdett 2003  
Burdett S, Stewart LA, Tierney JF. Publication bias and meta-analyses: a practical example. International Journal of Technology Assessment in Health Care 2003; 19: 129-134.

Cantekin 1991  
Cantekin EI, McGuire TW, Griffith TL. Antimicrobial therapy for otitits media with effusion ('secretory' otitits media). JAMA 1991; 266: 3309-3317.

Carter 2006  
Carter AO, Griffin GH, Carter TP. A survey identified publication bias in the secondary literature. Journal of Clinical Epidemiology 2006; 59: 241-245.

Chan 2004a  
Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA 2004; 291: 2457-2465.

Chan 2004b  
Chan AW, Krleža-Jeric K, Schmid I, Altman DG. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. Canadian Medical Association Journal 2004; 171: 735-740.

Chan 2005  
Chan AW, Altman DG. Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. BMJ 2005; 330: 753.

CLASP Collaborative Group 1994  
CLASP Collaborative Group. CLASP: a randomized trial of low-dose aspirin for the prevention and treatment of pre-eclampsia among 9364 pregnant women. The Lancet 1994; 343: 619-629.

Cook 1993  
Cook DJ, Guyatt GH, Ryan G, Clifton J, Buckingham L, Willan A, McIlroy W, Oxman AD. Should unpublished data be included in meta-analyses? Current convictions and controversies. JAMA 1993; 269: 2749-2753.

Copas 1999  
Copas J. What works?: selectivity models and meta-analysis. Journal of the Royal Statistical Society Series A 1999; 162: 95-109.

Copas 2000  
Copas JB, Shi JQ. Reanalysis of epidemiological evidence on lung cancer and passive smoking. BMJ 2000; 320: 417-418.

Cowley 1993  
Cowley AJ, Skene A, Stainer K, Hampton JR. The effect of lorcainide on arrhythmias and survival in patients with acute myocardial infarction: an example of publication bias. International Journal of Cardiology 1993; 40: 161-166.

Davey Smith 1994  
Davey Smith G, Egger M. Who benefits from medical interventions? Treating low risk patients can be a high risk strategy. BMJ 1994; 308: 72-74.

Dear 1992  
Dear KBG, Begg CB. An approach to assessing publication bias prior to Performing a meta-analysis. Statistical Science 1992; 7: 237-245.

Decullier 2005  
Decullier E, Lheritier V, Chapuis F. Fate of biomedical research protocols and publication bias in France: retrospective cohort study. BMJ 2005; 331: 19.

Decullier 2007  
Decullier E, Chapuis F. Oral presentation bias: a retrospective cohort study. Journal of Epidemiology and Community Health 2007; 61: 190-193.

Deeks 2005  
Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of Clinical Epidemiology 2005; 58: 882-893.

Dickersin 1992  
Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA 1992; 263: 374-378.

Dickersin 1993  
Dickersin K, Min YI. NIH clinical trials and publication bias. Online Journal of Current Clinical Trials 1993; Doc No 50.

Dickersin 1994  
Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ 1994; 309: 1286-1291.

Dickersin 1997  
Dickersin K. How important is publication bias? A synthesis of available data. AIDS Educucation and Prevention 1997; 9: 15-21.

Dickersin 2002  
Dickersin K, Olson CM, Rennie D, Cook D, Flanagin A, Zhu Q, Reiling J, Pace B. Association between time interval to publication and statistical significance. JAMA 2002; 287: 2829-2831.

Dong 1997  
Dong BJ, Hauck WW, Gambertoglio JG, Gee L, White JR, Bubp JL, Greenspan FS. Bioequivalence of generic and brand-name levothyroxine products in the treatment of hypothyroidism [see comments]. JAMA 1997; 277: 1205-1213.

Duval 2000  
Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000; 56: 455-463.

Easterbrook 1991  
Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. The Lancet 1991; 337: 867-872.

Egger 1997a  
Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629-634.

Egger 1997b  
Egger M, Zellweger Z, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. The Lancet 1997; 350: 326-329.

Egger 2003  
Egger M, Jüni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technology Assessment 2003; 7: 1.

Epstein 1990  
Epstein WM. Confirmational response bias among social work journals. Science, Technology and Human Values 1990; 15: 9-37.

Ernst 1994  
Ernst E, Resch KL. Reviewer bias: A blinded experimental study. Journal of Laboratory and Clinical Medicine 1994; 124: 178-182.

Fergusson 2000  
Fergusson D, Laupacis A, Salmi LR, McAlister FA, Huet C. What should be included in meta-analyses? An exploration of methodological issues using the ISPOT meta-analyses. International Journal of Technology Assessment in Health Care 2000; 16: 1109-1119.

Galandi 2006  
Galandi D, Schwarzer G, Antes G. The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004. BMC Medical Research Methodology 2006; 6: 30.

Givens 1997  
Givens GH, Smith DD, Tweedie RL. Publication bias in meta-analysis:a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Statistical Science 1997; 12: 221-250.

Glasziou 1995  
Glasziou PP, Iriwg LM. An evidence based approach to individualising treatment. BMJ 1995; 311: 1356-1359.

Godlee 1999  
Godlee F, Dickersin K. Bias, subjectivity, chance, and conflict of interest in editorial decisions. In: Godlee F, Jefferson T (editors). Peer Review in Health Sciences. London (UK): BMJ Books, 1999.

Gøtzsche 1987  
Gøtzsche PC. Reference bias in reports of drug trials. British Medical Journal (Clinical Research Edition) 1987; 295: 654-656.

Gøtzsche 1989  
Gøtzsche PC. Multiple publication of reports of drug trials. European Journal of Clinical Pharmacology 1989; 36: 429-432.

Grégoire 1995  
Grégoire G, Derderian F, LeLorier J. Selecting the language of the publications included in a meta-analysis: is there a Tower of Babel bias? Journal of Clinical Epidemiology 1995; 48: 159-163.

Harbord 2006  
Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Statistics in Medicine 2006; 25: 3443-3457.

Hartling 2004  
Hartling L, Craig WR, Russell K, Stevens K, Klassen TP. Factors influencing the publication of randomized controlled trials in child health research. Archives of Pediatrics and Adolescent Medicine 2004; 158: 983-987.

Hedges 1992  
Hedges LV. Modeling publication selection effects in meta-analysis. Statistical Science 1992; 7: 246-255.

Hemminki 1980  
Hemminki E. Study of information submitted by drug companies to licensing authorities. British Medical Journal 1980; 280: 833-836.

Heres 2006  
Heres S, Davis J, Maino K, Jetzinger E, Kissling W, Leucht S. Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. American Journal of Psychiatry 2006; 163: 185-194.

Hetherington 1989  
Hetherington J, Dickersin K, Chalmers I, Meinert CL. Retrospective and prospective identification of unpublished controlled trials: lessons from a survey of obstetricians and pediatricians. Pediatrics 1989; 84: 374-380.

Hopewell 2004  
Hopewell S. Impact of grey literature on systematic reviews of randomized trials (PhD thesis). University of Oxford, 2004.

Hopewell 2007a  
Hopewell S, Clarke M, Stewart L, Tierney J. Time to publication for results of clinical trials. Cochrane Database of Systematic Reviews 2007, Issue 2. Art No: MR000011.

Hopewell 2007b  
Hopewell S, McDonald S, Clarke M, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database of Systematic Reviews 2007, Issue 2. Art No: MR000010.

Hopewell 2008  
Hopewell, S, Louden, K, Clarke, M, Oxman, AD, Dickersin, K. Publication bias in clinical trials due to statistical significance or direction of trial results.
Cochrane Database of Systematic Reviews (to appear).

Huston 1996  
Huston P, Moher D. Redundancy, disaggregation, and the integrity of medical research. The Lancet 1996; 347: 1024-1026.

Hutchison 1995  
Hutchison BG, Oxman AD, Lloyd S. Comprehensiveness and bias in reporting clinical trials. Canadian Family Physician 1995; 41: 1356-1360.

Ioannidis 1998  
Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998; 279: 281-286.

Ioannidis 2001  
Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA 2001; 285: 437-443.

Ioannidis 2007a  
Ioannidis JP, Trikalinos TA. An exploratory test for an excess of significant findings. Clinical Trials 2007; 4: 245-253.

Ioannidis 2007b  
Ioannidis JP, Trikalinos TA. The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. Canadian Medical Association Journal 2007; 176: 1091-1096.

Irwig 1998  
Irwig L, Macaskill P, Berry G, Glasziou P. Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased. BMJ 1998; 316: 470-471.

Iyengar 1988  
Iyengar S, Greenhouse JB. Selection problems and the file drawer problem. Statistical Science 1988: 109-135.

Johansen 1999  
Johansen HK, Gøtzsche PC. Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis [see comments]. JAMA 1999; 282: 1752-1759.

Jüni 2002  
Jüni P, Holenstein F, Sterne J, Bartlett C, Egger M. Direction and impact of language bias in meta-analyses of controlled trials: empirical study. International Journal of Epidemiology 2002; 31: 115-123.

Kjaergard 2002  
Kjaergard LL, Gluud C. Citation bias of hepato-biliary randomized clinical trials. Journal of Clinical Epidemiology 2002; 55: 407-410.

Lexchin 2003  
Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 2003; 326: 1167-1170.

Liebeskind 2006  
Liebeskind DS, Kidwell CS, Sayre JW, Saver JL. Evidence of publication bias in reporting acute stroke clinical trials. Neurology 2006; 67: 973-979.

Light 1984  
Light RJ, Pillemer DB. Summing Up. The Science of Reviewing Research (1). Cambridge (MA): Harvard University Press, 1984.

Macaskill 2001  
Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine 2001; 20: 641-654.

Mahoney 1977  
Mahoney MJ. Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research 1977; 1: 161-175.

Mandel 1987  
Mandel EH, Rockette HE, Bluestone CD, Paradise JL, Nozza RJ. Efficacy of amoxicillin with and without decongestant-antihistamine for otitis media with effusion in children. New England Journal of Medicine 1987; 316: 432-437.

McAuley 2000  
McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? The Lancet 2000; 356: 1228-1231.

Melander 2003  
Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B. Evidence b(i)ased medicine – selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ 2003; 326: 1171-1173.

Moher 1996  
Moher D, Fortin P, Jadad AR, Jni P, Klassen T, Le Lorier J, Liberati A, Linde K, Penna A. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. The Lancet 1996; 347: 363-366.

Moher 2000  
Moher D, Pham B, Klassen TP, Schulz KF, Berlin JA, Jadad AR, Liberati A. What contributions do languages other than English make on the results of meta-analyses? Journal of Clinical Epidemiology 2000; 53: 964-972.

Moher 2003  
Moher D, Pham B, Lawson ML, Klassen TP. The inclusion of reports of randomised trials published in languages other than English in systematic reviews. Health Technology Assessment 2003; 7: 1-90.

Moher 2007  
Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Medicine 2007; 4: e78.

Moscati 1994  
Moscati R, Jehle D, Ellis D, Fiorello A, Landi M. Positive-outcome bias: comparison of emergency medicine and general medicine literatures. Academic Emergency Medicine 1994; 1: 267-271.

Olson 2002  
Olson CM, Rennie D, Cook D, Dickersin K, Flanagin A, Hogan JW, Zhu Q, Reiling J, Pace B. Publication bias in editorial decision making. JAMA 2002; 287: 2825-2828.

Orwin 1983  
Orwin RG. A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics 1983; 8: 157-159.

Peters 1982  
Peters DP, Ceci SJ. Peer review practices of psychology journals: The fate of published articles, submitted again. Behavioral and Brain Sciences 1982; 5: 187-255.

Peters 2006  
Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Comparison of two methods to detect publication bias in meta-analysis. JAMA 2006; 295: 676-680.

Peters 2007  
Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Statistics in Medicine 2007; 26: 4544-4562.

Peters 2008  
Peters J, Sutton AJ, Jones DR, Abrams KR, Rushton L. The contour enhanced funnel plot: an aid to interpreting funnel asymmetry.
Journal of Clinical Epidemiology (in press, 2008).

Pham 2005  
Pham B, Klassen TP, Lawson ML, Moher D. Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary. Journal of Clinical Epidemiology 2005; 58: 769-776.

Pittler 2000  
Pittler MH, Abbot NC, Harkness EF, Ernst E. Location bias in controlled clinical trials of complementary/alternative therapies. Journal of Clinical Epidemiology 2000; 53: 485-489.

Pocock 1987  
Pocock S, Hughes MD, Lee RJ. Statistical problems in the reporting of clinical trials. A survey of three medical journals. New England Journal of Medicine 1987; 317: 426-432.

Poole 1999  
Poole C, Greenland S. Random-effects meta-analyses are not always conservative. American Journal of Epidemiology 1999; 150: 469-475.

Ravnskov 1992  
Ravnskov U. Cholesterol lowering trials in coronary heart disease: frequency of citation and outcome. BMJ 1992; 305: 15-19.

Rennie 1991  
Rennie D. The Cantekin affair. JAMA 1991; 266: 3333-3337.

Rennie 1997  
Rennie D. Thyroid Storms. JAMA 1997; 277: 1238-1243.

Rosenthal 1979  
Rosenthal R. The 'file drawer problem' and tolerance for null results. Psychological Bulletin 1979; 86: 638-641.

Rücker 2008  
Rücker G, Schwarzer G, Carpenter J. Arcsine test for publication bias in meta-analyses with binary outcomes. Statistics in Medicine 2008; 27: 746-763.

Sampson 2003  
Sampson M, Barrowman NJ, Moher D, Klassen TP, Pham B, Platt R, St JP, Viola R, Raina P. Should meta-analysts search Embase in addition to Medline? Journal of Clinical Epidemiology 2003; 56: 943-955.

Scherer 2007  
Scherer RW, Langenberg P, von Elm E. Full publication of results initially presented in abstracts. Cochrane Database of Systematic Reviews 2007, Issue 2. Art No: MR000005.

Schulz 1995  
Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408-412.

Schwarzer 2007  
Schwarzer G, Antes G, Schumacher M. A test for publication bias in meta-analysis with sparse binary data. Statistics in Medicine 2007; 26: 721-733.

Simes 1987  
Simes RJ. Confronting publication bias: a cohort design for meta-analysis. Statistics in Medicine 1987; 6: 11-29.

Smith 1999  
Smith R. What is publication? A continuum. BMJ 1999; 318: 142.

Sterling 1959  
Sterling TD. Publication decisions and their possible effects on inferences drawn from tests of significance – or vice versa. Journal of the American Statistical Association 1959; 54: 30-34.

Sterling 1995  
Sterling TD, Rosenbaum WL, Weinkam JJ. Publication decisions revisted: The effect of the outcome of statistical tests on the decision to publish and vice versa. American Statatistician 1995; 49: 108-112.

Stern 1997  
Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ 1997; 315: 640-645.

Sterne 2000  
Sterne JAC, Gavaghan D, Egger M. Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology 2000; 53: 1119-1129.

Sterne 2001  
Sterne JAC, Egger M. Funnel plots for detecting bias in meta-analysis: Guidelines on choice of axis. Journal of Clinical Epidemiology 2001; 54: 1046-1055.

Stuck 1998  
Stuck AE, Rubenstein LZ, Wieland D. Bias in meta-analysis detected by a simple, graphical test. Asymmetry detected in funnel plot was probably due to true heterogeneity. Letter. BMJ 1998; 316: 469-471.

Tang 2000  
Tang JL, Liu JL. Misleading funnel plot for detection of bias in meta-analysis. Journal of Clinical Epidemiology 2000; 53: 477-484.

Tannock 1996  
Tannock IF. False-positive results in clinical trials: multiple significance tests and the problem of unreported comparisons. Journal of the National Cancer Institute 1996; 88: 206-207.

Taylor 1998  
Taylor SJ, Tweedie RL. Practical estimates of the effect of publication bias in meta-analysis. Australian Epidemiologist 1998; 5: 14-17.

Teo 1993  
Teo KK, Yusuf S, Furberg CD. Effects of prophylactic antiarrhythmic drug therapy in acute myocardial infarction. An overview of results from randomized controlled trials [see comments]. JAMA 1993; 270: 1589-1595.

Terrin 2003  
Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Statistics in Medicine 2003; 22: 2113-2126.

Terrin 2005  
Terrin N, Schmid CH, Lau J. In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. Journal of Clinical Epidemiology 2005; 58: 894-901.

Tetzlaff 2006  
Tetzlaff J, Moher D, Pham B, Altman D. Survey of views on including grey literature in systematic reviews.
14th Cochrane Colloquium, Dublin (Ireland), 2006.

Tramèr 1997  
Tramèr MR, Reynolds DJ, Moore RA, McQuay HJ. Impact of covert duplicate publication on meta-analysis: a case study. BMJ 1997; 315: 635-640.

Vevea 1995  
Vevea JL, Hedges LV. A general linear model for estimating effect size in the presence of publication bias. Psychometrika 1995; 60: 419-435.

Vevea 2005  
Vevea JL, Woods CM. Publication bias in research synthesis: sensitivity analysis using a priori weight functions. Psychological Methods 2005; 10: 428-443.

Vickers 1998  
Vickers A, Goyal N, Harland R, Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Controlled Clinical Trials 1998; 19: 159-166.

Villar 1997  
Villar J, Piaggio G, Carroli G, Donner A. Factors affecting the comparability of meta-analyses and largest trials results in perinatology. Journal of Clinical Epidemiology 1997; 50: 997-1002.

Weber 1998  
Weber EJ, Callaham ML, Wears RL, Barton C, Young G. Unpublished research from a medical specialty meeting: why investigators fail to publish. JAMA 1998; 280: 257-259.

Zarin 2005  
Zarin DA, Tse T, Ide NC. Trial Registration at between May and October 2005. New England Journal of Medicine 2005; 353: 2779-2787.