awaiting ae assignment bmj

Reviewing manuscripts

In this section:.

• How to peer review
• Peer Review Terms and Conditions
• The peer review process
• Guidance from our Editors
• Recognition for reviewers
• Become a reviewer

Our journals depend on our bank of reviewers to assess the quality and usefulness of the 47,000 manuscripts we receive each year. Using the menu to the left find out more about the peer review process, how to review and how to become a reviewer for BMJ.

Popular Articles

Sorry! nothing found for

How can I check the status of my submitted paper?

Modified on Fri, 27 Oct 2023 at 04:59 PM

To check the status of your submission in our system, log into your ScholarOne Manuscripts account, and click on “Author.” Under the Author Dashboard Section, click on “Submitted Manuscripts.” 

Please note that the following definitions generally apply to most journals. Each journal follows its own workflow, so some terms may not apply. Please contact the journal's editorial office for clarification.

Please see our resources on the peer review process and tips on How to Get Published .

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Let us know how can we improve this article! *

Feedback sent

We appreciate your effort and will try to fix the article

Log in using your username and password

• Search More Search for this keyword Advanced search
• Latest content
• For authors
• Browse by collection
• BMJ Journals More You are viewing from: Google Indexer

You are here

• Volume 9, Issue 2
• Analysis and reporting of adverse events in randomised controlled trials: a review
• Article Text
• Article info
• Citation Tools
• Rapid Responses
• Article metrics

• http://orcid.org/0000-0002-3634-7845 Rachel Phillips 1 ,
• Lorna Hazell 2 , 3 ,
• Odile Sauzet 4 ,
• Victoria Cornelius 1
• 1 Faculty of Medicine, School of Public Health , Imperial College London , London , UK
• 2 Clinical Research , Drug Safety Research Unit , Southampton , UK
• 3 Department of Pharmacy and Biomedical Sciences , University of Portsmouth , Portsmouth , UK
• 4 Epidemiologie & International Public Health, Faculty of Health Sciences , Universität Bielefeld , Bielefeld , Germany
• Correspondence to Miss Rachel Phillips; r.phillips{at}imperial.ac.uk

Objective To ascertain contemporary approaches to the collection, reporting and analysis of adverse events (AEs) in randomised controlled trials (RCTs) with a primary efficacy outcome.

Design A review of clinical trials of drug interventions from four high impact medical journals.

Data sources Electronic contents table of the BMJ , the Journal of the American Medical Association (JAMA) , the Lancet and the New England Journal of Medicine (NEJM) were searched for reports of original RCTs published between September 2015 and September 2016.

Methods A prepiloted checklist was used and single data extraction was performed by three reviewers with independent check of a randomly sampled subset to verify quality. We extracted data on collection methods, assessment of severity and causality, reporting criteria, analysis methods and presentation of AE data.

Results We identified 184 eligible reports ( BMJ n=3; JAMA n=38, Lancet n=62 and NEJM n=81). Sixty-two per cent reported some form of spontaneous AE collection but only 29% included details of specific prompts used to ascertain AE data. Numbers that withdrew from the trial were well reported (80%), however only 35% of these reported whether withdrawals were due to AEs. Results presented and analysis performed was predominantly on ‘patients with at least one event’ with 84% of studies ignoring repeated events. Despite a lack of power to undertake formal hypothesis testing, 47% performed such tests for binary outcomes.

Conclusions This review highlighted that the collection, reporting and analysis of AE data in clinical trials is inconsistent and RCTs as a source of safety data are underused. Areas to improve include reducing information loss when analysing at patient level and inappropriate practice of underpowered multiple hypothesis testing. Implementation of standard reporting practices could enable a more accurate synthesis of safety data and development of guidance for statistical methodology to assess causality of AEs could facilitate better statistical practice.

• randomised controlled trials
• adverse drug reactions
• systematic review
• investigational drug
• adverse events

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/ .

https://doi.org/10.1136/bmjopen-2018-024537

Statistics from Altmetric.com

Request permissions.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

This is the first review to examine and quantify the methods used for adverse event analysis in randomised controlled trials published in high impact general medical journals.

This review identifies methodological weakness that need to be addressed as well as good practice that could be adopted.

Articles included in this review were published in four of the top ranked general medical journals, therefore results are likely to be biased towards better practice.

Included articles are only for year 2015–2016 and as such may not reflect current practice.

Introduction 

The methods to analyse and report outcomes to measure benefit from randomised controlled trials (RCTs) are well developed but this progress has not been matched for adverse event (AE) outcomes. An AE is defined as ‘any untoward medical occurrence that may present during treatment with a pharmaceutical product but which does not necessarily have a causal relationship with this treatment’. 1 An adverse drug reaction (ADR) is defined as ‘a response to a drug which is noxious and unintended …’ where a causal relationship is ‘at least a reasonable possibility’. 1 2 RCTs provide an opportunity to compare rates of AEs between arms allowing causality to be evaluated. However, contemporary analysis and reporting practices are inadequate.

There are many challenges associated with analysing and reporting AEs in clinical trials. RCTs are typically designed to determine the efficacy of an intervention but are often underpowered to detect important differences in AEs between arms which may suggest an ADR. Often large numbers of AEs are reported during a study, sometimes exceeding the number of patients in the clinical trial. Performing hypothesis tests on these AEs would lead to issues of multiplicity; however, any adjustment for multiplicity would make a ‘finding untenable’. 3 4 The use of hypothesis testing may result in the medicinal product being deemed unsafe and a trial being halted too early due to a chance imbalance, or conversely deemed safe and not stopped early enough resulting in more patients than necessary suffering an ADR. 3 5 6 Unlike efficacy outcomes which are well defined and restricted in number at the planning stage of an RCT, we collect numerous, undefined AEs in RCTs. Furthermore, AE collection requires additional information to be obtained on factors such as severity, timing and duration, number of occurrences and outcome, which for our efficacy outcomes would have all been predefined.

Previous studies have examined the methods for AE collection and presentation only, and highlighted the inadequacies in AE reporting in journal articles. 7–16 In 2004, the Consolidated Standards of Reporting Trials (CONSORT) Group produced an extension to their guidelines for reporting trial results to cover the reporting of harms, however implementation of these guidelines has been shown to be poor. 10 14–17 Recently, a joint pharmaceutical/journal collaboration published practical guidance and examples on what should be reported in journal articles and how it should be displayed to ensure transparency and aid clinical interpretation. They promote the use of clinical judgement in reporting rather than mandatory guidance. 18  While this work has been undertaken there remains uncertainty about practice for reporting and presenting AE data, and in addition the analysis practice for AEs remains a neglected area for review.

The aim of this review was to evaluate contemporary practice for collection, reporting and analysis of AEs in RCTs where the primary outcome was efficacy. The aim being to identify and promote any areas of good practice, while highlighting any areas for improvement.

Search strategy

The top four general medical journals as ranked by impact factors that publish clinical trials of drug interventions were selected: the BMJ (Impact Factor 20.79), the Journal of the American Medical Association ( JAMA , IF 44.41), the Lancet (IF 47.83) and the New England Journal of Medicine ( NEJM , IF 72.41). Impact factors quoted are from 2016 to reflect the time period from which the articles were drawn. High impact journals were chosen as we would expect practice in these journals to be of high standard as they include statistical and methodological review. We limited the search to four journals after an initial scoping review revealed around 100 studies would be eligible for inclusion, which was a feasible number to review given the time and resources available and would provide a sufficient number to evaluate practice. One reviewer manually searched the electronic contents table of the journals for reports of original RCTs published between September 2015 and September 2016, inclusive. Any queries regarding eligibility were reviewed and discussed with a second reviewer.

Selection criteria

The inclusion criteria were phase II–IV RCTs of drug interventions where the primary outcome was efficacy of the intervention. We did not restrict according to number of treatment arms and included both parallel and cluster RCTs. We excluded cross-over RCTs, RCTs with adaptive randomisation, observational studies, case reports, editorials and letters. We also excluded RCTs where the intervention was not a drug product (ie, not classified as a clinical trial of an investigational medicinal product). As the study aimed to assess how the authors report and analyse AEs in studies where the primary outcome was efficacy, trials that were specifically designed to investigate safety as a primary outcome were not included.

Data extraction

Potentially eligible articles were identified based on titles and abstracts and the full text of these studies were retrieved. Supplementary material was also reviewed if readers were referred here from the main article for further results. Online supplementary table A1 lists all data items captured with guidance given to the reviewers for extraction. The items to be extracted were based on the work by Cornelius et al and the CONSORT harm extension with additional items added to capture more specific information on analysis practices. 11 17 Specifically, we focused on the following areas: how AE data were collected (mode of collection, timing) and defined (coding, attribution); how AEs were assessed in terms of severity of the event or relatedness to the medical intervention; if there was any planned AE analysis (final and interim monitoring plans and analysis populations); how events were selected for inclusion in the journal article; how summary event information was presented in the journal article and how AEs were analysed. 11 A more detailed rationale for the choice of items extracted is provided in the online supplementary material table A2 .

Supplemental material

A data extraction sheet was piloted and then single data extraction was performed by three reviewers (RP, VC and LH) with 10% independent check of a randomly sampled subset to verify quality. Queries were also informally discussed between reviewers on an ongoing basis. Where specific items were flagged for poor agreement these were re-extracted. Any queries during data extraction were shared and disagreements between reviewers were resolved through discussion.

Data analysis

The proportion of trials reporting each item, 3–4 and 8–34 in online supplementary table A1 were calculated and summary statistics (median and ranges) were calculated for items 5–7. All analyses were performed in Stata V.15. 19 A risk of bias assessment was not undertaken as this study aimed to describe best practice and not evaluate outcomes.

Patient and public involvement

This review forms part of a wider research project that was developed with input from a range of patient representatives. There were no study participants directly involved in this review but the original proposal and patient and public involvement (PPI) strategy were reviewed by service user representatives (with experience as clinical trial participants and PPI advisors) who provided advice specifically with regard to communication and dissemination to patient and public groups.

A total of 585 items were extracted twice across all three reviewers to check the quality of the data extraction. A total of 95 discrepancies were identified. This gave agreement of 84%. During this independent check several items were flagged for potential poor agreement. These items were 100% independently extracted by one author and verified. The items were: study duration; the AE collection method; timing of collection; how binary harm outcomes were summarised; whether continuous outcomes were dichotomised; if continuous outcomes were left as continuous how they were analysed.

Study characteristics

The search identified 184 eligible trial reports ( BMJ n=3; JAMA n=38, Lancet n=62 and NEJM n=81) in which a total of 496 911 participants were randomised with a median of 556 participants per trial (range 30, 205513; IQR 281, 1704). The median trial follow-up was 52 weeks (range 48 hours to 10 years; IQR 24, 104 weeks) and 93% were multicentre trials. Fifty per cent of studies had an active comparator and over 50% of trials received some element of industry funding ( table 1 ).

• View inline

Characteristics of included studies

Collection and assessment methods

Sixty-two per cent (n=114) of reports made reference to some form of passive (eg, spontaneously reported by patients) AE monitoring or collection methods. Of these, only 46.5% (53/114) or 29% of total reports included specific details (prompts, eg, questions about specific events or AEs in general, questionnaires or diaries) regarding these collection methods (online supplementary table A3 , examples 1–2). 20 21 The timing of collection was well documented (91%, 48 out of 53 reports) in the reports that included specific details about the prompts used to collect AEs. Although specific details on clinical examinations (eg, vital signs and blood pressure) and laboratory tests were not widely reported (only 57% of reports (95 out of 166 reports with clinical examinations and/or laboratory results presented) included details on the timing of such assessments), it was often clear from the results presented that participants had undergone these assessments (83% and 79% of studies reported clinical and laboratory results, respectively) ( table 2 ).

Collection, assessment and analysis methods reported by studies

Prespecified analysis

Thirty-one per cent of reports provided information on the planned analysis for AEs in the statistical analysis section of the paper and 45% prespecified a safety population (online supplementary table A3 , examples 3–4 and table 2 ). 22 23 A quarter of trials reported planned interim analysis with stopping criteria ( table 2 ), five (2.7%) of which included specific criteria on stopping for a harmful event (online supplementary table A4 ). 24–28

Selection of AEs and reporting practices

Two reports only made generic statements regarding AE data: ‘ there were no significant adverse events related to the procedure ’ and ‘ no excess in mortality or major adverse events were found…’ . Three reports made no mention of AEs throughout the manuscript. 29–33

Twenty-four (13%) trials only provided a summary of the number of AEs or serious AEs rather than listing the actual AEs that occurred. For example, ‘ Six serious adverse events occurred in the acetaminophen group and 12 in the ibuprofen group’. 34 Of these 24 trials, 10 did provide specific details of the types of events in an appendix. This means 8% of trials either did not report AEs or only included a summary ( table 3 ).

Summaries of results presented by studies

Eighty-nine per cent of trials reported a subset of all the AEs they collected. How AEs are ‘selected’ for inclusion in the article was not consistent or clear, and in 3% of studies it was impossible to discern how the authors had selected the AEs they presented for inclusion. Twenty-six per cent of reports selected events based on a frequency threshold, for example, events experienced by >x% in any group; 9% of reports used a measure of severity to select events, for example, AEs of grade 3 or higher; 23% of reports included events based on seriousness and 8% included AEs based on relatedness to treatment (percentages are not independent as the majority of reports used several different criteria for selection). Online supplementary tables A5 and A6 provide full details of selection criteria used.

We found that 41% of trials analysed AEs in participants that received at least one dose, 29% of trials used all randomised participants and 9% did not specify the analysis population ( table 3 ). Further details on analysis populations used are given in online supplementary table A7 .

Nearly 80% of trials reported the number of participants who withdrew from the trial; of these 35% (51 of 146 reports) reported whether the withdrawals were due to AEs and of these 24% (12 of 51 reports) reported the actual events that caused withdrawals. Results presented and analysis performed was predominantly on ‘patients with at least one event’ with 84% of reports providing no information on the number of events occurring. An example of how to incorporate information on number of events is presented in the study by Lind et al . 35 Forty-one per cent of trials reported information on the severity of AEs. Five per cent of trials included a report of at least one event with duration, but presenting such data is limited in the main report. The trials that did present this information did so in a variety of ways. For example, incorporating the information into the AE table with summary statistics such as the mean duration of certain events or presenting it for a subgroup of events in the footnotes of AE tables, for example, ‘ One event of non-serious squamous cell carcinoma (day 210, resolved on day 215; adalimumab treatment was not interrupted) ’. 36–38 Twenty-eight per cent of reports included information on the timing of AEs ( table 3 ).

Serious AEs were typically well documented (73%) and six reports (3%) explicitly stated that no serious events had occurred. However, for 44 reports (24%) it was not possible to discern if no serious events had occurred or whether they were simply omitted from the report. Forty-two per cent (57 of 134 reports) of reports included details on whether the events had been classified as related to the intervention ( table 3 ).

Analysis of AE outcomes

The majority of trials summarised binary outcomes using frequencies (94%) and percentages (87%). Despite a lack of power to undertake formal hypothesis testing, 47% reported p values for binary outcomes. For example, ‘ There were no between-group differences in the rate of patients with at least one adverse event (16.7% (14 patients) in the clopidogrel group vs 21.8% (19 patients) in the placebo group; difference, −5.2% (95% CI −17% to 6.6%); p=0.44)’ . However, with a total safety population of 171 such a test would have only had 13% power to detect such a difference and was therefore substantially underpowered. The conclusion that ‘ No significant increase in adverse events was observed ’ makes no reference to the 95% CI presented which indicates that the findings were in fact compatible with a 17% decrease in experiencing at least on AE as well as a near 7% increase. 39

There was a pervasive practice (59%) of categorising continuous clinical and laboratory outcomes. Of the trials that did not dichotomise continuous AE data, nearly 70% performed some form of statistical significance testing ( table 3 ). While continuous outcomes do not suffer to the same degree regarding lack of power, multiple testing is still a problem; however, no multiplicity corrections for continuous outcomes were performed.

Of the trials that performed statistical significance testing on AE data, only three made an adjustment for multiplicity of tests (all three on dichotomised outcomes). 36 40 41 Two of which used a Bonferroni correction and adjusted for the number of pairwise comparisons between each of the treatment groups for each individual event rather than the total number of significance tests performed. As such, both analyses would have still been affected by issues of multiple testing.

Twelve per cent of reports used graphs to illustrate AE data ( table 3 ). The CONSORT extension highlighted the value of graphs for summarising such data, especially for conveying information on time-to-event outcomes. 42 An example of such a plot is included in the study by Lingvay et al 43 (see supplementary eFigure2 of reference 43).

We assessed any reference to the CONSORT harm extension and found that none of the included studies mentioned it. Of the four journals included in the review, the Lancet was the only journal that made specific reference to the harm extension in their guidelines to the authors.

The safety profile of a medicinal product is established through evidence collected from several sources including clinical trials, observational studies and spontaneous reports. 44 The advantage of clinical trial data is that these provide a controlled comparison of the rate of AEs allowing causality to be evaluated but have the disadvantage that the sample size is often not large enough to detect rare ADRs.

To ensure that a useful and comprehensive picture of the safety profile is provided to all relevant parties clear reporting of AEs from clinical trials is required. Recent research has shown the quality of reporting is substandard. 7–16 The aim of this study was to review contemporary practice across four leading medical journals for AE collection, reporting and analysis practices, highlighting any areas for improvement and examples of good practice. We found that the collection, reporting and analysis of AE data in clinical trials is inconsistent and RCTs as a source of safety data are underused. Analysis of AE was often inappropriate with suboptimal practice including ignoring valuable information on repeated events and inappropriate practice of underpowered multiple hypothesis testing.

The CONSORT extension to harm was developed with the aim to improve reporting of safety data in RCTs. 42 None of the included studies referenced the CONSTORT harm extension and of the items in our review that are covered in CONSORT many were not well reported. 17 This suggests that the CONSORT extension is not being routinely adopted by the authors to aid their reporting. Most journals now request that the authors include a completed CONSORT checklist when they submit their article but we are not aware of any journal that request the CONSORT harm extension to also be submitted. Of the four journals in this review, the Lancet is the only journal that makes specific reference to the harm extension in their guidelines to the authors. The CONSORT statement contains a single item related to safety, item 19: ‘all important harms or unintended effects in each group’ should be reported. 42 This may explain why some items listed on the CONSORT extension for harm were reported by so few trials. The mandatory submission of CONSORT harms by journals may support better reporting.

We found that the method of AE collection was poorly reported. This has important implications for the type and frequency of AEs reported with ‘passive collection resulting in fewer recorded AEs’. 45 46 Where the method was given the timing of collection was typically also reported and we would recommend continuation of this practice. The frequency of AE collection has further important implications on the number of events reported. More frequent assessment and longer follow-up will result in more AEs reported. 17 It is important to consider these factors when making conclusions about the safety profile.

The method of attribution between drug and AE was another area where reporting practice was inadequate. However, the joint pharmaceutical/journal collaboration indicate that such attribution has ‘limited value’ given the ‘inherent subjectivity in such attribution’. 18

We found that formal assessments of AEs regarding stopping for emerging ADRs using statistical rules was rare. Subjective assessments of overwhelming amounts of data could easily lead to potential signals of harm being missed. There could be benefits to incorporating more objective statistical methods alongside clinical review to assist the evaluation of AE information to help better identify drug harm relationships. Graphical displays have gone some way towards aiding interpretation. 47–51

Due to space constraints in journal reports AE information is often included in the appendix. While we encourage use of appendices and supplementary material for including additional detail on AEs, we caution the authors against depositing all AE data into such documents without attempting to present a summary of the AE profile in the main article. It is important that the main report strikes a balance between efficacy and harm therefore allowing a risk-benefit assessment to be made solely from the article.

The failure to report any information on AEs restricts interpretation and prevents a risk-benefit assessment. We identified two reports that made generic summaries of the overall safety profile and it was clear in both that there had been harmful effects. However, the authors did not include any further information. Three reports contained no information leaving readers uninformed as to any additional information these studies may provide on the safety profile. Ambiguous reporting prevents building an accurate picture of the safety profile. As such profiles are developed on accumulating evidence, it is important that each study report to the same standard and information is not wasted.

We found that the selection criteria used by the authors to decide what AEs to include in the report were arbitrary and inconsistent. This will have important implications when synthesising data across studies to construct safety profiles. Authors would benefit from guidance to facilitate consistency but research in this area is lacking. Lineberry et al recommended clinically relevant events that should always be reported (deaths, serious AEs and events leading to discontinuation of intervention) and criteria that should be considered when deciding what other AEs to report, for example, interest based on the disease(s) under investigation, comorbidities of the study population, intervention mechanism, trial duration. 18 Standard outcomes for a drug class would be one potential solution to avoid issues of inconsistency suggested by Cornelius et al . 11

CONSORT recommend that AE analyses should be performed on the intention-to-treat (ITT) population to maintain the random assignment. 17 However, it is clear from our review that this population label is not always appropriately and consistently applied. There is a tendency for studies to make modifications to the ITT population. Using the ITT or modified ITT population is likely to underestimate the risk by inflating the denominator with participants who may have never received the study drug. 52 Such estimates are appropriate for health economic evaluations where estimates of the cost-effectiveness will inform policy level decisions regarding how to treat the population. However, a more appropriate population for AE analysis to inform prescriber and patient decisions may be those that receive at least one dose. It is important that the authors clearly define and specify a suitable safety analysis population and consider how this affects their conclusions.

Proxy outcomes can be used as a measure of the impact of AEs on patients. Examples include the number of withdrawals due to any reason, withdrawals due to AEs, the number of events an individual experiences, the severity of the AE and the duration. A high proportion of trials reported withdrawal for any reason and this is likely to be as a result of the CONSORT recommendations. 42 The other outcomes were not frequently reported and increasing this could facilitate interpretation. 17 This information would permit better evaluation of the impact of AEs and the tolerability of the intervention to inform patients’ and clinicians’ treatment decisions. Reporting numbers that experience at least one event only and not providing information on repeated events masks valuable information that may be important to the patient and the cost-effectiveness evaluation. For example, chronic, repeated headaches over an extended duration will have an important impact for patients compared with a single headache or headaches over a short duration but it is not possible to distinguish between these two scenarios when reported as ‘at least one event’. 18 Severity of events was also an important aspect that was often not differentiated. For example, there would be a different impact on patients’ quality-of-life with mild compared with severe nausea, which could lead to changes in dosing regimens. Displaying such information for all AEs in tables would soon become overwhelming and make interpretation difficult. Graphical approaches have been suggested as a solution to aid review. Examples of such a plot can be found in UW–Madison SDAC. 53 Online appendices and supplementary material provide more opportunity to include this important information.

For serious AEs information on the time of likely onset can be useful information to inform patient monitoring plans. For example, the documented risk of suicide and suicidal ideation within the first few weeks of starting an antidepressant allows patients and prescribers to remain alert and monitor closely for this period. Nearly a third of reports included such information and we would encourage the authors to adopt this practice.

The majority of trials in this review included a balanced report of AEs alongside benefit. However, many included generic statements regarding the safety profile such as ‘the intervention was well tolerated’ or ‘the intervention exhibited a good safety profile’ and these were frequently based on post hoc statistical tests. Guidelines caution against such tests. 18 The results of which are difficult to interpret as a lack of significance does not indicate that the intervention is safe and conversely multiple testing without adjustment will increase the number of significant differences due to chance. 54 55

Graphs are an efficient method to convey and interpret large amounts of data and can make it easier to flag potential safety signals. 50 51 53 Twelve per cent of studies included in the review used graphs to present AE data and an example of one such report is given in the study by Coovadia et al 56  (see  online supplementary eTable of reference 56).

Recommendations for consideration for immediate adoption by the clinical trial community are summarised in table 4 .

Recommendations to improve adverse event analysis and reporting in clinical trial report publications

Limitations of trials

Trials are a valuable source for high-quality AE data but compared with observational studies have smaller sample size, follow-up periods and generalisability, which restrict the ability to detect rare ADRs, ADRs with long latency and drug interactions in complex populations. The typical duration of a trial means there is often insufficient follow-up to fully characterise the safety profile as it provides limited information on long-term exposure. Stringent inclusion criteria restrict the population the intervention is assessed in and so limited information on drug interactions is obtained. 5

Limitations of this study

Articles included in this review were published in four of the top ranked medical journals, therefore results are likely to be biased towards better findings than we would expect if we included all RCTs. Articles are only for year 2015–2016 and as such may not reflect current practice. We also acknowledge that only completing 10% independent check of extracted data would not have removed subjectivity from the data extraction but are happy that ongoing discussion between the authors to clarify any queries would have kept this to a minimum. Despite these limitations, this review characterises what those leading the field are doing and provides some examples of good practice that could be adopted.

Conclusions and recommendations for future work

RCTs are a valuable source of information when establishing the safety profile of medicinal products. Our review has demonstrated that data are not being fully used. Analysis of AE data is frequently inappropriate and RCT reports published over a recent period in high impact general medical journals often provide insufficient and inconsistent information to allow a comprehensive summary of the safety profile to be established.

This research has identified two areas that would benefit from future research: (i) improving the consistency of reporting important AE outcomes across trials to facilitate comparison and synthesis. This is in line with work from the COMET Initiative group ( http://www.comet-initiative.org/ ) and the development of CORE safety outcomes by drug class could be considered. 7  (ii) Evaluation of methods to analyse AEs in RCTs.

• Edwards IR ,
• 2. ↵ The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) . ICH Harmonised Tripartite Guideline E2A Clinical Safety Data Management: Definitions and Standards for Expedited Reporting . 1994 .
• Jiang Q , et al
• 4. ↵ Food and Drug Administration . Attachment B: clinical safety review of an NDA or BLA of the good review practice . Clinical Reveiw Template 2010 .
• Ioannidis JP ,
• Contopoulos-Ioannidis DG
• Edwards JE ,
• McQuay HJ ,
• Moore RA , et al
• Boutron I ,
• Ahmad N , et al
• Cornelius VR ,
• Williams JE , et al
• Griebeler IH ,
• Dal Pizzol TS
• Katz NP , et al
• Maillet D ,
• Gan HK , et al
• Gøtzsche PC , et al
• Lineberry N ,
• Berlin JA ,
• Mansi B , et al
• 19. ↵ StataCorp . Stata Statistical Software: Release 15 . College Station, TX : StataCorp LLC , 2017 .
• Litonjua AA ,
• Laranjo N , et al
• Miller PD ,
• Hattersley G ,
• Riis BJ , et al
• Libman IM ,
• Miller KM ,
• DiMeglio LA , et al
• Glassman AR ,
• Jampol LM , et al
• Forbes A , et al
• Billings FT ,
• Hendricks PA ,
• Schildcrout JS , et al
• Beardsley J ,
• Wolbers M ,
• Kibengo FM , et al
• Carter RE ,
• Park PK , et al
• Little L , et al
• Jackson A ,
• Kearns R , et al
• Bangalore S ,
• Seth A , et al
• McCauley M , et al
• Isanaka S ,
• Langendorf C ,
• Berthé F , et al
• Natalucci G ,
• Koller B , et al
• Sheehan WJ ,
• Mauger DT ,
• Paul IM , et al
• Hirsch IB ,
• Tuomilehto J , et al
• Lincoff AM ,
• Povsic TJ , et al
• Koscielny S ,
• Bosq J , et al
• Nguyen QD ,
• Merrill PT ,
• Jaffe GJ , et al
• Rodés-Cabau J ,
• Horlick E ,
• Ibrahim R , et al
• Ruperto N ,
• Pistorio A ,
• Oliveira S , et al
• Whitehead KJ ,
• Sautter NB ,
• McWilliams JP , et al
• Schulz KF ,
• Altman DG ,
• Moher D , et al
• Lingvay I ,
• Pérez Manghi F ,
• García-Hernández P , et al
• Peacock J , et al
• Stephens MD ,
• Talbot JC ,
• Routledge PA
• Bechhofer R
• Rhorer J , et al
• Heiberger RM ,
• Wolfinger RD ,
• 53. ↵ UW–Madison SDAC . Sample closed session DMC report . 2016 https://www.biostat.wisc.edu/sites/default/files/Sample_Report_Closed_20160920.pdf ( Accessed 26 Mar 2018 ).
• Jonville-Béra AP ,
• Giraudeau B ,
• Autret-Leca E
• Coovadia A ,
• Abrams EJ ,
• Strehlau R , et al

Contributors RP conceived the idea for this review, conducted the search, carried out data extraction and analysis and wrote the manuscript. VC conceived the idea for the review, performed data extraction, critical revision of the manuscript and supervised the project. LH performed data extraction and critical revision of the manuscript. OS performed critical revision of the manuscript.

Funding Rachel Phillips is funded by a National Institute for Health Research (NIHR) Doctoral Fellowship.

Disclaimer This paper presents independent research funded by the National Institute for Health Research (NIHR). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Competing interests None declared.

Provenance and peer review Not commissioned; externally peer reviewed.

Data sharing statement Data are available upon reasonable request made to the corresponding author.

Patient consent for publication Not required.

Read the full text or download the PDF:

Current time by city

For example, New York

Current time by country

For example, Japan

Time difference

For example, London

For example, Dubai

Coordinates

For example, Hong Kong

For example, Delhi

For example, Sydney

Geographic coordinates of Bratsk, Irkutsk Oblast, Russia

City coordinates

Coordinates of Bratsk in decimal degrees

Coordinates of bratsk in degrees and decimal minutes, utm coordinates of bratsk, geographic coordinate systems.

WGS 84 coordinate reference system is the latest revision of the World Geodetic System, which is used in mapping and navigation, including GPS satellite navigation system (the Global Positioning System).

Geographic coordinates (latitude and longitude) define a position on the Earth’s surface. Coordinates are angular units. The canonical form of latitude and longitude representation uses degrees (°), minutes (′), and seconds (″). GPS systems widely use coordinates in degrees and decimal minutes, or in decimal degrees.

Latitude varies from −90° to 90°. The latitude of the Equator is 0°; the latitude of the South Pole is −90°; the latitude of the North Pole is 90°. Positive latitude values correspond to the geographic locations north of the Equator (abbrev. N). Negative latitude values correspond to the geographic locations south of the Equator (abbrev. S).

Longitude is counted from the prime meridian ( IERS Reference Meridian for WGS 84) and varies from −180° to 180°. Positive longitude values correspond to the geographic locations east of the prime meridian (abbrev. E). Negative longitude values correspond to the geographic locations west of the prime meridian (abbrev. W).

UTM or Universal Transverse Mercator coordinate system divides the Earth’s surface into 60 longitudinal zones. The coordinates of a location within each zone are defined as a planar coordinate pair related to the intersection of the equator and the zone’s central meridian, and measured in meters.

Elevation above sea level is a measure of a geographic location’s height. We are using the global digital elevation model GTOPO30 .

Bratsk , Irkutsk Oblast, Russia

Persistent organic pollutants in the natural environments of the city of Bratsk (Irkutsk Oblast): Levels and risk assessment

• Degradation, Rehabilitation, and Conservation of Soils
• Published: 06 November 2014
• Volume 47 , pages 1144–1151, ( 2014 )

Cite this article

• E. A. Mamontova 1 ,
• E. N. Tarasova 1 &
• A. A. Mamontov 1  

74 Accesses

3 Citations

Explore all metrics

The contents of persistent organic pollutants (POPs)—polychlorinated biphenyls (PCBs) and organochlorine pesticides (OCPs)—in the natural environments of an industrial city (Bratsk) of Irkutsk oblast have been studied. Features of the spatial and seasonal distribution of the PCBs and OCPs in the soils and the atmospheric air have been revealed. The structure of the homological and congeneric composition of the PCBs in the soils and the atmospheric air has been shown. Parameters of the carcinogenic and noncarcinogenic risks for human health from the impact of the PCBs and OCPs present in the soils and the atmospheric air have been determined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Characteristics of Plastic Pollution in the Environment: A Review

Environmental pollution in africa.

Anthropogenic Pollution and Ecological Risk in Urban Sediments: Assessing Heavy Metal and Organic Contamination in the Saida Watershed, North-Western Algeria

Atlas. The Irkutsk Region: Ecological Conditions of the Development (Moscow, Irkutsk, 2004) [in Russian].

Ts. I. Bobovnikova, F. I. Khakimov, A. Yu. Popova, D. B. Orlinskii, A. S. Kerzhentsev, N. R. Deeva, I. V. Priputina, L. B. Alekseeva, G. V. Chernik, G. A. Pleskatchevskaya, A. V. Shalanda, “The impact of the condenser plant on the environmental contamination of Serpukhov with polychlorinated biphenyls,” in Polychlorinated Byphenyls. Supertoxicants of the XXI Century , No. 5 (VINITI, Moscow, 2000), pp. 87–103 [in Russian].

Google Scholar  

E. S. Brodskii, A. A. Shelepchikov, D. B. Feshin, E. S. Efimenko, G. I. Agapkina, “Distribution of polychlorinated biphenyls’ congeners in soils of Moscow,” Vestn. Mosk. Univ., Ser. 17: Pochvoved., No 2, 35–40 (2012).

R. V. Galiulin and R. A. Galiulina, “Ecogeochemical assessment of the “reprints” of persistent organochlorine pesticides in the soil-surface water system,” Agrokhimiya, No. 1, 52–56 (2008).

M. I. Gerasimova, M. N. Stroganova, N. V. Mozharova, and T. V. Prokof’eva, Anthropogenic Soils: Genesis, Geography, and Reclamation (Oikumena, Smolensk, 2003) [in Russian].

Hygienic Norms for Concentrations of Pesticides in the Environmental Objects (Fed. Ts. Gosprirodnadzor, Minzdrav RF, Moscow, 2003) [in Russian].

State Report on the Environmental Protection and State of the Environment of Irkutsk Oblast in 2003 (Oblmashinform, Irkutsk, 2004) [in Russian].

State Report on the Environmental Protection in Irkutsk Oblast in 2011 (Forvard, Irkutsk, 2012) [in Russian].

State Report on the Environmental Protection and State of the Environment of Irkutsk Oblast in 2011 (Min. prirod. resurs. RF, Moscow, 2012) [in Russian].

State Report on the Ecological Situation in Irkutsk Oblast in 1993 (VS AGP, Irkutsk, 1994) [in Russian].

L. P. Ignat’eva, Extended Abstract of Doctoral Dissertation in Biology (Irkutsk, 1997).

Climate of Bratsk , Ed. by Ts. A. Shver and V. N. Babichenko (Gidrometeoizdat, Leningrad, 1985) [in Russian].

A. V. Konoplev, V. A. Nikitin, D. P. Samsonov, G. V. Chernik, A. M. Rychkov, “Polychlorinated biphenyls and organochlorine pesticides in the atmosphere of Russian Arctic in the Far East,” Meteorol. Gidrol., No. 7, 38–44 (2005).

Control of the Chemical and Biological Parameters of the Environment (Ekol. Ts. Soyuz, St. Petersburg, 1998) [in Russian].

T. I. Kukharchyk, S. V. Kakareka, V. S. Khomich, P. V. Kurman, E. N. Voropai, “Polychlorinated biphenyls in soils of Belarus: sources, contamination levels, and problems of study,” Eur. Soil Sci. 40 (5), 485–492 (2007).

Article   Google Scholar  

E. A. Mamontova, E. N. Tarasova, M. I. Kuz’min, B. Z. Borisov, A. P. Bul’ban, S. I. Levshina, E. V. Lepskaya, O. D. Tregubov, S. G. Yurchenko, A. A. Mamontov, “Distribution of persistent organic pollutants in the soil-atmosphere system of Siberia and the Far East,” Geoekologiya, No. 4, 328–338 (2014).

E. A. Mamontova, E. N. Tarasova, A. A. Mamontov, M. I. Kuz’min, B. Z. Borisov, A. P. Bul’ban, S. G. Yurchenko, E. V. Lepskaya, S. I. Levshina, O. D. Tregubov, “Persistent organic pollutants in atmospheric air of some territories of Siberia and the Far East of Russia,” Geogr. Prir. Resur., No. 4, 40–47 (2012).

State of the Environment and Environmental Pollution in the Russian Federation in 2008 , Ed. by Yu. A. Izrael (Rosgidromet, Moscow, 2009) [in Russian].

State of the Environment and Environmental Pollution in the Russian Federation in 2009 , Ed. by Yu. A. Izrael, G. M. Chernogaeva, V. I. Egorov, A. S. Zelenov, and Yu. V. Peshkov (Rosgidromet, Moscow, 2009) [in Russian].

Polychlorinated Biphenyls in the Baikal Region: Sources, Distant Transfer, and Risk Assessment (Izd. Inst. Geogr. SO RAN, Irkutsk, 2005) [in Russian].

Guidelines for Human Health Risk Assessment upon the Impact of Chemical Contaminants (Minzdrav Rossii, Moscow, 2004) [in Russian].

M. F. Savchenkov and L. P. Ignat’eva, Hygiene of the Application of Pesticides in Siberia (Izd. Irkutsk Gos. Univ., Irkutsk, 1994) [in Russian].

http://chm.pops.int/TheConvention/Overview/tabid/3351/Default.aspx .

N. N. Surnina, Yu. A. Anokhin, V. P. Kiryukhin, and A. V. Mitroshkov, “Atmospheric contamination in the Angara and Baikal regions with polychlorinated biphenyls,” in Monitoring of Lake Baikal (Gidrometeoizdat, Leningrad, 1991), pp. 54–59 [in Russian].

E. N. Tarasova, E. A. Mamontova, A. V. Goreglyad, L. L. Tkachenko, A. A. Mamontov, “Persistent organic pollutants in atmospheric air of the northern Khubsugul region,” in Lake Ecosystems: Biological Processes, Anthropogenic Transformation, and Water Quality (Izd. Ts. BGU, Minsk, 2011), pp. 186–187 [in Russian].

Yu. A. Treger, “Persistent organic pollutants. problems and solutions,” Vestn. MITKhT 6 (5), 87–97 (2011).

http://irkutskstat.gks.ru/wps/wcm/connect/rosstat_ts/irkutskstat/ru/statistics/population/ .

I. Ya. Shakhtamirov and Z. K. Amirova, “Atmospheric air and soil cover contamination with persistent organic pollutants in the residential zone of Groznyi,” Ekolog. Urbanizir. Territ., No. 4, 88–93 (2011).

A. A. Shelepchikov, E. S. Brodskii, D. B. Feshin, V. G. Zhil’nikov, E. Ya. Mir-Kadyrova, S. P. Balashova, “Polychlorinated dibenzo-p-dioxins, dibenzofurans, and biphenyls in soils of Moscow,” Eur. Soil Sci. 44 (3), 286–296 (2011).

R. E. Bailey, “Global hexachlorobenzen emissions,” Chemosphere 43 , 167–182 (2001).

Canadian Council of Ministers of the Environment, Canadian Environmental Quality Guidelines (Winnipeg, 1999).

L. Dusek and M. Tesarova, “Influence of polychlorinated biphenyls on microbial biomass and its activity in grassland soil,” Biol. Fertil. Soil, No. 22, 243–247 (1996).

J. N. Hogarh, N. Seike, Y. Kobara, A. Habib, J.-J. Nam, J. -S. Lee, Q. Li, X. Liu, J. Li, G. Zhang, S. Masunaga, “Passive air monitoring of PCBs and PCNs across East Asia: A comprehensive congener evaluation for source characterization,” Chemosphere 86 , 718–726 (2012).

V. Ivanov and E. Sandell, “Characterization of polychlorinated biphenyl isomers in sovol and trichlorodiphenyl formulations by high-resolution gas chromatography with electron capture detection and high-resolution gas chromatography — mass spectrometry techniques,” Environ. Sci. Technol. 26 , 2012–2017 (1992).

A. A. Mamontov, E. A. Mamontova, E. N. Tarasova, M. I. Kuzmin, M. S. McLachlan, “Persistent organic pollutants in soil and snow from the Lake Baikal region,” Organohalog. Compounds 66 , 1327–1332 (2004).

E. A. Mamontova, E. N. Tarasova, and M. S. McLachlan, “Tracing the sources of PCDD/Fs and PCBs to Lake Baikal,” Environ. Sci. Technol. 34 (5), 741–747 (2000).

E. A. Mamontova, M. I. Kuzmin, E. N. Tarasova, and M. Yu. Khomutova, “The investigation of PCBs and OCPs in air in the Irkutsk region (Russia) using passive air sampling,” Vestn. KazNU. Ser. Khimich., No. 4, 209–213 (2010).

E. A. Mamontova, A. A. Mamontov, E. N. Tarasova, M. I. Kuzmin, D. Ganchimeg, M. Yu. Khomutova, O. Gombosuren, and E. Ganjuurjav, “Polychlorinated biphenyls in surface soil in urban and background areas of Mongolia,” Environ. Pollut. 182 , 424–429 (2013).

S. N. Meijer, W. A. Ockenden, A. Sweetman, K. Brei- vik, J. O. Grimalt, K. C. Jones, “Global distribution and budget of PCBs and HCBs in background surface soils: implication for sources and environmental processes,” Environ. Sci. Technol. 37 , 667–672 (2003).

K. Pozo, T. Harner, S. Lee, F. Wania, D. C. G. Muir, K. C. Jones, “Seasonally resolved concentrations of persistent organic pollutants in the global atmosphere from the first year of the GAPS study,” Environ. Sci. Technol. 43 , 796–803 (2009).

M. Shoeib and T. Harner, “Characterization and comparison of three passive air samplers for persistent organic pollutants,” Environ. Sci. Technol. 36 , 4142–4151 (2002).

T. Takasuga, K. Senthilkumar, T. Matsumura, K. Shiozaki, S. Sakai, “Isotope dilution analysis of polychlorinated biphenyls (PCBs) in transformer oil and global commercial PCB formulations by high resolution gas chromatography-high resolution mass spectrometry,” Chemosphere, No. 62, 469–484 (2006).

S. Tao, W. Liu, Y. Li, Y. Yang, Q. Zuo, B. Li, J. Cao, “Organochlorine pesticides contaminated surface soil as reemission source in the Haihe Plain, China,” Environ. Sci. Technol. 42 , 8395–8400 (2008).

X. Zhao, M. Zheng, B. Zhang, Q. Zhang, W. Liu, “Evidence for the transfer of polychlorinated biphenyls, polychlorinated dibenzo-p-dioxins, and polychlorinated dibenzofurans from soil into biota,” Sci. Total Environ. 368 (2–3), 744–752 (2006).

Download references

Author information

Authors and affiliations.

Vinogradov Institute of Geochemistry, Siberian Branch, Russian Academy of Sciences, ul. Favorskogo 1a, Irkutsk, 664033, Russia

E. A. Mamontova, E. N. Tarasova & A. A. Mamontov

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to E. A. Mamontova .

Additional information

Original Russian Text © E.A. Mamontova, E.N. Tarasova, A.A. Mamontov, 2014, published in Pochvovedenie, 2014, No. 11, pp. 1356–1364.

Rights and permissions

Reprints and permissions

About this article

Mamontova, E.A., Tarasova, E.N. & Mamontov, A.A. Persistent organic pollutants in the natural environments of the city of Bratsk (Irkutsk Oblast): Levels and risk assessment. Eurasian Soil Sc. 47 , 1144–1151 (2014). https://doi.org/10.1134/S1064229314110076

Download citation

Received : 09 January 2014

Published : 06 November 2014

Issue Date : November 2014

DOI : https://doi.org/10.1134/S1064229314110076

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• polychlorinated biphenyls
• organochlorine pesticides
• Find a journal
• Publish with us
• Track your research

Contact details

Head office.

17 Ul. Marata, St. Petersburg 191025, Russian Federation

Records Management Department

[email protected]

PR Department

[email protected]

HR Department

[email protected]

Procurement

[email protected]

Sales Wood Chemicals

[email protected]

[email protected]

[email protected]

[email protected]

[email protected]

[email protected]

Sales Round Wood

[email protected]

Branch of Ilim Group

[email protected]

Koryazhma Forest

The ust-ilimsk branch of ilim group.

[email protected]

The Branch of Ilim Group in the Ust-Ilimsk District

The bratsk branch of ilim group.

[email protected]

The Branch of Ilim Group in the Bratsk District

[email protected]

Ilim Gofra Dmitrov

[email protected]