3,671
Views
6
CrossRef citations to date
0
Altmetric
Original Article

Prodromal signs and symptoms of serious infections with tocilizumab treatment for rheumatoid arthritis: Text mining of the Japanese postmarketing adverse event-reporting database

, , , , , & show all
Pages 435-443 | Received 10 May 2017, Accepted 03 Aug 2017, Published online: 07 Sep 2017

Abstract

Objective: To search for signs and symptoms before serious infection (SI) occurs in tocilizumab (TCZ)-treated rheumatoid arthritis (RA) patients.

Methods: Individual case safety reports, including structured (age, sex, adverse event [AE]) and unstructured (clinical narratives) data, were analyzed by automated text mining from a Japanese post-marketing AE-reporting database (16 April 2008–10 April 2015) assuming the following: treated in Japan; TCZ RA treatment; ≥1 SI; unable to exclude causality between TCZ and SIs.

Results: The database included 7653 RA patients; 1221 reports met four criteria, encompassing 1591 SIs. Frequent SIs were pneumonia (15.9%), cellulitis (9.9%), and sepsis (5.0%). Reports for 782 patients included SI onset date; 60.7% of patients had signs/symptoms ≤28 days before SI diagnosis, 32.7% had signs/symptoms with date unidentified, 1.7% were asymptomatic, and 4.9% had unknown signs/symptoms. The most frequent signs/symptoms were for skin (swelling and pain) and respiratory (cough and pyrexia) infections. Among 68 patients who had normal laboratory results for C-reactive protein, body temperature, and white blood cell count, 94.1% had signs or symptoms of infection.

Conclusion: This study identified prodromal signs and symptoms of SIs in RA patients receiving TCZ. Data mining clinical narratives from post-marketing AE databases may be beneficial in characterizing SIs.

Introduction

Current treatment guidelines for rheumatoid arthritis (RA) recommend the use of conventional synthetic disease-modifying antirheumatic drugs (csDMARDs)—methotrexate in the first instance—and biological DMARDs (bDMARDs) with an aim to achieving remission or low disease activity [Citation1–3].

Tocilizumab (TCZ), a recombinant humanized anti-interleukin-6 (IL-6) receptor monoclonal antibody, has been approved for the treatment of patients with RA in more than 100 countries. The efficacy of TCZ, which has a well-established safety profile, as monotherapy or in combination with csDMARDs has been demonstrated in patients with RA who have inadequate responses to csDMARDs. Data from clinical [Citation4–6] and post-marketing surveillance studies [Citation7] of TCZ indicate that infections are the most frequent adverse events (AEs) and serious AEs (SAEs) associated with TCZ therapy. TCZ exerts its therapeutic effects through inhibition of IL-6 signaling, which in turn suppresses the production of proinflammatory acute-phase reactants, including C-reactive protein (CRP) [Citation8,Citation9]. Therefore, there is concern that early signs and symptoms of infection, such as elevated CRP and fever, may not be detected in patients receiving TCZ, potentially allowing the infections to become serious. This highlights the need for identifying signs and symptoms that occur before worsening of an infection to allow for early and adequate safety management.

Electronic medical records and post-marketing AE-reporting databases that contain information on adverse drug reactions (ADRs) are a vast source of valuable patient information [Citation10]. Post-marketing AE-reporting databases are among the fundamental resources in pharmacovigilance [Citation11]. Previous reports, including some in patients treated with TCZ, have focused on structured data elements, such as age, sex, and onset of disease [Citation7,Citation12,Citation13]. However, other recent analyses suggest that clinical narratives may also be useful for obtaining important clinical insights [Citation14–18]. This approach may involve text mining, which enables efficient analysis of unstructured data elements from clinical narratives [Citation15,Citation19]. Indeed, text mining of clinical sources, among them electronic health care data and clinical notes and narratives, has been used in recent large-scale analyses of drug safety and diseases [Citation16,Citation17,Citation20], including those in patients with RA [Citation21].

Text mining electronic medical records has been used successfully to obtain insights from clinical narratives, such as enhancing opportunities for the early detection of RA [Citation16,Citation21]. However, this approach may be time consuming and costly because of practical issues requiring collaboration between several hospitals and integration of their data formats [Citation21,Citation22] to acquire enough patient data for analysis. In addition, it is customary to report diagnostic terms (e.g. pneumonia) rather than symptomatic terms (e.g. cough, pain, fever) when identifying AEs, resulting in a large amount of unused textual data regarding the signs and symptoms of AEs.

The analysis reported here used data from the post-marketing AE-reporting database maintained by Chugai Pharmaceutical Co., Ltd. (Tokyo, Japan), which compiles post-marketing AE data from locations throughout Japan and stores them in a consistent format, including unstructured clinical narratives reported with TCZ treatment. A retrospective analysis was performed by text mining data from the post-marketing AE-reporting database to identify symptoms before the development of a serious infection in TCZ-treated patients. To our knowledge, this is the first report of text mining of clinical narratives using a post-marketing AE-reporting database.

Methods

Data source

Data for this analysis were compiled from an AE-reporting database maintained by Chugai Pharmaceutical Co., Ltd., that includes all individual case safety reports (ICSRs) for the manufacturer’s authorized products. These ICSRs contain structured (age, sex, concomitant drugs, AE term, laboratory test values) and unstructured (clinical narratives) data from spontaneous reports of ADRs, post-marketing drug use surveillance, and published reports from the literature. All AEs and comorbidities were coded in accordance with the International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use guidelines and the Medical Dictionary for Regulatory Activities (MedDRA, McLean, VA) (version 17.1.) [Citation23] by predefined system organ class (SOC) and preferred term (PT). This study was registered at UMIN Clinical Trials Registry (UMIN000024071). The database used in this study is anonymously managed and contains no personal information. Ethics review was completed by the ethical review board of the Japanese Association for the Promotion of State-of-the-Art in Medicine (JAPSAM) on 19 April 2016; no ethical issues related to the study were identified.

Definition of serious infections

The analysis set included TCZ ICSRs, first reported between 16 April 2008 (the date TCZ was first approved for the treatment of patients with RA in Japan) and 10 April 2015, and it met all four of the following conditions: (i) the patient was treated in Japan; (ii) TCZ was administered to treat RA; (iii) the case report contained at least one reported AE of a serious infection following treatment with TCZ; and (iv) a causal relationship between TCZ and the serious infection could not be ruled out. This last condition was defined as follows: included in the ‘infections and infestations’ SOC in MedDRA [Citation23]; MedDRA judged to be serious by the reporting health care practitioner, the manufacturer, or both; a relationship between TCZ and the serious infection was determined by the reporting health care professional, the manufacturer, or both. The number of patients with serious infections and the proportion of serious infections were determined based on the site where the infection had its onset and on the MedDRA PT. Subsequent analyses were performed in patients for whom the date the infection became serious could be identified from narratives. Infections were considered to be serious on the day the patient was admitted to the hospital or transported to the hospital.

Assessments: signs and symptoms of serious infections

The analysis included investigation of clinical findings and laboratory data that could be signs and symptoms of infections becoming serious.

Signs and symptoms of serious infection were defined as any clinical symptoms that occurred within 28 days before the onset of a serious infection. Using text mining, we extracted possible signs and symptomatic terms from unstructured narratives. These possible signs and symptoms of serious infection for each site at which serious infection had its onset were coded by MedDRA PTs and reviewed to determine whether they were already generally known as signs or symptoms of infection (i.e. previously reported in medical textbooks, such as The Merck Manual of Diagnosis and Therapy [Citation24]) or whether they were newly identified symptoms. If they were newly identified, they were assessed by three of the authors (reviewed by Y.A. and S.T. and confirmed by T.A.). The number of days from the first occurrence of a sign or symptom until an infection became serious was calculated for each site of serious infection and by a sign or symptom; if any part of a date (day, month, or year) was missing, the data were excluded.

Relationships between laboratory data and infections becoming serious were explored based on different thresholds of CRP levels (<1.0 mg/dL/≥1.0 mg/dL), white blood cell (WBC) count (<10,000 µL/≥10,000 µL), and body temperature (<37.0 °C/≥37.0 °C to <38 °C/≥38.0 °C) using laboratory data nearest to the day the infection became serious and measured within 7 days; again, if any part of a date (day, month, or year) was missing, the data were excluded. Also excluded from the analysis as outliers were values outside the body temperature range of 34–42 °C, WBC count within the two-sided 95% distribution range, and CRP level outside the upper bound of the one-sided 95% distribution range.

Statistical analyses

Patient characteristics and data regarding serious infections were summarized using descriptive statistics. Unstructured narratives were analyzed with the use of a text mining approach to extract signs and symptoms of serious infection (within 28 days of an infection becoming serious) from patient narratives in the database of patients who developed serious infections, and symptoms were converted to structured data (see Supplementary Appendix A1 for the structuring procedure).

Text mining was performed using VextMiner version 9.0 (Vext Inc., Tokyo, Japan), and data processing and analysis were performed using SAS 9.4 (SAS Institute Inc., Cary, NC). Coding was performed to standardize terms in ICSRs using MedDRA version 17.1.

Results

Patient characteristics

A total of 7653 patients with RA were identified from the AE-reporting database, of whom 1221 met the four criteria for serious infection and 782 had known onset dates of serious infections (). Patient characteristics were similar among the overall RA population, patients who developed serious infections, and patients with known onset dates of serious infections (). There were slight differences in age; patients in the total RA population were younger than those who developed serious infections and those who had known onset dates of serious infections (mean age: 60.0 versus 63.4 and 63.2 years, respectively). Glucocorticoid use was reported by approximately one-third (399/1221; 32.7%) of patients who developed serious infections and those with known onset dates of serious infections (300/782; 38.4%) (). Less than 5% of patients who developed serious infections had previously received bDMARDs (53/1221; 4.3%); the most common previous bDMARDs reported were etanercept [received by 20 patients (1.6%)] and adalimumab [received by 17 patients (1.4%)]. Concomitant csDMARD use was reported by approximately two-thirds (771/1221; 63.1%) of patients who developed serious infections and patients with known onset dates of serious infections (547/782; 69.9%). The most common concomitant csDMARD reported was methotrexate, which was received by 574 patients (55.4%) ().

Figure 1. Data disposition used to analyze reports of serious infection. aSymptoms within 28 days before the date of onset of serious infection. RA: rheumatoid arthritis; SI: serious infection.

Figure 1. Data disposition used to analyze reports of serious infection. aSymptoms within 28 days before the date of onset of serious infection. RA: rheumatoid arthritis; SI: serious infection.

Table 1. Patient characteristics.

Serious infection

In total, 1591 serious infections were reported in 1221 patients. The mean (±standard deviation) number of days from the initiation of TCZ treatment to the onset of serious infection in 750 patients with available data was 318.0 (±423.0) days. Sites for the onset of serious infection were respiratory (623/1591; 39.2%), skin (329/1591; 20.7%), gastrointestinal tract (183/1591; 11.5%), sepsis (137/1591; 8.6%), urinary tract (72/1591; 4.5%), and other (247/1591; 15.5%) (). Common serious infections were pneumonia (253/1591; 15.9%), cellulitis (158/1591; 9.9%), and sepsis (80/1591; 5.0%).

Table 2. Site of onset for most frequently reportedTable Footnotea serious infections in patients who developed serious infections (N = 1221).

Signs and symptoms of serious infection

Of the 782 patients for whom the date of confirmed diagnosis of serious infection could be identified, 475 (60.7%) had signs or symptoms within 28 days before the diagnosis of serious infection, 256 patients (32.7%) had signs or symptoms but their date could not be identified, 13 patients (1.7%) had no signs or symptoms, and it was unknown whether 38 patients (4.9%) had signs or symptoms.

The most common signs and symptoms of serious infection were pyrexia, pain, cough, and swelling (). Swelling and pain were counted in large numbers regardless of the site of infection, but many other symptoms were specific to the site of serious infection (Supplementary Table S1).

Table 3. Signs and symptoms of infectionTable Footnotea that occurred in patients who developed serious infection and had known onset dates of serious infections (N = 782).

The five most commonly reported signs or symptoms of infection were most often reported in the week preceding the diagnosis of serious infection (). The median number of days from the first occurrence of signs or symptoms of serious infection to the onset of a serious infection ranged from 1 to 14 days (Supplementary Table S2). Signs and symptoms of serious infection occurred on the day the infection became serious in 475 (60.7%) of the 782 patients for whom the date of diagnosis of the infection as serious could be identified. The most common signs and symptoms that occurred on the day the infection became serious were pyrexia (138/782; 17.6%), productive cough (95/782; 12.1%), and dyspnea (77/782; 9.8%) (Supplementary Table S3).

Figure 2. Frequency of the five most common signs or symptoms of infection (A–E) according to time before diagnosis of serious infection. SD: standard deviation.

Relationship between laboratory data and serious infection

Among patients whose laboratory test results were available, similar proportions of CRP level measurements were <1.0 mg/dL (43.5%) or >1.0 mg/dL (56.5%), similar proportions of body temperature measurements were <37.0 °C (51.1%) or ≥37 °C (48.9%), and similar proportions of WBC counts were <10,000/µL (57.2%) or ≥10,000/µL (42.8%) when measured within 7 days before infections became serious (). In reports with known onset dates of serious infection, 8.7% (68/782) of patients had normal laboratory test results (CRP <1.0 mg/dL, body temperature <37.0 °C, and WBC count <10,000/µL). Among these 68 patients with normal laboratory test results, four had no signs or symptoms of serious infection and 64 had signs or symptoms of serious infection ().

Table 4. Laboratory results measured within 7 days of infections becoming serious.

Discussion

This retrospective analysis of a Japanese postmarketing AE-reporting safety database successfully used text mining to identify trends for signs and symptoms of serious infections reported within 28 days before the infections became serious.

Demographics and characteristics of patients in the AE-reporting safety database were generally similar between all RA patients and the subset who developed serious infection, except that patients who developed infection tended to be older than the total population, which might be expected given the increased risk for infection in older patients [Citation7]. It is difficult to provide an interpretation of difference in body weight between the patient groups because data were missing for more than half the patients.

The use of text mining methods in our analysis enabled automatic extraction of potential candidate signs and symptoms of serious infection from clinical narratives entered in the post-marketing AE-reporting database. In this analysis, the most common signs and symptoms indicative of an infection becoming serious were pyrexia, pain, cough, and swelling, and the most common signs and symptoms on the day the infection became serious were pyrexia, productive cough, and dyspnea. Pain was identified as a new sign or symptom for respiratory tract infections, skin infections, gastrointestinal infections, sepsis, urinary tract infections (as well as back pain), and other infections. Other newly identified signs or symptoms of infection were swelling with skin infections, sepsis, and other infections, rash with skin infections, and nausea with urinary tract infections.

Analysis of laboratory results for patients who developed serious infections suggested that laboratory test data (CRP level, body temperature, WBC count) were not associated with the development of a serious infection; however, it was considered that these measures alone may not be sufficient to identify infections likely to become serious in patients treated with TCZ. Of note, only four patients with normal laboratory test results did not have any signs or symptoms of infection, and some patients had signs and symptoms of infection despite normal laboratory test results, which meant that most patients in the analysis with normal laboratory test results had some type of sign or symptom of infection. Therefore, to prevent infections from becoming serious during TCZ treatment, it is crucial to acknowledge the signs and symptoms of infection detected in this analysis and to educate patients to contact their health care professionals should they experience any of these signs or symptoms.

To our knowledge, this is the first published report of text mining data from clinical narratives of a post-marketing AE-reporting database. Previous reports have used clinical notes and narratives, or other electronic health care data, to facilitate the early identification of drug–drug interaction signals or to determine AE co-occurrence [Citation16,Citation17]. For example, in patients with RA, annotation analysis of unstructured clinical notes and subsequent mining of the resultant annotations has been successfully used to calculate the risk for myocardial infarction in those treated with rofecoxib [Citation14]. This highlights the applicability of data mining approaches to evaluate potentially SAEs associated with drugs already on the market.

This study includes several limitations. First, the potential effect of underreporting AEs, which is an inherent limitation of post-marketing AE-reporting databases [Citation25], resulted in some misclassification of information for AEs and previous or concomitant use of drugs. In addition, the infection course and symptoms might not have been adequately reported (e.g. the treating physician might have considered symptoms to be related to infection but might not have reported them in the narrative if they were not severe; therefore, absence of a symptom in the report does not necessarily preclude its occurrence). This lack of adequate reporting has the potential to introduce a large bias. However, it might be expected that there would be less underreporting of SAEs than of non-SAEs because this analysis focused on SAEs, and physician motivation on AE reporting is expected to be higher for SAEs [Citation26]. The fact that manufacturers carefully queried reporting physicians during follow-up for SAEs could also have helped decrease the effects of underreporting. Second, the lack of comparison with patients who developed infections that did not become serious means that the signs and symptoms identified are indicative only of the development of serious infection, and a causal relationship cannot be claimed. Third, there is a need for technical improvements in text mining approaches. For example, because we considered only fragmented words rather word combinations, it was difficult to distinguish several pain-related words (e.g. abdominal pain, back pain, chest pain, pain in throat), and these words were considered as pain. As a result, frequently appearing words to describe symptoms such as pain tended to be easily identified in our analysis. Considering the use of additional text mining techniques, such as named entity recognition, may improve the quality of the results. Finally, in some cases (e.g. reports from the literature), crucial information such as the patient’s medical history was not available unless the clinical notes were described in detail. Thus, insights obtained from this study should be interpreted as new hypotheses rather than confirmed evidence; validation studies are necessary to confirm our findings. Although AE-reporting data do have several limitations, the advantage of a relatively quick analysis and the opportunity for a safety database text mining approach represent an important opportunity for obtaining further safety insights and generating new hypotheses.

In clinical practice, patients are likely to experience multiple signs and symptoms of infection simultaneously; therefore, the time to onset of serious infection and the sequence of signs and symptoms may aid in early detection of infections before they become serious. This study successfully identified signs and symptoms of serious infection by site in patients with RA who developed infections that became serious after the administration of TCZ. The findings highlight that retrospective analyses of post-marketing AE databases using text mining of clinical narratives may be beneficial for characterizing serious infections associated with the treatment of RA.

Conflict of interest

T.A. has received personal fees from Chugai Pharmaceutical Co. Ltd., during the conduct of the study as well as grants, personal fees, and other from Astellas, Mitsubishi Tanabe, Chugai Pharmaceutical Co. Ltd., and Eisai; personal fees and other from Takeda; personal fees from Pfizer, AbbVie, and UCB Japan; grants from Sanofi, Alexion, Bristol-Myers, and Janssen; and other from Daiichi Sankyo and Bayer outside the submitted work. Y.A., S.M., S.T., R.T., N.T., and A.N. report personal fees from Chugai Pharmaceutical Co. Ltd., during the conduct of the study.

Supplemental material

IMOR_1366007_Supp_Appendix.docx

Download MS Word (25.8 KB)

Acknowledgements

The authors thank all the investigators and the study team at Chugai Pharmaceutical Co., Ltd., especially Yukiko Hayashi and Yoshiyuki Moriguchi, for their contributions. Professional writing and editorial assistance was provided by Liselle Bovell, PhD, and Sara Duggan, PhD, of ApotheCom on behalf of F. Hoffmann La-Roche Ltd.

Additional information

Funding

Chugai Pharmaceutical Co., LtdThis study was funded by Chugai Pharmaceutical Co., Ltd.

References

  • Smolen JS, Landewe R, Breedveld FC, Buch M, Burmester G, Dougados M, et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2013 update. Ann Rheum Dis. 2014;73:492–509.
  • Singh JA, Saag KG, Bridges SL Jr, Akl EA, Bannuru RR, Sullivan MC, et al. 2015 American College of Rheumatology guideline for the treatment of rheumatoid arthritis. Arthritis Care Res. 2016;68:1–26.
  • Smolen JS, Breedveld FC, Burmester GR, Bykerk V, Dougados M, Emery P, et al. Treating rheumatoid arthritis to target: 2014 update of the recommendations of an international task force. Ann Rheum Dis. 2016;75:3–15.
  • Nishimoto N, Miyasaka N, Yamamoto K, Kawai S, Takeuchi T, Azuma J. Long-term safety and efficacy of tocilizumab, an anti-interleukin-6 receptor monoclonal antibody, in monotherapy, in patients with rheumatoid arthritis (the STREAM study): evidence of safety and efficacy in a 5-year extension study. Ann Rheum Dis. 2008;68:1580–4.
  • Genovese MC, Rubbert-Roth A, Smolen JS, Kremer J, Khraishi M, Gómez-Reino J, et al. Longterm safety and efficacy of tocilizumab in patients with rheumatoid arthritis: a cumulative analysis of up to 4.6 years of exposure. J Rheumatol. 2013;40:768–80.
  • Kivitz A, Olech E, Borofsky M, Zazueta BM, Navarro-Sarabia F, Radominski SC, et al. Subcutaneous tocilizumab versus placebo in combination with disease modifying antirheumatic drugs in patients with rheumatoid arthritis. Arthritis Care Res. 2014;66:1653–61.
  • Koike T, Harigai M, Inokuma S, Ishiguro N, Ryu J, Takeuchi T, et al. Effectiveness and safety of tocilizumab: postmarketing surveillance of 7901 patients with rheumatoid arthritis in Japan. J Rheumatol. 2014;41:15–23.
  • Mihara M, Kasutani K, Okazaki M, Nakamura A, Kawai S, Sugimoto M, et al. Tocilizumab inhibits signal transduction mediated by both mIL-6R and sIL-6R, but not by the receptors of other members of IL-6 cytokine family. Int Immunopharmacol. 2005;5:1731–40.
  • Nishimoto N, Terao K, Mima T, Nakahara H, Takagi N, Kakehi T. Mechanisms and pathologic significances in increase in serum interleukin-6 (IL-6) and soluble IL-6 receptor after administration of an anti-IL-6 receptor antibody, tocilizumab, in patients with rheumatoid arthritis and Castleman disease. Blood. 2008;112:3959–64.
  • Harpaz R, Dumouchel W, Shah NH, Madigan D, Ryan P, Friedman C. Novel data-mining methodologies for adverse drug event discovery and analysis. Clin Pharmacol Ther. 2012;91:1010–21.
  • Nomura K, Takahashi K, Hinomura Y, Kawaguchi G, Matsushita Y, Marui H, et al. Effect of database profile variation on drug safety assessment: an analysis of spontaneous adverse event reports of Japanese cases. Drug Des Devel Ther. 2015;9:3031–41.
  • Dore DD, Seeger JD, Arnold CK. Use of a claims-based active drug safety surveillance system to assess the risk of acute pancreatitis with exenatide or sitagliptin compared to metformin or glyburide. Curr Med Res Opin. 2009;25:1019–27.
  • Yamamoto K, Goto H, Hirao K, Nakajima A, Origasa H, Tanaka K, et al. Longterm safety of tocilizumab: results from 3 years of followup postmarketing surveillance of 5573 patients with rheumatoid arthritis in Japan. J Rheumatol. 2015;42:1368–75.
  • LePendu P, Iyer SV, Fairon C, Shah NH. Annotation analysis for testing drug safety signals using unstructured clinical notes. J Biomed Semantics. 2012;3(Suppl. 1):S5.
  • Harpaz R, Vilar S, Dumouchel W, Salmasian H, Haerian K, Shah NH, et al. Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions. J Am Med Inform Assoc. 2013;20:413–19.
  • Iyer SV, Harpaz R, LePendu P, Bauer-Mehren A, Shah NH. Mining clinical text for signals of adverse drug-drug interactions. J Am Med Inform Assoc. 2014;21:353–62.
  • Roitmann E, Eriksson R, Brunak S. Patient stratification and identification of adverse event correlations in the space of 1190 drug related adverse events. Front Physiol. 2014;5:332.
  • Imai T, Aramaki E, Kajino M, Miyo K, Onogi Y, Ohe K. Finding malignant findings from radiological reports using medical attributes and syntactic information. Stud Health Technol Inform. 2007;129:540–4.
  • Gonzalez GH, Tahsin T, Goodale BC, Greene AC, Greene CS. Recent advances and emerging applications in text and data mining for biomedical discovery. Brief Bioinform. 2016;17:33–42.
  • Iqbal E, Mallah R, Jackson RG, Ball M, Ibrahim ZM, Broadbent M, et al. Identification of adverse drug events from free text electronic patient records and information in a large mental health case register. PLoS One. 2015;10:e0134208.
  • Chin CY, Weng MY, Lin TC, Cheng SY, Yang YH, Tseng VS. Mining disease risk patterns from nationwide clinical databases for the assessment of early rheumatoid arthritis risk. PLoS One. 2015;10:e0122508.
  • Bruland P, McGilchrist M, Zapletal E, Acosta D, Proeve J, Askin S, et al. Common data elements for secondary use of electronic health record data for clinical trial execution and serious adverse event reporting. BMC Med Res Methodol. 2016;16:159.
  • Brown EG, Wood L, Wood S. The medical dictionary for regulatory activities (MedDRA). Drug Saf. 1999;20:109–17.
  • Porter RS, Kaplan JL, eds. The Merck manual of diagnosis and therapy. 19th ed. Kenilworth (NJ): Merck Publishing; 2011.
  • Hazell L, Shakir SA. Under-reporting of adverse drug reactions: a systematic review. Drug Saf. 2006;29:385–96.
  • Matsuda S, Aoki K, Kawamata T, Kimotsuki T, Kobayashi T, Kuriki H, et al. Bias in spontaneous reporting of adverse drug reactions in Japan. PLoS One. 2015;10:e0126413.