Co-occurrence
The Co-occurrence report enables users to explore all pairs of occurrences (adverse events (AE), concomitant medications (CM), deaths) that happen simultaneously within a patient, overlapping in time, and generate an estimate of that overlap in the number of days. Further, users can compare the overlap of occurrences to the marginal frequencies where occurrences happen individually. Further, occurrence pairs will be presented by treatment to assess if certain pairs occur more frequently than others within specific treatments or to compare the amount of time pairs occur together within treatment. This report considers occurrences such as adverse events from the AE domain, concomitant medications from the CM domain, or deaths based on the presence of a death date in either DM or ADSL.
Unlike the Nearby Occurrences report that expects the user to identify reference occurrences of interest to explore other nearby occurrences that appear within a user-defined time window, Co-occurrence looks for the overlap of all possible pairs of occurrences according to the Term of Interest and determines the length of time these occurrence pairs take place within each patient. Nearby Occurrences is more appropriate to examine specific terms of interest, while Co-occurrence examines overlap for all terms to see what relationships might arise.
Methodology
Pairs are built from potentially multiple instances of the individual components present in the data. In other words, when joining individual records to each other, two or more (possibly overlapping) periods of Terms of Interest (say, phenobarbital and dexamethasone) may be identified in the study. However, no attempt to identify and distinguish distinct periods of overlap is currently being made. The Number of Days of Overlap is the frequency of unique study days where both Terms of Interest in an Occurrence Group (currently just pairs) are observed together.
No attempt is being made to assess overlap with respect to the time of day. If the Terms of Interest occur on the same day, they are considered to overlap with each other.
In practice, missing dates for deaths and AEs are likely not to occur. However, medications for chronic disease may have unknown starts dates (indicating the medication was started long in the past) or unknown end dates (implying the drug is still being used to manage disease). While JMP Clinical makes every effort to impute partial dates according to pre-defined rules, in some instances missing dates may still occur. When start or end dates are missing entirely, these will be imputed using the earliest/latest date according to the following rules, assessing the presence of variables in order:
| • | Start date: Enrollment date (ENRLDT), informed consent date (RFICDT), earliest visit start date (JMPC_ASTDT) |
| • | End date: End of study date (EOSDT), end of participation date (RFPENDT), most recent of visit end date (JMPC_AENDT) or disposition event dates (JMPC_ASTDT). |
For instances where the stop dates of medications or AEs were not collected as part of the eCRF design, the stop dates are assumed to be equal to the start dates. In other words, the occurrences start and end on the same day. This assumption is always made for deaths.
For all studies, occurrences are classified according to the treatment arm; this includes the set of treatments for crossover or multi-treatment studies. Further potential enhancements of the Co-occurrence report could assess the overlap of pairs of Terms of Interest in conjunction with the treatment received (even no treatment) on a given study day.
Usage and Interpretation
The primary output consists of an UpSet Plot which has several important areas of focus. UpSet plots are used to communicate the frequency of subgroups produced according to one or more factors compared to the marginal frequencies of considering each factor alone.
Example 1: Default Settings
Running Co-occurance for Nicardipine using default settings to demonstrate usage and interpretation of results. The Upset plot is shown in Figure 1.
Figure 1: UpSet Plot
Features of the UpSet plot are listed below:
| • | The vertical and horizontal axes are ordered according to these frequencies so that the further right (or down) in the plot, the smaller the frequency. |
| • | The line and dots area of the figure illustrate the connections between Terms of Interest along the Occurrence vertical axis and the Occurrence Group horizontal axis. |
| • | The Bar Chart present in the Overall Frequency of Patients in Occurrence Group vertical axis and Occurrence Group horizontal axis presents the frequency of each Occurrence Group, which for now is limited to pairs of occurrences. This bar chart is presented in decreasing frequency, left to right. |
| • | The bar chart present in the Occurrence vertical axis and the Overall Frequency of Patients with Occurrences horizontal axis presents the frequency of each Occurrence individually. This bar chart is presented in decreasing frequency, top to bottom. |
| • | The top area of the figure, within the Proportion of Treatment vertical axis and the Occurrence horizontal axis is a stacked bar chart which shows the proportion of Occurrence Group pairs that are attributable to a particular treatment. This part of the graph has numerous additional options that are discussed further below. |
For example, phenobarbital and dexamethasone are the left-most pair of terms, indicating that they occur with the greatest frequency (n = 470) among all possible pairs of terms. This overlap in Terms of Interest can be compared to the individual marginal frequencies of phenobarbital (n = 695) and dexamethasone (n = 599). In other words, 695-470=225 patients had phenobarbital with no overlapping dexamethasone, while 599-470=129 patients had dexamethasone with no overlapping phenobarbital. The underlined text highlights a very important distinction about the Co-occurrence report, which specifically looks for pairs of Terms of Interest overlapping in time within patient. A patient could take both phenobarbital and dexamethasone, but if there is no overlap on the same study days, it is not counted towards the 470 patients with phenobarbital and dexamethasone.
So, among the 225 patients with phenobarbital with no overlapping dexamethasone:
| • | A subset will not have dexamethasone at all. |
| • | The remaining patients will have taken some dexamethasone, but not on the same days as phenobarbital. |
Similarly, of the 129 patients that had dexamethasone with no overlapping phenobarbital:
| • | A subset will not have phenobarbital at all. |
| • | The remaining patients will have taken some phenobarbital, but not on the same days as dexamethasone. |
Of these 470 pairs, 0.48 and 0.52 of them occur within patients on Nicardipine or Placebo, respectively. Marginal counts for each treatment are visible in the data table, or the user can click Frequencies by Treatment to change the bar charts to side by side bar charts with sample sizes for each treatment (Figure 3). Although filtering may be needed to view treatment-specific sample sizes, we can observe that 230 and 240 patients on Nicardipine or Placebo, respectively, had the “Dexamethasone, Phenobarbital” pair.
The Number of Days of Overlap table (Figure 2) lists summaries by treatment and overall for the Number of Days of Overlap.
Figure 2: Number of Days of Overlap table
Other summary statistics for the Number of Days of Overlap are available in the data table.
Note: Summary statistics with the word “Overall” contained in column name are across all treatments, while the others are specific to the treatment listed in a particular row.
Options
Data - Adverse Events
Term Level
Use this option to specify which level of terms to use as categories.
Possible term levels are report-specific and are listed in the following table:
|
Term Level |
Corresponding Variable |
Function |
||||||
|
Preferred Term (PT) |
AEDECOD in AE |
|
||||||
|
Verbatim Term (VT) |
AETERM in AE |
|
||||||
|
Body System |
AEBODSYS in AE |
|
||||||
|
High(er) Level Term (HLT) |
AEHLT in AE |
|
||||||
|
High(er) Level Group Term (HLGT) |
AEHLGT in AE |
|
||||||
|
Standard MedDRA Query |
|
|
||||||
|
Primary System Organ Class (SOC) |
AESOC in AE |
|
||||||
|
Lowest Level Term (LLT) |
AELLT in AE |
|
||||||
|
Body System or Organ Class |
AEBODSYS in AE |
|
||||||
|
Dictionary-Derived Term |
AEDECOD in AE |
|
||||||
|
Reported Term for the Adverse Event |
AETERM in AE |
|
||||||
|
Reported Name |
either CMTRT (for Concomitant Medications) or SUTRT (for Substance Use) |
|
||||||
|
Standardized Name |
either CMDECOD (for Concomitant Medications) or SUDECOD (for Substance Use) |
|
Note: Input data determines the availability of options. Not all term levels are available in all of the reports in which term levels are specified.
Note: The dictionary name and version used to generate the descriptions should be included as part of the submission.
Include serious adverse events only
Check this box to include only serious adverse events in the analysis.
Serious events are identified by a “Y” value in the expected AESER variable in the AE or ADAE data sets.
Event Type
Use this feature to specify the inclusion of particular events in the analysis. The selection limits the report to only adverse events of that type.
By default, all events are included in the analysis.
Available options are listed in the following table:
|
Option: |
Select when you want to: |
|||
|
All event types |
|
|||
|
Pre treatment events |
|
|||
|
Treatment emergent adverse events |
Note: For information about how treatment emergent adverse events (TEAEs) are defined, please refer to How does JMP Clinical determine whether an Event Is a Treatment Emergent Adverse Event?. |
|||
|
On treatment events |
|
|||
|
Off treatment follow up events |
|
Note: When crossover is detected, only those events that occur within the specified treatment period dates are shown. This is true even when All Event Types has been selected. For example, pre-treatment events are not assigned to a treatment and therefore not shown in the report.
Ignore available treatment emergent flags
This option applies only if the selected event type specifies treatment-emergent events. If this option is not checked, then the report will check for existing treatment emergent flags in the data and subset based on those flags. If the option is checked, then the Algorithm JMP Clinical uses to define treatment emergence will be applied.
Data - Concomitant Medications
Term Level
Use this option to specify which level of terms for for interventions to use as categories.
Possible term levels are report-specific and are listed in the following table:
|
Term Level |
Corresponding Variable |
Function |
|||
|
Reported Term for the Drug, Med, or Therapy |
CMTRT in CM |
|
|||
|
Standardized Medication Name |
CMDECOD in CM |
|
|||
| Category for Medication |
CMCAT in CM |
|
Intervention Type
Use this feature to specify the inclusion of particular type of intervention in the analysis. By default, all interventions are included in the analysis.
Available options are listed in the following table:
|
Option: |
Select when you want to: |
|||
|
All intervention types |
|
|||
|
Pre treatment interventions |
|
|||
|
Treatment emergent interventions |
Note: For information about how treatment emergent interventions are defined in JMP Clinical, please refer to How does JMP Clinical determine whether an Event Is a Treatment Emergent Adverse Event?. |
|||
|
On treatment interventions |
|
|||
|
Off treatment follow up interventions |
|
Note: When crossover is detected, only those interventions that occur within the specified treatment period dates are shown. This is true even when All Intervention Types has been selected.
Truncate data to the start of the study
Check this option to truncate start dates to use (in order), enrollment date, informed consent date, or earliest visit date. Note: Checking this option does not delete records (generally medications) if they start prior to the study.
Display
Upset Format
UpSet plots are used to communicate the frequency of subgroups produced according to one or more factors compared to the marginal frequencies of considering each factor alone.
This plot can be formatted in a number of different ways:
BarChart
The default view of the upper part of the UpSet plot is the stacked Bar Chart, shown above, summarizing the proportion of treatments. Choose Stacked Bar to produce this view.
Box Plot
Choose Box Plot to produce side by side Box Plots, shown below, summarizing the Number of Days of Overlap for Occurrence Groups, shown below.
Range Bar
Choose Range Bar to produce a range bar plot, formatted to appear like a confidence interval, that summarizes the median value as a symbol with low and high interval values represented by the minimum and maximum observed values, respectively, shown below.
Interquartile Range Bar
Choose Interquartile Range Bar to produce a range bar plot, formatted to appear like a confidence interval, that summarizes the median value as a symbol with low and high interval values represented by the first quartile and third quartile values, respectively, shown below.
Term of Interest
The Term of Interest list option makes it straightforward to select all pairs in the data filter that contain a particular term. Note: It is important to clear the data filter of current selections since selecting a Term of Interest will respect current filter selections.
Frequencies by Treatment
Check this box to display frequencies by treatment for both the patients in occurrence groups and patients with occurrences.
Report Filter
The Report filter includes a number of important columns from the Number of Days of Overlap data table by default.
Domain Pair lists the domains from where each Term of Interest is derived, and currently includes adverse events (AE), concomitant medications (CM), or deaths (ADSL). This is the most straightforward way to look at overlapping pairs of medications or adverse events, or all medications being taken when death occurred.
Pair is the set of Terms of Interest where the first term always comes before the second term alphabetically. This is a useful way to select individual pairs of interest. As described above, all pairs containing a single term can be selected from the Term of Interest list box.
Overall Frequency of Patients in Occurrence Group is the total number of patients across all treatments for the Occurrence Group. Essentially, this is the sample size for the bar chart present in the Overall Frequency of Patients in Occurrence Group vertical axis and Occurrence Group horizontal axis.
Maximum Difference in Treatment Frequencies is the difference in the maximum and minimum treatment sample size for an Occurrence Group. Essentially, this is the difference derived for the bar chart present in the Overall Frequency of Patients in Occurrence Group vertical axis and Occurrence Group horizontal axis when Frequencies by Treatment is checked.
Maximum Difference in Treatment Median Days is the difference in the maximum and minimum treatment median days for the Number of Days of Overlap.
Refer to Data Filter for more information.
Note: Filter specifications are reapplied when any widget options are changed.
General and Drill Down Buttons
Action buttons provide you with an easy way to drill down into your data. The following action buttons are generated by this report:
| • | Click to reset all report options to default settings. |
| • | Click to view the associated data tables. Refer to Show Tables for more information. |
| • | Click to generate a standardized PDF- or RTF-formatted report containing the plots and charts of selected sections. |
| • | Click to generate a JMP Live report. Refer to Create Live Report for more information. |
| • | Click to take notes, and store them in a central location. Refer to Add Notes for more information. |
| • | Click to read user-generated notes. Refer to View Notes for more information. |
Default Settings
Refer to Set Study Preferences for default Subject Level settings.
References
Mallet S. (2023). Interactive Safety Graphics for Regulatory Decision Making: Opportunities and Challenges. PhUSE Webinar.
Ballarini NM, et al. (2020). A critical review of graphics for subgroup analyses in clinical trials. Pharmaceutical Statistics 19: 541–560.






to reset all report options to default settings.
to view the associated data tables. Refer to
to generate a standardized
to generate a JMP Live report. Refer to
to take notes, and store them in a central location. Refer to
to read user-generated notes. Refer to