var _paq = window._paq = window._paq || []; /* tracker methods like "setCustomDimension" should be called before "trackPageView" */ _paq.push(['trackPageView']); _paq.push(['enableLinkTracking']); (function() { var u="https://rwrregs.matomo.cloud/"; _paq.push(['setTrackerUrl', u+'matomo.php']); _paq.push(['setSiteId', '1']); var d=document, g=d.createElement('script'), s=d.getElementsByTagName('script')[0]; g.async=true; g.data-privacy-src='//cdn.matomo.cloud/rwrregs.matomo.cloud/matomo.js'; s.parentNode.insertBefore(g,s); })();

About stuart.mccully

This author has not yet filled in any details.
So far stuart.mccully has created 658 blog entries.

Real World Evidence (RWE) 101 – A Career of Many Pathways

RWE 101 – A Career of Many Pathways

Real-world evidence (RWE) refers to the information on health care that is derived from analysis of real-world data (RWD). RWE is increasingly used in health care decisions.

The career path to get into RWE is not set in stone, as it involves a combination of skills from different disciplines such as epidemiology, biostatistics, public health, computer science, and data analysis. However, below are some usual steps that individuals may follow:

[1] Education: This typically involves obtaining a Bachelor’s degree in a relevant field such as biology, public health, epidemiology, or statistics. A Master’s degree or a Ph.D. in a related field such as epidemiology, biostatistics, public health, or health economics is highly valuable. Also, acquiring knowledge in the field of data science or bioinformatics could be beneficial.

[2] Entry-Level Experience: This could be roles in clinical research, health services research, or other types of medical or public health research. This might also involve experience in data analysis or management, particularly with healthcare datasets.

[3] Mid-Level Experience: As one gains experience, they may start to specialize in areas related to RWE. This could involve roles in health economics and outcomes research (HEOR), pharmacovigilance, or clinical epidemiology.

[4] Advanced-Level Experience: Eventually, they may move into roles that directly involve the generation, analysis, or interpretation of RWE. This could be in a pharmaceutical company, a consulting firm, a healthcare provider, or a public health agency.

[5] Continuous Learning: As the field of RWE evolves rapidly with the development of new methodologies and data sources, continuous learning is essential. This could involve regular participation in professional development opportunities and staying current with the scientific literature.

It’s important to remember that this is just a general path, and many individuals may take different routes into RWE, leveraging their unique skills and experiences. For instance, some might come from a medical background, using their clinical knowledge to help shape and interpret RWE studies. Others might come from a more traditional epidemiology or public health background, applying those skills to the analysis of RWE. Some may even come from a data science or bioinformatics background, using their skills to manage and analyse large, complex healthcare datasets.

RWE is a dynamic and interdisciplinary field, so there are many pathways into it. It’s all about finding the intersection of your skills and interests with the needs of the field

Share this story...

Real World Evidence (RWE) 101 – A Career of Many Pathways2023-08-07T22:28:44+00:00

Real World Evidence (RWE) 101 – Evolution of Regulatory Affairs

RWE 101 – Evolution of Regulatory Affairs

Real-world evidence (RWE) and real-world data (RWD) are increasingly influencing regulatory affairs in the biopharmaceutical and healthcare industry. This change has been brought about due to the recognition of the value of real-world data in assessing the safety, efficacy, and effectiveness of therapies beyond traditional clinical trials.
 
[1] Increased Importance of Post-Marketing Surveillance: With RWE, regulatory agencies now have increased access to post-marketing surveillance data. This data is helping in better identification of adverse events and monitoring the safety of products in the market.
 
[2] Regulatory Decision Making: RWE is becoming increasingly significant in regulatory decision-making, including label extensions, post-approval studies requirements, and in some cases, approval decisions themselves. Regulatory bodies such as the FDA and EMA are now considering RWE as part of their evidence package, though with caution and scrutiny.
 
[3] Guidelines and Policies: Regulatory bodies are developing guidelines for the use of RWE in regulatory decision-making. The FDA, for instance, has issued guidance on the use of RWE to support approval of new indications for already approved drugs or to satisfy post-approval study requirements.
 
[4] Innovative Trial Design: The increased use of RWE is promoting the use of innovative clinical trial designs like pragmatic clinical trials (PCTs), which make use of real-world data.
 
[5] Technology and Data Privacy Considerations: With RWE coming largely from electronic health records, insurance claims data, and wearables, regulatory affairs, especially study start-up professionals, will need to grapple with data privacy and cybersecurity issues. There’s an increasing need for regulations that guide the use and protection of such data.
 
[6] International Harmonization: As RWE can be collected globally, there are efforts to harmonize the guidelines across different countries to make multinational studies feasible.
 
[7] Transparency and Trust: Ensuring the validity and reliability of RWE studies is a growing concern. This has led to an increased focus on transparency in data collection, analysis methods, and reporting, all of which regulatory affairs must oversee, especially in the context pf RWE used for regulatory submissions, such as marketing authorisations..
 
Thus, the intersection of RWE and regulatory affairs is evolving and holds potential for improving healthcare decisions and outcomes. Regulatory affairs professionals must adapt to these changes, requiring new skills and competencies in data analysis and understanding of the evolving regulatory landscape for RWE.

Share this story...

Real World Evidence (RWE) 101 – Evolution of Regulatory Affairs2023-08-07T22:02:40+00:00

Real World Evidence (RWE) 101 – Project Managers

RWE 101 – Project Managers

Real-World Evidence (RWE) observational studies and clinical trials are both key elements of medical research, but they involve very different methodologies, aims, and requirements. As a result, the role of a project manager in each type of study will differ significantly.
 
Here’s a high-level overview of how the role of a project manager differs for RWE observational studies versus clinical trials:
 
[1] Study Design and Execution: In RWE studies, the project manager has to deal with more varied and unpredictable study designs since these studies often rely on data that is collected during routine clinical practice. This role requires a higher degree of flexibility and the ability to adjust study plans and analysis methods as new data becomes available.
 
[2] Regulatory Compliance: Clinical trial project managers have to comply with strict regulations based on guidelines such as Good Clinical Practice (GCP). Whereas, the regulatory landscape for RWE studies is more varied, with guidelines and norms often differing by data source and locality. However, RWE studies are increasingly being used in regulatory decision-making, so there is a growing focus on maintaining data quality and ensuring appropriate use of data.
 
[3] Data Management: In clinical trials, project managers oversee data is gathered in a very structured way with predefined data points. Project managers in RWE studies deal with large, real-world data sets that can come from a variety of sources, like electronic health records (EHRs), insurance claims data, or patient registries. They have to manage complex, unstructured data and may have to deal with issues related to data cleaning, missing data, or data integration.
 
[4] Stakeholder Engagement: Project managers for clinical trials and observational studies must coordinate with a variety of stakeholders, including clinicians, patients, sponsors, regulatory bodies, and ethics committees. They have to manage patient recruitment and retention, monitor trial progress, and handle any issues that arise during the trial.
 
[5] Analysis and Reporting: For both clinical trials and observational studies project managers play a crucial role in ensuring that analysis is conducted as per the pre-specified statistical analysis plan and results are reported in a standardized format. Project managers overseeing RWE studies have to navigate more complex and varied analysis strategies due to the nature of the data. They may also have to engage more with stakeholders to communicate findings and their implications, and reporting may be more tailored to the needs of specific stakeholders.
 
In both types of studies, the project manager is responsible for ensuring the project is delivered on time, within budget, and to a high standard of quality. However, the specifics of what this involves can vary considerably depending on whether the study is a clinical trial or an RWE observational study.

Share this story...

Real World Evidence (RWE) 101 – Project Managers2023-08-07T21:50:20+00:00

Real World Evidence (RWE) 101 – Ethical Imperatives (CIOMS 2023)

RWE 101 – Ethical Imperatives (CIOMS 2023)

Informed decision making with patients typically relies on evidence from clinical trials that describe the likely benefits and toxicities. However, patients treated in everyday practice tend to be older and more frail, to have poorer function and performance status, and to have more comorbidities and less social support than those selected to participate in clinical trials. Thus, generalisability to typical patient populations treated in daily practice is often limited. Kennedy-Martin et al explored the generalisability of RCTs in cardiology, mental health, and oncology by assessing studies comparing participants in such trials with those in everyday clinical practice. Patients treated in everyday clinical practice tended to be older, were more often women, and had more comorbidities; 71% of studies concluded explicitly that RCTs were not broadly representative of real-world patients, in particular, pregnant and lactating women are a very large population that is often entirely unrepresented in clinical trials. Furthermore, patients enrolled in trials were treated according to guidelines more often and received more in-hospital procedures. Strict selection criteria for RCTs meant that participants were at a much lower risk of adverse events compared with patients treated in clinical practice.
 
If the efficacy-effectiveness gap means that patients are being given inaccurate information about the potential benefits and risks of treatments, then decisions made using that information may be being made without valid informed consent, disrespecting patient’s autonomy and putting them at risk of avoidable harm. The efficacy-effectiveness gap also raises important issues regarding justice; if resource allocation decisions, including which treatments are funded, are made using evidence that is biased by the efficacy-effectiveness gap, then those decisions will also be flawed, with potentially wide implications for patients. Ultimately, the efficacy-effectiveness gap undermines the gold standard status of RCTs, and actually suggests that it would be unethical to continue with such a flawed representation of real-world effects on patients. Increasing use of RWE is one important way to fill the efficacy-effectiveness gap and augment the evidence from RCTs. This should not be seen as dropping the gold standard, or diminishing the standard of evidence required; rather, enhancing and supplanting RCT evidence with RWD can instead be viewed as reinforcing the gold standard with platinum plating.
 
Source: Section 4.2 (Ethical arguments for incorporating more RWE) of the CIOMS Draft Guidance – Real-World Data and Real-World Evidence in Regulatory Decision Making (6 June 2023)

Share this story...

Real World Evidence (RWE) 101 – Ethical Imperatives (CIOMS 2023)2023-08-07T21:46:07+00:00

Real World Evidence (RWE) 101 – Ethical Imperatives

RWE 101 – Ethical Imperatives

Real-world evidence (RWE) refers to the clinical evidence regarding the usage and potential benefits or risks of a product derived from analysis of real-world data (RWD). These data are routinely collected from a variety of sources, such as electronic health records, claims and billing data, patient registries, and data gathered through personal devices. RWE is increasingly being used in clinical trials and marketing authorisations.
 
The ethical imperative of incorporating RWE into clinical trials intended to support marketing authorizations arises from several factors:
 
[1] Patient-centric Approach: RWE provides a more holistic and accurate view of the patient experience as it considers a wide range of factors such as comorbidities, patient behaviour, social determinants of health, and the full array of interventions. This allows for a patient-centric approach in medical research, which respects the dignity, rights, and welfare of individuals.
 
[2] Generalizability: RWE is collected from diverse patient populations and settings and can therefore inform on how a drug or intervention works in the ‘real world,’ beyond the controlled environment of randomized controlled trials (RCTs). This increases the generalizability of research findings and supports the ethical principle of justice, ensuring that the benefits of research are applicable and beneficial to all groups.
 
[3] Safety and Effectiveness: RWE can provide additional information on a drug’s safety and effectiveness in broader populations and over longer periods, beyond what can be feasibly assessed in RCTs. This can provide early signals of potential harm and help prevent unnecessary patient exposure to harmful interventions.
 
[4] Efficiency: Incorporating RWE can make research more efficient, reducing the time and cost of bringing a new product to market. This is ethically significant as it can accelerate patient access to beneficial new treatments.
 
[5] Informed Decision Making: RWE helps physicians, patients, and policy-makers make informed decisions. Better evidence can improve the quality of care, patient outcomes, and health system efficiency.
 
[6] Inclusivity: Traditional clinical trials often exclude certain patient groups, such as the elderly or those with multiple health conditions. RWE includes data from these often under-represented groups, ensuring that the findings are applicable to them.
 
The importance of RWE lies in its ability to provide an enhanced understanding of a drug’s safety, effectiveness, and value in routine clinical practice. It can capture the wide heterogeneity of patients, healthcare providers, and treatment settings, providing a much-needed complement to traditional RCTs. By integrating RWE into the process of marketing authorizations, regulators can make more informed decisions, ensuring that only safe and effective drugs reach the market, ultimately improving patient health outcomes.

Share this story...

Real World Evidence (RWE) 101 – Ethical Imperatives2023-08-07T21:29:44+00:00

Real World Evidence (RWE) 101 – The Importance of Intent

RWE 101 – The Importance of Intent

Real-world evidence (RWE) is the clinical evidence about the usage and potential benefits or risks of a product derived from the analysis of real-world data (RWD). RWD and RWE are playing an increasing role in health care decisions. They can be used to support regulatory decision-making, clinical trial designs, guideline development, and healthcare policy-making.
 
Understanding the intent of the use of RWE in the design and conduct of an RWE study is critical for several reasons:
 
[1] Regulatory Requirements: The regulatory standards for evidence used to support different types of decisions can vary substantially. For instance, the data standards required by the FDA for a new drug approval (which often rely on randomized clinical trials) are much more stringent than the standards for post-marketing surveillance or comparative effectiveness research. Understanding the end use of the evidence helps in designing a study that meets the appropriate regulatory standards and complies with the relevant requirements.
 
[2] Data Integrity and Quality: The quality of RWD can vary widely, depending on the source. If the evidence is being used to support high-stakes decisions (like regulatory approval), the data used must be of very high integrity and quality. For instance, data from electronic health records or insurance claims may be sufficient for some types of observational studies, but they might not be adequate for regulatory decisions without additional validation.
 
[3] Study Design: The intent of the study impacts the choice of study design. For instance, randomized controlled trials are considered the gold standard for demonstrating cause-effect relationships and are often required for regulatory approval. However, if the goal is to understand how a treatment works in routine clinical practice, an observational study using RWD might be more appropriate.
 
[4] Data Analysis: The intent of the RWE study also determines the methods used to analyze the data. For example, methods to control for confounding factors, which can bias the results, might be more critical in studies used for regulatory decision-making than in those used for exploratory analyses.
 
[5] Ethical Considerations: Depending on the intent, different ethical considerations might apply. For instance, if the RWE study is designed to inform clinical decision-making, it’s crucial to ensure that patient privacy is protected, informed consent is obtained (when required), and results are communicated transparently.
 
In summary, understanding the intended use of RWE is crucial in the design and conduct of an RWE study because it impacts everything from the regulatory requirements to the quality and integrity of data used, to the choice of study design and data analysis methods, to the ethical considerations. These considerations can substantially influence the validity, generalizability, and acceptability of the study’s results.

Share this story...

Real World Evidence (RWE) 101 – The Importance of Intent2023-08-07T21:21:30+00:00

Real World Evidence (RWE) 101 – Inspections

RWE 101 – Inspections

Real-World Evidence (RWE) can include data from sources such as electronic health records (EHRs), insurance claims and billing activities, patient registries, patient-generated data, and data gathered from other sources that reflect the patient’s health status. Regulatory authorities, such as the U.S. Food and Drug Administration (FDA) and the European Medicines Agency (EMA), inspect RWE studies to ensure that they’re conducted to the highest standards of scientific integrity, validity, and reliability.
 
Here are some key aspects that are usually inspected in the context of regulatory authority inspections:
 
[1] Data Quality and Integrity: Regulatory authorities review the systems and processes in place to ensure data accuracy, completeness, and consistency. This can include reviewing data collection methods, data management systems, and any algorithms used to process or analyse the data.
 
[2] Methodology: The design and conduct of RWE studies are critically reviewed. This includes the study protocol, statistical analysis plan, and any modifications made during the study. The methodology should be clear, robust, and scientifically sound to generate reliable evidence. Where consideration of a scientific standard or best practice is recommended (e.g., ISPE GPP) and not followed, this should be justified.
 
[3] Regulatory Compliance: While RWE (observational) studies may not fall under the GCP umbrella, ethical conduct, patient privacy, and data protection are still paramount. Compliance with laws like HIPAA in the United States or GDPR in the European Union, is essential, as is compliance with the local laws that govern RWE studies.
 
To prepare for a regulatory authority inspection, consider the following steps:
 
[1] Ensure data quality: Maintain rigorous data management practices. Make sure your data is accurate, complete, and auditable.
 
[2] Document everything: Keep comprehensive records of all activities related to the study. This includes detailed protocols, data collection methods, data handling procedures, and analysis plans. Also, document any changes made during the study and the reasons for those changes.
 
[3] Protect patient privacy: Ensure that your data management systems meet the required standards for protecting patient privacy. Anonymize data whenever possible and follow all relevant data protection laws.
 
[4] Prepare a team: Have a team that’s familiar with the study and prepared to answer questions from inspectors. This team should be knowledgeable about the study design, data management, and analysis.
 
[5] Conduct internal audits: Regular internal audits can help identify potential issues before an inspection. They can also provide opportunities to improve your procedures and systems.
 
Remember, each regulatory authority may have its own specific requirements, so it’s essential to understand and comply with the regulations of the jurisdiction in which you’re operating.

Share this story...

Real World Evidence (RWE) 101 – Inspections2023-08-07T21:10:28+00:00

Real World Evidence (RWE) 101 – Audits

RWE 101 – Audits

A quality assurance auditor in the context of a real-world evidence (RWE) study has several responsibilities, key among them ensuring that all facets of the study align with applicable regulations, guidelines, and established protocols. In a study conducted in multiple countries, each with their unique regulatory requirements, the auditor would typically focus on the following aspects:
 
[1] Regulatory Compliance: The audit evaluates whether the study aligns with the different regulatory requirements of each involved country. This also includes adherence to international standards and guidelines, such as the Declaration of Helsinki and ISPE GPP, which are recognized globally.
 
[2] Study Protocol Adherence: The audit checks whether the study is being conducted according to the approved protocol, evaluating the study’s procedures and operations for alignment.
 
[3] Informed Consent: The process of obtaining informed consent from participants is critical in RWE studies. The audit reviews this process to verify that consent is obtained appropriately and aligns with the local regulations and cultural norms of each country.
 
[4] Data Collection, Management, and Analysis: The audit examines the processes of data collection, storage, and analysis to ensure accuracy, consistency, and compliance with data privacy regulations. This involves evaluating any electronic data capture systems, as well as the procedures for data validation and error correction.
 
[5] Safety Reporting: The audit reviews the systems for reporting safety and adverse events, ensuring that all events are recorded and reported properly according to regulatory requirements. The audit also checks for appropriate responses to any adverse events.
 
[6] Personnel Training and Qualifications: An audit reviews the training records to confirm that all personnel involved in the study have the necessary qualifications and have received suitable training.
 
[7] Subcontractors and Vendors: If the study employs any subcontractors or vendors (e.g., laboratories or data management companies), the audit reviews their practices and procedures to verify their adherence to required standards.
 
[8] Study Reports: Lastly, interim and final study reports are reviewed to ensure they accurately represent the study data and meet all required standards for scientific reporting and regulatory submission.
 
These areas comprise the primary focus of a quality assurance audit for a multi-country RWE study. The overarching goal is to ensure that the RWE study is conducted ethically and appropriately, with reliable and accurate resulting data.

Share this story...

Real World Evidence (RWE) 101 – Audits2023-08-07T21:01:15+00:00

Real World Evidence (RWE) 101 – Compliance Maps

RWE 101 – Compliance Maps

In the context of multi-country Real-World Evidence (RWE) studies, “Regulatory Compliance Maps” are essentially a detailed representation of the diverse regulatory requirements specific to each participating country.
 
RWE studies involve the analysis of data derived from a number of different sources outside of typical clinical trials, such as electronic health records (EHRs), medical claims and billing data, patient registries, and patient-generated data. Different countries have varied regulations regarding the use and sharing of such data, including the handling of patient privacy, data security, and informed consent among others.
 
To navigate through this complex landscape, regulatory compliance maps are created for several purposes:
 
[1] Understanding the Regulation: These maps help in identifying the specific regulatory requirements in each country. They define how to handle, process, store, and share patient data.
 
[2] Comparison: They also provide a comparative view of the regulatory landscape across different countries. This comparison allows companies to understand the relative complexity of conducting RWE studies in different regions.
 
[3] Planning: Based on these compliance maps, companies can strategise and design their RWE studies to ensure they meet all regulatory requirements. This might involve altering the study design or selecting specific data collection tools in different regions.
 
[4] Risk Mitigation: By understanding the specific regulations in each region, companies can take proactive steps to minimize risks associated with non-compliance, which might lead to legal repercussions or reputational damage.
 
[5] Collaboration: These maps also facilitate better communication and cooperation with local authorities, including IRBs/RECs, as they demonstrate the company’s understanding and respect for local regulations.
 
Creating and maintaining regulatory compliance maps can be a complex task due to the evolving nature of regulations, the diversity of data sources, and the need for expertise in different jurisdictional laws. However, it is an essential part of conducting efficient and ethical multi-country RWE studies.

Share this story...

Real World Evidence (RWE) 101 – Compliance Maps2023-08-07T20:50:45+00:00

Real World Evidence (RWE) 101 – SOPs and Regional Regulations

RWE 101 – SOPs and Regional Regulations

In the realm of quality assurance (QA), it’s vital that standard operating procedures (SOPs) are crafted in a way that accurately and specifically reflects the control measures, tasks, and processes that the organization can directly influence and manage. Here are several reasons why it is not advisable to include processes in SOPs that you have no control over, such as country-specific regulations for Real-World Evidence (RWE) studies:
 
[1] Inaccuracy and Inconsistency: Country-specific regulations can vary significantly and may change over time. The organization has no control over these changes and thus cannot guarantee that their SOPs will stay up-to-date with the current regulations in each country.
 
[2] Potential for Non-Compliance: If the SOP includes processes dictated by external regulations that subsequently change, the company might unknowingly be in non-compliance. This could lead to regulatory consequences, including fines or other penalties.
 
[3] Confusion: Inclusion of country-specific regulations in the SOPs can cause confusion among the staff who are required to follow these procedures. If an SOP describes a procedure that is not applicable or is different in their specific context, this could lead to errors, misunderstandings, or non-compliance.
 
[4] SOP Management Complexity: SOPs should be as concise, clear, and easy to manage as possible. By including country-specific regulations, the SOPs become more complex and harder to maintain, which increases the risk of errors and decreases efficiency.
 
Instead of including country-specific regulations in SOPs, a better approach would be to make SOPs generic enough to accommodate various situations, while ensuring compliance with overarching international or regional regulations. Furthermore, local teams should be trained and have access to resources that detail the country-specific regulations applicable to them. They could also have local operating procedures or instructions that explain how the SOP should be implemented in light of these regulations.
 
Finally, there should be a process in place to ensure that the organization is constantly up-to-date with any changes in country-specific regulations and can adjust its procedures accordingly. This might involve dedicated personnel or teams, use of regulatory consultancy services, or subscription to regulatory update feeds. These processes would lie outside the SOPs, but would be critical to maintaining regulatory compliance.

Share this story...

Real World Evidence (RWE) 101 – SOPs and Regional Regulations2023-08-07T20:02:24+00:00
Go to Top