Review essayTheory and methods in comparative drug and alcohol policy research: Response to a review of the literature
Introduction
Policy is a device for scaling a practice within a legal or institutional framework. At the core of policy research is the question of what effects a practice codified in a policy produces. If the policy has positive effects, at reasonable cost and without significant side effects, research can spur the policy’s refinement and wider adoption. If a policy causes harm, or provides too few benefits to justify the costs of enforcement, research can help speed its modification or repeal. Comparative research has been used to assess the impact of policies on health (Burris & Anderson, 2013). Alcohol research, particularly in the road safety domain, has demonstrated the potential for rigour and impact in this tradition. In a 2016 review of 62 comparative policy analysis studies published since 2010, Ritter et al. report that the practice lacks “a clear definition of what counts as CPA” and consensus on methods of “policy specification” (Ritter, Livingston, Chalmers, Berends, & Reuter, 2016) (“Ritter et al.”). In an unpublished portion of the study, which I read as a peer reviewer and allude to with permission, the authors also noted the absence of explicit theory in nearly half the papers reviewed.
There is good reason to be talking now about the state of CPA. Though prohibitionist policies remain widespread, there are also many signs of declining faith in that model, leading to more openness to policy innovation and research that tests the current approach or evaluates innovations. This includes not just outright legalization of some drugs, and substantial abandonment of criminalization for others, but also policies of non-enforcement and the creation of safe spaces for services and treatment (Csete et al., 2016). There has always been “considerable room for manoeuvre” in the international conventions (Bewley-Taylor & Jelsma, 2011), and that space grows as support for prohibition declines.
As the policy environment features more legalization, or at least changes in policy and practice that make drugs a little less illegal, drug research gradually looks more like alcohol research, with greater interjurisdictional variation, better access to data and more opportunities for research funding. Chatwin (2016) suggests that this is a time of opportunity to promote policy innovation as a virtue and evaluation of innovation as a primary role of national and international drug control and health agencies. From the epistemologically Machiavellian point of view, even jurisdictions that adhere to rigid prohibition can assist in the identification of positive innovation by serving as die-hard counterfactuals.
Yet there are those bumps in the road of CPA highlighted by Ritter et al.: lack of a clear definition and taxonomy of CPA, problems in the specification of the policy under study, and a failure to exploit theory as a way to strengthen research and its utility across disciplines. I confronted these same obstacles in my work providing funding and technical assistance in the overlapping field of public health law research (PHLR)—“the scientific study of the relation of law and legal practices to population health” (Burris et al., 2010, Wagenaar and Burris, 2013). This paper draws on the PHLR experience to suggest ways to address these key challenges in CPA.
Section snippets
The importance of defining and classifying CPA
Ritter et al. (2016, p. 40) start with a crucial observation: “Comparative policy analysis is a diverse set of activities, undertaken by many different disciplines, all with their own approaches — it is not a unified field of study”. It is a good thing that contributors to CPA do not use the same theoretical frameworks, methods or designs. It is good that they may be interested in different aspects of policy phenomena, different dimensions of implementation processes, or different outcomes.
A new definition of CPA based on a model of its subject
I suggest that empirical papers in CPA fall for the most part into four groups: (1) policymaking studies, which investigate the determinants of policy and the policy-making process; (2) mapping studies, which measure policy prevalence, characteristics and/or change over time; (3) implementation studies, which investigate the process of putting a policy into practice and its proximate outcomes; and (4) evaluation studies, which try to assess the impact of policies on the world. This taxonomy
The “policy” problem — defining the independent variable
As the reader may well have noticed, the model in Fig. 1 supposes that “policy” does not include “settled practices” or “routine functions” or any other phenomenon in an organization that cannot be tied to a rule or other rule-like, formal statement of the actions required or systematically encouraged. We got here on an argument from simplicity, but there are several more important reasons to insist that CPA confine its primary gaze to formalized policies.
Such a restriction does not change much
The problem of missing theory
In an unpublished portion of Ritter et al., the authors examined the CPA literature’s deployment of theory for the conceptualization of the relationship between the policy under study and its impacts. In a preliminary analysis, the authors found that almost half of the papers in their sample did not specify any theory, and many of the remaining articles used an economic theory, often in a cursory way. Although these findings did not make it into the final paper, the problem has been noted as
Conclusion
How drug policies are made, their characteristics and distribution, how they are implemented and what impact they have are crucial social questions that raise profound questions of social justice and welfare. Building on a thorough review of recent CPA studies, I have proposed the adoption of a few basic definitions and standards for the practice. CPA is pragmatically defined as the empirical study of the development, characteristics, implementation or effects of a drug policy across more than
Acknowledgements
Work on this paper was supported in part by the National Institute on Drug Abuse (Contract Number HHSN271201500081C). The author thanks Sarah B. Klieger, MPH, for advice and assistance. The opinions expressed in the paper are solely those of the author.
Conflict of interest
The author declares that he has no conflict of interest.
References (36)
Supradisciplinary research practices: History, objectives and rationale
Futures
(2004)- et al.
Medical marijuana laws in 50 states: Investigating the relationship between state legalization of medical marijuana and marijuana use, abuse and dependence
Drug & Alcohol Dependence
(2012) - et al.
Public health and international drug policy
The Lancet
(2016) Cannabis policy reforms in the Americas: A comparative analysis of Colorado, Washington, and Uruguay
International Journal of Drug Policy
(2014)- et al.
Comparative policy analysis for alcohol and drugs: Current state of the field
International Journal of Drug Policy
(2016) - et al.
The science of team science: Overview of the field and introduction to the supplement
American Journal of Preventive Medicine
(2008) National-level drug policy and young people’s illicit drug use: A multilevel analysis of the European Union
Drug & Alcohol Dependence
(2013)- et al.
Researchers and research knowledge in evidence-informed policy innovation
- et al.
Measuring statutory law and regulations for empirical research
- et al.
Medical cannabis laws and opioid analgesic overdose mortality in the United States, 1999–2010
JAMA Internal Medicine
(2014)
Vested interests in addiction research and policy alcohol policies out of context: Drinks industry supplanting government role in alcohol policies in sub-Saharan Africa
Addiction
Fifty years of the 1961 single convention on narcotic drugs: A reinterpretation
Series on legislative reform of drug policies
Legal regulation of health-related behavior: A half century of public health law research
Annual Review of Law and Social Science
Policy surveillance: A vital public health practice comes of age
Journal of Health Politics Policy & Law
Moving from intersection to integration: Public health law research and public health systems and services research
Milbank Quarterly
Integrating diverse theories for public health law evaluation
Making the case for laws that improve health: A framework for public health law research
Milbank Quarterly
Cited by (17)
Drug policy analysis
2023, Substance Use and Addiction Research: Methodology, Mechanisms, and TherapeuticsLegal responses to novel psychoactive substances implemented by ten European countries: An analysis from legal epidemiology
2022, Emerging Trends in Drugs, Addictions, and HealthSisters are never alike? Drug control intensity in the Nordic countries
2019, International Journal of Drug PolicyCitation Excerpt :Including measures for sanction severity will provide a more realistic appraisal of the deterrent effects of drug control policy and a more nuanced assessment of overall policy priorities. Finally, I have used a data-driven approach to control policy coding throughout the study (Burris, 2017). While these data allow for comparison within each country over time and between countries, it is decidedly an input model where I measure what the Nordic countries do and not what outcomes the policies produce.
Principles, practice, and policy vacuums: Policy actor views on provincial/territorial harm reduction policy in Canada
2019, International Journal of Drug PolicyCitation Excerpt :Our approach may also be relevant for other jurisdictions with similar decentralized governance structures over healthcare and harm reduction policies and programs. Burris (2017) has argued that comparative drug policy analysis “should confine its primary gaze to formalized policies” based on the (reasonable) expectation that “practice will now take place more widely, more thoroughly, more consistently, more effectively” when codified in formal policy (Burris, 2017, p. 129). However, our findings suggest that, at least in Canada, participants in policymaking do not always share this optimism, and highlight a variety of ways in which they navigate variable policy contexts to advance harm reduction outside of formal policy development and implementation.
Drug policy constellations: A Habermasian approach for understanding English drug policy
2018, International Journal of Drug PolicyCitation Excerpt :To understand drug policy, we need to develop explanatory theories of how drug policy decisions are produced (Burris, 2017; Ritter, Livingston, Chalmers, Berends, & Reuter, 2016; Stevens, 2011a).
Editorial: Comparing drug policies
2018, International Journal of Drug Policy