Meet the IIU’s Behavioural Science Fellow: Michael Weiss
Impact Canada, Impact & Innovation Unit, Privy Council Office
Michael is a Behavioural Science Fellow at the Impact and Innovation Unit, working on the Program of Applied Research on Climate Action in Canada (PARCA). His work focuses on the ongoing national survery of Canadians' attitudes, beliefs and action regarding climate change.
Prior to joining the IIU, Michael was a postdoctoral fellow at the University of Montreal. His academic work on music cognition explored the development of musical capacities using a variety of computational, behavioural, and neuroscientific methods.
Angela is a Behavioural Science Fellow with the Impact and Innovation Unit and the Public Health Agency of Canada. Her work is focused on risk communications, exploring topics such as vaccine confidence and public trust in government.
Angela has a Master’s degree in Behavioural Neuroscience from Wilfrid Laurier University. In 2021, she completed a Ph.D. in Behavioural Neuroscience from Wilfrid Laurier University, where she studied food behaviour and cravings.
Matt is a Behavioural Science Fellow at the Impact and Innovation Unit of the Privy Council Office. He works with Agriculture and Agri-Food Canada to help accelerate the adoption of environmentally beneficial management practices in Canada's agriculture system.
Prior to joining the Fellowship, he worked at the Library of Parliament, where he provided custom research on social and economic issues to MPs and Senators. He has also spent time in a social innovation incubator, and as a program manager at an environmental non-profit.
Journeying into unknowns of innovation
Impact Canada, Impact & Innovation Unit, Privy Council Office
As a child, I remember wanting to be able to predict the future. Clairvoyance meant acing every test at school and winning the lottery countless times. At the time, I hadn’t realized that fortune telling is not a helpful superpower for daydreamers and trailblazers. Instead, leveraging uncertainty in work, as in life, is a catalyst for creativity — it certainly has been for me during this past year as a Challenge Fellow at Impact Canada. What exactly is uncertainty and how can we use it to innovate?
Uncertainty describes a situation that is understood well, including what causes it and the impact it will have. However, no trends nor patterns are available to predict how the situation will evolve. The more uncertainty the greater number of possible “futures”. These futures can be either favourable or unfavourable.
A recent example of creativity emerging from uncertainty comes from the COVID-19 pandemic. A need for urgent problem solving was required to keep people safe, and the world operational, without knowing how the pandemic would evolve. Many people and businesses needed to find the flexibility to navigate an unpredictable future for their work, tools, or services. Even in sectors where change is historically slow due to the practice of extensive planning and the desire for certainty, novel solutions emerged rapidly to respond to the unpredictable times. For example, in many parts of Canada, the healthcare sector placed an emphasis on keeping COVID-19 case rates low but required the flexibility to explore ways to do so as the pandemic evolved. The experience resulted in new models of care, digital tools, and health services — all of which continue to develop for other health aspects, even from innovators who never previously worked in the sector. It is a perfect case for the power of uncertainty: embracing it does not mean lacking direction and accepting all potential future states. Instead, it means having a very clear direction towards a subset of those future states where a clearly defined problem is solved, or a clear goal is achieved.
All roads lead to Rome” you just might not know which one to take
Even the most creative people in the world need a focal point from which to build their ideas. Challenges, such as those launched through Impact Canada, similarly are a focal point for open innovation competitions. They provide prize funding to a broad range of innovators by defining specific criteria and requirements, directing them to explore many possibilities (including non-traditional ones) that will achieve certain outcomes for desired future states. I have been lucky to support the development of the most recent Impact Canada Challenge, the Type 2 Diabetes Prevention Challenge (T2DP), launched by the Public Health Agency of Canada (PHAC). After an extensive research and consultation phase, gathering subject matter and lived experience advice, along with data to support what could be the most impactful outcomes for Canada, the T2DP goal was narrowed down to focus on finding ways to remove persisting health and social barriers that lead to an increased risk for type 2 diabetes. These barriers are different depending on the community in Canada, and thus there cannot be one overarching problem to solve but various problems experienced by each community. As a result, a Grand Challenge approach has been used to guide innovators to incorporate Challenge principles that can build on the strengths of a community to help prevent type 2 diabetes (such as by reducing stigma or increasing human-centered care). It allows innovators to create new approaches for prevention or adapt something that already exists in order to reach the Challenge goal.
Defining success matters when navigating uncertainty. Challenges set goals that are broad enough for innovators to adapt to a situation as they refine their approach or solution, but are clear enough to achieve the desired outcome. In addition, Challenges often provide supports outside of prize funding to accelerate transforming ideas into innovation, pushing participants further along towards success. Both the funder and the innovators have to embrace uncertainty, being open to multiple opportunities, events, and ideas. They work towards a successful future in lieu of a meticulously planned one. The approach allows veering off the tried and tested paths which only produce already known results and ideas, but do nothing to address persisting problems.
A problem well defined is half solved
- Charles Kettering
Embracing uncertainty isn’t the acceptance of risk, which is the possibility of loss and is measurable unlike uncertainty. To innovate means limiting losses while exploring and testing uncertainty. Challenges carefully define goals and parameters for innovators to operate within, so the risks are minimal when experimenting with what might work to achieve a goal and it’s easy to pivot to a solution that works. They create the conditions for a nothing to lose experimentation approach, using uncertain possibilities for potentially huge pay-offs. For example, at all stages of the T2DP Challenge, there will be benefits for PHAC, for innovators, and ultimately for people communities in Canada from sharing ideas and exploring different ways to prevent type 2 diabetes. The benefits can include, but are not limited to, new partnerships and opportunities to collaborate, new organizations becoming active in diabetes prevention and shared ways of understanding, measuring or responding to being at risk for type 2 diabetes. Endeavours like Challenges, de-risk the act of breaking out of a pattern of reproducing known successes which limits creative exploration.
Uncertainty is the only certainty there is, and knowing how to live with insecurity is the only security
- John Allen Paulos
Working with uncertainty can be scary but doesn’t have to be. I am 100% certain of my uncertain future and it doesn’t scare me. In fact, when people talk about “future proofing” I like to think of it as working towards only the parts of the ideal future that meet our goals. All the other parts will fall into place even if we don’t quite know how. Believe me — I’m still no clairvoyant but it’s worked out very creatively for me.
Driving the Clean Energy Economy with Female-led Innovation
Impact Canada, Impact & Innovation Unit, Privy Council Office
NRCan is a science-based department that works to advance the prosperity of Canada’s natural resource sectors. The Department supports the sustainable development of Canada’s natural resources through world-class research and evidence-informed policy and programs, including domestic and international engagement and in collaboration with Indigenous peoples in Canada.
OERD leads the Government of Canada’s efforts in delivering energy research, development, and demonstrating (RD&D) funding, accelerating efforts in energy innovation and clean technology (“cleantech”) programming. Leveraging over forty years of experience and unique science and technology expertise, OERD invests in thirteen federal departments and agencies to undertake RD&D, as well as a wide range of Canadian small and medium enterprises, utilities, industry, and other firms, all in support of Canada’s energy innovation and climate change goals.
OERD led the Cleantech stream of Impact Canada Challenges, with a $75M portfolio of six unique Challenges. Through the Cleantech stream, NRCan experimented with different challenge designs while striving to maximize the program’s overall impact across the natural resources sector. As one of the first departments to launch Impact Challenges, NRCan’s program team has developed a unique perspective on how innovative funding mechanisms can be applied in different contexts to ensure greatest impact. Ultimately, NRCan hopes to take the lessons learned and best practices from this experience and apply it to future programing, while also aiming to support learning across the federal system by sharing insights from the NRCan Impact model with other departments considering the development of challenge portfolios.
Impact Canada, situated within the Privy Council Office, uses novel public policy methods to address identified gaps in effectively translating policy objectives into meaningful and measurable outcomes for Canadians. The Impact and Innovation Unit, which manages Impact Canada, is working to close the gap between policy development and implementation, by actioning high-level policy commitments and working on design, implementation, and assessment. It delivers on its mandate through the deployment of two main lines of business: Impact Canada Challenges and Impact Canada applied behavioural science and advanced policy research.
Impact Canada Challenges focus on more effectively deploying grants and contributions funding – a traditionally under-optimized, yet highly influential government lever – shifting from paying for expenditures or activities to rewarding the achievement of outcomes, not outputs. Impact Canada Challenges use financial and non-financial incentives to encourage participants to tackle well defined problems where solutions are not apparent or current responses are not achieving the desired results.
In 2017, when this Challenge was under development, only 5% of tech companies in Canada were founded by women. The lack of female representation in science and technology oriented industries was clearly exemplified in the #movethedial11 report on women in Canada’s innovation community. It was reported that only 13% of companies have female representation at the executive level, and 73% of company boards have no female representation at all. These statistics were even more pronounced in the cleantech sector.
Similarly, in a 2018 survey of 350 startups, the Boston Consulting Group reported that female entrepreneurs raised an average of just under $1 million in early-stage capital, less than half the funds raised by men. The authors found that “the disparity in the funding is not due to qualitative differences in pitches or underlying businesses.” In fact, startups run by women performed much better, returning 78 cents per dollar of investment during their early years of operation compared with just 31 cents for those run by men.22
The Government of Canada recognizes that the gender gap, particularly in areas of innovation, is inhibiting economic growth by leaving a portion of the skilled talent untapped. To solve the complex problems we face as a country, we need to rely on the diversity, ingenuity, and creativity of all Canadians – and not simply those who have traditionally contributed to solutions. This means encouraging the active participation of non-traditional solvers, including those who have been excluded from participation, and those who didn’t know they had a seat at the table. It means increasing general societal awareness of the challenges needing solving, actively engaging citizens through more effective collaboration and co-creation, and partnering with civil society to magnify results. Lastly, it means that innovation can do more than just drive economic growth; it can also meaningfully address key societal challenges like climate change and social inclusion – all at the same time. In response to the growing recognition that diversity is essential to building economic resilience, NRCan launched the Women in Cleantech Challenge in 2018 in collaboration with Toronto’s MaRS Discovery District.
The Women in Cleantech Challenge was designed to have a meaningful impact on the underrepresentation of women in Canada’s cleantech sector by supporting a cohort of entrepreneurs with the financial, business, and technical resources they need to be globally competitive. It set sights on leveling the playing field for women innovators, and increasing awareness of the key role women must play in tackling some of the greatest energy and environmental challenges that face society, while also inspiring the next generation of female cleantech entrepreneurs.
Following a national call that saw nearly 150 top female innovators from across Canada apply to the Challenge, an expert selection process chose six women to participate in an intensive 3-year program culminating in a $1-million grand prize for the finalist judged to have made the most progress in advancing their technology and growing their business.
The following four main objectives encompassed this Challenge:
Applicants needed to be:
Within the Impact Canada Challenge framework, challenges may be designed to follow stage-gates or filters, like the Women in Cleantech Challenge. These provide opportunities to select and filter the best ideas and provide more intensive support (both financial and non-financial) to an increasingly refined group of competitors. This structure aims to influence and improve the quality of the solutionsproduced. Stage-gates are particularly useful for Challenges that aim to support innovators at an early stage of product development, or start-up businesses in need of seed capital to kick-start the work33.
During the 3-year incubation period, finalists each received:
Over that time, finalists:
Throughout the Challenge design and implementation phases, a singular focus on outcomes ensured that decisions were made to maximize impact for the entrepreneurs. The key goals of the Women in Cleantech Challenge were to level the playing field for six high-potential women innovators, and to inspire an emerging generation of women in fields of clean technology entrepreneurship. All design decisions were made in service of these outcomes, and built around three pillars of support: business, technical, and financial. These created the backbone of support mechanisms that worked together to incubate the six business ventures that were selected to participate in the Challenge.
Knowing that collaboration would be the key to achieving results for a Challenge with such broad objectives, NRCan decided to work with MaRS to leverage their strengths in cleantech business development and complement NRCan’s science, technology and program expertise. NRCan opted for a third-party delivery agent model to facilitate this, and to ensure sustained access to MaRS resources for the duration of the Challenge. Collaborating with MaRS allowed the finalists to receive high-caliber training and advisory support, while effectively tapping into a broader innovation ecosystem and investor network. It also facilitated early engagement between MaRS and other key stakeholders, such as Écotech Québec, to further support Challenge activities. MaRS leveraged its deep roots in the global cleantech ecosystem to deliver bespoke training, access to a vast network of advisors and investors, and numerous thoughtfully curated opportunities. The finalists were also prominently featured at global innovation and investment events, such as the 2019 Clean Energy Ministerial, Mission Innovation, EDC’s Cleantech Export Week, and 2021 MaRS Climate Impact Week. MaRS’ strong networks allowed for the Challenge to have a bigger and more public presence, including the recruitment of a prominent judging panel with powerhouse women: Janie C. Béïque, Elicia Maine, Humera Malik, Jennifer Ramsey, and internationally acclaimed Canadian author, Margaret Atwood.
As a complement to the MaRS curated business development curriculum, the Challenge offered access to federal laboratory facilities and expertise, with the aim of furthering technology development and accelerating market readiness. Through NRCan, finalists were able to work with world class federal research labs to test, improve, and de-risk their technologies with collaborative R&D projects. These projects were carried out through an NRCan mechanism known as the Science and Technology Assistance for Cleantech (STAC). The STAC model supports organizations with capacity gaps, such as those with limited research infrastructure, technical expertise or cash flow constraints that would impede an organization’s ability to advance their technology or service to market. This unique mechanism can be an especially powerful support for small and medium sized enterprises in that there are no direct costs to the organization for the collaborative R&D project. In this way, Challenge finalists were able to collaborate with the federal laboratories and their scientists, which are known for their vast and specialized expertise in applied science and exceptionally well positioned to work through the challenging stages of pilot testing and scaling up technologies.
Enabling the entrepreneurs to focus all of their time and attention on growing their businesses was a priority for the Challenge, and for this reason an annual living stipend was another important design feature and one of the financial support mechanisms finalists received. This element enabled the cohort to put their best efforts into nurturing their ventures, but also ensured that there was an even playing field across the finalists. It allowed the finalists to put full-time effort into their business venture goals and have singular focus by minimizing competing priorities, which is very different from the reality of what most entrepreneurs face when growing their businesses. Ultimately, the annual stipend was highly regarded by the entrepreneurs as one of the key benefits to the Challenge.
While a Challenge has the potential to attract non-traditional solvers to a problem, it cannot do so without significant promotion and marketing campaigns that engage networks beyond those targeted by traditional government programming. The Challenge was made visible through a number of channels, including email blasts to MaRS Cleantech lists, targeted social media advertisements, blog posts, a piece in The Globe and Mail, video footage posted across social media platforms, and organic social posts. Additionally, the partnership between NRCan and MaRS meant that the Challenge benefitted from cross promotion of social media posts and communications, which amplified the messaging and garnered additional public attention. These efforts resulted in widespread engagement, both at the launch of the Challenge and for the finale. The number of applicants exceeded expectations by 87%, and dedicated web platforms and social media received above average views and re-shares in comparison to traditional government initiatives. Lastly, another factor that cannot be overlooked is that the Women in Cleantech Challenge was about increasing representation in the innovation ecosystem, at a time when equity, diversity and inclusion were increasingly in the public eye. This was another reason that the program quickly garnered public support and awareness, and allowed for high levels of engagement throughout the duration of the Challenge.
The Challenge sought to mobilize new talent to address the under-representation of women in the cleantech industry. Using an open approach with low initial barriers to entry, it encouraged broad participation and enticed non-traditional entrants who might have had limited experience participating in traditional government grants and contributions programs. This enabled the Challenge to attract talented applicants and semi-finalists of diverse ethnicities, ages, and technology areas.
The Challenge effectively addressed key barriers to women’s success in a coordinated and complementary fashion by assembling training and support components into a comprehensive package. Bundling these elements together significantly reduced the burden on participants, who would otherwise have needed to assemble them on their own. For example, the finalists received negotiation training through MaRS, and were then able to apply those skills and gain experience using them by negotiating contracts with collaborators or investors. The integrated program created the opportunity to learn, put that learning into action, and improve through iterative feedback loops. Ultimately, the finalists who were excellent technical leaders were now able to focus on becoming excellent business leaders as well.
Furthermore, the program’s design also enabled capacity increases at MaRS. As an organization, MaRS gained additional experience supporting women entrepreneurs and created strong networks in a challenge or Accelerator framework. This new expertise can be utilized in future MaRS programming to impart long term social benefits for Canada – and in fact, this is already underway!
Through the entrepreneurial training provided by MaRS, the potential for the finalists to attract private investment was significantly increased. Not only were finalists able to meet with targeted investors, corporates and potential partners, they also received training on how to effectively deliver pitches and were provided the opportunity to receive feedback on their delivery. These opportunities all played a role in accelerating the growth of the cohort that allowed the finalists to make significant business development headway. At the end of the Challenge, the cohort collectively raised $52.5 million in funding, and the number of paid employees grew from a total of 10 to 82.5, which represents a 725% increase.
The Challenge has been an effective and innovative funding approach to tackle high priority issues for the Government of Canada and society. It was well-timed in that it launched during a period of increased federal attention to gender inequality, and a growing interest and comfort with the use of innovative funding mechanisms. The 2018 Federal Budget had an unprecedented focus on advancing gender equality in Canada, and introduced the Government’s new Gender Results Framework which highlighted key gender equality goals for Canada, including Education and Skills Development, Economic Participation and Prosperity, which are particularly relevant to this Challenge. This has undoubtedly channeled greater support and increased attention across the Government and innovation ecosystems.
At the same time, the federal government advanced the use of innovative funding mechanisms and championed greater experimentation. This included Impact Canada’s set of horizontal Terms and Conditions for transfer payments, which provided enhanced flexibility to NRCan to pursue innovative program delivery using Challenges. It also included the STAC collaboration mechanism, which at the time was a first of kind model pioneered by OERD. Approval of the STAC model was a significant achievement, as traditionally the Transfer Payment Policy was interpreted to prevent collaborative R&D projects between federal laboratories and recipients of Grants and Contributions.
Perhaps one of the main reasons behind the success of the entrepreneurs and their business ventures was the unanticipated “cohort effect” that came about during the Challenge. The cohort had an undeniably collaborative spirit, one where the relationships were built on strong mutual support, sharing of knowledge, and the reinforcement and amplification of each other’s work. This team approach for a prize-based competition was not only remarkable, but also created massive benefits for the entire cohort. Some of the Challenge design features that could have played a role in enabling this effect include:
Ultimately, the “cohort effect” was a powerful mechanism that transformed the experiences of the individual finalists. It was even noted by the finalists as potentially being more valuable than the grand prize money at stake at the end of the Challenge.
Building on the success of the Women in Cleantech Challenge program model, MaRS launched the RBC Women in Cleantech Accelerator (the “Accelerator”) in 2021. The Accelerator’s goal is to continue increasing female representation in Canada’s clean technology innovation economy, by recruiting new entrepreneurs to participate in future cohorts. The curriculum for the Accelerator was designed based on feedback from MaRS’ experts and the Women in Cleantech Challenge finalists and leverages the enhanced public profile of the Women in Cleantech Challenge. The continuation of Women in Cleantech funded by private sector investment is a testament to the true success of the Challenge, signaling that there is and can be an alignment between public and private sector goals. It also demonstrates the beginning of ripple effects of the Challenge and how it has impacted our views of the innovation ecosystem and the role that women need to play in it.
Summit Nanotech has developed an innovative method of lithium-ion extraction from produced brine water, having the potential to revolutionize both the mining and energy-storage sector. The approach creates an inexpensive and sustainable source of green lithium for batteries used in electric vehicles, portable devices and mobile gadgets, all of which are fast-growing, multibillion-dollar markets. Summit Nanotech was awarded the Solar Impulse Efficient Solution Label, has been named by Corporate Knights as one of the 50 fastest-growing green companies in Canada, and most recently closed US$50 million in Series A2 funding.
Support in the cleantech ecosystem for women is growing stronger every day. There are opportunities in various incubators and acceleration platforms, but beyond this your fellow female cleantech CEOs will catch you before you fall.
Evercloak uses an energy-efficient and affordable process to develop nanofilms and nanocoatings. The films significantly reduce the energy required for commercial and residential air conditioning and are often used in cleantech applications, including water purification, energy storage, corrosion prevention, sensing, and smart packaging. In 2021, Evercloak engaged in a $4.5M collaboration with Environmental Systems Corp.
The Women in Cleantech Challenge was the launch pad for Evercloak, inspiring me to make the leap to entrepreneurship. The tailored mentoring and access to federal labs to scale Evercloak’s technology has equipped me with tools to accelerate our growth.
Open Ocean Robotics designs and builds autonomous solar-powered boats that collect real-time data on emissions, oil spills, and other risks to the ocean. Julie’s goal is to create a ‘digital ocean’ to connect and exchange ocean data. Julie is a recipient of the British Columbia Cleantech Industry Icon Award and more recently, Open Ocean Robotics was awarded ventureLAB’s Company of the Year Award.
Cleantech entrepreneurship offers incredible opportunities to improve our planet's sustainability, create economic prosperity and advance technological innovations. To achieve these things we need diversity and more women to pursue STEM fields and take leadership roles in driving change.
Dispersa has harnessed a bacterial process to produce biodegradable biosurfactants — active agents that are used in a variety of products today. Dispersa’s non-toxic, palm-oil free biosurfactants can be readily integrated into end-user formulations, such as cleaning products, detergents, and cosmetics. Recently, Dispersa has been selected as a SheEO Venture Semi-Finalist in Canada.
Creating an impactful sustainable difference through innovation has always been a dream of mine. The Challenge helped transform my vision into reality by providing an incredible amount of curated support and resources necessary to transition from an idea I had as an undergrad into the growing cleantech venture Dispersa is today.
Solistra
Solistra developed a technology that converts CO2 and methane into clean carbon products. The approach could prove a powerful, energy-efficient way to turn CO2 captured from power plants or the atmosphere into clean chemicals and fuels. In 2019, Alexandra was named a top 30 under 30 sustainable leader in Corporate Knights magazine. More recently, Alexandra has taken on a postdoctoral associate role at the Massachusetts Institute of Technology.
As a PhD engineer, it has been invaluable to learn about the broader cleantech ecosystem, business practices and strategies, and the economics of technology commercialization. I have been able to broaden my STEM career, since STEM in isolation cannot solve the world’s problems — a more holistic approach is required.
Genecis has developed a solution that converts organic waste into a polyhydroxyalkanoate (PHA) based bioplastic. PHA bioplastics are fully biodegradable in marine and terrestrial environments and can be used in traditional plastic applications such as packaging films, bags, containers, utensils, and other items. Genecis is one of the youngest teams to receive a multimillion-dollar grant from Sustainable Development Technology Canada. More recently, Genecis announced that it has raised US$7 million in Series A funding led by Khosla Ventures and BDC Capital’s Cleantech Practice.
The Women in Cleantech Challenge has not only navigated our company out of an innovation ‘Valley of Death’ and played an instrumental role in our success but, most importantly, it demonstrated that there is no longer a ceiling to what women pursuing a career in cleantech can do.
In November 2021, Amanda Hall of Summit Nanotech was awarded the $1M grand prize. The competition tasked six first-time women entrepreneurs with scaling their startups over the course of more than three years.
Designing and delivering a Challenge is a process of continual reflection, learning and adaptation. Every Challenge is unique and it’s impossible to predict and plan for all potential outcomes in advance, so there is no single script to follow. The delivery teams at NRCan and MaRS were constantly tracking progress, considering how the Challenge could be improved in potential future iterations, and exploring how the learnings could be applied in different contexts. A Challenge is an opportunity to try new things and to consider innovative solutions to better service intended outcomes.
In order to solve the complex problems we face as a country, we need to rely on the diversity, ingenuity, and creativity of all Canadians – and not simply those who have traditionally contributed to solutions. This means encouraging the active participation of non-traditional solvers, including those who have been excluded from participation, and those who didn’t know they had a seat at the table. It means increasing general societal awareness of the challenges needing solving, actively engaging citizens through more effective collaboration and co-creation, and partnering with civil society to magnify results. Lastly, it means that innovation can do more than just drive economic growth; it can also meaningfully address key societal challenges like climate change and social inclusion – all at the same time. By being thoughtful in program design decisions, social, environmental, and economic outcomes can all be equally addressed rather than being mutually exclusive of one another.
By maintaining ongoing engagement with aspiring cleantech entrepreneurs, the successful Women in Cleantech Challenge has the potential to lead to long term benefits to Canadians. It is NRCan’s hope that the Challenge will continue to inspire the next generation of women innovators for years to come and its ripple effects will work toward closing the gender gap as we know it.
The presentation of ideas can drastically alter the way that they are received and acted upon. This is one reason why, for all-encompassing public health matters like mental health, the framing of the problem can fundamentally define the approaches we consider for addressing it.
In the late 1970s/early 1980s, two researchers — Amos Tversky and Daniel Kahneman — laid the foundations of a psychological theory for understanding how the presentation of information affects peoples’ decisions. The key takeaway was the critical importance of message framing: even when the substance of two options are identical, our choices and decisions are highly swayed by the way in which they are presented. In doing so, Tversky and Kahneman transformed our understanding of human behavior by demonstrating that the way we interpret information is strongly biased by the framing of the message or concept.
Consider, for example, that the appeal of a hand sanitizer advertised as killing almost 90% of germs might vastly outweigh the appeal of one advertised as leaving more than 10% of germs behind. While the substance of the two options is effectively identical, the presentation can affect our preferences and influence how we evaluate the available options.
Since then, Tversky and Kahneman’s 1981 paper (The framing of decisions and the psychology of choice)Footnote 1 has been cited more than 24,000 times. While the nuance of how different conceptual frames affect our decisions remains a matter of ongoing debate and study, new work has shown that a wide variety of factors (like the emotional tone and context of a message) can influence how we interpret informationFootnote 2.
It is unsurprising, then, that this work has since been applied extensively in the context of political decision-making and policyFootnote 3 including in the context of public health. The importance of framing goes well beyond simple risk-choice experiments in a laboratory. The framing of a message or concept can affect public perception of major issues and support for policies, and some work has shown that changing the message framing can affect the way that people respond to policiesFootnote 4. In short, altering the framing of a concept or message can drastically change the way that people act or respond to it.
My name is Anthony Murkar, and I joined Impact Canada as a Behavioural Science Fellow in February 2022. I presently work jointly with the Public Health Agency of Canada’s (PHAC) Behavioural Science Office (BeSciO). When I joined the Impact Canada Behavioural Science Team, I started observing the discourse surrounding mental health in Canada. Prior to joining, I had been working in one of Canada’s largest mental health facilities on primarily pre-clinical models of mental illness. Naturally, the framing of mental health in the context of pre-clinical drug research was usually disease-oriented. When I transitioned into government work, I was met with a very different take on mental health: PHAC’s mandate towards health promotion and prevention of disease places a much greater emphasis on what can be done to improve the mental health of Canadians through preventative measures.
A colleague recently clarified the problem of our current framing of mental health in a striking way: “For many Canadians,” they said, “mental health means mental illness.” Indeed, it has long been the case that mental health has been defined solely as the absence of psychopathologiesFootnote 5.
The view of mental health as an ‘absence of mental illness’ certainly framed my own perspectives on mental health. As someone educated with a PhD in Psychology, I was alarmed by the realization that in nearly a decade of psychological education the concept of positive mental health had rarely come up.
Just as the framing of a concept affects choices, so too does the framing of a problem affect the approaches we consider for solving it. The conceptualization of mental health as an absence of mental illness has driven the way we talk about mental health problems as researchers and, subsequently, our approach to solving them.
While the medicalization of mental health has had some positive effects (e.g., reducing stigmatization and broadening the public understanding that mental disease has a biological origin), it has also presented a major roadblock to governments’ approaches to treatment. An illness-centric framing of mental health places the emphasis of intervention solely on those who have already reached a point of crisis. The treatment of disease only targets those with currently active illness, and is therefore unsuitable for making population-level shifts in health. Critically, the evidence indicates that this approach has not been successful at reducing the prevalence, age of onset, or disease burden of mental health problems Footnote 6. In other words, our efforts were too late: more upstream approaches are needed to promote positive mental health earlier, before problems arise.
We are in the midst of a global shift in the way the concept of mental health is framed. For the past twenty-odd years, the characterization of mental health by public health officials has been re-orienting towards a definition that is more conducive to mental health promotion and the upstream prevention of mental health problems and their systemic causes and social determinants. While the idea of framing mental health as a positive factor that is common to everyone (instead of just an absence of mental illness) had been well established over 60 years ago Footnote 7, positive mental health promotion was still regarded as a new area of work in health promotion as little as two decades agoFootnote 8.
In 1996, the World Health Organization (WHO)’s first Global Burden of Disease study brought mental illness into the spotlight of Public Health, with depression being revealed as the fourth leading cause of disease burdenFootnote 9. By 2004 the WHO had published its report on mental health promotion with the aim to shift the framing of mental health away from a sole focus on mental illness as a disease. The aim? Population-level changes that could reduce the disease burden of mental health. While the framing of mental health as the absence of mental illness only targets those with currently active disease, the promotion of positive mental health can instead target all members of society.
In short, by simply re-framing mental health as a positive concept that applies to all members of society, the approaches to targeting mental health were also shifted. By re-framing the concept, the trajectory of new approaches to reducing the global disease burden of mental health was fundamentally changed. The main problems were that an illness-centric model of mental health targets very few people, intervention occurs at too late a stage (only after illness has already begun), and the illness-centric framing largely leads to treating mental health with reactive measures alone.
In contrast, the framing of mental health as a positive trait that applies to everyone instead necessitates a proactive approach that occurs before the onset of mental health problems. Its target is also population-wide — and while the reactive approach was largely failing to move the needle on prevalence of mental health problems, the positive mental health approach demands preventative interventions that instead occur at a much earlier stage (before the onset of mental health issues). Thus, its reach is much broader and it has greater potential for making population-level changes in mental health status.
The WHO’s reports on mental health now explicitly emphasize that mental health is more than the absence of mental illnessFootnote 10, and this sentiment has been echoed by institutions around the world. In Canada, our institutions had already been leading the way by pivoting to make the shift to a more inclusive framing of mental health as a positive concept that applies to everyone. PHAC currently defines positive mental health as “the capacity of each and all of us to feel, think, act in ways that enhance our ability to enjoy life and deal with the challenges we face. It is a positive sense of emotional and spiritual well-being that respects the importance of culture, equity, social justice, interconnections and personal dignity.” PHAC has also developed frameworks for monitoring positive mental health and wellness (the positive mental health surveillance indicator framework). Some provincial jurisdictions now explicitly highlight that mental health is a positive conceptFootnote 11. Other institutions reinforce a two-continuum model of mental healthFootnote 12 highlighting that it is possible to experience poor mental health without having a mental illness and vice versaFootnote 13 (i.e., that the predictors of positive mental health and the predictors of mental illness are distinct from one another). All in all the reframing of mental health in a positive light has been well underway in Canada for some time.
While this shift in the way we frame mental health is still ongoing, the way forward could not be clearer. Reinforcing these changes in the way we conceptualize mental health around the world continues to be critical towards fostering more upstream approaches that can improve mental health and reduce the global disease burden of mental health problems.
Since 2017, Impact Canada has been partnering with federal partners to leverage Challenges as an innovative financing tool to help solve complex problems for Canadians. Impact Canada Challenges differ from other traditional government funding programs as they are designed as an "outcomes-based" approach using financial and non-financial incentives to draw innovators to direct their talents towards finding solutions to specific problems.
Since the introduction of Challenges as a tool in the Government of Canada toolbox, Impact Canada has been working on measuring their impact, as well as improving how they are designed and implemented. Guided by a clear Logic Model, Impact Canada has operationalized both quantitative research with Statistics Canada, and qualitative research, including case studies, surveys and social network analyses.
This summary report focuses on one line of inquiry that Impact Canada is using for impact measurement of Challenges: Stakeholder surveys. In March and April 2022, Impact Canada launched a series of surveys targeting three stakeholder groups: (1) Applicants, (2) Jury panel members, and (3) Departmental partners.
Impact Canada is part of a comprehensive set of initiatives launched by the Government of Canada in 2017 aimed at solving complex policy challenges using challenge prizes, pay-for-success, and behaviourally based models. Impact Canada enables the use of challenge prizes through a set of flexible Terms and Conditions (Ts&Cs) for Grants and Contributions that allow funding to be linked to outcomes achieved as well as funding rigorous, research based evaluations.
The Impact and Innovation Unit at the Privy Council Office helps departments develop innovative funding opportunities that bring together the best ideas and brightest talent, and reward those organizations and individuals that deliver high impact results for Canadians.
Since the launch of the first set of Challenges, Impact Canada has been developing a framework for measuring and evaluating the impact of Challenges. Guided by a clear Logic Model, which presents the outcomes we seek to achieve through Challenges, Impact Canada has been using multiple lines of inquiry to understand short, medium and long-term outcomes of Challenges. For an overview of the different research methods and approaches we have been leveraging for impact measurement, read a recent blogpost by Kiran Toor. In short, Impact Canada has operationalized both quantitative research with Statistics Canada, and qualitative research, including case studies, surveys and social network analyses.
This mini report is focused on one line of inquiry that Impact Canada is using for impact measurement of Challenges: Stakeholder surveys. In March and April 2022, Impact Canada launched a series of surveys targeting three types of audiences:
For operational purposes, the surveys were administered with relatively short timelines for response (data collection took place between March 24 and April 1, 2022), potentially explaining the lower than expected response rate in some categories (between 17–33%).
Overall, survey results demonstrate that the Impact Canada Challenge model is an effective policy approach for delivering on government priorities, with most respondents acknowledging that challenges are delivering on their intended outcomes.
66% of jury respondents and 64% of department respondents indicated that a Challenge was the appropriate mechanism to address the problem area to a very large or large extent. Further, only 2% of jury respondents and 8% of department respondents indicated that the Challenge was a minimally or not at all effective mechanism to address the problem area. This large proportion of respondents confirming that the use of a Challenge was appropriate to address the problem area, is a good indication of the usefulness of Challenges as a tool in Government of Canada toolkit to address complex problems.
Table 1. In your opinion, was the use of a Challenge appropriate to address the problem area? [Surveyed departmental partners (n=47) and jury members (n=93)]
While departmental respondents held positive views that Impact Canada Challenges are meeting stated objectives, Challenge applicants and jurors, had even stronger positive views. This is an indication that Challenges may be more closely meeting the needs of Canadians than anticipated by our departmental partners.
For example, applicants and jurors placed a higher value for the role of Challenges in raising awareness, creating innovative solutions, enhancing solvers’ skills, increasing investments, and achieving long term outcomes.
Table 2. In your view, how much did the Challenge contribute to the following results: [Departmental partners; n=47]
Jurors also placed higher value on improving the assessment of applications, better aligning funding decision making to industry needs, increasing transparency, and democratizing funding decision making.
Table 3. In your view, how much did the Challenge contribute to the following results: [Jury members; n=93]
Table 4. In your view, how much did the Challenge contribute to the following results: [Applicants; n=426]
The survey results show that Challenges are successful in drawing new talent and engaging non-traditional actors, with above-average proportions of youth, women, and minorities applying to Challenges. For example, youth (35 years old or under) represented nearly one fifth of Challenge applicants that responded to the survey; women were nearly one fourth, entrepreneurs from visible minorities or indigenous groups were nearly 40%, and entrepreneurs living with a disability (e.g., physical, mental, or other long-term condition) were 7% of applicants.
There is also evidence that Impact Canada Challenges have contributed to mobilizing new talent to solving complex problems; talent that might not have been mobilized otherwise. Nearly one-fourth (23%) of applicant respondents indicated that the Challenge was the sole motivation for them to work on the specific problem area and nearly half (48%) indicated that the Challenge motivated them to work on the problem to a large extent.
Table 5. To what extent did the Challenge motivate you to work on this specific problem? [Applicants; n=426]
Among the applicants, 16% had minimal or no knowledge of the problem area prior to the launch of the Challenge.
Table 6. Prior to the launch of this Challenge, to what extent did you know about the Challenge problem area? [Applicants; n=426]
With respect to the sector/domain, 19% of applicant respondents indicated that they were previously working in a different sector than the problem area.
Table 7. Prior to the launch of this Challenge, were you working in the same sector/domain as the Challenge problem area?
In addition, 18% of applicant respondents indicated that they developed their solutions after launch of the Challenge.
Table 8. Prior to the launch of this Challenge, were you working on developing your proposed solution?
For applicants who were working on their solutions prior to the Challenge, 72% admitted having made improvements and changes to their solution to apply to the Challenge.
Table 9. Did you make changes/improvements to your solution in order to apply to this Challenge?
There is a wide range of applicants to Impact Canada Challenges. At the time of application, only about half of respondents (52%) were businesses and over one-fifth (22%) were not-for-profits. Under one-fifth (18%) were individuals or group of individuals, many of whome ended up incorporating into companies or not-for-profits. Applicants also included academic institutions (4%), indigenous groups (3%), and government organizations (1%, mostly municipalities that applied to the Smart Cities Challenge).
More than two-thirds (69%) had never applied to government funding before, resulting in Impact Canada Challenges being their first opportunity to seek government financial support for their work.
Table 10. Other than Impact Canada Challenges, have you ever applied for a Government of Canada grant or contribution program?
The majority (89%) of applicant respondents were considered small businesses (defined by Industry Canada as having less than 100 employees) and half (50%) had less than 10 employees. Only 4% of applicants were large enterprises (over 500 employees), and most were recently established as organizations.
Table 11. What is the size of your organization? [Applicants; n=426]
More than half (52%) were established less than 5 years prior to Challenge launch and one-tenth (11%) were established after Challenge launch (i.e., organizations incorporated to participate in the Challenge).
Table 12. When was your organization established?
Applicants to Challenges are more motivated by working on the Challenge problem than by the financial reward. Successful applicants in particular, were more likely to value the non-financial support associated with Challenges (e.g., partnerships, access to experts, mentoring and skills development).
Table 13. Indicate the importance of the following incentives in motivating you to participate in the Challenge
Conducting a survey was an effective way of not only collecting information where data gaps exist for impact measurement purposes, but it was also beneficial to obtain feedback on ways to enhance Impact Canada Challenges, as well as collect information on our partners’ experience participating . Having the ability of curating questionnaires to particular policy needs makes surveys a method that complements other modes of inquiry well.
Stay tuned to this site for more on how Impact Canada is exploring different methods to measure the impact of our work and evaluate Challenges as a public sector instrument.
Since 2017, Impact Canada has been partnering with federal partners to leverage Challenges as an innovative financing tool to help solve complex problems for Canadians. Impact Canada Challenges differ from other traditional government funding programs as they are designed as an "outcomes-based" approach using financial and non-financial incentives to draw innovators to direct their talents towards finding solutions to specific problems.
Since the introduction of Challenges as a tool in the Government of Canada toolbox, Impact Canada has been working on measuring their impact, as well as improving how they are designed and implemented. Guided by a clear Logic Model, Impact Canada has operationalized both quantitative research with Statistics Canada, and qualitative research, including case studies, surveys and social network analyses. To read more about Impact Canada’s impact measurement approach, read our Logic Model, and this blog.
In a previous summary report, we presented highlights from Stakeholder surveys. Here, we present results from another line of inquiry that we are exploring for measuring the impact of Impact Canada Challenges: Social network analysis. In collaboration with students from the Master of Data Science at the University of British Columbia (UBC), and Statistics Canada, our team at Impact Canada embarked on a pilot project to leverage social network analysis in measuring the impact of our Deep Space Food Challenge. The result of this exercise was the development of a methodology that can be replicated for impact measurement of all challenges.
Impact Canada is part of a comprehensive set of initiatives launched by the Government of Canada in 2017 aimed at solving complex policy challenges using challenge prizes, pay-for-success, and behaviourally based models. Impact Canada enables the use of challenge prizes through a set of flexible Terms and Conditions (Ts&Cs) for Grants and Contributions that allow funding to be linked to outcomes achieved as well as funding rigorous, research based evaluations.
The Impact and Innovation Unit at the Privy Council Office helps departments develop innovative funding opportunities that bring together the best ideas and brightest talent, and reward those organizations and individuals that deliver high impact results for Canadians.
Social network analysis is a process of studying relationships among people and organizations. Using a graph theoretical approach, social networks can be conceptualized as a graph with nodes (units or points) representing the relationships and interactions between social actors.
With this approach, our team tried to answer the following research questions around the impact of Challenges:
While a number of social media platforms were explored, we ultimately chose to use Twitter, as it is a popular platform used by our audience and has wildly available public data (e.g. user followers, followings, tweets, and profile information) to develop a proof-of-concept. Further, given its overall popularity and open structure, there are a significant number existing and available research tools designed for collecting and analyzing its data.
In order to answer our questions on the Impact of Challenges, we developed a step-wise approach to developing the proof-of-concept. Briefly, we used the steps outlined below:
The preliminary results of our social network analysis suggests that the Impact Canada Challenge model is effective in drawing attention to the problem and expanding networks of people and organizations engaged with the problem.
Using 'deep space food' to query and visualize social network activity, we observed a significant expansion in the network of actors and the number of interactions around the topic after the launch of the Deep Space Food Challenge.
There were only a limited number of posts and engagement on the topic of 'deep space food' in the period between August 1st, 2019 and January 11th, 2021. Unsurprisingly, the largest nodes, representing the highest ranking social media actors in terms of the number of posts, are NASA and CSA_ASC.
A great expansion in the number of posts and individuals engaged on the topic of 'deep space food' were observed in the period after the launch of the Challenge between January 12th and May 31st, 2021.
Another way to measure the impact of Challenges in raising awareness about the problem is to look at the number of interactions and engagements on social media. Table 1 below shows that there was a large increase in the number of discussions (e.g. tweets) about the issue on social media (nearly five times more tweets after launch of Challenge), as well as a significant increase in interactions and engagements (e.g. retweets, mentions, comments).
| Count | Before Challenge Launch | After Challenge Launch | Growth |
|---|---|---|---|
| Tweets | 349 | 1,709 | +390% |
| Interactions | 14,238 | 40,733 | +186% |
Sentiment analysis was conducted on the tweets to better understand the content of the conversations about the issue. Interestingly, the overall sentiment of the social media messages was positive and had a more positive score after the Challenge was launched.
Using social network analysis, the team investigated who are the actors engaging with Impact Canada Challenges. As the Deep Space Food Challenge in particular was an international endeavour launched jointly in Canada by the Canadian Space Agency and Impact Canada and in the United States by NASA, it was no surprise that the Challenge reach was international in nature, with thousands of connections between the United States, Canada, and the rest of the world.
During the first 18 months since Challenge launch, there were 1,309 actors engaged in the network (represented as nodes) and 1,402 distinct interactions and relationships between those actors (represented as edges). The network is shown in Figure 2 below, using a geography-based layout, where the American network is illustrated in pink and the Canadian one in blue.
1,309 actors engaged in the network (represented as nodes) and 1,402 distinct interactions and relationships between those actors (represented as lines connecting nodes) shown on a map. The American network is illustrated in pink and the Canadian one in blue. The Canadian network is centered around the Canadian Space Agency (CSA) and Impact Canada (Impact and Innovation Unit) in Montreal and Ottawa. Lines all over the map reveal interactions from across the globe.
Zooming in on the Canadian network, one can clearly see that the network is centered around the Canadian Space Agency (CSA) and Impact Canada (Impact and Innovation Unit). The size of the nodes in Figure 3 below is scaled based on eigenvector centrality calculations, which measure the degree of influence in the network. One interesting finding is that Impact Canada has nearly an equal level of influence as the CSA who is the problem-owner and is implementing the Challenge. This is a validation of the importance of Impact Canada’s reach and the benefit for Government of Canada departments to leverage Impact Canada’s resources to expand the network of solvers and reach a large talent pool. The graph also allows for the identification of different groups/communities engaged with the Challenge. Using modularity measures and color to determine community association, subnetworks can be identified, such as the orange subnetwork below, which is an academic network centered around the University of Guelph.
Shown are nodes representing actors engaged in the network. The size of the nodes are scaled based on eigenvector centrality calculations, which measure the degree of influence in the network. The node for Impact Canada has nearly an equal level of influence as the one representing CSA who is the problem-owner and is implementing the Challenge. Using modularity measures and color to determine community association, subnetworks can be identified. Shown are a number of subnetworks including one academic network centered around the University of Guelph.
The team also used social network analysis to investigate the networks formed by applicants and participants in the Deep Space Food Challenge. The objective was to understand whether Challenges support the expansion of collaborative networks and partnerships. Interestingly, the team found that participants who were successful in the first stage of the Challenge (selected as a semi-finalist) were more likely than unsuccessful applicants to have a bigger network online and more likely to have a higher follower to following ratio (i.e. they had more followers for every person they followed on social media).
However, there are limitations to this data. First, the team was only able to identify the public social media account information for approximately 20% of the challenge applicants. Second, given the time and resources constraints, it was not possible to extract time-series data to understand when different connections were made. This meant that there was no meaningful way to study the evolution of those networks over time, including the establishment of a baseline for the size and structure of the participants’ network prior to Challenge Launch.
The participants’ network based on data from May/June 2022 is shown in Figure 4 below.
Shown is a graph of participant networks, displayed as spheres of nodes representing each participants reach and lines to represent connections between them (using approximately 20% of challenge participants and data from May and June 2022). In this representation, Noblegeninc and JustVertical have the largest networks.
Social network analysis is a powerful tool that can be leveraged to measure the impact of Challenge competitions. For the Deep Space Food Challenge, used as a pilot for this study, the analysis seems to confirm that Challenges can greatly help in raising awareness about a topic. It can also study the diversity of actors engaged with Challenges, as well as the different networks formed between those actors, particularly Challenge applicants and participants. Identifying influential actors in a network can be an important tool for Challenges to use as a medium for reaching a larger number of solvers, as well as communicating results of the Challenge and promoting solutions.
Moving forward, it would be beneficial to integrate the collection of social network data early in the Challenge process as many types of data cannot be collected retroactively (for example number of followers/following prior to a certain date). It would also be helpful to have closer coordination with Challenge applicants and participants in the collection of this data (for example, ask applicants to share their Twitter handles or other public social media pages).
In addition to Twitter, LinkedIn could be a very useful tool in impact measurement of Challenges. It can be used to better study participants growth via job postings and number of employees, as well as the type of talent hired and the expansion of professional connections over time. However, accessing LinkedIn data will most likely require a formal partnership with LinkedIn since public access to their API was shut off in 2015Footnote 1 and web scraping of LinkedIn data was deemed difficult due to the security features of the siteFootnote 2.
Thank you to co-authors Andrew Nguyen, Kristy Phipps, Nelson Tang, and Carl Zou from the Master of Data Science at the University of British Columbia (UBC), and to Statistics Canada.
My background is in mental health and neuropsychology, which are fields that integrate insights from a variety of disciplines. Throughout my postdoctoral training, for example, I had the opportunity to work with multidisciplinary teams to identify and address service barriers for autistic youth. These experiences have taught me the importance of considering diverse perspectives and I hope to continue to collaborate and learn from others in my new role as a Fellow.
I was motivated to apply to the Fellowship program because it offers the opportunity to leverage my knowledge and skills to inform health initiatives and address key problems facing Canadians. By directly tackling these issues in real-world contexts, it also helps to bridge the gap from research to practice/implementation and facilitate evidence-based decision making, which is really exciting to be a part of!
The application of behavioural science insights can help us respond to pressing societal challenges because it is a systematic approach to problem-solving that is driven by scientific principles.
In other words, using a behavioural science lens, we can better assess, and understand, the extent of these challenges and develop and test out interventions to solve them in a systematic way.
"Using a behavioural science lens, we can better assess, and understand, the extent of these [societal] challenges and develop interventions to solve them in a systemic way."