Advanced Research and Invention Agency (ARIA) | Safeguarded AI

Thumbnail

Event details

Date 02.01.2025
Category Call for proposal
Aim: The foundation is looking to support teams from the economic, social, legal and political sciences to consider the sound socio-technical integration of Safeguarded AI systems. This solicitation seeks R&D Creators – individuals and teams – to work on problems that are plausibly critical to ensuring that the technologies developed a part of the programme will be used in the best interest of humanity at large, and that they are designed in a way that enables their governability through representative processes of collective deliberation and decision-making. 

A few examples of the open problems to address:
  • Qualitative deliberation facilitation: What tools or processes best enable representative input, collective deliberation and decision-making about safety specifications, acceptable risk thresholds, or success conditions for a given application domain?
  • Quantitative bargaining solutions: What social choice mechanisms or quantitative bargaining solutions could best navigate irreconcilable differences in stakeholders’ goals, risk tolerances, and preferences, in order for Safeguarded AI systems to serve a multi-stakeholder notion of public good?
  • Governability tools for society: How can we ensure that Safeguarded AI systems are governed in societally beneficial and legitimate ways?
  • Governability tools for organisations: Organisations developing Safeguarded AI capabilities have the potential to create significant externalities – both risks and benefits. What set of decision-making and governance mechanisms are best to ensure that entities developing or deploying Safeguarded AI capabilities have and maintain these externalities as appropriately major factors in their decision-making?
Call is also open to applications proposing other lines of work which illuminate critical socio-technical dimensions of Safeguarded AI systems, if they propose solutions to increase assurance that these systems will reliably be developed and deployed in service of humanity at large.

Duration: 18 months

Funding: ARIA expects to invest £3.4 million across 2-6 teams

Eligibility:
  • Applications from across the R&D ecosystem, including individuals, universities, research institutions, small, medium and large companies, charities and public sector research organisations are welcomed
  • Overseas applicants are advised that ARIA's primary focus will be on funding those who are based in the UK or those willing to conduct all or part of the project from the UK. However, funding will be available to applicants outside the UK if ARIA believes the proposed project can significantly benefit the UK (examples of benefit listed here, p.23)
How to Apply: Applications must be submitted on ARIA’s own platform, via the applicant’s account. You’ll find a walkthrough of the platform here.

Deadline, Concept paper: 02 January 2025

Further information
  • More information about the program is available here and full call here
  • Application portal can be found here
  • For any other questions, please contact the Research Office.

Practical information

  • General public
  • Free

Event broadcasted in

Share