17 ago
|
Future of Life Organizations
|
España
17 ago
Future of Life Organizations
España
The case that AGI and ASI pose catastrophic risks is strong but poorly systematized: fragmented across literatures, inconsistently formalized, and vulnerable to motivated dismissal. CARMA is building an evidentiary infrastructure to fix this. It combines ontologies, knowledge graphs, defeasible argumentation frameworks, and LLM-assisted population pipelines under expert curation, feeding structured argument content into communications flows that reach policymakers, technical audiences, journalists, and the public.
In this role, you'll develop and operate that system. You'll work where argumentation theory meets agentic AI tooling, building machinery that is both formally tractable and persuasive in practice, the epistemic backbone that will help stakeholders elucidate why good arguments for prospective expectations are good, and why bad arguments are bad.
This position is 100% remote but requires occasional travel.
About CARMA
The Center for AI Risk Management & Alignment (CARMA)
works to help society navigate the complex and potentially catastrophic risks arising from increasingly powerful AI systems. Our mission is specifically to lower the risks to humanity and the biosphere from transformative AI.
We focus on grounding AI risk management in rigorous analysis, developing policy frameworks that squarely address AGI, advancing technical safety approaches, and fostering general perspectives on durable safety. Through these complementary approaches, CARMA aims to provide critical support to society for managing the outsized risks from advanced AI before they materialize.
CARMA is a fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation.
Responsibilities
- Extend ontologies and knowledge graph schemas representing claims, evidence, argument structures, defeaters, and confidence
- Implement defeasible argumentation frameworks (e.g., ASPIC+, Dung-style, argumentation schemes) that capture both logical st
📌 AI Safety Argumentation Platform Research (España)
🏢 Future of Life Organizations
📍 España