06 oct
|
Dowjones
|
Madrid
Job Description: About the Team: Our Technology team drives the evolution of our Technology, Engineering, AI, Data, Product and User Experience functions. With a keen focus on delivering cutting-edge solutions, we shape the digital landscape for our customers, readers, and users with a focus on safeguarding the future of journalism.
The AI Governance team sits at the heart of this mission, ensuring that as we harness the power of Generative AI, we do so with the responsibility, ethics, and accuracy that our readers, corporate clients, and partners expect from us.
About the Role: Reporting to the VP, Data & AI Governance, you will lead the technical assessment and assurance of AI systems across Dow Jones, including internally developed solutions, third-party tools and AI capabilities embedded in existing platforms.
You will Lead technical AI risk assessments. Review architectures, data flows, model configurations, integrations and deployment environments. Identify risks, recommend proportionate mitigation and document residual risks and approval conditions using the Dow Jones AI Risk Matrix.
Assess agentic capabilities and system access. Establish which tools and actions an agent can use, under whose identity and permissions, and with what degree of autonomy. Evaluate access through MCP, APIs, command-line interfaces and browser automation, including potential changes to enterprise systems, human approval requirements, action limits and recovery mechanisms.
Evaluate changes to previously approved tools. Determine whether AI or agent access introduces new users, permissions, data flows,
scale of activity or autonomy beyond the original approval. Reuse existing assessments and focus additional review on material changes.
Define and validate technical controls. Partner with technical owners to establish least-privilege access, credential protection, data handling restrictions, human oversight, audit logging and mechanisms to suspend or revoke access. Review implementation evidence and test results to establish whether controls work as intended.
Assess AI-specific security and data risks. Work with Cyber Security and Privacy to address prompt injection, unintended disclosure, inappropriate tool use and risks introduced by external models, connectors and dependencies. Evaluate how sensitive information, proprietary content and personal data enter model context, retrieval systems, outputs and logs.
Establish AI evaluation and monitoring requirements. Define proportionate tests for accuracy, groundedness, reliability, bias and safe behaviour, including tool selection and execution for agents. Work with delivery teams to set acceptance criteria and monitor failures, control effectiveness and changes in system behaviour.
Build scalable governance processes. Develop technical standards,
assessment templates and approved integration patterns. Establish clear routes for routine approvals, exceptions and reassessment when models, tools, permissions or intended uses change.
Conduct technical vendor assessments and support pilots. Examine vendor architecture, data handling, access controls, evaluation evidence and monitoring capabilities. Define risk and performance criteria for proofs of concept and assess readiness for production use.
Support governance throughout the AI life cycle. Maintain visibility into system owners, risk assessments, dependencies, approval conditions and outstanding mitigation. Contribute to incident reviews and ensure lessons inform future controls and assessments.
Provide clear technical advice. Present findings and recommendations to the AI Steering Committee and other decision-makers. Translate policy and regulatory requirements into technical guidance with Legal and Privacy, and contribute targeted training for teams building or deploying AI.
You Have: Typically 4 - 7 years of relevant experience in AI or data engineering, technical AI governance, security architecture, technology risk, model validation or a related discipline, including practical experience assessing or deploying AI systems.
Strong understanding of LLMs, retrieval-augmented generation, AI agents and tool calling, including their limitations and failure modes. Familiarity with traditional machine learning and model evaluation is also valuable.
A
#J-18808-Ljbffr
📌 Manager, AI Governance (Madrid)
🏢 Dowjones
📍 Madrid