Research Assistant in Explainable and Causality Informed Reinforcement Learning (DEIS)
Aalborg Universitet
Research Assistant in Explainable and Causality Informed Reinforcement Learning
We invite applications for a full-time, one-year position as Research Assistant in the Section of Distributed, Embedded and Intelligent Systems (DEIS), Department of Computer Science, Aalborg University. The position focuses on developing reinforcement learning methods that produce understandable control strategies and provide insight into the underlying system dynamics and causal relationships. The research will address safe and effective control of cyber-physical systems, with particular emphasis on UPPAAL Stratego and collaboration with domain experts and external partners.
Expected starting date: 01.12.2026.
Your work tasks
You will develop and evaluate methods for explainable and causality informed reinforcement learning. The aim is to make learned strategies transparent to human domain experts, support well-founded trust in their decisions, and improve understanding of hidden dynamics and causal relationships in the systems being controlled. Your tasks will include:
Developing compact, interpretable representations of learned control strategies, including strategy minimisation with guaranteed preservation of safety properties.
Investigating how causal information can inform reinforcement learning and help explain the behaviour and decisions of learned strategies.
Working with reinforcement learning and recurrent neural networks in UPPAAL Stratego, including implementation and experimental evaluation.
Applying and evaluating the methods on safety-critical cyber-physical systems, with relevant case studies in water and wastewater infrastructure.
Collaborating with DEIS researchers, the UPPAAL development team and external partners, and contributing to scientific publications and dissemination.
The work builds on DEIS research in safe reinforcement learning and practical experience with UPPAAL Stratego for modelling and optimal control of wastewater infrastructure, including collaboration with HOFOR continuing the DIREC Bridge project Verifiable and Safe AI.
Your competencies
You should have a strong background in reinforcement learning and machine learning, solid programming skills, and experience implementing and evaluating research methods. Knowledge of explainable AI, causal reasoning, recurrent neural networks, or interpretable policy representations is particularly relevant. Experience with UPPAAL or UPPAAL Stratego, formal verification, and modelling and control of cyber-physical systems is an advantage. You should be able to work independently, collaborate with researchers and domain experts, and communicate research clearly in English.
Qualification requirements
Appointment as a research assistant requires academic qualifications at master’s degree level. A relevant degree in computer science or a closely related discipline is expected.
Who we are
You will join Section DEIS at the Department of Computer Science, Aalborg University. The position brings together research in formal methods, machine learning and cyber-physical systems, with opportunities to contribute to the UPPAAL tool suite and its applications.
How to apply
Your application must include the following:
An application stating your reasons for applying, qualifications in relation to the position, and intentions and visions for the position.
Curriculum Vitae (CV).
Diplomas.
A list of publications. You may attach a maximum of five publications (optional).
Documentation of teaching qualifications, following the relevant faculty guidelines for teaching portfolios.
Dissemination qualifications, including participation in committees, boards or organisations.
Additional qualifications relevant to the position.
References or recommendations.
Please consult Aalborg University’s application requirements for further guidance.
The application must be submitted via Aalborg University’s recruitment system, which can be accessed under the job advertisement on Aalborg University’s website.
Aalborg University wants to reflect the surrounding society and has diversity as a core value. Therefore, everyone, regardless of personal background and orientation, is encouraged to apply for the position.
Do you have any questions
For questions about the position, please contact Professor Kim Guldstrand Larsen, kgl@cs.aau.dk, telephone +45 22 17 11 59.
Further information
Read more about our recruitment process here
The appointment process at Aalborg University involves a shortlisting process. You can read more about the shortlisting and appointment process here.
The hiring process at Aalborg University may include a risk assessment as a tool to identify potential risks associated with new hires, ensuring the safety, compliance, and integrity of the workplace.
Salary and terms of employment
The employment is in accordance with the Ministerial Order on the Appointment of Academic Staff at Universities and the Ministerial Order on Job Structure for Academic Staff at Universities. Furthermore, your terms of employment and salary are in accordance with the collective agreement between the Danish Confederation of Professional Associations and the state (AC collective agreement) and protocol on certain terms of employment of academic staff at universities.
You can find information about the salary and salary structure for the position in the Salary Overview for Recruitment - Scientific positions (VIP). Please refer to the introductory section of the page and the section entitled “Research assistant”.
There is a mutual probationary period of 3 months for the position.
Aalborg University - Knowledge for the world
Aalborg University is an international workplace with more than 3,700 employees. We offer real-world-oriented education and create world-class research results through collaboration between researchers, students, and public and private companies. This is how we achieve insights, new solutions to societal problems, and knowledge that changes the world. Our main campus is in Aalborg, but we also have campuses in Esbjerg and Copenhagen. Contacts Sektionsleder Kim Guldstrand Larsen: kgl@cs.aau.dk
Ansøgningsmulighederne vises, når siden er indlæst.