aes24 International Evaluation Conference

9:00am AEST

Opening plenary: Welcome to Country followed by June Oscar "Wiyi Yani U Thangani - re-imagining evaluation with a gender justice lens" Plenary 1Jess Dart • June Oscar AO • Kiri Parata

11:00am AEST

Evaluation that adds value for People and Planet: Perspectives, Challenges, and Opportunities for Indigenous Knowledge Systems in Africa. 104Alice Muller • Awuor Ponge • Grace Wanjiru Murigo Appreciating First Nations voices: Using appreciative inquiry and participation in the evaluation of Community Justice Groups 101-102Carol Vale • Michael Limerick • Melinda Mann Design-stage evaluative thinking: helping NGOs and grant makers learn to love evaluation from the start 103Christina Kadmos • Duncan Rintoul • Claire Grealy • Jacqueline Webb • Virginia Poggio • Kirsty Burrow • Luciana Campello The psychology of evaluation capacity building: Finding the way with the rider, elephant and the pathway 106Anthea Rutter • Samantha Abbato Innovating Value for Money: Finding Our Way to Greater Value for All 105Jade Maloney • Julian King • John Gargani • Farida Fleming Planning your conference voyage: Key evaluation concepts for novice sailors Plenary 1Miriam Marembo • Charlie Tulloch

11:30am AEST

Culturally Responsive Initiatives: Lessons in effective Initiative Design and Evaluation of initiatives that affect First Nations people 104Alice Muller • Steven Legg • Eugenia Marembo

12:00pm AEST

From bottlenecks to breakthroughs: Insights from a teacher workforce initiative evaluation 104Alice Muller • Rhiannon Birch • Hayden Jose Warlpiri ways of assessing impact - How an Aboriginal community is defining, assessing and taking action for a good life in their community. 101-102Carol Vale • Alex Gyles • Emily Lapinski • Glenda Napaljarri Wayne • Raelene Nangala Jigili, • Rhonda Larry Nungarray • Tyrone Japaljarri Spencer Navigating collaborative practice - the role of evaluation in brokering shared outcomes 106Anthea Rutter • Caroline Crothers Enhancing Stakeholder Engagement Through Culturally Sensitive Approaches: A Focus on Aboriginal and Torres Strait Islander Communities 105Jade Maloney • Carol Vale • Mark Power Valuing First Nations Cultures in Cost-Benefit Analysis 103Christina Kadmos • Laura Faulkner • Shaun Cumming

1:30pm AEST

Enhancing evaluation value for small community organisations: A case example 104Duncan Rintoul • Allison Clarke • Stephanie Button • Carolyn McSporran Envisioning and Encountering Relational Aboriginal and Pacific Research Futures 105Martina Donkers • Lisa Faerua • Nathan Sentance • David Lakisa • Alli Burness Learning from failure at a NFP - pitfalls and pointers 103Squirrel Main • Victoria Pilbeam Measuring (in)equity for people with disability: How to do it, and why it is rarely done well 103Squirrel Main • Aleisha Carroll No help? No worries! How to find your way on your own 103Squirrel Main • Rachel Wilks Revitalising Survey Engagement: Strategies to Tackle Low Response Rates 103Squirrel Main • Hannah Nguyen Sign here: Supporting Deaf participation in evaluation 103Squirrel Main • Susie Fletcher Beyond Numbers: Weaving Stories, Sculpting Change and Signal Spotting through Collaborative Impact Yarns 106Melinda Mann • Katie Stubley • Chloe Wegener • Banok Rind • Sophie Spry • Terri Reid • Niamh Kealy • Skye Trudgett Cultivating Equity: A Roadmap for New and Student Evaluators' Journeys 101-102Nick Field • Ayesha Boyce • Aileen M. Reid Link-Up Services and wayfinding: Co-creating and navigating a culturally safe national monitoring and evaluation strategy Plenary 1Lyndal Sleep • Kathleen Stacey • Raelene Rosas • Patricia Thompson AM

2:00pm AEST

Evaluation for whom? Shifting evaluation to increase its value for local actors 104Duncan Rintoul • Linda Kelly • Lisa Buggy • Linda Vaike

2:30pm AEST

Navigating a path to system impact: designing a strategic impact evaluation of education programs 104Duncan Rintoul • Amanda Reeves • Eunice Sotelo If treaty is like a marriage, state evaluation needs sustained deep work: Evaluation and Victoria's First Peoples Treaty 105Martina Donkers • Kate Nichols • Milbert Gawaya When "parachuting in" is not an option: Exploring value with integrity across languages, continents and time zones 106Melinda Mann • Julian King • Adrian Field Elevating evaluation: practical insights for supporting systems transformation 101-102Nick Field • Kathryn Erskine • Michael Maher When speed is of the essence: How to make sure the rubber hits the road 103Squirrel Main • Kristy Hornby

3:30pm AEST

Plenary: James Copestake "What next? From evaluating to anticipating" Plenary 1Donna Loveridge • James Copestake

4:30pm AEST

Wayfinding for integrating social justice and culturally responsive and equitable evaluation practices in meta-evaluation: Learning from the UN evaluation quality assessments. 101-102Carlos Rodriguez • Sandra Ayoo Developing a Tool for Measuring Evaluation Maturity at a Federal Agency 105Marwan El Hassan • Michael Amon • Anthony Alindogan • Claudia Oke Uncovering Hidden STEM Footprints: Leveraging Output Data from Questacon’s Outreach Programs 104Grace Nicholas • Jake Clark • Nick Phillis Evaluation Lab: Using design to solve evaluation challenges Plenary 1Duncan Rintoul • Matt Healey • Shani Rajendra Navigating the choppy waters of the evaluation landscape in the Pacific 106Charlie Tulloch • Allan Mua Illingworth • Eroni Wavu • Fiona Fandim • Mereani Rokotuibau • Chris Roche Rebalancing Power Dynamics: Philanthropy Through the Lens of First Nations Community-Driven MEL 103Samantha Mayes • Skye Trudgett • Rachel Kerry • Tara Leslie

5:00pm AEST

Trigger warnings - do they just trigger people more? 104Grace Nicholas • Kizzy Gandy Development and implementation of a culturally grounded evaluation Framework: Learnings from an Aboriginal and Torres Strait Islander Peak. 101-102Carlos Rodriguez • Candice Butler • John Prince Failing your way to better practice: How to tread carefully when things aren't going as planned 105Marwan El Hassan • Stephanie White

5:30pm AEST

AES 2024 Annual General Meeting Plenary 1Kiri Parata

8:30am AEST

Plenary: Elizabeth Hoffecker "Wayfinding tools for learning and evaluation in complex systems" (followed by panel) Plenary 1Jess Dart • Matt Healey • Donna Loveridge • Elizabeth Hoffecker • Tony Kiessler

10:30am AEST

Evaluating capacity building for sustainability scientists: Pathways for early career researchers 104Su-Ann Drew • Lisa Walker National impact, regional delivery - Robust M&E for best practice Australian horticulture industry development. 101-102Caitlin Vaughan • Carl Larsen • Zarmeen Hassan • Ossie Lang An evaluator in need of an evaluation 105Charlie Tulloch • Dana Cross Navigating the maze of causality: Understanding the relationship between carcinogenic betel nut consumption and learning outcomes 106Mary Ann Wong • Kabira Namit • Kathryn Lee Commissioning evaluations - finding the way from a transactional to a relational approach Plenary 1Vanessa Hood • Eleanor Williams • Skye Trudgett • George Argyrous • Josephine Norman • Luke Craven • Kristy Hornby

11:00am AEST

Learn, evolve, adapt: Evaluation of climate change and disaster risk reduction programs 104Su-Ann Drew • Justine Smith Culturally inclusive evaluation with culturally and linguistically diverse communities in Australia 101-102Caitlin Vaughan • Lena Etuk Our journey so far: a story of evaluation to support community change in South Australia 103Michael Amon • PENNY BALDOCK • Jessie Sleep

11:30am AEST

Bringing the "human" into measurement: From in-depth inquiry to systemic change 104Su-Ann Drew • Julia Suh • JESSICA LEEFE "Nothing about us, without us": Developing evaluation framework alongside victim-survivors of modern slavery using representative participatory approaches 101-102Caitlin Vaughan • Ellie Taylor Navigating complex government reforms: a tool to examine program theory. How complete and relevant is government program theory? 105Charlie Tulloch • Nerida Rixon Social Impact Measurement & Evaluation – the similarities & differences that complement our journey to more fit-for-purpose destinations. 106Mary Ann Wong • Caitlin Barry • Elliott Tester • Gerard Atkinson • Paula Simões dos Santos • Sandra Opoku A new tool for participatory evaluation: A case study of the process of conducting online workshops with young creators with disabilities to tell stories using virtual reality animation 103Michael Amon • Samantha Abbato

12:00pm AEST

Systems evaluation to the rescue!: How do we use systems evaluation to improve societal and planetary wellbeing? 104Su-Ann Drew • Kristy Hornby • Tenille Moselen Optimising Evaluations of Wellbeing Programs in Schools 105Charlie Tulloch • Tamara Van Der Zant • Katherine Dix Getting to the value add: Timely insights from a realist developmental evaluation Plenary 1Vanessa Hood • Phillip Belling Navigating the unfamiliar: Evaluation and sustainable finance 101-102Caitlin Vaughan • Donna Loveridge

1:30pm AEST

Man vs. Machine: Reflections on machine-assisted and human-driven approaches used to examine open-text progress reports. 101-102Emily Saurman • Kathleen De Rooy • Steph Quail Evaluation by Stealth: Insights from Embedded Evaluation Practice 104Kathleen Stacey • Samiha Barkat • Edgar Daly Scaling Impact: How Should We Evaluate the Success of a Scaling Journey? 106Carolyn Wallace • John Gargani A tool for addressing violence against women: An examination of the creation, benefits, and drawbacks of the Evidence Portal 103Prescilla Perera • Charlotte Louisa Grace Bell • Lauren Hamilton The Art of Qualitative Sensemaking: Exploring New Methods 105Janet Conte • Matt Healey • Sharon Marra_Brown • Monica Wabuke • Alli Burness Perspectives on the Appropriate Use of RCTs in Evaluation? Plenary 1Rick Cummings • Vanessa Gstrein • Eleanor Williams • Wendy Jarvie • Bruce Cunningham • Lisa Cameron • Patricia Rogers • Scott Bayley

2:00pm AEST

Harnessing AI for Qualitative Data Analysis 101-102Emily Saurman • Ethel Karskens

2:30pm AEST

Monitoring and Evaluation Journeys: Making footprints, community-based enterprise in Australian First Nations contexts 104Kathleen Stacey • Sharon Babyack • Donna-Maree Stephens A long road ahead: Evaluating long-term change in complex policy areas. A case study of school active travel programs in the ACT 106Carolyn Wallace • Mallory Notting Our new ways: Reforming our approach to impact measurement and learning 105Janet Conte • Kaitlyn Scannell An update on practical applications of machine learning in evaluation 101-102Emily Saurman • Gerard Atkinson Where next? Evaluation to transformation 103Prescilla Perera • Rachel Wilks

3:30pm AEST

Constructing a Wisdom Base: A Hands-On Exploration of First Nations Knowledge Systems 106Sandra Ayoo • Skye Trudgett • Levi McKenzie-Kirkbright • Haley Ferguson • Tara Beattie • Jess Dart Charting the Course: Measuring Organisational Evaluation Capacity Building 104Claire Grealy • Rochelle Tobin Journey Mapping: Visualising Competing Needs within Evaluations 104Claire Grealy • Jolenna Deo Reflections by a non-analyst on the use of state-wide data sets and modelled data in evaluation 104Claire Grealy • Gabby Lindsay-Smith The evolution of evaluation: Retracing our steps in evaluation theory to prepare for the future 104Claire Grealy • James Ong There and back again: a digital journey from outcomes to dashboards (and back!) 104Claire Grealy • Nicola Sloan From KPIs to systems change: Reimagining organisational learning 101-102Elissa Mortimer • Katrina Barnes Growing Australia's future evaluators: Lessons from emerging evaluator networks across the Asia Pacific Plenary 1Maya Cordeiro • Qudratullah Jahid • Eroni Wavu • Amanda Mottershead Committed to mentoring 103Laura Holbeck • Julie Elliott • Rick Cummings • Martina Donkers • Lydia Phillips The learning journey: competency self-assessment for personal learning and profession development 105Peter Bowers • Amy Gullickson • Taimur Siddiqi

9:00am AEST

Plenary: Indy Johar "Navigating transitions through risk and uncertainties" Plenary 1Matt Healey • Indy Johar

10:30am AEST

Involving children and young people in evaluations: Equity through active participation Plenary 1Laura Bird • Sharon Marra_Brown • Moya Johansson • Mitchell Rice-Brading Following the (matched) data to understand impact: adventures in quasi-experimental evaluation 101-102Allison Clarke • Kira Duggan • Mohib Iqbal • Ben McNally To tinker, tailor, or craft from scratch? The tension in using validated tools in novel contexts 104Phillip Belling • Matt Healey • Tenille Moselen • Alicia McCoy The Road Home - an evaluation journey to discover and demonstrate a new and exciting way to deliver a crisis housing response. 105Robert Sale • Anne Smyth • Lesley Thornton • Kym Coupe • Caroline Lynch Walking together: First Nations participation, partnerships and co-creation in Evaluation. 106Rachel George • Alice Tamang • Tony Kiessler Reviewing and writing for the Evaluation Journal of Australasia 103Kate O'Malley • John Guenther • Anthea Rutter • Yvonne Zurynski • Jeff Adams

11:00am AEST

Participatory Analysis Workshops: a novel method for identifying important factors across diverse projects 104Phillip Belling • Martina Donkers • Ellen Wong • Jade Maloney Impact evaluation: bringing together quantitative methods and program theory in mixed method evaluations 101-102Allison Clarke • Harry Greenwell • Vera Newman Value Propositions: Clearing the path from theory of change to rubrics Plenary 1Laura Bird • Julian King • Adrian Field

11:30am AEST

Our five guiding waypoints: Y Victoria's journey and learning from applying organisation-wide social impact measurement 103Kate O'Malley • Caitlin Barry • Ian Boorman Reflections on a Developmental Evaluation of a traditional healing service model for the Kimberley region of Western Australia 106Rachel George • Tammy Solonec • Gillian Kennedy • Eva Nargoodah The ACT Evidence and Evaluation Academy 2021-24: Lessons learned from a sustained whole-of-government ECB effort 105Robert Sale • Duncan Rintoul • George Argyrous • Narina Dahms Gamified, flexible, and creative tools for evaluating a support program for palliative children and their families 104Phillip Belling • Erika Fortunati

12:00pm AEST

Designing a baseline research for impact : The SKALA experience 101-102Allison Clarke • Johannes Prio Sambodho Embracing the L in "MEL": A Journey Towards Participatory Evaluation in Government Programs 103Kate O'Malley • Milena Gongora If the destination is improvement, recommendations are the signpost 106Rachel George • Larissa Brisbane • Laura Baker Place-based evaluation: collaborating to navigate learning in complex and dynamic contexts 105Robert Sale • Sandra Opoku • Kate Matthies-Brown A sprint, not a marathon: Rapid Evaluation as an approach for generating fast evidence and insights 104Phillip Belling • Marnie Carter

1:30pm AEST

From evaluation to impact-practical steps in a qualitative impact study 101-102James Copestake • Linda Kelly • Elisabeth Jackson Fidelity to context: A realist perspective on implementation science 105Virginia Poggio • Andrew McLachlan Finding ways to empower multicultural survivors of violence through evaluation: strategies, learnings and reflections 104Kira Duggan • Lydia Phillips Learning from the past: Reflections and opportunities for embedding measurement and evaluation in the national agenda to end Violence against Women and Children 106Milena Gongora • Lucy Macmillan • Tessa Boyd-Caine • Micaela Cronin Navigating ethics dilemmas when evaluating for government: The good, the bad and the ugly Plenary 1Sally Clifford • Mandy Charman • Kristy Hornby • Eleanor Williams Exploring the potential of qualitative sketch mapping in evaluation: mapping fear of crime. 103Carina Calzoni • Nicola Sloan Investment logic mapping or evaluation logic modelling? Similarities and differences. 103Carina Calzoni • Charlie Tulloch Measuring Impact Through Storytelling: using Most Significant Change to evaluate the effectiveness of QHub for LGBTIQA+ young people. 103Carina Calzoni • Gina Mancuso • Arielle Donnelly Program Evaluation Fundamentals in the NSW Department of Planning, Housing and Infrastructure: An eLearning course on evaluation 103Carina Calzoni • Anabelle (Pin-Ju) Chen Putting values on the evaluation journey map 103Carina Calzoni • Samantha Abbato Squaring up with rubrics 103Carina Calzoni • Josh Duyker Voices of the Future: Elevating First Nations Leadership in the Evolution of Educational Excellence 103Carina Calzoni • Sharmay Brierley • Skye Trudgett

2:00pm AEST

A practical approach to designing and implementing outcome measures in psychosocial support services. 101-102James Copestake • Lauren Gibson In the spotlight: An arts industry-led approach to evaluation 105Virginia Poggio • Kirstin Clements Introducing a trauma informed AI assessment tool for evaluators of AI (artificial intelligence) assisted programs and services. 104Kira Duggan • Lyndal Sleep

2:30pm AEST

Closing plenary: Panel, John Gargani "Finding Our Way to the Future Profession of Evaluation" Plenary 1Amy Gullickson • John Gargani • James Copestake • Doyen Radcliffe • Elizabeth Hoffecker • Kiri Parata