Make ‘fast’ stay ‘fast’ without turning into ‘fragile’ – the first Quality Engineer in an established Agentic AI team
- Build our Automation from the ground-up!
- Join the Agentic AI Engineering team driving ATI Group’s global form automations push
- Sydney-based, in-office three days a week
About CORTO
We are CORTO, a cutting-edge software company dedicated to revolutionising the legal industry. Our mission is to empower legal practitioners with AI-driven solutions that streamline their workflow, boost productivity, and provide more efficient client service.
Our team of AI experts and engineers collaborate to develop intelligent software tailored to the unique needs of lawyers, paralegals, and legal assistants.
Our innovative AI solutions automate routine tasks, simplify document management, and enhance decision-making, allowing legal professionals to focus on what they do best—providing expert legal counsel.
We’re rapidly scaling from 80 to 150+ employees, with a highly technical workforce where around 90% of the team are developers and engineers. Working alongside our Sydney-based team of passionate high achievers, you’ll join a fast-growing technology business where things rarely stay the same for long - and if you’re smart, caring, and ambitious, you’ll be in great company.
What you’ll do
You’ll be the first Quality Engineer in an established Agentic AI team, reporting to Dale Hurley, Head of Agentic AI Engineering, and joining a team of 8 (and growing) working on the delivery of agentic AI products directed by the founder of ATI Group, global LegalTech leader Christian Beck. The team has embraced AI-assisted coding and is shipping fast, starting with the Global Forms Automation project, which is about to ship, with a pipeline of successor products behind it.
Your job is to make sure that ‘fast’ stays ‘fast’ without turning into ‘fragile’. You’ll design and build the quality foundations that let a small team of AI-augmented engineers keep moving at pace while shipping products that lawyers actually trust with their work. Christian is the visionary leader who founded LEAP Legal Software in 1992 and is pioneering the future of AI in legal.
To make this happen you will
- Partner with engineers to build the testing strategy, tooling, and automation that matches an AI-assisted development workflow.
- Design and implement evaluation frameworks for agentic and generative AI features – regression suites for prompts, models, retrieval quality, tool use, and end-to-end agent behaviour.
- Own the automated test stack across unit, integration, contract, and end-to-end layers, making pragmatic calls on coverage, tooling, and where human review still matters most.
- Build the CI/CD quality gates that let the team ship multiple times a day without breaking customer trust – pre-merge checks, canary strategies, and production observability for AI behaviour.
- Establish the feedback loops between production signals (errors, user corrections, eval drift, cost and latency regressions) and the development cycle so the team learns fast and fixes faster.
- Shape how the team uses AI-assisted coding tools safely – spotting the failure modes (plausible-but-wrong code, missing edge cases, silent regressions) and building the guardrails that catch them.
- Present your thoughts, findings, and progress clearly and confidently to internal teams and leadership.
What you’ll bring
- You’ve shipped quality frameworks for products that went from zero to thousands of users, on small, fast-moving teams where you had to build the tooling yourself rather than hand specs to a QA team.
- Hands-on experience testing Generative AI or agentic systems in production – evals, LLM-as-judge, golden datasets, regression detection on non-deterministic output, cost and latency budgets, safety and hallucination checks. You’ve seen AI products break in ways traditional QA doesn’t catch, and you know how to catch them.
- Deep fluency with modern test automation – unit, integration, contract, and end-to-end – across cloud services, APIs, and data pipelines. You write code, not just test plans.
- You’ve worked on teams using AI-assisted coding (Claude Code, Cursor, Copilot, or similar) and have opinions on how quality practices need to adapt when humans are reviewing AI-generated code at volume.
Even better if you have
- Experience in document-heavy workflows, or SaaS
- Experience testing document automation, forms, or structured extraction systems where correctness really matters
- Experience in internal venture studios, innovation teams, startups, or product incubation environments
- Background building out QE practice as the first quality hire on a team
You are the type of person who
- Defaults to the customer – cares less about test coverage percentages and more about whether a lawyer using the product is going to trust what it does
- Credible and clear with engineers, product, and senior leadership alike – gets quality work done across teams without direct authority, and owns problems end-to-end rather than throwing them over a wall
- Holds yourself and those around you to a high bar, because you care deeply about what gets shipped
- Defaults to ‘how do we ship this safely?’ rather than ‘how do we slow this down?’
CORTO is an inclusive, people-first company committed to breaking down institutional barriers that keep people from reaching their potential. If you meet some, but not all the requirements above, we encourage you to still submit your application.
Why join CORTO?
- Your work matters. We solve real world problems that improve and support local, everyday law firms. So they can do their best work for the people in the communities they serve.
- Make an impact. You won’t be another ‘cog in the wheel’ here. We give full trust and autonomy for you to be heard, to work on big & complex projects – and to make a real difference.
- Work with a group of authentic, passionate people who love what they do.
- Well-funded and global. CORTO is part of ATI Global – one of the largest international LegalTech companies.
- Flexible and hybrid working. We engage, share, and collaborate on ideas and workflows.
- Career and learning opportunities - we move fast and need smart people to get us where we're going. We are a scaling business and looking for people who want to grow with us.
- Have fun with us. Celebrations. Socials. Sports teams. Access to sailing and yacht events.
- We value your well-being with additional time off, gym membership and other perks.
- Fast-paced tech environment, if we don't disrupt ourselves someone else will do it!
- Access to LEAP Home - a program unique to the ATI Group to support you in buying your primary residence.
