Strong engineering skills with a proven track record in software development.
A solid understanding of the AI model lifecycle, especially AI model evaluation concepts.
In-depth knowledge of AI pipelines and experience building, managing, and optimizing them for product development and evaluation.
Demonstrable experience applying software engineering best practices to machine learning projects.
Proficiency in creating end-to-end software stacks, including front-end and back-end development.
Hands-on experience deploying and managing systems on major cloud service providers such as AWS, GCP, or Azure.
Strong programming skills in languages such as Python.
Experience with relevant AI/ML frameworks and libraries such as TensorFlow, PyTorch, and scikit-learn.
Responsibilities
Collaborate with senior AI/ML scientists and product managers to design, build, and maintain an adversarial AI evaluation platform.
Architect and implement programmatic platforms for evaluating AI models and assessing their performance, robustness, and potential risks.
Implement and optimize AI pipelines, ensuring efficient data flow, model training, inference, and evaluation processes.
Apply software engineering best practices to machine learning projects, including version control, automated testing, code reviews, and continuous integration/continuous deployment.
Develop and integrate UI/UX components for internal tools and evaluation platforms.
Deploy and manage AI applications and evaluation infrastructure on cloud service providers such as AWS, GCP, or Azure, ensuring scalability, reliability, and security.
Collaborate with data scientists, actuaries, and product managers to translate complex requirements into robust technical solutions for building and evaluating AI.
Troubleshoot, debug, and optimize existing AI systems to improve performance and stability.
About Armilla AI
Armilla AI is a cutting-edge startup based in Toronto, Ontario, Canada, operating at the intersection of artificial intelligence and insurance. We're not just talking about AI risk; we're actively building the solutions to manage, underwrite, and insure it. Our dynamic team is passionate about pioneering the future of AI risk management through the development of sophisticated AI-powered tools and programmatic evaluation platforms.
The Role: Building & Evaluating AI Solutions
We're looking for a talented and experienced AI Engineer to join our growing team. This is a pivotal role where you'll be instrumental in both building our core AI-powered tools and developing the programmatic platforms to rigorously evaluate AI systems. If you're passionate about applying robust engineering principles to AI, creating end-to-end solutions, and building systems for comprehensive AI assessment, we want to talk to you.
Role Responsibilities
In this exciting role, you'll:
Collaborate with senior AI/ML Scientists and Product Managers to design, build and maintain an adversarial AI evaluation platform.
This role requires a combination of strong engineering skills, product development experience, and AI/ML process-flow knowledge.
Architect and implement programmatic platforms for evaluating AI models, assessing their performance, robustness, and potential risks.
Implement and optimize AI pipelines, ensuring efficient data flow, model training, inference, and evaluation processes.
Apply software engineering best practices to machine learning (ML) projects, including version control, automated testing, code reviews, and continuous integration/continuous deployment (CI/CD).
Develop and integrate UI/UX components to ensure seamless and intuitive user experiences for both our internal tools and evaluation platforms.
Deploy and manage AI applications and evaluation infrastructures on various Cloud Service Providers (CSPs) like AWS, GCP, or Azure, ensuring scalability, reliability, and security.
Collaborate closely with data scientists, actuaries, and product managers to translate complex requirements into robust technical solutions for both building and evaluating AI.
Troubleshoot, debug, and optimize existing AI systems to improve performance and stability.
What We're Looking For
We're seeking a candidate who brings:
Strong engineering skills with a proven track record in software development.
Solid understanding of AI model lifecycle and especially concepts around AI model evaluations
In-depth knowledge of AI pipelines and experience in building, managing, and optimizing them for both product development and evaluation.
Demonstrable experience applying software engineering best practices to ML projects.
Proficiency in creating end-to-end software stacks, including front-end (UI/UX) and back-end development.
Hands-on experience with deployment and management on major Cloud Service Providers (CSPs) such as AWS, GCP, or Azure.
Strong programming skills in languages like Python.
Experience with relevant AI/ML frameworks and libraries (e.g., TensorFlow, PyTorch, scikit-learn).
Exceptional problem-solving abilities and a commitment to producing high-quality, maintainable code.
Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team.
What's In It For You
Joining Armilla AI means:
Pioneering a New Frontier: You'll have a significant impact on our core products and infrastructure, shaping how AI risks are understood and managed globally.
Diverse Technical Challenges: You'll work on both developing cutting-edge AI tools and building sophisticated systems for AI evaluation.
Collaborative Environment: Be part of a highly skilled and supportive team that values innovation and continuous learning in a fast-paced startup.
Dynamic Work Environment: Enjoy a hybrid work environment based in Toronto's trendy Liberty Village, fostering a collaborative and innovative atmosphere.
Professional Growth: This role offers immense opportunities for personal and professional development in the burgeoning field of AI risk.
Access to Cutting-Edge Tooling: You'll have access to your choice of leading AI models (e.g., GPT), operating systems, and cloud compute services to empower your work.
How to Apply
Ready to help us build and evaluate the future of AI risk solutions? If you're an experienced AI Engineer passionate about robust software and cutting-edge technology, we encourage you to apply! Please submit your resume and a cover letter outlining your relevant experience and why you're a great fit for Armilla AI