Senior Chaos Engineer

Our Values:

Dream big
—Be visionary, strategic, and open to innovation
Build great things
—Work in service of our users, always improving and pushing higher
Take ownership
—Take responsibility with bold decision-making and bias for action
Win like a sports team
—Be trusting and collaborative while empowering others
Learn and grow fast
—Never stop learning and iterate fast
Share our passion
—Share ideas and practice enthusiasm and joy
Be user obsessed
—Empathetic, inquisitive, practical

Do you love breaking things on purpose?

At Goodnotes, we're building a world-class digital productivity platform used by millions globally — and we’re serious about scaling with resilience. That’s why we’re hiring our first Chaos Engineer to lead the charge in uncovering weaknesses before they become incidents.

This is a rare opportunity to define a chaos engineering program from scratch. You’ll work across all layers of our system to design controlled, creative failure scenarios — from network blackholes to gremlins and zombie services — and help build a culture of reliability through experimentation and learning.

What You’ll Be Doing

• Define the chaos engineering strategy at Goodnotes, including tools, safety practices, and long-term roadmap.
• Design and run fault injection experiments across mobile and backend systems, targeting failure points in user flows, APIs, and infrastructure components.to surface hidden risks.
• Simulate real-world issues like latency spikes, dependency outages, cascading failures, and resource exhaustion.
• Build and scale tooling for automating experiments, tracking outcomes, and improving observability.
• Establish clear guardrails and blast radius controls to ensure experiments are safe, measured, and reversible.
• Collaborate across engineering teams to identify critical flows, formulate hypotheses, and stress-test assumptions.
• Facilitate resilience drills and chaos game days, driving cross-team engagement and response readiness.
• Document findings, communicate insights, translate chaos learnings into actionable improvements, and influence our engineering teams to enact recommended changes
• Help shape the future of the chaos engineering function — including mentoring and hiring as the team grows.

Who You Are

• Proven experience with chaos engineering or fault injection, ideally in distributed, production-scale environments.
• Comfortable with iOS platforms, mobile networking, and understanding how client-side failures impact backend systems. Strong experience with Swift programming.
• Strong understanding of resilience patterns (e.g., circuit breakers, bulkheads, timeouts, retries) and system failure modes.
• Prior involvement in incident postmortems, war games, or reliability reviews.
• Comfortable building tools or scripts to automate chaos experiments and analyse system behavior under stress.
• With your scientific mindset, you love forming hypotheses, testing limits, and uncovering how systems really behave at the edge.
• You're excited to build a program from scratch, not just join one.

Even if you don’t meet all the criteria listed above, we would still love to hear from you! Goodnotes places a lot of value on learning and development and will support your growth if needed.

The interview process:

• Introduction: The Talent Team want to hear more about your background, what you are looking for, and why you’d like to join Goodnotes.
• Technical screening: A timed online coding skills test.
• Live coding & Technical interview: A live coding call with one of our engineers. This is where you get to see what it would be like working at Goodnotes as well as the chance to ask any engineering questions you may have
• Hiring Manager interview: A call with your hiring manager. This is the person who will be managing you day to day, working on your growth and development with you as well as support you throughout your career at Goodnotes.
• Passion presentation: A short presentation on something you are passionate about or are proud of

What’s in it for you:

• Remote friendly
• Flexible working hours and location
• Medical insurance for you and your dependents
• Great annual leave allowance
• Meaningful equity in a profitable tech-startup
• Budget for things like noise cancelling headphones, setting up your home office, personal development, professional training, and health & wellness
• Sponsored visits to our Hong Kong or London office every 2 years
• Company wide annual offsite
• Fantastic maternity/ paternity packages and and allowances