Senior Data Engineer
Prevalent AI
Senior Data Engineer
Prevalent AI
Cybersecurity risk management platform & analytics
Role Purpose :
We are looking for a hands-on Senior Data Engineer with strong expertise in Python, PySpark and Apache Spark to develop, troubleshoot and optimise production-grade distributed data-processing workloads.
This is a
Spark engineering role, not a general data engineering or orchestration role. The successful candidate must be able to write efficient PySpark code, understand Spark execution behaviour, diagnose complex performance bottlenecks and independently own engineering problems through implementation, testing and production delivery.
Key Accountabilities:
PySpark Development and Distributed Processing
Spark Internals, Optimisation and Troubleshooting
Production Engineering and Reliability
Technical Ownership and Collaboration
Skills and Experience :
Must Have
Good to Have
Cybersecurity risk management platform & analytics
Prevalent AI provides tailored cybersecurity risk management solutions that unify security data on a single platform. It uses security data science and the NIST Cybersecurity Framework to guide activities in identifying, protecting, and detecting threats. The platform consolidates data and applies analytics to help clients understand and control their risk, delivering scalable and cost-effective capabilities. Differences from competitors come from serving a selective set of organizations seeking proactive risk management with customized solutions, clear guidance, and direct control over their security posture. The company aims to help organizations stay ahead of the evolving threat landscape by improving their cybersecurity posture through precise risk management and effective incident response.
Explore more opportunities at Prevalent AI