Staff Data Engineer
Posted on 2/11/2023
INACTIVE
Locations
Canada • Remote • United States
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
Apache Kafka
Data Science
Data Structures & Algorithms
Java
Requirements
  • Experience working on and/or a demonstrable understanding of messaging/queuing systems or stream processing systems
  • A strong understanding and experience with topics related to platform scale, security, availability, deployment and operation
  • 3-5 years of experience designing, building, or supporting high performance distributed systems
  • 5+ years of experience building software in preferably Scala or Java
  • Solid understanding in designing and building web-based APIs
  • 3+ years of experience working with tools supporting streaming pipelines using Kafka, Akka (plus), Spark Streaming (plus)
  • Working knowledge of the Go programming language (plus)
Responsibilities
  • The ideal candidate would be someone who has significant experience building, refactoring and maintaining complex data pipelines using the latest technologies. We are in the process of reengineering our existing pipelines to improve performance, eliminate batch processes, and increase the sophistication of our machine learning models
  • To be successful long term, you'll need to have or rapidly develop domain expertise regarding how the internet works. The Attribution team is our reservoir of domain knowledge regarding DNS, WHOIS, routing, etc. and you will work in close collaboration with the Data Science and Threat Intelligence teams to build effective algorithms and models that scale
  • Make recommendations regarding technologies, improvements to data models, and processes taking into account, cost, complexity, and performance
  • Automate the infrastructure supporting the data pipeline as code and deployments by improving CI/CD pipelines. Monitor, troubleshoot, and improve the data platform to maintain stability and optimal performance
  • Diplomatically partnering with engineering, product, and data teams to innovate and enable business critical applications, tools, and data intelligence at scale
  • Collaborating with product managers, developers, and data engineers to empower and evolve the culture of data driven decision making
  • Designing, developing, and improving self-service user experience and tools
SecurityScorecard

501-1,000 employees

Predictive cybersecurity platform
Company Overview
SecurityScoreCard's mission is to make the world a safer place by transforming the way organizations understand, mitigate, and communicate cybersecurity risk to their boards, employees, and vendors.
Benefits
  • Health benefits
  • Education stipend
  • Unlimited PTO
  • Parental leave
  • 401K
  • Stock options
  • Referral bonuses
  • Remote work available
Company Core Values
  • Solutions Focused
  • Customer Obsessed
  • One Scorecard
  • Resilient
  • Embody #SecurityDNA