Clearwater

Healthcare cybersecurity, risk, and HIPAA compliance.

Senior Security Data Engineer

Data EngineeringConfirmed live in the last 24 hours

Full-timePune, Maharashtra, IndiaNo salary listedIn-person

About the Job

Requirements

Proficiency in Python for extract, transform, and load (ETL) work and SQL for complex querying.
Experience with message queues such as Kafka or Pub/Sub, and stream-processing concepts.
Mastery of regular expressions (Regex) and log-parsing strategies for standard formats such as Syslog, Common Event Format (CEF), and JSON.
Understanding of data lake principles and Parquet or Avro formats in comparison with data warehouses.
Ability to exercise appropriate judgment and demonstrate initiative and independence.
Excellent written and oral communication skills.
Ability to use a personal computer for extended periods.

Responsibilities

Maintain high-throughput streaming pipelines that ingest logs from firewalls, cloud, and endpoint sources to a central destination.
Write parsers to convert raw logs into standard schemas such as Open Cybersecurity Schema Framework (OCSF) or Elastic Common Schema (ECS) for consistent querying.
Implement routing logic to send high-value data to the security information and event management (SIEM) system and bulk data to low-cost object storage in a data lake.
Clean and structure data to support AI/ML detection models and advanced analytics.
Perform duties outside normal responsibilities as needed.

Desired Qualifications

Experience with vector databases for storing embeddings.
Knowledge of log observability and routing tools used as middleware to route logs.
Familiarity with big data frameworks such as Spark or Flink.

JOB TITLE: Senior Security Data Engineer

EXPERIENCE: 5–10 Years	Approved Date:
REPORTS TO: Shivendra Ashish	Revised Dates:
POSITIONS SUPERVISED:

Core Responsibilities:

Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination.
Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying.
Cost Optimization: Implement routing logic to send "high-value" data to the SIEM and "bulk" data to low-cost Object Storage (Data Lake).
Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics.

Must-Have Skills:

Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying).
Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts.
Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON).
Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses.

Preferred / Nice to Have:

Experience with Vector Databases for storing embeddings.
Knowledge of Log Observability/Routing tools (middleware that routes logs).
Familiarity with Big Data frameworks (e.g., Spark, Flink).

Ability to embrace Clearwater's CLEAR core values (Commitment to Client Success, Lead with Accountability, Integrity & Collaboration, Excellence in All That We Do, Advance Colleague Success, Respect & Transparency) and culture.

Disclaimer: The above statements are intended to describe the general nature and level of work being performed by people assigned to this position. They are not to be construed as an exhaustive list of all responsibilities, duties, and skills required of colleagues in the role. All colleagues may be required to perform duties outside of their normal responsibilities from time to time, as needed.

Clearwater is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. Please inform Clearwater/Redspin’s Recruiting team if you need any assistance completing any forms or to otherwise participating in the application process.

Mental/Physical Requirements: Fast paced environment handling multiple demands. Must be able to exercise appropriate judgment as necessary. Requires a high level of initiative and independence. Excellent written and oral communication skills required. Requires the ability to use a personal computer for extended periods of time.

About the Company

Clearwater

Healthcare cybersecurity, risk, and HIPAA compliance.

Clearwater provides cybersecurity, compliance, and cyber risk management solutions tailored for the healthcare sector. Its products combine 24/7 Security Operations Center threat detection and response with a proprietary IRM|Pro platform for risk analysis, governance, and vulnerability management, offered alongside consulting, assessments, and managed cloud services. Clearwater differentiates itself by focusing exclusively on healthcare and by integrating security with HIPAA and other regulatory compliance, plus specialized CMMC-related work through its Redspin division. Its goal is to help healthcare organizations strengthen their security and compliance posture while navigating complex regulations and evolving cyber threats.

Company size: 201-500
Company stage: Not listed
Total funding: Not listed
Headquarters: Nashville, TN
Founded: Not listed

Recently Posted Jobs

Explore more opportunities at Clearwater

See more jobs