Simplify Logo

Full-Time

Data Engineer

Mongodb/Databricks with Devops

Confirmed live in the last 24 hours

Harmonia

Harmonia

Senior

Remote in USA

Flexible schedules and teleworking options available.

US Top Secret Clearance Required

Category
Data Engineering
Data & Analytics
Required Skills
NoSQL
AWS
MongoDB
Data Analysis
Requirements
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • At least 5 years of experience in data engineering, with a focus on MongoDB database management and optimization.
  • Expert in NoSQL (MongoDB) database management and optimization.
  • Proficient in data modeling techniques and database architecture principles, particularly for MongoDB.
  • Strong experience with Databricks for data analytics and pipeline development.
  • Knowledge of data pipeline orchestration and scheduling.
  • Deep understanding of data security and compliance requirements.
  • Knowledge of legacy data formats such as QSAM and VSAM.
  • Experience with big data technologies is a plus.
  • Experience modernizing data stores.
  • Proficiency in CI/CD tools, scripting, and automation.
  • Experience with infrastructure as code (IaC) and configuration management tools.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.
  • Must have or be able to obtain an MBI (Minimum Background Investigation) clearance.
Responsibilities
  • Design, implement, and maintain MongoDB data models and schemas for real-time event-driven processing.
  • Develop and optimize data pipelines and workflows using Databricks.
  • Create and manage MongoDB databases to serve as authoritative transactional data stores for online processing.
  • Collaborate with software engineers to integrate MongoDB solutions into applications.
  • Implement and manage CI/CD pipelines for MongoDB and Databricks workflows.
  • Automate data infrastructure provisioning and management using infrastructure as code (IaC) tools.
  • Monitor and optimize MongoDB performance, ensuring scalability and reliability.
  • Ensure data security and compliance with IRS standards, implementing necessary security measures.
  • Develop technical documentation, including data models, data dictionaries, and data flow diagrams.
  • Provide support for data migration and integration from legacy systems to MongoDB.
  • Conduct performance tuning and index optimization for MongoDB databases.
  • Manage data replication and backup strategies to ensure data availability and integrity.
  • Execute tasks to support environments within AWS Gov Cloud or Treasury Cloud.
  • Provide data engineering design activities to modernize legacy functionality into event-driven and business rules orchestrated services.
  • Develop and assess logical and physical designs.
  • Analyze legacy system use cases, features, and functionality that should be built into the modernized system for requirement support.

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A