M

M1 Technology

Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.
  • At least 5 years of software development experience with at least one of Python, Java, C#, JavaScript, or Ruby; Python is strongly preferred.
  • At least 5 years of experience working with databases and applications in classified intelligence community environments.
  • Extensive experience designing and maintaining SQL-based data systems and crafting complex queries.
  • Proficiency in generating and interpreting technical documentation, including entity-relationship diagrams, schemas, and architecture diagrams.
  • In-depth knowledge of intelligence community cloud environments and C2E cloud services.
  • Experience integrating data systems with visualization and analytics platforms such as Tableau, Power BI, Kibana, or Grafana.

Responsibilities

  • Maintain and execute data extraction pipelines to transport data in and out of multiple environments.
  • Enrich existing datasets using external and under-represented data sources.
  • Integrate and manage data catalog capabilities for discoverability and governance.
  • Troubleshoot and resolve issues related to data ingestion, integration, and processing.
  • Develop and enhance scripts and tools using Python and PySpark to process structured SQL and unstructured JSON and XML data.
  • Interface with cloud-based storage solutions, including object repositories and relational database management systems, to support analytics platforms.
  • Manage data acquisition via secure HTTPS requests, direct database connections, and standalone file transfers.

Desired Qualifications

  • Familiarity with intelligence community metrics and assessments, including alignment with intelligence needs, responsiveness, and collection discipline utilization.
  • Experience building tools to assess and visualize large-scale datasets.
  • Proven ability to design and implement secure application programming interfaces for data access and integration.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at M1 Technology

See more jobs