P

Particle41

Provides expert application, DevOps, ML teams

Data Consultant

Data EngineeringConfirmed live in the last 24 hours
Full-timeRemote in USANo salary listed

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, or a related field.
  • More than three years of experience in data engineering.
  • Proficiency in Python.
  • Experience with SQL databases such as MySQL and PostgreSQL, and NoSQL databases such as MongoDB.
  • Understanding of programming libraries, frameworks, and technologies including Flask, API frameworks, data warehousing and lakehouse principles, databases and object-relational mapping, Databricks, pandas, Spark, PySpark, machine learning, OpenCV, and scikit-learn.
  • Familiarity with logging, requests, subprocess, regular expressions, and pytest.
  • Experience with the ELK stack, Redis, and distributed task queues.
  • Understanding of concurrent and parallel processing concepts.
  • Familiarity with at least one cloud data engineering stack (Azure, AWS, or Google Cloud Platform) and ability to learn ETL/ELT tools across cloud providers.
  • Familiarity with Git and collaborative development workflows.
  • Competence working on Linux and creating shell scripts.
  • Understanding of software engineering principles, design patterns, and best practices.

Responsibilities

  • Design, develop, and maintain scalable ETL pipelines to process large volumes of data from diverse sources.
  • Build and optimize data lakes and data warehouses for efficient data retrieval and processing.
  • Integrate structured and unstructured data from internal and external systems to create a unified view for analysis.
  • Validate, cleanse, and transform data to ensure accuracy, consistency, and completeness.
  • Document data processes, tools, and systems and promote efficient workflow best practices.
  • Collaborate with product managers and other stakeholders to gather requirements and translate them into technical solutions.
  • Participate in requirement analysis sessions and provide technical insights and recommendations.
  • Participate in Agile development, including sprint planning, daily stand-ups, and sprint reviews.
  • Work with Agile teams to deliver software solutions on time and within scope, adapting to changing priorities and requirements.
  • Test and debug applications for reliability, security, and performance; write unit and integration tests to validate functionality.
  • Identify and resolve software defects, code smells, and performance bottlenecks.
  • Stay current with full-stack development technologies and trends, and propose improvements to performance, security, scalability, and maintainability.
  • Optimize and refactor existing code for efficiency and stay current with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Collaborate with testers, product managers, and cross-functional teams.

About the Company

Particle41

Provides expert application, DevOps, ML teams

Particle41 builds expert teams across software development, DevOps, and machine learning to strengthen a client’s capabilities. It assembles cross-functional teams that integrate into client projects, guiding work with clear communication and predictable timelines to drive fast progress. The service emphasizes specialized, high-caliber teams that augment the client’s own capabilities with speed, transparency, and forward planning. Its goal is to amplify a client’s business by delivering dependable teams that advance critical development, operations, and ML initiatives.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Frisco, TX
Founded
2015

Recently Posted Jobs

Explore more opportunities at Particle41

See more jobs