Simplify Logo

Full-Time

Senior Data Engineer

Posted on 1/31/2024

10pearls

10pearls

1,001-5,000 employees

Specializes in digital transformation and software development

Consulting
Enterprise Software
Social Impact
Financial Services

Senior

Remote in USA

Category
Data Engineering Management
QA & Testing
Data & Analytics
Required Skills
Microsoft Azure
Agile
Redshift
Python
Apache Spark
SQL
AWS
Data Analysis
Snowflake
Requirements
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Proven experience in data engineering development and implementation.
  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.
  • Ability to work collaboratively in a team environment.
  • Familiarity with Agile development methodologies.
  • Experience with a modern data platform (Databricks, Snowflake, AWS Redshift, Azure Synapse Analytics, etc.)
  • Strong programming skills with SQL, Python, and Apache Spark.
  • In-depth knowledge of data architecture, deployment, and administration.
  • Proficiency in implementing and optimizing ETL processes.
  • Familiarity with cloud platforms (AWS, Azure)
  • Excellent problem-solving and communication skills.
Responsibilities
  • Partner with business stakeholders and cross-functional teams to gather and analyze requirements.
  • Translate business requirements into technical specifications for data and analytics solutions and data engineering pipelines.
  • Design, develop, and implement data solutions to automate and optimize data and analytics processes.
  • Utilize SQL, Python, or an ETL platform for building data pipelines.
  • Contribute to strategy and design of environments.
  • Configure and administer CI/CD pipelines across all environments.
  • Implement best practices for data storage, data processing, and data security.
  • Support testing of data pipelines to ensure functionality and performance meet business requirements.
  • Collaborate with quality assurance teams to address and resolve any issues identified during testing.
  • Create comprehensive documentation for data engineering solutions, including technical specifications, test plans, and user guides.
  • Maintain documentation to ensure accuracy and relevance.
  • Work closely with cross-functional teams, including business analysts, developers, and project managers, to ensure successful delivery of data engineering solutions.
  • Provide technical expertise, guidance, and mentoring to team members.

10Pearls specializes in digital transformation and software development, leveraging emerging and modern technologies to create innovative digital products and experiences. Their services include modernizing existing technology, automating manual business processes, and extending agile development teams for faster software delivery.

Company Stage

M&A

Total Funding

N/A

Headquarters

Herndon, Virginia

Founded

2015

INACTIVE