B

BID Operations

Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeShenzhen, Guangdong Province, ChinaNo salary listedIn-person

About the Job

Requirements

  • A bachelor's or master's degree in Computer Science, Engineering, or a related field is required.
  • Proven experience in data engineering, including a strong background in designing and implementing extract, transform, and load (ETL) processes within cloud environments.
  • Strong programming skills in Python and experience developing robust, maintainable, and scalable data-processing pipelines.
  • Extensive knowledge of and experience with SQL.
  • Ability to work collaboratively in a team environment.
  • Ability to convey complex technical concepts to non-technical stakeholders.

Responsibilities

  • Design and implement highly scalable, reliable, and performant data pipelines to support ETL processes, integrating technologies such as Kafka, Spark, ClickHouse, and RabbitMQ.
  • Work within cloud environments to deploy and manage data services, ensuring best practices in security, scalability, and efficiency.
  • Develop and maintain robust data storage solutions, optimizing data storage and retrieval processes in ClickHouse or similar technologies.
  • Collaborate with data analysts and other stakeholders to understand data needs and implement systems that support data analysis and reporting.
  • Monitor, troubleshoot, and optimize data pipelines, identifying and resolving performance bottlenecks and ensuring data quality and integrity.
  • Participate in the design and implementation of data models and schemas that support business processes and objectives.
  • Keep up with industry trends and advancements in data engineering technologies and methodologies, and continuously seek ways to improve data systems.
  • Ensure compliance with data governance and security policies.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at BID Operations

See more jobs