Full-Time
Python Data Engineer
ShyftLabs
11-50 employees
Data-driven decision-making platform for organizations
No salary listed
Noida, Uttar Pradesh, India
Hybrid
 Data & Analytics (1) |
|---|
- 5+ years of professional software development experience with Python and SQL
- Strong understanding of software engineering best practices (testing, version control, CI/CD)
- Experience building and optimizing ETL/ELT processes and data pipelines
- Proficiency with SQL and database concepts
- Experience with data processing frameworks (e.g., Pandas)
- Understanding of software design patterns and architectural principles
- Ability to write clean, well-documented, and maintainable code
- Experience with unit testing and test automation
- Experience working with any cloud provider (GCP is preferred)
- Experience with CI/CD pipelines and Infrastructure as code
- Experience with Containerization technologies like Docker or Kubernetes
- Develop and maintain data pipelines and ETL/ELT processes using Python
- Design and implement scalable, high-performance applications
- Work collaboratively with cross-functional teams to define requirements and deliver solutions
- Develop and manage near real-time data streaming solutions using PubSub or Beam.
- Contribute to code reviews, architecture discussions, and continuous improvement initiatives
- Monitor and troubleshoot production systems to ensure reliability and Performance.
- Experience with GCP services, particularly Cloud Run and Dataflow
- Experience with stream processing technologies (Pub/Sub)
- Familiarity with big data technologies (Airflow)
- Experience with data visualization tools and libraries
- Knowledge of CI/CD pipelines with Gitlab and infrastructure as code with Terraform
- Familiarity with platforms like Snowflake, BigQuery or Databricks
ShyftLabs helps organizations adopt a data-first approach to decision making by designing and implementing processes that turn data into actionable insights. Its solution builds structured analytics workflows and governance, so teams access trustworthy data, follow defined steps, and act on results with clarity. Unlike tools that only show dashboards, ShyftLabs focuses on repeatable data practices and governance that speed up decisions and reduce ad hoc analysis. The goal is to help organizations stay ahead of the competition by enabling faster, more informed decisions across the business.
Company Size
11-50
Company Stage
N/A
Total Funding
N/A
Headquarters
Canada
Founded
2018
Simplify's Take
What believers are saying
- ShyftLabs hires Apache Druid Engineers and Data Architects in Gurugram and Toronto.
- ShyftLabs powers 200+ experts streamlining operations for major public agencies.
- ShyftLabs modernizes legacy systems with cloud migration for scalable citizen services.
What critics are saying
- Databricks Lakehouse erodes consulting margins as clients build in-house pipelines.
- Snowflake Cortex AI bypasses ShyftLabs BI with native serverless ML functions.
- Talent exodus to AWS drains ShyftLabs engineers amid 30% higher salaries.
What makes ShyftLabs unique
- ShyftLabs delivers privacy-first Carter platform for secure public sector AI.
- ShyftLabs unlocked $500 million value via data and AI for retailers and health.
- ShyftLabs builds custom low-latency pipelines embedding intelligence for real-time decisions.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Health Insurance
Hybrid Work Options
Professional Development Budget