Technical Lead Data Engineering - Databricks Champion
About the job
- 8+ years of track record of relevant work experience and a computer Science or a related technical discipline is required
- Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff
- Experience working with large, complex data sets from a variety of sources
- Experience with Hadoop, Spark, or similar stack a must
- Experience with functional and object-oriented programming, Python or Scala a must
- Effective communication skills (both written and verbal)
- Ability to collaborate with a diverse set of engineers, data scientists and product managers
- Technical knowledge in Spark, Hadoop & GCS Stack.
- Comfort in a fast-paced start-up environment
- Align Sigmoid with key Client initiatives
- Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
- Connect with VP and Director level clients on a regular basis
- Travel to client locations
- Ability to understand business requirements and tie them to technology solutions
- Facilitate in Technical Aspects
- Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies.
- Excellent experience in Application development and support, integration development and data management.
- Provide technical leadership and manage it day to day basis
- Guiding developers in day to day design and coding tasks
- Play a key role in hiring technical talents to build the future of Sigmoid.
- Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
- Hands on coder with good understanding on enterprise level code
- Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
- Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
- Culture
- Must be a strategic thinker with the ability to think unconventional / out:of:box.
- Analytical and data driven orientation.
- Raw intellect, talent and energy are critical.
- Entrepreneurial and Agile : understands the demands of a private, high growth company.
- Ability to be both a leader and hands on "doer".
- Experience in agile methodology
- Development and support experience in Big Data domain
- Architecting, developing, implementing and maintaining Big Data solutions
- Experience with database modeling and development, data mining and warehousing.
- Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)
About the company
Sigmoid analyzes real-time ad bid and auction data to optimize advertising spend and revenue. The platform, SigView, processes billions of ad impressions in real time to deliver business intelligence, sales forecasting, trend analysis, and bid optimization for both buy-side players (buyers, DSPs, ad networks) and sell-side players (SSPs, ad exchanges). It is subscription-based, granting clients instant access to bid and auction data for ad hoc exploration and informed decision-making. Compared with competitors, Sigmoid combines real-time, large-scale data analytics across both sides of the market and provides a unified view for optimizing campaigns and revenue, rather than offering a single-side solution.
Company Size
1,001-5,000
Company Stage
Series B
Total Funding
$12M
Headquarters
Jersey City, New Jersey
Founded
2013
Get referred to Sigmoid
See people who can refer or advise you
Simplify's Take
What believers are saying
- Sigmoid expanded Bengaluru with a 40,000-square-foot AI innovation hub in 2026.
- Sigmoid's 2026 newsroom highlights ISG leadership in supply chain analytics and U.S. AI.
- OpenAI partnership deepens enterprise AI sales across CPG, pharma, healthcare, and manufacturing.
What critics are saying
- Sigmoid last raised $12 million in 2022, limiting cash against larger vendors.
- Accenture, Databricks, Snowflake, and OpenAI all chase the same enterprise AI budgets.
- If OpenAI centralizes implementation in 2027, Sigmoid becomes a commoditized reseller.
What makes Sigmoid unique
- Sigmoid became an OpenAI Select Partner on September 23, 2026.
- Sigmoid holds Databricks Select Partner status and AWS Data and Analytics Competency.
- Its 2026 site emphasizes governed, real-time pipelines, DataGuard, RapidML, and CloudPulse.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Remote Work Options
Professional Development Budget
Growth & Insights and Company News
6 month growth
1%1 year growth
0%2 year growth
2%Sigmoid named an OpenAI Select Partner. Recognition deepens Sigmoid's work bringing OpenAI's frontier models into enterprise data, agentic, and operational workflows. Jersey City, NJ, 23rd Sept 2026 - Sigmoid today announced that it has been named an OpenAI Select Partner within the OpenAI Partner Network. The OpenAI Partner Network is a global program for partners to build, sell, and deliver AI solutions with OpenAI. It brings together partners with deep industry expertise, delivery capabilities, and customer relationships while equipping them with resources, enablement, and support to help enterprises adopt OpenAI frontier models and products and turn them into measurable impact. As an OpenAI Select Partner, Sigmoid will continue working with OpenAI to help organizations build, deploy, and scale AI solutions responsibly and effectively. This work will help organizations put GPT-6 Astra to work across more of their business, using deeper reasoning and computer use to complete complex workflows and deliver finished work. Sigmoid brings deep industry expertise and enterprise AI capabilities to help organizations apply advanced AI, copilots and agentic workflows across R&D, commercial, customer and operational functions. "Being named an OpenAI Select Partner reflects the work we have put into helping enterprises move from AI experiments to production impact. Our collaboration with OpenAI accelerates enterprise Agent Control Plane working in unison with robust Data and Security Planes-to build the enterprise context layer required for process transformation. By surrounding state-of-the-art models with unified data, control, and trust, we help organizations translate AI into measurable business value while driving the organizational change and adoption essential for lasting impact." said Mayur Rustagi, CTO and Co-Founder, Sigmoid. Sigmoid supports organizations across CPG, life sciences, healthcare, manufacturing and financial services with enterprise AI, generative AI, AI copilots and intelligent workflow solutions. Its work includes an AI-powered smart factory assistant helping frontline teams troubleshoot production issues in real time, a portfolio intelligence solution helping a global chocolate manufacturer accelerate product recommendations and sales, and AI-powered R&D knowledge solutions helping teams rapidly discover, summarize and act on complex product and scientific information. Looking ahead, Sigmoid plans to expand its OpenAI-based offerings, invest in talent and enablement, and scale customer deployments across CPG, Financial services, Pharma & Life sciences, helping customers translate AI ambition into business outcomes. About Sigmoid. Sigmoid helps enterprises modernize data, transform business processes, and make better decisions with AI to gain a competitive advantage. By partnering with Sigmoid to build bespoke GenAI and agentic AI solutions, powered by strong data foundations and contextual knowledge, global enterprises unlock new revenue and operate with greater efficiency. A data engineering pioneer since 2013 and trusted AI transformation partner to Fortune 500 leaders, Sigmoid combines deep data and AI expertise with a growing portfolio of pre-built agents and accelerators. Media contact. Being named an OpenAI Select Partner reflects the work Sigmoid has put into helping enterprises move from AI experiments to production impact. Its collaboration with OpenAI accelerates enterprise Agent Control Plane working in unison with robust Data and Security Planes-to build the enterprise context layer required for process transformation. Mayur Rustagi.
Sigmoid was recognized for its ability to deliver AI-driven insights and advanced BI capabilities through end-to-end data modernization, AI expertise, and proprietary solutions.JERSEY CITY, N.J., Jan. 14, 2025 /PRNewswire/ -- Sigmoid , a leading data engineering and AI consulting firm, today announced that it has been named a 'Rising Star' in the ISG Provider Lens™ for Advanced Analytics and AI Services - 2024 for the US region."This recognition underscores Sigmoid's commitment to helping enterprises to navigate data complexity and integrate AI for real-time insights," said Lokesh Anand, CEO and Co-Founder of Sigmoid. "By infusing our industry expertise with accelerators , our innovative solutions have helped clients expedite time to value from data and achieve impactful outcomes with AI", he added.ISG identified several Sigmoid strengths and differentiators across the three quadrants:Data Modernization Services : Sigmoid's service portfolio demonstrates a comprehensive approach to data modernization and management, emphasizing seamless integration, security, and cost optimization across cloud and data environments.: Sigmoid's service portfolio demonstrates a comprehensive approach to data modernization and management, emphasizing seamless integration, security, and cost optimization across cloud and data environments. Data Science and AI Services : Sigmoid's comprehensive approach blends consulting with deep industry-specific analytics and GenAI capabilities, enabling organizations with intelligent decision-making to move seamlessly from insights to strategic action.: Sigmoid's comprehensive approach blends consulting with deep industry-specific analytics and GenAI capabilities, enabling organizations with intelligent decision-making to move seamlessly from insights to strategic action. Advanced BI and Reporting Modernization Services: Provides user-centric BI reporting and data democratization with centralized data portals and customized dashboards for various user personas."Sigmoid's advanced analytics expertise, proprietary tools, and end-to-end data modernization services enable businesses to unlock value across operations. With scalable AI solutions and continuous model optimization, Sigmoid ensures agility and long-term relevance empowering enterprises to adapt to evolving market dynamics and achieve impactful, data-driven decision-making," said Gowtham Kumar Sampath, Principal Analyst at ISG.Rahul Kumar Singh, Chief Analytics Officer and Co-Founder of Sigmoid said, "We offer holistic data science and AI services that help businesses transform raw data into predictive intelligence that drives competitive advantage." He added, "Our advanced BI and reporting services streamline decision-making by providing access to critical information, supported by scalable data architectures to ensure real-time BI reporting".For more information, download the custom report here .About SigmoidSigmoid combines data engineering and AI consulting to help enterprises gain competitive advantage through effective data-driven decision-making
Sigmoid was recognized for demonstrating strong capability in predictive analytics and delivering tailored solutions to bolster informed decision-making.JERSEY CITY, N.J., Sept. 10, 2024 /PRNewswire/ -- Sigmoid , a leading data engineering and AI consulting firm, announced that it has been recognized as a 'Leader' in Supply Chain Analytics Service globally in 2024 ISG Provider Lens™. ISG, a leading global technology research and advisory firm, evaluated 17 top market providers, examining their strengths, challenges, and competitive advantages to help decision-makers choose the best analytics services for supply chain ."We are honored to receive this recognition from ISG, as we continue to help companies enhance transparency, efficiency, and responsiveness in supply chain operations," stated Lokesh Anand, CEO and Co-Founder of Sigmoid.ISG identified several Sigmoid strengths and differentiators, including:AI for supply chain efficiency and agility : Sigmoid combines data, analytics and advanced AI models to optimize supply chains through demand forecasting, inventory management and logistics routing.: Sigmoid combines data, analytics and advanced AI models to optimize supply chains through demand forecasting, inventory management and logistics routing. Enhanced visibility through control towers : Sigmoid's Supply Chain Control Tower accelerators, built on scalable data foundations with strong governance, offer comprehensive end-to-end visibility and real-time actionable insights.: Sigmoid's accelerators, built on scalable data foundations with strong governance, offer comprehensive end-to-end visibility and real-time actionable insights. Accelerator-led approach for solution delivery: Sigmoid employs pre-built AI and ML models that help enterprises make data-driven decisions and optimize workflows in an expedited manner. This enables faster time-to-value as supply chain clients can predict disruptions and undertake risk mitigation steps proactively."Sigmoid's investments in predictive and prescriptive analytics reflect its commitment to modernizing the data ecosystem and enhancing supply chain resilience
SINGAPORE, Oct. 17, 2023 /PRNewswire/ -- Sigmoid, a leading data engineering and AI consulting firm, today announced the appointment of Shankar Viswanathan as their Chief Commercial Officer.
SAN FRANCISCO, May 2, 2023 /PRNewswire/ -- Sigmoid, a leading data engineering and AI consulting firm, has partnered with Jack In The Box, a leading restaurant chain with over 2,200 locations in the US to improve brand perception and sales for all their outlets with data driven insights for leadership teams. Sigmoid partnered with Jack In The Box to develop an automated data ingestion and visualization platform that enabled granular insights into multiple key performance metrics across sales, operational efficiency, brand loyalty and profitability."We were trying to consolidate data from multiple sources for a holistic view of performance metrics across our US outlets for a long time. With Sigmoid's data engineering and dashboarding solutions, we now have access to a near real time scorecard that tracks various brand performance metrics efficiently, and improved decision making to drive brand value." said Doug Cook, CTO at Jack in the box.With Sigmoid's low-code architecture on AWS, Jack in the Box was able to easily ingest, transform, and load data from various sources with varying layers of granularity into a unified data warehouse built on Amazon Redshift. This allowed for near-real time analysis and reporting. These insights across critical brand performance pillars such as brand loyalty, operational excellence, profitability, supply chain, restaurants' reach, resulted in improved business outcomes."We are thrilled to have partnered with Jack in the Box to help them strengthen their data and analytics capabilities. Our solution improves business agility by providing faster access to insights at scale and makes the integration of newer data sources for advanced analytics and BI faster", said Mayur Rustagi, CTO and co-founder of Sigmoid