L

Lincoln Financial

Insurance, retirement, and financial services provider

Lead Software Engineer

Data EngineeringPosted on Nov 11
Full-time

About the Job

Requirements

  • A bachelor's degree or equivalent in Computer Science, Information Systems, Engineering, or a related field.
  • At least 7 years of experience in AWS data engineering or a similar role.
  • Proven ability to lead a team, own delivery of complex projects, and communicate with stakeholders.
  • Expertise in Aurora PostgreSQL and Amazon Redshift, including database analysis, query optimization, advanced SQL, execution plans, indexing, distribution and sort keys, and workload tuning.
  • A holistic understanding of end-to-end data processing from source to consumption, including dependencies, bottlenecks, and downstream impact.
  • Experience integrating data and applications with upstream source systems and downstream consumers, including APIs, files, messaging, and reporting.
  • Hands-on experience with AWS Glue, Lambda, S3, Athena, EC2, and IAM.
  • Experience developing ETL and integration using Python, PySpark, and SQL in Agile, SDLC-based environments.
  • Experience with DevOps and scheduling, including Git, CI/CD pipelines, automated testing, CloudFormation or similar tools, and Stonebranch or a similar scheduler such as Autosys.
  • Hands-on use of approved AI development tools such as GitHub Copilot or Claude Code, validating their output and following data privacy and responsible AI requirements.
  • Ability to lead and prioritize work, own delivery, set standards and technical vision, review code, mentor engineers, and develop future leaders.
  • Ability to integrate structured and unstructured data from internal and external sources.
  • Ability to design technical solutions from business requirements and apply data modeling standards and data quality practices.
  • Ability to ensure data security, governance, and compliance and to monitor, troubleshoot, and optimize data workflows.

Responsibilities

  • Provide technical leadership for the Data Strategy and Delivery team by designing, building, and maintaining scalable data pipelines and optimizing data systems.
  • Lead and prioritize work, own delivery, set standards and technical vision, review code, mentor engineers, and grow future leaders.
  • Design, build, and maintain batch and streaming data pipelines, including change data capture, to support business intelligence and analytics.
  • Integrate structured and unstructured data from internal and external sources.
  • Develop ETL workflows using AWS Glue, Lambda, custom Python, PySpark, and SQL-based scripts.
  • Analyze database workloads and optimize queries, indexing, partitioning, and storage in Aurora PostgreSQL and Amazon Redshift for integrity, performance, and cost.
  • Build S3-based data lake and warehouse layers using Glue Data Catalog, Athena, and Parquet, with fine-grained access controls.
  • Own end-to-end data flows from source to consumption and trace and resolve issues across the full chain.
  • Apply data modeling standards, including normal form, star, and snowflake, and data quality practices; create technical designs from business requirements.
  • Orchestrate and schedule workflows using Stonebranch, Step Functions, and Airflow or MWAA, and monitor them with CloudWatch and automated data quality checks.
  • Ensure data security, governance, and compliance; monitor, troubleshoot, and optimize data workflows.
  • Integrate with upstream and downstream applications and collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.
  • Help shape data infrastructure strategy on AWS.

Desired Qualifications

  • AWS certification such as Data Engineer – Associate, Solutions Architect, or a specialty certification.
  • Experience with EMR, Kinesis, Lake Formation, DynamoDB, or Apache Iceberg.
  • Experience with Microsoft 365 Copilot and Claude Cowork, and coaching teams on safe AI use.
  • Experience with RAG data preparation, embeddings, vector stores, and AWS AI services such as Bedrock, SageMaker, or Amazon Q.
  • Experience with Salesforce CRM and MuleSoft for API-led integration as upstream or downstream systems.
  • Experience with MicroStrategy and Tableau reporting and business intelligence.
  • Financial data experience, especially in insurance, annuities, or retirement (401k/403b).

About the Company

Lincoln Financial

Insurance, retirement, and financial services provider

Lincoln Financial Group offers life insurance, annuities, and retirement income products through its network of affiliated companies, and also provides securities and investment advisory services via affiliated broker-dealers. Its products combine insurance coverage or retirement-focused contracts with investment options, where customers fund premiums, choose subaccounts or riders, and receive benefits such as death benefits, living benefits, or guaranteed income in retirement. The company differentiates itself with a family of affiliated brands and distributors that coordinate life, annuity, and advisory products under one umbrella. Its goal is to help individuals and families protect loved ones, plan for retirement, and achieve financial security through integrated protection and investment solutions.

Company size
Not listed
Company stage
Not listed
Total funding
$128.8M
Headquarters
Radnor Township, Pennsylvania
Founded
1905

Recently Posted Jobs

Explore more opportunities at Lincoln Financial

See more jobs