Data Engineer

The data strategy and analytics group (DSA) at LEARFIELD has partnered with the business in creating data solutions that will help drive the business forward into a digital transformation age.

As a Senior Data Engineer, you will help drive the development and adaptation of new technologies to help the business reach its goals. The data engineering team is looking for a candidate with in-depth hands-on experience designing, architecting, and developing data solutions in a SQL environment. This will include data ingestion, cleansing, modeling, and automation.

The ideal candidate will have hands-on experience in Azure data technologies including Azure SQL database, Data Factory, Data Lake/Storage Accounts, Azure DevOps, along with Big Data technologies such as Spark and Streaming Analytics.

As a Senior Data Engineer, you will report to the Director of Data Engineering. Additionally, you will work closely with all other members of the development team including data analysts, visualization developers, project management, QA analysts, stakeholders and product owners.

Responsibilities

• Architect new features/solutions into the current data warehouse solution
• Troubleshoot and evaluate bottlenecks in current ingestion techniques
• Design, develop, test data services in current Azure environment
• Develop and automate processes using Power Platform tools
• Creation and maintenance of clear and impactful technical documentation
• Mentoring and upskilling other team members
• Support and maintenance of the production environment and data pipelines
• Data architecture, design, development and implementation, using Azure technologies for large-scale data solutions
• Design and build scalable, reliable, and reusable data products that serve internal and external stakeholders
• Collaborate with product managers and cross-functional teams throughout the product development lifecycle, from ideation to deployment and iteration
• Implement and optimize medallion architecture (bronze, silver, gold layers) in Databricks or Microsoft Fabric to support scalable and maintainable data pipelines
• Translate business requirements into technical specifications and data models that align with product goals
• Technical authoring & solution design for data warehousing
• Ability to adapt to rapidly evolving environments

Qualifications

• Proven and comprehensive track record building and deploying scalable solutions in an Azure cloud environment
• Familiar with Azure DevOps CI/CD concepts
• Familiar with Spark and subsequent languages (PySpark, SparkSQL, etc)
• Extensive working knowledge in T-SQL
• Working knowledge of data warehousing/data modeling concepts
• Experience working with structured, semi structured and unstructured data
• Experience in Azure cloud technologies including:
  • Azure Data Lake Gen2/Storage Accounts (ADL)
  • Azure Data Factory (ADF)
  • Azure SQL Database
  • Azure DevOps
  • Power Platform
• Experience in database administration/performance optimization technologies and techniques, but not required
• 4+ years working in data engineering environment
• 3+ years working experience on Azure technologies
• Knowledge of Agile/Scrum project management lifecycle
• Knowledge of security best practices and industry standards and how to apply them within an Azure environment. (SOC2 working knowledge a plus)
• Proven experience designing and delivering data products in a production environment
• Strong understanding of product development lifecycles, including Agile methodologies and iterative delivery
• Hands-on experience implementing medallion architecture in Databricks or Microsoft Fabric
• Familiarity with Delta Lake, Unity Catalog, and Lakehouse paradigms is a plus
• Tableau Server and Desktop knowledge is a plus
• Experience with front end / middle technologies including: (but not required)
  • C#
  • Entity Framework
  • Angular
  • API’s (REST)

Learfield offers a full spectrum of benefits for eligible employees including Medical, Dental, Vision, Health Savings Account, Life Insurance and Other Insurance Plans, Flexible Paid Time Off (minimum 10+ days annually), including Parental Leave, 20 Paid Holidays, 401(k) + Match, and Short/Long Term Disability. Leave benefits are consistent with state and local laws, including the Colorado Health Families and Workplaces Act.

Learfield is an Equal Opportunity Employer. We provide equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.