Full-Time
Lead Big Data Developer
Posted on 4/18/2024
Specializes in financial services data engineering
Consulting
Financial Services
Senior, Expert
Tampa, FL, USA
Required Skills
Agile
Apache Spark
SQL
AWS
Data Analysis
Snowflake
Requirements
- 11+ years of overall software development experience in enterprise systems.
- 10+ years of Data Management experience in an enterprise environment.
- 10+ years of experience with SQL.
- 8+ years of experience with AWS S3, Spark and Glue (PySpark primarily / some Scala).
- 5+ years as an AWS solutions architect.
- 5+ years working with Snowflake, Databricks.
- Expert knowledge of metadata management, data governance, and data lineage.
- In-depth knowledge of Agile Software Development practices.
- Possess the ability to decompose business problems into smaller parts to correctly solution.
- Team player with excellent problem-solving and troubleshooting skills.
- Familiar with software engineering practices, including CI/CD pipelines, Automated Testing, and Performance Engineering.
- Working knowledge of SDLC, especially regarding improving agile delivery metrics.
- Strong communication and team/technical leadership skills.
- Bachelor’s degree in computer science, MIS, or a related field.
- Consulting experience.
Responsibilities
- Design and implement scalable, robust, and efficient data architectures, including data lakes, data warehouses, and data pipelines.
- Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines to ingest, process, and transform large volumes of data from various sources, ensuring data quality and reliability.
- Design and implement data models and schemas to organize and structure data for efficient storage, retrieval, and analysis, considering business requirements and data governance principles.
- Integrate data from diverse sources, such as databases, APIs, files, and streaming platforms, ensuring seamless data flow and interoperability across systems.
- Implement data transformation and enrichment processes to derive insights, perform aggregations, and create derived datasets for analytics, reporting, and machine learning.
- Establish and enforce data governance policies, standards, and best practices to ensure data integrity, security, privacy, and compliance with regulatory requirements.
- Optimize data pipelines and queries for performance, scalability, and efficiency, leveraging techniques such as partitioning, indexing, and query optimization.
- Collaborate with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and deliver data solutions that meet business needs.
Doran Jones Inc. is a highly regarded employer in the financial services sector, focusing on data engineering and application development. The company's emphasis on leveraging agile transformation expertise, AI, and machine learning tools offers a dynamic and technologically advanced working environment. This focus not only drives the digital transformation of its clients but also positions Doran Jones Inc. as a leader in developing solutions for capital markets, risk, and regulatory compliance.
Company Stage
M&A
Total Funding
N/A
Headquarters
Charlotte, North Carolina
Founded
2010
Growth & Insights
Headcount