S

SunnyData

Builds data platforms and AI on Databricks

Data Solutions Architect - Financial Services

Pre-Sales Solution Engineering +1Confirmed live in the last 24 hours
Full-timeRemote in USARemote

About the Job

Requirements

  • Seven or more years as a hands-on Solutions Architect and/or Senior Data Engineer, including recent implementation experience with Databricks.
  • Expertise in Spark, Hadoop, Kafka, the Databricks platform, and data science or machine-learning tools including pandas and scikit-learn.
  • Deep understanding of the end-to-end data analytics workflow, including data modeling, extract-transform-load processes, and data integration using modern engineering techniques.
  • Ability to conduct architecture discovery and solution-design sessions and create implementation blueprints for engineering and analytics teams.
  • Proficiency in Java, Python, and/or Scala.
  • Experience with AWS, Azure, and/or GCP cloud platforms.
  • Ability to write, debug, and optimize SQL queries.
  • Strong written and verbal communication skills and experience in client-facing roles.
  • Ability to build and deliver detailed presentations to clients and stakeholders.
  • Experience producing detailed solution documentation, including proofs of concept, roadmaps, sequence diagrams, class hierarchies, and logical system views.
  • Experience managing teams and mentoring engineers.
  • Ability to take technical solutions into production while ensuring performance, security, scalability, and robust data integration.
  • A four-year Bachelor's degree in Computer Science or a related field.

Responsibilities

  • Serve as a trusted advisor to customers, guiding their data engineering and architecture strategy with a focus on Databricks solutions.
  • Design, build, and deploy end-to-end data solutions that capture, transform, and activate data for artificial intelligence, machine learning, and business intelligence initiatives.
  • Partner with sales teams to present technical solutions to prospective clients and demonstrate the value of SunnyData's offerings.
  • Manage multiple customer accounts, ensuring timely delivery and clear reporting on progress and outcomes.
  • Architect data solutions that incorporate best practices in governance, security, and data quality.
  • Evaluate data sources for their value and recommend inclusion strategies that strengthen analytics.
  • Guide internal teams, mentor project members, and educate end users on data products and analytic environments.
  • Perform system analysis, diagnose data and system defects, and apply appropriate fixes.
  • Test data movement, transformation code, and data components for accuracy and reliability.

Desired Qualifications

  • Familiarity with cloud and distributed data storage systems such as S3, ADLS, HDFS, GCS, Kudu, Elasticsearch/Solr, Cassandra, or other NoSQL storage systems.
  • Experience with data integration technologies such as Spark, Kafka, StreamSets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure Data Factory, and Informatica Intelligent Cloud Services (IICS).
  • Comprehensive experience with the complete software development lifecycle, including design, documentation, implementation, testing, and deployment.
  • Expertise in automated data transformation and curation using tools such as dbt, Spark, Spark Streaming, and automated pipelines.
  • Experience with workflow management and orchestration tools such as Airflow, AWS Managed Airflow, Luigi, and NiFi.
  • Background working in the Financial Services industry, preferably in banking.
  • Understanding of industry compliance requirements and standards, specifically in banking IT landscapes.
  • At least two of the following certifications: Associate Developer for Apache Spark, Data Engineer Associate, Professional Data Engineer, Machine Learning Associate, or Professional ML Engineer.

About the Company

SunnyData

Builds data platforms and AI on Databricks

SunnyData builds data platforms and AI applications for businesses using Databricks, a cloud system for storing, processing and analyzing company data. It migrates older systems and connects scattered information so customers can run analytics and machine learning on a shared foundation. Customers hire its consultants and engineers to design architectures, build pipelines and put AI projects into production, with data access and regulatory controls built into the work. The firm serves financial institutions, healthcare organizations, retailers and manufacturers, adapting implementations to their operating requirements. SunnyData is headquartered in Minneapolis, Minnesota.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Minneapolis, MN
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at SunnyData

See more jobs