Senior Data Engineer

Confirmed live in the last 24 hours

Locations

Washington, DC, USA

Experience Level

Entry

Junior

Mid

Senior

Expert

Desired Skills

Data Analysis

Airflow

Postgres

Python

Requirements

Navigating between project management, technical leadership, and individual contributor roles
Negotiating between new requirements, legacy systems, technical debt, and best practices
Mentoring colleagues on data engineering best practices and systems design
B.S. or M.S. in Computer Science (or a related field) or equivalent work experience
Experience with various data-stores, distributed messaging platforms, or data processing frameworks
Experience designing and building reliable systems and data pipelines
Experience working with large structured and unstructured data sets
Effective coding, documentation, and communication habits
Proficient understanding of distributed computing principles
Experience integrating/fusing data from multiple data sources and domains
Knowledge of various ETL techniques, frameworks, and best practices
Strong communication, project management and organizational skills
Experience supporting and working with cross-functional teams in a dynamic environment
Proficiency with Python

Responsibilities

Work with industry standard and/or open source software such as s3, PostgreSQL and Airflow
Support machine learning and application teams by setting up custom data solutions
Build event and batch driven ingestion systems for machine learning and R&D as needed
Develop and administer databases, knowledge bases, and distributed data stores
Create and use systems to clean, integrate, or fuse datasets to produce data products
Establish and monitor data integrity and value through visualization, profiling, and statistical tools
Perform updates, migrations, and administration tasks for data systems
Translate data governance strategy into implementation

Desired Qualifications

Experience with Machine Learning workflows and operations

At Kensho, we hire talented people and give them the autonomy, support, and resources needed to build cutting edge technology and products. We produce a suite of AI-powered solutions that solves the challenges of the largest, most successful businesses and institutions, helping them make sense out of a world full of messy data.

We are seeking an experienced Software Engineer with a specialization in data engineering to join our Machine Learning Team. You will be responsible for implementing data ingestion pipelines to further our large language model efforts. You will work with stakeholders across Kensho and S&P to proactively understand the data landscape, triage data requirements, and ultimately incorporate the necessary data sets into our training corpus.

Our ideal candidate has 5+ years of experience, has been recognized as a technical leader, and has demonstrated success:

- Navigating between project management, technical leadership, and individual contributor roles

- Negotiating between new requirements, legacy systems, technical debt, and best practices

- Mentoring colleagues on data engineering best practices and systems design

What You’ll Do:

Work with industry standard and/or open source software such as s3, PostgreSQL and Airflow
Support machine learning and application teams by setting up custom data solutions
Build event and batch driven ingestion systems for machine learning and R&D as needed
Develop and administer databases, knowledge bases, and distributed data stores
Create and use systems to clean, integrate, or fuse datasets to produce data products
Establish and monitor data integrity and value through visualization, profiling, and statistical tools
Perform updates, migrations, and administration tasks for data systems
Translate data governance strategy into implementation

What You’ll Need:

B.S. or M.S. in Computer Science (or a related field) or equivalent work experience
Experience with various data-stores, distributed messaging platforms, or data processing frameworks
Experience designing and building reliable systems and data pipelines
Experience working with large structured and unstructured data sets
Effective coding, documentation, and communication habits
Proficient understanding of distributed computing principles
Experience integrating/fusing data from multiple data sources and domains
Knowledge of various ETL techniques, frameworks, and best practices
Strong communication, project management and organizational skills
Experience supporting and working with cross-functional teams in a dynamic environment
Proficiency with Python
(Bonus) Experience with Machine Learning workflows and operations

At Kensho, we pride ourselves on providing top-of-market benefits, including:

- Medical, Dental, and Vision insurance

- 100% company paid premiums

- Unlimited Paid Time Off

- 26 weeks of 100% paid Parental Leave (paternity and maternity)

- 401(k) plan with 6% employer matching

- Generous company matching on donations to non-profit charities

- Up to $20,000 tuition assistance toward degree programs, plus up to $4,000/year for ongoing professional education such as industry conferences

- Plentiful snacks, drinks, and regularly catered lunches

- Dog-friendly office (CAM office)

- In-office gyms and showers (CAM, DC)

- Bike sharing program memberships

- Compassion leave and elder care leave

- Mentoring and additional learning opportunities

- Opportunity to expand professional network and participate in conferences and events

About Kensho

Kensho is an Artificial Intelligence company that builds solutions to uncover insights in messy and unstructured data that enable critical workflows and empower businesses to make decisions with conviction.

Kensho was founded in 2013 and was acquired by S&P Global in 2018. Kensho continues to operate as a startup in order to maintain our distinct, independent brand and to promote our breakthrough, innovative culture. Our team of Kenshins enjoy a dynamic and collaborative work environment that runs autonomously from S&P Global, while leveraging the unparalleled breadth and depth of data and resources available as part of S&P Global. As Kenshins, we pride ourselves on maintaining an innovative culture that depends on diversity and inclusion.

We are an equal opportunity employer that welcomes future Kenshins with all experiences and perspectives. Kensho is headquartered in Cambridge, MA, with offices in New York City, and Washington D.C. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.

51-200 employees

Website

Kenshoo is the global leader in agile marketing software.

Company Overview

Kensho is committed to creating a kind, diverse and equitable workplace, fostering a sense of belonging, and ensuring that the company is a place where employees can bring their whole selves to work. The company develops agile marketing software.

Benefits

Health - 100% employer-paid insurance that covers you and your family... and more
Wellness - 26 weeks paid parental leave, flexible work hours... and more
Growth - 6% 401K match, 20K tuition reimbursement, Knowledge Days... and more

Company Core Values

Go Team - We put the team before ourselves. We aren’t selfish. We disagree but commit.
Empowerment - We prefer a flat hierarchy and don’t pay much attention to titles. We encourage intelligent risk-taking; we like action, and we don’t waste time.
Inclusion - We encourage differences. We respect and seek out backgrounds and opinions that are different from our own.
Open Communication - We default to openness and happily acknowledge and embrace failures so we can learn from them.
Pursuit of Excellence - We never sacrifice our high bar and optimize under the assumption that quality work hours from the best people are the scarcest resource.