Senior Data Engineer @ Kensho

INACTIVE

Full-Time

Senior Data Engineer

Kensho

51-200 employees

Kenshoo is the global leader in agile marketing software.

AI & Machine Learning

Senior

Washington, DC, USA

Required Skills

Python

Airflow

Postgres

Data Analysis

Requirements

Navigating between project management, technical leadership, and individual contributor roles
Negotiating between new requirements, legacy systems, technical debt, and best practices
Mentoring colleagues on data engineering best practices and systems design
B.S. or M.S. in Computer Science (or a related field) or equivalent work experience
Experience with various data-stores, distributed messaging platforms, or data processing frameworks
Experience designing and building reliable systems and data pipelines
Experience working with large structured and unstructured data sets
Effective coding, documentation, and communication habits
Proficient understanding of distributed computing principles
Experience integrating/fusing data from multiple data sources and domains
Knowledge of various ETL techniques, frameworks, and best practices
Strong communication, project management and organizational skills
Experience supporting and working with cross-functional teams in a dynamic environment
Proficiency with Python

Responsibilities

Work with industry standard and/or open source software such as s3, PostgreSQL and Airflow
Support machine learning and application teams by setting up custom data solutions
Build event and batch driven ingestion systems for machine learning and R&D as needed
Develop and administer databases, knowledge bases, and distributed data stores
Create and use systems to clean, integrate, or fuse datasets to produce data products
Establish and monitor data integrity and value through visualization, profiling, and statistical tools
Perform updates, migrations, and administration tasks for data systems
Translate data governance strategy into implementation

Desired Qualifications

Experience with Machine Learning workflows and operations

At Kensho, we hire talented people and give them the autonomy, support, and resources needed to build cutting edge technology and products. We produce a suite of AI-powered solutions that solves the challenges of the largest, most successful businesses and institutions, helping them make sense out of a world full of messy data.

We are seeking an experienced Software Engineer with a specialization in data engineering to join our Machine Learning Team. You will be responsible for implementing data ingestion pipelines to further our large language model efforts. You will work with stakeholders across Kensho and S&P to proactively understand the data landscape, triage data requirements, and ultimately incorporate the necessary data sets into our training corpus.

Our ideal candidate has 5+ years of experience, has been recognized as a technical leader, and has demonstrated success:

- Navigating between project management, technical leadership, and individual contributor roles

- Negotiating between new requirements, legacy systems, technical debt, and best practices

- Mentoring colleagues on data engineering best practices and systems design

What You’ll Do:

Work with industry standard and/or open source software such as s3, PostgreSQL and Airflow
Support machine learning and application teams by setting up custom data solutions
Build event and batch driven ingestion systems for machine learning and R&D as needed
Develop and administer databases, knowledge bases, and distributed data stores
Create and use systems to clean, integrate, or fuse datasets to produce data products
Establish and monitor data integrity and value through visualization, profiling, and statistical tools
Perform updates, migrations, and administration tasks for data systems
Translate data governance strategy into implementation

What You’ll Need:

B.S. or M.S. in Computer Science (or a related field) or equivalent work experience
Experience with various data-stores, distributed messaging platforms, or data processing frameworks
Experience designing and building reliable systems and data pipelines
Experience working with large structured and unstructured data sets
Effective coding, documentation, and communication habits
Proficient understanding of distributed computing principles
Experience integrating/fusing data from multiple data sources and domains
Knowledge of various ETL techniques, frameworks, and best practices
Strong communication, project management and organizational skills
Experience supporting and working with cross-functional teams in a dynamic environment
Proficiency with Python
(Bonus) Experience with Machine Learning workflows and operations

At Kensho, we pride ourselves on providing top-of-market benefits, including:

- Medical, Dental, and Vision insurance

- 100% company paid premiums

- Unlimited Paid Time Off

- 26 weeks of 100% paid Parental Leave (paternity and maternity)

- 401(k) plan with 6% employer matching

- Generous company matching on donations to non-profit charities

- Up to $20,000 tuition assistance toward degree programs, plus up to $4,000/year for ongoing professional education such as industry conferences

- Plentiful snacks, drinks, and regularly catered lunches

- Dog-friendly office (CAM office)

- In-office gyms and showers (CAM, DC)

- Bike sharing program memberships

- Compassion leave and elder care leave

- Mentoring and additional learning opportunities

- Opportunity to expand professional network and participate in conferences and events

About Kensho

Kensho is an Artificial Intelligence company that builds solutions to uncover insights in messy and unstructured data that enable critical workflows and empower businesses to make decisions with conviction.

Kensho was founded in 2013 and was acquired by S&P Global in 2018. Kensho continues to operate as a startup in order to maintain our distinct, independent brand and to promote our breakthrough, innovative culture. Our team of Kenshins enjoy a dynamic and collaborative work environment that runs autonomously from S&P Global, while leveraging the unparalleled breadth and depth of data and resources available as part of S&P Global. As Kenshins, we pride ourselves on maintaining an innovative culture that depends on diversity and inclusion.

We are an equal opportunity employer that welcomes future Kenshins with all experiences and perspectives. Kensho is headquartered in Cambridge, MA, with offices in New York City, and Washington D.C. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.

Kensho

View

Website

View Company Profile

Kensho is committed to creating a kind, diverse and equitable workplace, fostering a sense of belonging, and ensuring that the company is a place where employees can bring their whole selves to work. The company develops agile marketing software.

Company Stage

M&A

Total Funding

$675.9M

Headquarters

Cambridge, Massachusetts

Founded

2013

Growth & Insights

Headcount

6 month growth

↑ 10%

1 year growth

↑ 34%

2 year growth

↑ 34%

Benefits

Health - 100% employer-paid insurance that covers you and your family... and more

Wellness - 26 weeks paid parental leave, flexible work hours... and more

Growth - 6% 401K match, 20K tuition reimbursement, Knowledge Days... and more

INACTIVE