Nitor Infotech

GenAI-first software product engineering services

Big Data Engineer / Architect

Data EngineeringConfirmed live in the last 24 hours

Full-timePortland, OR, USANo salary listedIn-person

About the Job

Requirements

Experience with data architecture, big data, and ETL environments.
Experience designing ETL using Informatica, Talend, Oracle Data Integrator, Dell Boomi, or equivalent tools.
Experience with big data and analytics solutions including Hadoop, Pig, Hive, Spark, Spark SQL, Storm, and AWS services such as EMR, Redshift, and S3, or Azure services such as HDInsight and Data Lake Design.
Experience building and managing hosted big data architecture, with familiarity in Hadoop, Oozie, Sqoop, Pig, Hive, HBase, Avro, Parquet, Spark, and NiFi.
Knowledge of foundational data management concepts, including RDM and MDM.
Experience using JIRA, Git, Bitbucket, JUnit, and other code management toolsets.
Hands-on knowledge of at least one solutioning language: Java, Scala, or Python.
Healthcare domain knowledge.
A bachelor's degree and at least 6 to 9+ years of relevant experience, or equivalent.
Extensive experience in data architecture, big data, and ETL environments.

Responsibilities

Participate in technical planning and requirements gathering, including architectural design, coding, testing, troubleshooting, and documenting big data-oriented software applications.
Ingest, maintain, improve, clean, and manipulate data in operational and analytics databases, and troubleshoot issues.
Implement, troubleshoot, and optimize distributed solutions using modern big data technologies such as Hive, Hadoop, Spark, Elasticsearch, Storm, and Kafka, in on-premises and cloud deployment models.
Design, enhance, and implement cloud-based ETL and data ingestion platforms.
Work with data warehousing, including data cleanup, ETL, ELT, and scalability issues for enterprise-level data warehouses.
Investigate and become familiar with new datasets quickly.
Troubleshoot and solve problems in large data environments.
Build data platforms on AWS or Azure.
Use Python, Java, or another language to solve data problems.
Implement SDLC best practices and Agile methods.

Job Description

Responsibilities and Duties

Participate in technical planning & requirements gathering phases including architectural design, coding, testing, troubleshooting, and documenting big data-oriented software applications.
Responsible for the ingestion, maintenance, improvement, cleaning, and manipulation of data in the business’s operational and analytics databases, and troubleshoots any existent issues.
Implementation, troubleshooting, and optimization distributed solutions based on modern big data technologies like Hive, Hadoop, Spark, Elastic Search, Storm, Kafka, etc. in both an on premise and cloud deployment model to solve large scale processing problems
Design, enhance and implement ETL/data ingestion platform on the cloud.
Strong Data Warehousing skills, including: Data clean-up, ETL, ELT and handling scalability issues for enterprise level data warehouse
Capable of investigating, familiarizing and mastering new data sets quickly
Strong troubleshooting and problem-solving skills in large data environment
Experience with building data platform on cloud (AWS or Azure)
Experience in using Python, Java or any other language to solving data problems
Experience in implementing SDLC best practices and Agile methods.

Qualifications

Required Skills:

Data architecture/ Big Data/ ETL environment
Experience with ETL design using tools Informatica, Talend, Oracle Data Integrator (ODI), Dell Boomi or equivalent
Big Data & Analytics solutions Hadoop, Pig, Hive, Spark, Spark SQL Storm, AWS (EMR, Redshift, S3, etc.)/Azure (HDInsight, Data Lake Design)
Building and managing hosted big data architecture, toolkit familiarity in: Hadoop with Oozy, Sqoop, Pig, Hive, HBase, Avro, Parquet, Spark, NiFi
Foundational data management concepts - RDM and MDM
Experience in working with JIRA/Git/Bitbucket/JUNIT and other code management toolsets
Strong hands-on knowledge of/using solutioning languages like: Java, Scala, Python - any one is fine
Healthcare Domain knowledge

Required Experience, Skills and Qualifications

Qualifications:

Bachelor’s Degree with a minimum of 6 to 9 + year’s relevant experience or equivalent.
Extensive experience in data architecture/Big Data/ ETL environment.

Additional Information

All your information will be kept confidential according to EEO guidelines.

About the Company

Nitor Infotech

GenAI-first software product engineering services

Nitor Infotech is a GenAI-first software product engineering company that provides product engineering services to ISVs, enterprises, and tech firms. It co-crafts customized software and helps turn ideas into MVP, offering prompt engineering and platform engineering, and it works with Microsoft, AWS Select, OutSystems, Snowflake, FintechOS, Precisely, and Finboot. Its approach combines a data-first philosophy with modernization and a global team of about 900 experts in Pune and Chicago to deliver end-to-end product development. Its goal is to help clients modernize and speed up software development while maintaining a people-powered, ethical, and health-conscious culture with strong core values.

Company size: 501-1,000
Company stage: Not listed
Total funding: Not listed
Headquarters: Pune, India
Founded: 2006

Recently Posted Jobs

Explore more opportunities at Nitor Infotech

See more jobs