U

University of Arkansas

Public research university in Arkansas

Data Engineer 4

Data EngineeringConfirmed live in the last 24 hours
Full-timeLittle Rock, AR, USA$95k

About the Job

Requirements

  • A master's degree in Computer Science, Information Science, or a related discipline is required.
  • At least 4 years of experience as a data engineer, software developer, software engineer, database administrator, or in a similar role is required.
  • At least 2 years of experience leading a team of data engineers is required.
  • Expert proficiency in data models, data pipelines, extract, transform, and load (ETL) processes, data stores, data mining, and segmentation techniques.
  • Expert proficiency in programming and scripting languages, including Java and Python.
  • Expert proficiency in data integration platforms and SQL database design.
  • Expert proficiency in numerical, analytical, and data security skills.
  • Expert proficiency in collecting raw data from social media platforms.
  • Expert proficiency in creating continuous integration and continuous deployment (CI/CD) pipelines.
  • Expert proficiency in front-end development, including HTML/CSS, JavaScript, and Node.js.
  • Expert proficiency in training and deploying machine learning models on datasets.
  • Ability to lead a large team of 5 or more data engineers.
  • Expert proficiency with Kafka and MongoDB for NoSQL storage across Kubernetes clusters.
  • Expert proficiency with microservices, Python, Golang, FlaskAPI, GraphQL, and Docker.
  • Expert proficiency with Elasticsearch, Grafana, Prometheus, and Kibana.
  • Expert proficiency in data modeling concepts, including entity relationship diagrams, dimensional modeling, and Data Vault, and data APIs such as RESTful APIs.
  • Expert proficiency in data processing software, including Hadoop, Spark, TensorFlow, Pig, and Hive, and algorithms such as MapReduce and Flume.
  • Expert proficiency in cloud platforms, including AWS, Azure, and GCP, and data warehousing solutions, including Snowflake, Amazon Redshift, Google BigQuery, and Azure Synapse.
  • Expert proficiency in technical communications.

Responsibilities

  • Lead a team of data engineers.
  • Collect and analyze raw data from various sources, including social media platforms.
  • Organize and maintain datasets.
  • Improve data quality and process efficiency.
  • Design and manage ETL pipelines moving data from source to destination systems, processing more than 10 million data points daily, using Kafka for real-time data streaming and MongoDB for NoSQL storage across Kubernetes clusters.
  • Design and deploy scalable microservices in Python and Golang, using FlaskAPI, GraphQL, and Docker to ensure sub-second response times and efficient concurrency with goroutines.
  • Migrate large amounts of data from legacy databases to MongoDB to achieve sub-second access latencies and optimize storage for unstructured data through Elasticsearch integration.
  • Set up and manage infrastructure for data ingestion, processing, and storage.
  • Evaluate model needs and objectives, and interpret data trends and patterns.
  • Conduct complex data analysis and report results.
  • Prepare data for analysis and reporting by transforming and cleansing it.
  • Combine raw information from different sources.
  • Explore ways to enhance data quality and reliability.
  • Identify opportunities for data acquisition.
  • Develop analytical tools and programs.
  • Collaborate with teams at COSMOS on several projects.
  • Manage services and operational infrastructure for system reliability and resiliency.
  • Create CI/CD pipelines with Jenkins and GitLab CI to automate service and system deployment.
  • Integrate Prometheus for monitoring, Grafana for real-time dashboarding and visualization, and Kibana for log analysis sourced from Elasticsearch.
  • Perform front-end development using HTML/CSS, JavaScript, and Node.js.
  • Train machine learning models on datasets.
  • Deploy machine learning models.
  • Enhance system fault tolerance by incorporating alert mechanisms.
  • Develop frameworks such as Spring Boot and React.
  • Work on other tasks as assigned.
  • Collaborate with researchers, participate in research projects, and interact with developers at the COSMOS Research Center and partner organizations to achieve performance metrics across projects.

Desired Qualifications

  • A Ph.D. degree in Computer Science, Information Science, or a related discipline is a plus.

About the Company

University of Arkansas

Public research university in Arkansas

University of Arkansas is a public land-grant research university in Fayetteville, Arkansas. It provides undergraduate and graduate education, conducts research, and supports public-service and extension activity. Academic colleges, laboratories, student services, facilities, and administrative units make up the campus operating environment. Faculty, research, student-support, technical, trades, and professional roles support the institution. The profile is campus-specific while recognizing that the University of Arkansas System uses a shared official careers platform.

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Salt Lake City, UT
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at University of Arkansas

See more jobs