U

University of Arkansas

Public research university in Arkansas

Data Engineer 3

Data EngineeringConfirmed live in the last 24 hours
Full-timeLittle Rock, AR, USA$85k

About the Job

Requirements

  • A master's degree in Computer Science, Information Science, or a related discipline is required.
  • At least 2 years of experience as a data engineer, software developer, software engineer, database administrator, or in a similar role is required.
  • At least 1 year of experience leading a team of data engineers is required.
  • Advanced proficiency with data models, data pipelines, extract-transform-load (ETL) processes, data stores, data mining, and segmentation techniques.
  • Advanced proficiency with programming and scripting languages such as Java and Python.
  • Advanced proficiency with data integration platforms and SQL database design.
  • Advanced proficiency with numerical, analytical, and data security skills.
  • Advanced proficiency in collecting raw data from social media platforms.
  • Advanced proficiency in creating continuous integration and continuous deployment (CI/CD) pipelines.
  • Advanced proficiency with front-end development, including HTML/CSS, JavaScript, and Node.js.
  • Advanced proficiency with training and deploying machine learning models on datasets.
  • Ability to lead a team of data engineers.
  • Advanced proficiency with Kafka and MongoDB for NoSQL storage across Kubernetes clusters.
  • Advanced proficiency with microservices, Python, Golang, FlaskAPI, GraphQL, and Docker.
  • Advanced proficiency with Elasticsearch, Grafana, Prometheus, and Kibana.
  • Proof of legal authority to work in the United States on the first day of employment is required.

Responsibilities

  • Lead a team of data engineers.
  • Collect and analyze raw data from various sources, including social media platforms.
  • Organize and maintain datasets.
  • Improve data quality and process efficiency.
  • Design and manage data ETL pipelines that move data from source to destination systems, processing more than 10 million data points daily using Kafka for real-time streaming and MongoDB for NoSQL storage across Kubernetes clusters.
  • Design and deploy scalable microservices in Python and Golang using FlaskAPI, GraphQL, and Docker, targeting sub-second response times and efficient concurrency with goroutines.
  • Migrate large amounts of data from legacy databases to MongoDB to achieve sub-second access latencies and optimize storage for unstructured data through Elasticsearch integration.
  • Set up and manage infrastructure for data ingestion, processing, and storage.
  • Evaluate model needs and objectives, and interpret data trends and patterns.
  • Conduct complex data analysis and report results.
  • Prepare data for analysis and reporting by transforming and cleansing it.
  • Combine raw information from different sources.
  • Identify ways to enhance data quality and reliability.
  • Identify opportunities for data acquisition.
  • Develop analytical tools and programs.
  • Collaborate with COSMOS teams on multiple projects.
  • Manage services and operational infrastructure for system reliability and resiliency.
  • Create CI/CD pipelines with Jenkins and GitLab CI to automate service and system deployment.
  • Integrate Prometheus for monitoring, Grafana for real-time dashboarding and visualization, and Kibana for log analysis sourced from Elasticsearch.
  • Develop front-end functionality using HTML/CSS, JavaScript, and Node.js, among other technologies.
  • Train machine learning models on datasets.
  • Deploy machine learning models.
  • Enhance system fault tolerance by incorporating alerting mechanisms.
  • Perform other tasks as assigned.

About the Company

University of Arkansas

Public research university in Arkansas

University of Arkansas is a public land-grant research university in Fayetteville, Arkansas. It provides undergraduate and graduate education, conducts research, and supports public-service and extension activity. Academic colleges, laboratories, student services, facilities, and administrative units make up the campus operating environment. Faculty, research, student-support, technical, trades, and professional roles support the institution. The profile is campus-specific while recognizing that the University of Arkansas System uses a shared official careers platform.

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Salt Lake City, UT
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at University of Arkansas

See more jobs