U

University of Arkansas

Public research university in Arkansas

Data Engineer 3

Data EngineeringConfirmed live in the last 24 hours
Full-timeLittle Rock, AR, USA$85k /yr

About the Job

Requirements

  • A master's degree in Computer Science, Information Science, or a related discipline is required.
  • At least 2 years of experience as a data engineer, software developer, software engineer, database administrator, or in a similar role is required.
  • At least 1 year of experience leading a team of data engineers is required.
  • Advanced proficiency in data models, data pipelines, extract, transform, and load (ETL) processes, data stores, data mining, and segmentation techniques is required.
  • Advanced proficiency in programming and scripting languages, such as Java and Python, is required.
  • Advanced proficiency in data integration platforms and SQL database design is required.
  • Advanced proficiency in numerical, analytical, and data security skills is required.
  • Advanced proficiency in collecting raw data from social media platforms is required.
  • Advanced proficiency in creating continuous integration and continuous deployment (CI/CD) pipelines is required.
  • Advanced proficiency in front-end development, including HTML, CSS, JavaScript, and Node.js, is required.
  • Advanced proficiency in training and deploying machine learning models on datasets is required.
  • Ability to lead a team of data engineers is required.
  • Advanced proficiency with Kafka, MongoDB, and Kubernetes clusters is required.
  • Advanced proficiency with microservices, Python, Golang, FlaskAPI, GraphQL, and Docker is required.
  • Advanced proficiency with Elasticsearch, Grafana, Prometheus, and Kibana is required.

Responsibilities

  • Lead a team of data engineers.
  • Collect and analyze raw data from various sources, including social media platforms.
  • Organize and maintain datasets.
  • Improve data quality and process efficiency.
  • Design and manage ETL pipelines that move data from source to destination systems, processing more than 10 million data points daily, using Kafka for real-time streaming and MongoDB for NoSQL storage across Kubernetes clusters.
  • Design and deploy scalable microservices in Python and Golang using FlaskAPI, GraphQL, and Docker, ensuring sub-second response times and concurrency with goroutines.
  • Migrate large volumes of data from legacy databases to MongoDB to achieve sub-second access latencies and optimize storage for unstructured data through Elasticsearch integration.
  • Set up and manage infrastructure for data ingestion, processing, and storage.
  • Evaluate model needs and objectives and interpret data trends and patterns.
  • Conduct complex data analysis and report results.
  • Prepare data for analysis and reporting by transforming and cleansing it.
  • Combine raw information from different sources.
  • Explore ways to enhance data quality and reliability.
  • Identify opportunities for data acquisition.
  • Develop analytical tools and programs.
  • Collaborate with COSMOS teams on projects.
  • Manage services and operational infrastructure for system reliability and resiliency.
  • Create CI/CD pipelines with Jenkins and GitLab CI to automate service and system deployment.
  • Integrate Prometheus for monitoring, Grafana for real-time dashboards and visualization, and Kibana for log analysis sourced from Elasticsearch.
  • Develop front-end applications using HTML, CSS, JavaScript, and Node.js.
  • Train and deploy machine learning models on datasets.
  • Enhance system fault tolerance by incorporating alert mechanisms.
  • Perform other tasks as assigned.

About the Company

University of Arkansas

Public research university in Arkansas

University of Arkansas is a public land-grant research university in Fayetteville, Arkansas. It provides undergraduate and graduate education, conducts research, and supports public-service and extension activity. Academic colleges, laboratories, student services, facilities, and administrative units make up the campus operating environment. Faculty, research, student-support, technical, trades, and professional roles support the institution. The profile is campus-specific while recognizing that the University of Arkansas System uses a shared official careers platform.

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Salt Lake City, UT
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at University of Arkansas

See more jobs