Lead Backend Software Engineer
Digital Assembly Line
Confirmed live in the last 24 hours
Avala AI

11-50 employees

Digital labor opportunity platform
Company Overview
Avala is on a mission to empower communities, ensuring the highest quality of service for our customers, and the highest quality of life for our team. Avala's platform works towards this alignment by enabling the continuous integration of human feedback and human input at scale.
Locations
Palo Alto, CA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Apache Spark
AWS
Data Analysis
Django
Docker
Elasticsearch
Flask
Hadoop
MySQL
NumPy
Pandas
Postgres
Redis
REST APIs
SQL
Tornado
Kubernetes
Python
CategoriesNew
Software Engineering
Requirements
  • BS in Computer Science, Physics, Computer Engineering, Electrical Engineering or proof of exceptional skills in related fields or practical software engineering experience
  • Strong knowledge of at least one programming language related to data engineering. Python is required
  • Solid back-end experience in building RESTful Python applications
  • Knowledge of various Python backend frameworks (e.g.Flask, Django, Tornado). Django is preferred
  • Experience with SQL, both relational and non-relational databases (SQL Server, MySQL, Redis)
  • Experience working with Docker and container orchestration technologies such as Kubernetes
  • You understand how to create an efficient, reliable, scalable, and maintainable software architecture
  • Hands on experience with CI/CD pipelines to deploy fast and often
  • Experienced in end-to-end development processes, including unit, integration & functional testing
  • Good understanding of logging, monitoring and alerting system
  • Exceptional communication skills, both oral and written
Responsibilities
  • Take ownership of the architecture, design, development, deployment, and operations of the backend API stack you will develop, using software engineering best practices, and other cutting-edge methodologies
  • Design and implement large-scale data processing pipelines that handle a diverse set of Avala-related data such as images, videos, text, audio, neural networks, and human annotations
  • Design and implement tools, tests, metrics, and dashboards to accelerate the development cycle of our model training
  • Work closely with frontend engineers to seamlessly integrate with backend systems
  • Influence architectural decisions with focus on security, scalability, reliability and high performance
  • Setup and maintain monitoring, metrics & reporting systems for fine-grained observability and actionable alerting
  • Collaborate with colleagues in design and code reviews
  • Develop means for deploying, scaling, and monitoring software systems
  • Characterize complex problems related to the scalability, reliability, performance, and security of the software
  • Own projects and always seeks ways to improve efficiency and operations
  • Contribute relevant, clean, concise quality documentation to Avala's knowledge base to support/increase organizational information sharing
  • Evangelize best practices in Software development and Software development lifecycle
Desired Qualifications
  • Experience with cloud computing such AWS EC2/S3/RDS is a plus
  • Experience with ElasticSearch or other scalable search systems is a plus
  • Experience with real-time data processing is a plus
  • Experience with AWS services such as EC2/S3/RDS/SQS
  • Experience with big data systems such as Spark, Hadoop/MapReduce
  • Experience with scientific computing libraries such as numpy, pandas, or scikit-learn
  • In-depth knowledge of container orchestrators and cluster management software
  • Experience with data stores and indexers like PostgreSQL, ElasticSearch, Redis