Data Integration System Engineer

Job Description

Dev-ops / data integration systems administration at the City offers a unique opportunity for impactful, dynamic work and professional growth, leveraging cutting-edge technologies. This is a position on a diverse team of engineers, analysts, and GIS specialists, contributing to developing, maintaining, and optimizing our data pipelines and integration strategies, assisting departments and agencies to innovate and enhance the City’s service to its residents.

This role will work closely with a senior Systems Engineer to support and enhance existing infrastructure. The dev-ops / data integration systems engineer will help deploy and streamline the team’s various server stacks and automations that host the City’s data engineering infrastructure, pipelines, models, and integrations. The team (CityGeo) uses a blend of open source, custom developed and off-the-shelf tools, including Kubernetes, Docker, OpenTofu (Terraform), Python, Bash, DBT, GIS, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, GitHub actions, MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.

Some prominent services the team is responsible for include DataBridge, OIT’s enterprise data warehouse, AIS, the City’s custom address information systems which supports public address search and internal geocoding, and Airflow, a custom workflow generator and orchestrator for departmental integrations (https://metadata.phila.gov/) and open data publishing (https://opendataphilly.org/). Some examples of OIT’s commitment to serving the public through the effective and innovative integration of City open data include:

https://Atlas.phila.gov

https://property.phila.gov

https://Openmaps.phila.gov

https://streetsmartphl.phila.gov/

www.phila.gov/solarmap

www.phila.gov/stressmap

We are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work and data-driven decision-making, we encourage you to apply.

Essential Functions

• Design and implement new deployment and automation strategies for maintaining and updating various server stacks in the cloud (AWS(primary)/Azure) on Linux and Windows servers, using Infrastructure as Code (IaC) and other best practices
• Configuring various system health monitors using Grafana, AlertManager, and Prometheus, AWS CloudWatch, SNS
• Work closely with data engineers to support integration and open data initiatives, developing and maintaining critical systems like the City’s DataBridge, Airflow, MuleSoft and AIS.
• Design, develop, expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools.
• Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.

Qualifications

• Previous work experience in a dev-ops or related role that included managing systems/software stacks in a production environment with proper testing/deployment practices.
• Bachelor’s/advanced degree in Computer Science, Information Systems, a related field or equivalent work experience.
• Dedication to making Philadelphia municipal government more robust, efficient, and equitable.
• Previous work in a public sector or large organization setting is a plus.

Competencies:

• Clear and concise writing and communication skills – documentation driven.
• Creative problem-solving and critical thinking.
• Efficient time management and the ability to manage multiple workflows simultaneously.

Knowledge and Skills:

• Proficient in Systems Administration (Linux preferred, but we work with Windows too).
• Proficient with CLI (Linux and PowerShell), Bash and Python.
• Proficient with Kubernetes and Docker
• Automation Mindset: Leverages automation for maintainability/security with CI/CD pipelines.
• Familiar or ability to learn tools like GitHub Actions, Terraform, Jenkins, Airflow.
• Understanding of Git/GitHub for version control and CI/CD pipelines.
• Experience or ability to learn databases administration (Postgres preferred) and SQL (proficiency a plus).
• Experience working with cloud technologies, containers, and orchestration tools (AWS: Batch, ECS, EKS, CloudWatch).
• Experience working with spatial datasets a plus.

Abilities:

• Troubleshoot system health and understand the basics of deploying maintainable systems.
• Maintain clean and secure data environments.
• Work effectively in a hybrid (on-premises and cloud) environment.
• To communicate complex technical concepts in understandable terms.

Additional Information

Salary cannot exceed $87,550

We’re interested in hiring the best possible candidate for the role. We recognize that experience, education, and qualifications can be attained in a variety of ways and that many skillsets are transferable. If you feel you’re a good fit, please don’t hesitate to apply.

Please include:

• Resume
• A cover letter 

Please note: Applications will not be considered without a cover letter.

Did you know?
● We are a Public Service Loan Forgiveness Program qualified employer : 25% tuition discount program for City employees (and sometimes spouses and dependents as well) in partnership with area colleges and universities

● We offer Comprehensive health coverage for employees and their eligible dependents
● Our wellness program offers eligibility into the discounted medical plan
● Employees receive paid vacation, sick leave, and holidays
● Generous retirement savings options are available

*The successful candidate must be a city of Philadelphia resident within six months of hire
Effective May 22, 2023, vaccinations are no longer required for new employees that work in non-medical, non-emergency or patient facing positions with the City of Philadelphia. As a result, only employees in positions providing services that are patient-facing medical care (ex: Nurses, doctors, emergency medical personnel), must be fully vaccinated.

The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at 215-686-4670 or send an email to faqpchr @phila.gov. For more information, go to: Human Relations Website:
http://www.phila.gov/humanrelations/Pages/default.aspx

Compensation: N/A to 87550 (USD) (YEARLY)