Invisible Technologies AI

AI-assisted business process outsourcing platform

Automation Engineer

Backend EngineeringConfirmed live in the last 24 hours

Full-timeSan Francisco, CA, USANo salary listedRemote

About the Job

Requirements

Strong hands-on experience in Python programming.
Experience with web-scraping libraries including Requests, BeautifulSoup, Selenium, and Scrapy.
At least 3 years of experience working with web development frameworks such as Flask, Django, FastAPI, Tornado, or Pandas.
Knowledge of building application programming interfaces and services using REST.
Experience with a relational database management system and strong SQL knowledge.
Understanding of object-oriented programming concepts.
Strong troubleshooting skills.
Proficiency with Git and code versioning tools.
Basic understanding of front-end technologies including JavaScript, HTML5, and CSS3.
Understanding of fundamental design principles for scalable applications.

Responsibilities

Create crawlers for each source URL using Python modules including Scrapy, Selenium, Requests, BeautifulSoup, and Splash.
Create and maintain Scrapy pipelines and middlewares to manage crawler output.
Create crawlers for different types of websites despite technical roadblocks.
Manage crawlers to overcome IP bans, geolocation bans, CAPTCHA challenges, and bot-blocking services.
Write SQL queries to manage database operations using Python modules such as SQLAlchemy.
Deploy Python scripts and crawlers to Linux-based Amazon Web Services servers.

Desired Qualifications

Familiarity with user-interface frameworks such as Angular or ReactJS.
Strong unit-testing and debugging skills.
Strong knowledge of data-engineering platforms such as Airflow.
Experience with Google Cloud and Docker.
Experience with Agile and Scrum.
Experience with Jira and Confluence.
Experience with ETL and Celery.

Job Description

Job Responsibilities:

Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup and splash]

Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers.

Create crawlers for all types of websites irrespective of the technical roadblocks.

Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha and bot blocking services.

Write SQL queries to manage database operations using Python modules like sqlalchemyDeploy the python scripts / crawlers to Linux based AWS servers

SkillsMust Haves:

Strong hands-on experience in Python programming

Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy.

Proven 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/PandasKnowledge of building APIs and services using REST.

Experience with any RDBMS and strong SQL knowledge.

Clear with Object-oriented concepts.

Excellent troubleshooting skills.

Proficient understanding of code versioning tools like git.

Basic understanding of front-end technologies, such as JavaScript, HTML5 and CSS3Understanding of fundamental design principles behind a scalable application.

Nice to have:

Familiar with UI frameworks like Angular/ReactJS

Strong unit test and debugging skills.

Strong knowledge of data engineering platforms such as Airflow.

Experience with the Google CloudDockerAgile and Scrum. Even better if have worked in Jira and confluence.

Experience with ETLCeleryExcellent interpersonal skills and ability to to work with a diverse team

Qualifications

Required: Technical Skills

Python
JavaScript
PostgresSQL
Web Scraping using Requests, BeautifulSoup, Selenium and Scrapy
Frameworks such as Flask/Django/FastAPI/Tornado/Pandas
Building APIs and services using REST

Additional Information

https://jobs.lever.co/invisible/e3f21175-7605-4b30-8790-5ddbd97ab3b5

About the Company

Invisible Technologies AI

AI-assisted business process outsourcing platform

Invisible Technologies automates repetitive digital work by combining artificial intelligence with a global team of human agents. It offers a subscription-based BPO platform where clients get a dedicated assistant who oversees and delegates tasks, using AI to speed up work and human agents to ensure accuracy. The product works through a high-touch service model: clients subscribe, access a portal to track task progress, usage, and billing, and rely on a dedicated assistant to manage workflows. The company differentiates itself with its transparent, subscription-based approach, long-term partnerships, and the pairing of AI with a global workforce to replace traditional outsourcing and provide more predictable pricing and results. Its goal is to streamline client operations, improve efficiency, and reduce costs by delivering digital work faster, better, and cheaper through ongoing, managed automation.

Company size: 1,001-5,000
Company stage: Growth Equity (Venture Capital)
Total funding: $107.9M
Headquarters: New York City, New York
Founded: 2015

Recently Posted Jobs

Explore more opportunities at Invisible Technologies AI

See more jobs