S

Source

Global data ecosystem linking intelligence providers

Web Scraping Engineer – Mid/Senior - Python

Backend EngineeringUpdated on Nov 6
Full-timeVilnius, Vilnius City Municipality, Lithuania€4.5k - €7k /moHybrid

About the Job

Requirements

  • Experience working with Python.
  • Understanding of computer science, including data structures, algorithms, computability, and complexity.
  • Version control skills using Git.
  • Knowledge of how to unblock websites for scraping.
  • Ability to use different scraping techniques and open-source tools to build scrapers.
  • Comfort using browser developer tools.
  • Knowledge of network protocols and TLS/SSL.
  • Experience working with browser automation.
  • Knowledge of asynchronous programming.

Responsibilities

  • Develop scalable scrapers.
  • Define resilient scraping strategies and unblock websites for scraping.
  • Improve observability in the system.
  • Develop backend solutions for scraping and parsing problems of various magnitudes.
  • Maintain the current system and develop new features related to scraping and parsing.

Desired Qualifications

  • Web development knowledge.
  • Knowledge of CSS selectors and XPath for parsing.
  • Experience working with Go and C++.
  • Experience working on browser source code.
  • Knowledge of any front-end framework.
  • Experience working with Pydantic, FastAPI, and SQLAlchemy.
  • Experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, and monitoring tools such as Grafana and Prometheus.
  • Experience with machine learning specific to the scraping domain.
  • Experience building scalable systems.

About the Company

Source

Global data ecosystem linking intelligence providers

The company operates as a data ecosystem that connects several independent tech firms—Oxylabs, Decodo, Webshare, ScrapingBee, Honeygain, and upcoming ventures—under shared standards, strategic support, and a commitment to responsible access to data. Each member company runs its own team and product, but they collaborate through common intelligence and scale to serve a wider market. Their approach is to provide a networked set of data tools and services that collectively enable customers to access and use data more efficiently. The goal is to empower the next generation of data-powered products and decisions by offering interoperable capabilities and scalable data access while maintaining clear accountability for data use.

Company size
501-1,000
Company stage
Not listed
Total funding
Not listed
Headquarters
Boston, MA
Founded
2012

Recently Posted Jobs

Explore more opportunities at Source

See more jobs