Joom

Global cross-border marketplace and B2B platform

Senior Data Acquisition Engineer

Data EngineeringConfirmed live in the last 24 hours

Full-timeLisbon, Portugal

About the Job

Requirements

At least 3 years of experience building distributed crawlers running in production.
Strong Python skills with Scrapy or Playwright, or Node.js skills with Puppeteer or Crawlee.
Ability to simulate human behavior, including mouse trajectories, realistic timing, scrolling, and clicking patterns, to bypass behavioral biometrics.
A security research mindset, including monitoring target sites for changes, detecting changes, and proactively updating bypass logic.
Experience with residential, mobile, ISP, and rotating proxy infrastructure.
Experience reverse engineering private APIs using mitmproxy, Charles, or Burp.
Experience scaling crawlers on distributed queues such as Redis, Kafka, or SQS.
Active use of large language models and an experimental approach to solving problems.
Ability to proactively identify useful data and bring it to the team without detailed specifications.
English proficiency sufficient for daily work in an international team.

Responsibilities

Own and develop scraping of Mercado Livre, the main data source for JoomPulse, and extend scraping to new marketplaces such as Shopee.
Build and maintain distributed crawlers running in production.
Monitor target marketplaces for changes, detect them early, and proactively update bypass logic.
Reverse engineer private APIs to acquire data faster and more reliably than through HTML.
Keep crawlers scalable and observable through distributed queues, success-rate monitoring, and alerts on anti-bot regressions.
Investigate pipeline failures caused by new anti-bot checks and restore data flow.
Use large language models and other tools to research and solve problems without ready-made answers.
Identify data useful to the product and share insights with the team.

Desired Qualifications

Direct experience with Mercado Livre, Amazon, Shopee, or TikTok Shop.
A public GitHub profile containing marketplace crawlers or contributions to Scrapy, Playwright, curl-impersonate, or undetected-chromedriver.
Experience with anti-detect browsers and stealth tools such as Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, or tls-client.
Experience running a project end-to-end or managing other engineers.

Senior Data Acquisition Engineer at JoomPulse

Joom · Lisbon, Portugal (Hybrid) · — · Posted 2026-11-06

Workplace: hybrid

Department: Software Development

Description

JoomPulse is an AI analytics tool for Mercado Livre and Shopee sellers, providing insights into the most profitable products and fastest-growing categories — helping sellers boost their profits with data-driven decisions.

JoomPulse is one of the key businesses of Joom Group, an international tech-centric group of e-commerce companies that was founded in 2016 in Latvia. Joom Group also includes the following businesses: Joom, a global cross-border marketplace; JoomPro, the first and only end-to-end cross-border B2B marketplace; and Onfy, a pharmaceutical marketplace in Germany. Joom Group has offices in Latvia, China, Germany, and Brazil, with its headquarters in Lisbon, Portugal. We work as one international team, sharing knowledge and collaborating across countries, businesses and products.

We are looking for an experienced Senior Data Acquisition Engineer who will own the data acquisition pipelines behind JoomPulse analytics. Marketplaces keep raising their anti-bot defences, so this is a role about solving problems that have no ready answers yet — hands-on, experimental, and with full freedom in tooling.

Responsibilities

Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee
Build and maintain distributed crawlers running in production
Monitor target marketplaces for changes, detect them early and update bypass logic proactively
Reverse engineer private APIs to get data faster and more reliably than through HTML
Keep crawlers scalable and observable: distributed queues, success-rate monitoring, alerting on anti-bot regressions
Investigate pipeline failures caused by new anti-bot checks and restore the data flow
Use LLMs and any other tooling to research and solve problems that have no ready answers
Spot data that can be useful for the product and bring these insights to the team

Requirements

3+ years of building distributed crawlers running in production
Strong Python (Scrapy / Playwright) or Node.js (Puppeteer / Crawlee)
Behavioral simulation: human-like mouse trajectories, realistic timing, scroll and click patterns, bypassing behavioral biometrics
Security research mindset: monitoring target sites for changes, change detection, proactive updates of bypass logic
Experience with proxy infrastructure: residential, mobile, ISP, and rotating proxies
Reverse engineering of private APIs via mitmproxy, Charles, or Burp
Scaling crawlers on distributed queues: Redis, Kafka or SQS
Active use of LLMs and an experimental mindset — you try every available tool until the result is there
Proactivity: you notice useful data and bring it yourself, without a detailed specification
English sufficient for daily work in an international team

Preferred

Direct experience with Mercado Livre, Amazon, Shopee or TikTok Shop
Public GitHub: marketplace crawlers, or contributions to Scrapy, Playwright, curl-impersonate, undetected-chromedriver
Experience with anti-detect browsers and stealth tooling: Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, tls-client
Experience running a project end-to-end or managing other engineers

Benefits

Compensation package: base salary and performance-based bonuses
Office-first: flexible hours with the possibility to work remotely 52 days per year, and 22 days of paid annual leave
Care & Wellbeing: health insurance (including dental care) for employees and their children, daily meal allowance, and 100% paid sick leave
AI-first approach: licenses and access to a wide range of AI tools
Team & Growth: collaboration with colleagues across Portugal, Brazil, Latvia and China, with opportunities for promotions, professional training, and English courses
Community & Engagement: annual team-building activities, knowledge-sharing workshops, and a strong sense of teamwork

Before applying for the above position, please review our Candidate Privacy Notice here: https://legal.joom.com/recruitment/Joom_Unipessoal_LDA_Job_Applicant_Privacy_Notice.pdf
By responding to the vacancy, you acknowledge that you have read our Privacy Notice.

Apply

Apply at Joom

About the Company

Joom

Global cross-border marketplace and B2B platform

Joom is an international group of e-commerce companies focused on making global trade easier and more transparent through technology. Its offerings include Joom, a cross-border retail marketplace; JoomPro, an end-to-end cross-border B2B marketplace that handles orders of any size; JoomPulse, an AI analytics tool that helps sellers identify profitable products and fast-growing categories; and Onfy, a pharmaceutical marketplace in Germany. Joom connects buyers and sellers across borders through marketplaces, JoomPro handles the full B2B order process, JoomPulse analyzes data to guide seller decisions, and Onfy specializes in selling pharmaceutical products online in Germany. The goal is to make cross-border commerce more transparent, efficient, and accessible for buyers and sellers worldwide by leveraging technology across multiple commerce models and markets.

Company size: 201-500
Company stage: Not listed
Total funding: Not listed
Headquarters: Moscow, Russia
Founded: 2016

Recently Posted Jobs

Explore more opportunities at Joom

See more jobs