Senior Backend / Automation Engineer
PythonFastAPIPlaywrightPuppeteer
Yesterday
backendsenior
Q
QAIL AI
About the Position
Senior Backend / Automation Engineer — Data Intelligence Platform. We're building a social media intelligence platform that collects and analyzes public content across audience segments in real time. We need an engineer who can own the infrastructure, data collection pipeline, and backend.
Responsibilities3
- Build and maintain the data collection infrastructure: provisioning servers, managing browser-based scrapers, and automating data pipelines at scale.
- Design the backend API, data storage layer, and integrate with the Next.js dashboard.
- Monitor system health and scale from prototype to production.
Requirements8
- 5+ years of experience
- Python (FastAPI or similar async framework)
- Browser automation at scale (Playwright, Puppeteer, or Selenium)
- Residential proxy management — rotation strategies, sticky sessions, IP health monitoring
- Web scraping at production scale — handling rate limits, retries, and data quality
- CAPTCHA solving service integration (2Captcha, CapMonster, or similar)
- Docker / Docker Compose on bare metal or cloud (Hetzner, AWS, etc.)
- PostgreSQL and Redis
Benefits2
- Competitive compensation based on experience
- Contract starting immediately with path to ongoing engagement
Senior Backend / Automation Engineer
View Original