Skip to main content

ETL / Data Pipeline Specialist

PostgreSQLMongoDBSnowflakeAWS
4 days ago
data_science
T

TechBiz Global

Work Typeremote
Job Typefull time

About the Position

At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an ETL / Data Pipeline Specialist to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.

Responsibilities9

  • Monitor and manage overnight scraper and ingestion runs, triaging failures and applying fixes in real time to minimize data gaps before US market open
  • Verify data completeness and quality across all automated feeds, flagging anomalies and coordinating with the Houston team on persistent issues
  • Maintain run logs, error documentation, and escalation notes for seamless async handoffs
  • Build and maintain scrapers, parsers, and ingestion pipelines across a growing set of energy market data domains
  • Contribute to the design and build-out of our broader ETL infrastructure, including scheduling, orchestration, and error handling
  • Write transformation logic to clean, normalize, and load raw data into PostgreSQL staging and production tables
  • Optimize existing pipelines for performance, reliability, and cost efficiency
  • Help build monitoring dashboards and alerting for pipeline health and data freshness
  • Document data lineage, schema changes, and pipeline dependencies

Requirements7

  • 3+ years of experience building and maintaining ETL pipelines or data engineering systems
  • Strong Python skills with experience in web scraping, data parsing, and automation
  • Proficiency in SQL and experience working with relational databases (PostgreSQL preferred)
  • Experience with headless browsers, anti-bot mitigation, and scraping resilience patterns
  • Comfortable working independently during overnight hours with minimal real-time supervision
  • Strong debugging instincts and ability to triage pipeline failures quickly
  • Clear written communication in English for async collaboration and documentation

Benefits5

  • Competitive compensation and benefits with room to grow as the team scales
  • Direct impact on the data infrastructure behind a leading natural gas intelligence platform
  • A small, senior team where your work is visible and valued from day one
  • Flexible remote work with clear async workflows
  • Exposure to the North American energy markets and commodity data at scale
ETL / Data Pipeline Specialist
View Original