ETL / Data Pipeline Specialist
PostgreSQLMongoDBSnowflakeAWS
4 дні тому
data_science
T
TechBiz Global
Про позицію
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an ETL / Data Pipeline Specialist to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.
Обовʼязки9
- Monitor and manage overnight scraper and ingestion runs, triaging failures and applying fixes in real time to minimize data gaps before US market open
- Verify data completeness and quality across all automated feeds, flagging anomalies and coordinating with the Houston team on persistent issues
- Maintain run logs, error documentation, and escalation notes for seamless async handoffs
- Build and maintain scrapers, parsers, and ingestion pipelines across a growing set of energy market data domains
- Contribute to the design and build-out of our broader ETL infrastructure, including scheduling, orchestration, and error handling
- Write transformation logic to clean, normalize, and load raw data into PostgreSQL staging and production tables
- Optimize existing pipelines for performance, reliability, and cost efficiency
- Help build monitoring dashboards and alerting for pipeline health and data freshness
- Document data lineage, schema changes, and pipeline dependencies
Вимоги7
- 3+ years of experience building and maintaining ETL pipelines or data engineering systems
- Strong Python skills with experience in web scraping, data parsing, and automation
- Proficiency in SQL and experience working with relational databases (PostgreSQL preferred)
- Experience with headless browsers, anti-bot mitigation, and scraping resilience patterns
- Comfortable working independently during overnight hours with minimal real-time supervision
- Strong debugging instincts and ability to triage pipeline failures quickly
- Clear written communication in English for async collaboration and documentation
Переваги5
- Competitive compensation and benefits with room to grow as the team scales
- Direct impact on the data infrastructure behind a leading natural gas intelligence platform
- A small, senior team where your work is visible and valued from day one
- Flexible remote work with clear async workflows
- Exposure to the North American energy markets and commodity data at scale
ETL / Data Pipeline Specialist
Оригінал