H
Hanna Robulets Company
Data ScienceSenior
Senior Data Engineer (US-Based Product ,Real-Time Data Platform)
SqlPythonAws Kinesis FirehoseAmazon S3GitDbtGoogle BigqueryDockerAWS ECSSalesforce
Про позицію
We are building a US-based, data-driven product focused on scalability and real-time data processing. The Senior Data Engineer will own the data platform architecture and drive technical excellence across ingestion, modeling, and performance optimization using SQL, Python, AWS infrastructure, and modern data stack principles.
Обовʼязки
- Design and maintain a scalable real-time and batch data platform
- Architect ingestion pipelines using AWS Kinesis and Python
- Ensure high availability and reliability of data flows
- Enable near-real-time data processing for operational alerting and anomaly detection
- Transform raw event data into business-ready datasets using dbt
- Design scalable, maintainable schemas aligned with product evolution
- Optimize SQL queries and storage structures
- Design cost-efficient partitioning strategies
- Monitor and reduce warehouse and infrastructure costs
- Balance real-time and batch processing appropriately
- Lead and participate in code reviews
- Enforce high standards of performance, security, and maintainability
- Improve observability and monitoring across pipelines
- Work closely with Data Analysts and Product Managers
- Translate business requirements into scalable technical solutions
- Communicate trade-offs between speed, cost, and complexity
Вимоги
- Expert-Level SQL: Complex analytical queries, window functions, query optimization, execution plan analysis, partitioning, clustering strategies
- Python: Advanced data manipulation, scalable ETL/ELT frameworks, production-grade data services, automation and monitoring scripts
- AWS Core Infrastructure: AWS Kinesis Firehose, Amazon S3 (data lake architecture), designing reliable ingestion layers
- Version Control: Git (GitHub/GitLab), branching strategies, leading technical code reviews
- Experience: 5+ years
- English: B2 or higher
- Nice-to-have: dbt, Google BigQuery, Docker/ECS, CI/CD, Salesforce data integration, AI/ML exposure
Senior Data Engineer (US-Based Product ,Real-Time Data Platform)
Оригінал