Skip to main content
Hanna Robulets Company
Scraped fromDjinniToday
Data ScienceSenior

Senior Data Engineer (US-Based Product ,Real-Time Data Platform)

SqlPythonAws Kinesis FirehoseAmazon S3GitDbtGoogle BigqueryDockerAWS ECSSalesforce
Work Type
Remote
Job Type
Full Time
Location
Worldwide
Salary
Not specified

About the Position

We are building a US-based, data-driven product focused on scalability and real-time data processing. The Senior Data Engineer will own the data platform architecture and drive technical excellence across ingestion, modeling, and performance optimization using SQL, Python, AWS infrastructure, and modern data stack principles.

Responsibilities

  • Design and maintain a scalable real-time and batch data platform
  • Architect ingestion pipelines using AWS Kinesis and Python
  • Ensure high availability and reliability of data flows
  • Enable near-real-time data processing for operational alerting and anomaly detection
  • Transform raw event data into business-ready datasets using dbt
  • Design scalable, maintainable schemas aligned with product evolution
  • Optimize SQL queries and storage structures
  • Design cost-efficient partitioning strategies
  • Monitor and reduce warehouse and infrastructure costs
  • Balance real-time and batch processing appropriately
  • Lead and participate in code reviews
  • Enforce high standards of performance, security, and maintainability
  • Improve observability and monitoring across pipelines
  • Work closely with Data Analysts and Product Managers
  • Translate business requirements into scalable technical solutions
  • Communicate trade-offs between speed, cost, and complexity

Requirements

  • Expert-Level SQL: Complex analytical queries, window functions, query optimization, execution plan analysis, partitioning, clustering strategies
  • Python: Advanced data manipulation, scalable ETL/ELT frameworks, production-grade data services, automation and monitoring scripts
  • AWS Core Infrastructure: AWS Kinesis Firehose, Amazon S3 (data lake architecture), designing reliable ingestion layers
  • Version Control: Git (GitHub/GitLab), branching strategies, leading technical code reviews
  • Experience: 5+ years
  • English: B2 or higher
  • Nice-to-have: dbt, Google BigQuery, Docker/ECS, CI/CD, Salesforce data integration, AI/ML exposure
Senior Data Engineer (US-Based Product ,Real-Time Data Platform)
View Original