N
Nix
Data ScienceSenior
Senior Data Engineer
PythonScalaSqlDatabricksSnowflakeBigquerySynapseSparkPysparkDbtData MeshLakehouseTerraformCi/CdDockerKubernetesFeature StoresVector DatabasesAWSGCPAzure
Про позицію
Join Nix as a Senior Data Engineer and lead data strategy for global clients, designing complex Lakehouse architectures and acting as a reliable technical advisor. Your mission will involve creating scalable, secure, and cost-effective data platforms to address critical business challenges.
Обовʼязки
- Lead the design and implementation of scalable pipelines and Lakehouse architectures.
- Act as a key technical expert (Design Authority) on projects.
- Address complex technical challenges such as optimizing high-load streaming pipelines and debugging intricate Spark jobs.
- Participate in technical assessments, audits of existing systems, and proposal preparations.
- Ensure all solutions are production-ready: secure, monitored, cost-effective (FinOps), and documented.
- Establish coding standards, conduct code reviews, and mentor Middle/Junior engineers to develop the Data Engineering direction.
Вимоги
- Expert level in Python or Scala (Design Patterns), SQL (Expert Level).
- Experience with Databricks (Unity Catalog), Snowflake, BigQuery, Synapse.
- Deep understanding of Spark/PySpark (internal mechanisms, tuning, streaming), dbt (Enterprise patterns).
- Knowledge of Data Mesh, Lakehouse (Delta Lake/Iceberg), Lambda/Kappa.
- Advanced Terraform/IaC, CI/CD, Docker/Kubernetes skills.
- Experience with Feature Stores, Vector Databases, basics of MLOps.
- Ability to design end-to-end solutions and defend choices to client management.
- Expert knowledge of AWS, GCP, or Azure with a deep understanding of networking (VPC, PrivateLink), security (IAM), and integration limits.
Senior Data Engineer