Skip to main content
Nix
Scraped fromWorkToday
Data ScienceSenior

Senior Data Engineer

PythonScalaSqlDatabricksSnowflakeBigquerySynapseSparkPysparkDbtData MeshLakehouseTerraformCi/CdDockerKubernetesFeature StoresVector DatabasesAWSGCPAzure
Work Type
Remote
Job Type
Full Time
Location
Worldwide
Salary
Not specified

About the Position

Join Nix as a Senior Data Engineer and lead data strategy for global clients, designing complex Lakehouse architectures and acting as a reliable technical advisor. Your mission will involve creating scalable, secure, and cost-effective data platforms to address critical business challenges.

Responsibilities

  • Lead the design and implementation of scalable pipelines and Lakehouse architectures.
  • Act as a key technical expert (Design Authority) on projects.
  • Address complex technical challenges such as optimizing high-load streaming pipelines and debugging intricate Spark jobs.
  • Participate in technical assessments, audits of existing systems, and proposal preparations.
  • Ensure all solutions are production-ready: secure, monitored, cost-effective (FinOps), and documented.
  • Establish coding standards, conduct code reviews, and mentor Middle/Junior engineers to develop the Data Engineering direction.

Requirements

  • Expert level in Python or Scala (Design Patterns), SQL (Expert Level).
  • Experience with Databricks (Unity Catalog), Snowflake, BigQuery, Synapse.
  • Deep understanding of Spark/PySpark (internal mechanisms, tuning, streaming), dbt (Enterprise patterns).
  • Knowledge of Data Mesh, Lakehouse (Delta Lake/Iceberg), Lambda/Kappa.
  • Advanced Terraform/IaC, CI/CD, Docker/Kubernetes skills.
  • Experience with Feature Stores, Vector Databases, basics of MLOps.
  • Ability to design end-to-end solutions and defend choices to client management.
  • Expert knowledge of AWS, GCP, or Azure with a deep understanding of networking (VPC, PrivateLink), security (IAM), and integration limits.
Senior Data Engineer