L
Luxoft Poland
Data ScienceSenior
Senior Big Data Engineer (Spark/Scala/Java)
Apache SparkAzure DatabricksJavaScalaCi/CdGitLabKubernetes
About the Position
The ACQA platform, built on Microsoft Azure, aims to deliver scalable infrastructure and improved regulatory compliance. The role involves enabling teams to build Big Data solutions and managing the ACQA Databricks platform.
Responsibilities
- Work with multiple federated teams to enable them to build Big Data solutions
- Manage the ACQA Databricks platform – provide monitoring and other tooling
- Provide best practices for runtime upgrades
Requirements
- Development of big data technologies like Apache Spark and Azure Databricks
- Programming complex production systems in Java and Scala
- Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
- Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
- Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes
Benefits
- Copyrights which means higher net salary for Developers
- Stable employment based on an employment contract
- LuxMed health & dental care
- Life insurance
- Travel insurance
- MyBenefit program (sports card, well-being program etc.)
- Employee assistance program for you and your family! (consultations with a psychologist, coaching sessions, assistance in private life)
- Car rental
- LuxTalent platform (webinars, training, courses with certificates)
- Internal Mobility program - possibility of rotation between projects, locations, accounts
Senior Big Data Engineer (Spark/Scala/Java)