Data Engineer - Azure Databricks & Application Development H/F/X

Description de l'entreprise

DigiTribe is an IT & business consulting company specialized in Cyber Security, Cloud, Architecture and Digital Enablement. We co-develop our services & approaches with the community to bring innovation, leverage digital practices and infuse purpose to large corporate organizations in digital transformation. We pride ourselves on our capacity to support our clients not only by allocating resources to reinforce organizations but by co-creating with the community and bringing value through workshops and content creation. That is our vision of a more valuable consultancy world. We believe that the « super-connected community » is the future. A community about encouraging « many-to-many » organic relationships to crack the opportunities and solve the business problems that conventional skillsets and approaches can't.

Description de la fonction

Data Engineer - Azure Databricks & Application Development
 
Position Overview
 
DigiTribe is looking for a Data Engineer with deep expertise in Azure and Databricks to design, develop, and maintain scalable data engineering solutions. You will build production-grade ETL/ELT pipelines, develop data processing applications, and contribute to a modern lakehouse architecture. Working cross-functionally with Architecture, Data, AI, Cloud, and CI/CD teams, you will translate business and analytical requirements into robust, reusable, and cost-efficient data solutions.
 
Key Responsibilities

• Design, develop, test, and maintain scalable data engineering solutions on Microsoft Azure and Databricks, using Python, PySpark, Scala, and SQL.
• Implement reliable batch and streaming data workflows using Azure Databricks, Delta Lake, and modern data lakehouse patterns.
• Develop data processing applications for ingestion, transformation, enrichment, validation, and serving of analytical datasets.
• Build CI/CD pipelines for data applications using Azure DevOps YAML pipelines and apply software engineering best practices: modular design, clean code, version control, code reviews, and documentation.
• Develop reusable libraries, utilities, and frameworks to accelerate data product delivery and support less experienced engineers through coaching and knowledge sharing.
• Collaborate with Cloud, DevOps, and Platform teams on deployment, environment configuration, and operational readiness.

 
Skills & Qualifications
 
Technical Skills

• 5+ years of hands-on experience in data engineering, application development, or cloud-based data platform development.
• Strong hands-on development experience with Python, PySpark, Scala, SQL, and ETL/ELT development.
• Solid experience with the Azure Databricks ecosystem: notebooks, jobs, Spark clusters, Delta Lake, lakehouse architecture, and performance tuning.
• Good knowledge of Azure data services: Azure Data Lake Storage, Azure Data Factory, Azure Key Vault, Azure DevOps, and Azure monitoring/logging capabilities.
• Experience with CI/CD pipelines (Azure DevOps YAML), version control, automated testing, modular development, and code reviews.
• Understanding of cloud security, access management, observability, and cost-aware development practices.
• Working knowledge of Terraform or infrastructure-as-code concepts is a plus.

 
Preferred Qualifications

• Experience with large-scale distributed data processing using Spark and streaming/real-time ingestion patterns.
• Experience building reusable data engineering frameworks, libraries, or shared components.
• Knowledge of data quality frameworks, metadata management, lineage, and governance practices.
• Experience integrating data pipelines with AI, machine learning, or analytics use cases; familiarity with MLOps is an advantage.
• Preferred certifications: Microsoft Azure Data Engineer Associate, Azure Developer Associate, Azure Solutions Architect Expert, Databricks Certified Data Engineer Associate/Professional, or Databricks Certified Developer for Apache Spark.

 
Soft Skills

• Strong communication and documentation skills, with the ability to explain technical data engineering concepts to diverse audiences.
• Strong problem-solving mindset with a focus on automation, reliability, and maintainability.
• Team-oriented, proactive, and comfortable working in a cross-functional environment.
• Continuous improvement mindset and willingness to adopt evolving data platform technologies.

 
Our Offer
 
We...

Compétences linguistiques

• Anglais (atout)

  • Comprendre : Indépendant - (B1)
  • Écrire : Indépendant - (B1)
  • Lire : Indépendant - (B1)
  • Parler : Indépendant - (B1)

• Français (atout)

  • Comprendre : Indépendant - (B1)
  • Écrire : Indépendant - (B1)
  • Lire : Indépendant - (B1)
  • Parler : Indépendant - (B1)

• Néérlandais (atout)

  • Comprendre : Indépendant - (B1)
  • Écrire : Indépendant - (B1)
  • Lire : Indépendant - (B1)
  • Parler : Indépendant - (B1)

Envie d'en apprendre davantage sur ce métier ou sur un métier proche de celui-ci ? Parcourez toutes les informations utiles sur Panorama des métiers. Panorama des métiers