.webp)
Mid Senior Data Engineer
Mid Senior
India
Full Time
CET Time Zone
A Mid-Senior Azure Data Engineer will play a key role in designing, building, and optimizing data pipelines and architectures within the Azure ecosystem. This role involves working with Azure Data Factory (ADF), Databricks, PySpark, Scala, and Python to support data ingestion, transformation, and orchestration workflows. While collaborating with senior team members, they will enhance data solutions, contribute to AI-driven projects, and ensure scalability and performance. Additionally, they will provide technical guidance to junior engineers and help implement best practices for data security and compliance.
Join us to explore new possibilities with data and help shape our future with meaningful discoveries.
Responsibilities
- Design and deploy scalable data pipelines using Azure Synapse, Azure Databricks, Azure Stream Analytics, Azure ML, Azure Data Factory.
- Optimize data storage (e.g., partitioning in ADLS, Cosmos DB for real-time data).
- Implement DevOps practices (CI/CD, IaC) via Azure DevOps or GitHub Actions.
- Integrate data solutions with AI/ML services (e.g., Azure Machine Learning, OpenAI models).
- Develop data governance frameworks (security, RBAC, encryption).
- Troubleshoot performance bottlenecks and automate monitoring/alerting.
- Collaborate with AI engineers to productionize GenAI models
Education
- 3–5 years of Azure data engineering experience.
- Proficiency in advanced SQL, PySpark, and data orchestration tools (e.g., Airflow).
- Expertise in performance tuning (partitioning, indexing, caching).
- Strong understanding of DevOps and IaC (Terraform, ARM templates).
- Experience with AI/ML workflows and real-time data streaming.
Does this sound like you?
