Azure Data Engineer

Job Description

Design and implement scalable ETL/ELT pipelines using Azure Data Factory, SQL, and Azure data services to support enterprise-scale data integration and analytics solutions.

About the role

As an Azure Data Engineer in Pune, you will build and optimize production-grade Azure Data Factory pipelines for enterprise data integration and transformation. You will work with large-scale datasets, orchestrate complex workflows, and develop scalable cloud-based data solutions using Azure services.

Responsibilities

• Design and develop Azure Data Factory pipelines for data ingestion and transformation.
• Build reusable and metadata-driven ETL/ELT pipeline frameworks.
• Implement parameterized pipelines, triggers, and workflow orchestration.
• Integrate data from databases, APIs, cloud storage, and enterprise applications.
• Develop data movement solutions between Azure Data Lake, SQL databases, and storage systems.
• Write and optimize complex SQL queries and stored procedures for data transformation.
• Implement monitoring, logging, retry logic, and error handling mechanisms for pipelines.
• Troubleshoot performance issues and maintain documentation and data lineage.

Job Requirement

• 3+ years of experience in Azure Data Engineering or ETL development.
• Strong hands-on experience with Azure Data Factory (ADF) pipelines and activities.
• Expertise in SQL, including joins, aggregations, stored procedures, and query optimization.
• Experience building ETL/ELT pipelines and handling large relational datasets.
• Good understanding of data warehousing, data lake, and modern data architecture concepts.
• Experience with Mapping Data Flows, linked services, datasets, and incremental data loading.
• Exposure to Azure Databricks, Apache Spark, or Python is a plus.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.