Job Title: Azure Data Engineer
Experience Required: 4–6 Years
Employment Type: Full-Time (Payroll)
Location: Bangalore
Job Summary:
We are seeking a highly skilled Azure Data Engineer with 4–6 years of relevant experience in data engineering, including at least 2–3 years of hands-on expertise with Azure cloud technologies. The ideal candidate will have a solid background in building scalable data pipelines using Azure services such as Data Factory, Data Lake, Databricks, and Synapse, and should be well-versed in ETL processes, PySpark, and SQL development.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines using Azure Data Factory, Data Lake, and Synapse Analytics (MPP).
- Create and optimize Azure Databricks notebooks using PySpark, Databricks SQL, and Delta Lake.
- Build and support ETL/ELT processes for structured and semi-structured data ingestion from sources like relational databases, FTP, and SAP.
- Implement efficient data transformations for varied file formats including Parquet, JSON, XML, and CSV.
- Support production systems, ensuring SLAs are met and collaborating with cross-functional teams to troubleshoot issues.
- Participate in cloud migration projects and performance remediation for legacy systems.
- Apply DevOps practices for automated deployments using CI/CD pipelines (ADF, ADB, SQL).
- Follow best practices for data security, cluster configuration, and performance optimization.
- Develop and maintain conceptual, logical, and physical data models aligned with business needs.
- Work within Agile/Scrum teams to deliver high-quality solutions in a fast-paced environment.
Required Skills:
| Skill | Experience | Proficiency |
|---|---|---|
| Azure (Overall) | 6+ Years | Advanced |
| Azure Data Factory (ADF) | 3+ Years | Intermediate |
| Azure Databricks (ADB) | 3+ Years | Intermediate |
| Azure Data Lake | 3+ Years | Intermediate |
| ETL/ELT Development | 3+ Years | Intermediate |
| PySpark | 3+ Years | Intermediate |
| SQL (including stored procedures, CTEs, functions) | Strong | Advanced |
| Azure Synapse Analytics | Hands-on | Intermediate |
| NoSQL Databases | Familiarity | Intermediate |
Preferred Qualifications:
- Certifications (Preferred but not mandatory):
- DP-203: Azure Data Engineer Associate
- Databricks Data Engineering Certification
- Experience with:
- Data warehousing concepts, SCD types, normalization
- Reverse engineering and analysis of legacy data systems
- Handling large volumes of data with optimal cluster usage and partitioning
- Data ingestion performance tuning and remediation
- End-to-end cloud migration projects
Soft Skills:
- Strong analytical thinking and problem-solving ability
- High data affinity and attention to detail
- Excellent collaboration and communication skills
- Ability to work in agile environments and deliver consistent project outcomes
Location: Bangalore
Job Type: Full-Time (Payroll)
Job Category: Information Technology
Job Type: Full Time
Job Location: Bengaluru