Job
Description
company name=Apptad Technologies Pvt Ltd., industry=Employment Firms/Recruitment Services Firms, experience=5 to 12 , jd=
- Azure Data EngineerJob Type:- Full TimeJob Location:- BangaloreJD:-We are looking for a skilledAzure Data Engineerto design, develop, and maintain data solutions on the Microsoft Azure cloud platform. The ideal candidate will have experience in data engineering, data pipeline development, ETL/ELT processes, and cloud-based data services. They will be responsible for implementing scalable and efficient data architectures, ensuring data quality, and optimizing data workflows.
Key Responsibilities:
Design and implement
data pipelinesusing
Azure Data Factory (ADF), Azure Databricks, and Azure Synapse Analytics.Develop and optimize
ETL/ELTprocesses to extract, transform, and load data from various sources into
Azure Data Lake, Azure SQL Database, and Azure Synapse.Work with
Azure Data Lake Storage (ADLS)and
Azure Blob Storageto manage large-scale structured and unstructured data.Implement
data modeling, data partitioning, and indexingtechniques for optimized performance in Azure-based databases.Develop and maintain
real-time and batch processing solutionsusing
Azure Stream Analytics and Event Hub.Implement
data governance, data security, and compliancebest practices using
Azure Purview, RBAC, and encryption mechanisms.Optimize query performance and improve data accessibility through
SQL tuning and indexing strategies.Collaborate with
data scientists, analysts, and business stakeholdersto define and implement data solutions that support business insights and analytics.Monitor and troubleshoot
data pipeline failures, performance issues, and cloud infrastructure challenges.Stay updated with the latest advancements in
Azure data services, big data technologies, and cloud computing.
Required Skills & Qualifications:
Bachelor’s or master’s degree in computer science, Information Technology, Data Science, or a related field.
5-8 years of experiencein
data engineering, cloud data platforms, and ETL development.
Strong expertise in Azure servicessuch as:
Azure Data Factory (ADF)
Azure Synapse Analytics
Azure Databricks (PySpark, Scala, or Python)
Azure Data Lake Storage (ADLS)
Azure Blob Storage
Azure SQL Database / Cosmos DB
Azure Functions & Logic Apps
Azure DevOps for CI/CD automationProficiency in
SQL, Python, Scala, or Sparkfor data transformation and processing.Experience with
Big Data frameworks(Apache Spark, Hadoop) and data pipeline orchestration.Hands-on experience in
data warehousing concepts, dimensional modelling, and performance optimization.Understanding of
data security, governance, and compliance frameworks.Experience with
CI/CD pipelines, Terraform, ARM templates, or Infrastructure as Code (Isac).Knowledge of
Power BI or other visualization toolsis a plus.Strong problem-solving and troubleshooting skills.
Preferred Qualifications:
Familiarity with
SAP, Salesforce, or third-party APIsfor data integration., Title=Azure Data Engineer, ref=6566567