Technical Lead-Azure Data Engineer

Job Title: Technical Lead-Azure Data Engineer

Experience: 6 to 8Years

About the Role

We are looking for a Data Engineer who is passionate about building and maintaining large-scale, high-performance data systems in the cloud. The ideal candidate will have hands-on experience working with modern data platforms, ETL tools, and cloud technologies — especially Azure. You’ll work on multi-terabyte operational marketing databases integrating with global cloud-based platforms, supporting critical business objectives.

Key Responsibilities

Develop, maintain, and optimize scalable data pipelines and architectures.

Work as an Individual Contributor (IC) handling mid to complex-level tasks with minimal supervision.

Understand business requirements and translate them into technical solutions.

Integrate data from multiple sources including cloud storage, APIs, and streaming platforms.

Develop ETL processes using tools like Azure Data Factory, SSIS, or Informatica.

Perform data modeling, data warehousing, and ensure data quality and reliability.

Collaborate with cross-functional teams and communicate effectively with internal and external stakeholders.

Prepare documentation for technical processes and workflows.

Must-Have Skills

Cloud Platforms: Strong experience in Azure (preferred); knowledge of AWS or GCP is a plus.

Databases: Proficiency in Snowflake, BigQuery, Azure Synapse, Redshift, or Oracle.

SQL Expertise: Strong skills in SQL and Spark SQL.

ETL Tools: Hands-on experience with Azure Data Factory, SSIS, or Informatica.

Big Data Technologies: Experience with Azure Databricks, PySpark, and Spark Streaming.

Data Storage: Experience with Azure Data Lake Storage, Azure Blob Storage, and Azure SQL Database.

Streaming Data: Knowledge of Kafka or Kinesis.

Scripting: Proficiency in Python or UNIX shell scripting.

Workflow Tools: Familiarity with Tivoli, Tidal, or Stonebranch.

Data Concepts: Strong understanding of relational and non-relational databases, data modeling, and data warehousing.

Debugging & Version Control: Good debugging skills and experience with SVN and JIRA.

Communication: Excellent written and verbal communication skills.

Good-to-Have Skills

Experience working in Agile environments.

Prior exposure to Customer Data Platforms (CDP) or Master Data Management (MDM) systems.

Familiarity with data marketing or campaign management platforms.

Client-facing experience and ability to collaborate across teams.

Education

Bachelor’s Degree in Computer Science, Information Systems, or a related field.

Certifications (Preferred)

Microsoft Azure Certification (Preferred) or equivalent in AWS / GCP.

Snowflake Associate / Core Certification.