Azure Data Engineer Grade II with BPO Exp (Immediate Joiner)

Role and Responsibilities

• Develops and operationalizes data pipelines to make data available for consumption (BI, Advanced analytics, Services).
• Works in tandem with data architects and data/BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
• Designs, develops, and implements ETL/ELT processes using Azure services such as Azure Data Bricks, Azure SQL Synapse, ADLS etc. to improve and speed up delivery of our data products and services.
• Implement solutions by developing scalable data processing platforms to drive high-value insights to the organization.
• Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery.
• Identifies ways to improve data reliability, efficiency, and quality of data management.
• Communicates technical concepts to non-technical audiences both in written and verbal form.
• If Lead - Then performs peer reviews for other data engineer work.

Skills

• Good Understanding of Data integration: Onboarding and integration of data from external and internal data sources through API management, sftp processes and others using synapse pipelines
• Deep expertise of core data platforms: Azure, Data Lakehouse design, big data concept using spark architecture
• Strong knowledge:
• With Integration technologies: pySpark, Python, ADF, Databricks
• With conceptual, logical, and physical database modeling.
• T-SQL knowledge and experience working with relational databases, query authoring, stored procedure development, debug, and optimize SQL queries.
• Proven success as a technical lead and individual contributor
• Familiarity with Project management methodologies: Agile, DevOps.

Qualification

• Bachelors degree (or equivalent) in computer science, information technology, engineering, or related discipline
• Experience in building or maintaining ETL processes
• Professional certification