Senior Cloud Data Engineer - Azure Data Factory/DataLake

5 years

0 Lacs

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Responsibilities

  • Design, develop, and maintain scalable and reliable data pipelines and ETL/ELT processes using Azure Data Factory (ADF).
  • Build and manage data lakes and storage solutions on Azure Data Lake Storage (ADLS).
  • Develop and optimize data warehouse solutions using Azure Synapse Analytics (SQL DW).
  • Utilize Azure SQL Server and other Azure database services to build and manage data stores.
  • Implement and manage real-time data ingestion and processing solutions using Azure Event Hubs.
  • Demonstrate deep expertise in various Azure cloud technologies relevant to data engineering (e.g., Azure VMs, Azure Functions, Azure Databricks).
  • Provide technical guidance, mentorship, and support to other database developers and data engineers across different teams and projects.
  • Act as an internal consultant and subject matter expert, advocating for and mentoring on the adoption of new cloud data technologies and best practices.
  • Collaborate closely with the IT Security team to address and respond to security concerns, ensuring all cloud data environments adhere to company security guidelines and compliance standards.
  • Understand and consider the impact of database and integration technology solutions on business processes, including production support and operational efficiency.
  • Provide technical leadership to data engineering teams, promoting a culture of continuous improvement, adherence to best practices, and the adoption of innovative data engineering Requirements & Qualifications :
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of professional experience in data engineering roles, with a strong emphasis on cloud technologies.
  • Demonstrable deep expertise in Microsoft Azure data services, including :
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • Azure Synapse Analytics (SQL DW)
  • Azure SQL Server
  • Azure Event Hubs
  • Strong understanding of data modeling, data warehousing concepts, and database design principles.
  • Experience with scripting and programming languages relevant to data engineering (e.g., SQL, Python, Scala).
  • Experience in building and optimizing ETL/ELT pipelines for large-scale data processing.
  • Strong understanding of data security and compliance best practices in cloud environments.
  • Excellent problem-solving, analytical, and communication skills.
  • Proven ability to work independently and collaboratively in a remote team environment.
  • Must be located in the United States and eligible to work in the US without sponsorship.
  • Must provide a link to your active LinkedIn Qualifications :
  • Experience with other cloud platforms (e.g., AWS, GCP).
  • Experience with data streaming technologies.
  • Familiarity with DevOps practices and infrastructure-as-code (IaC) tools.
  • Experience with data governance and data quality frameworks
(ref:hirist.tech)

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You