42 Azure Data Lake Jobs

Optimizing or even re-designing data pipelines to support the modernization of data platform Design and build scalable and reliable data pipelines with the latest tech stack Facilitate real-life actionable use cases leveraging our data with a user- and product-oriented mindset Support teams without data engineers with building decentralized data solutions and product integrations Conceptualize, design and implement improvements to ETL processes and data through independent communication with data-savvy stakeholders Designing, building, and operating a Data Lake or Data Warehouse Knowledge to ingest, cleanse, transform and load data from varied data sources in the above Azure Services (Databr...

AZURE Devops JD Design, implement, and manage CI/CD pipelines using Azure DevOps. Expert in writing YAML/JSON based CI/CD pipeline using tools like Azure DevOps. Proficient in version control systems like Git, GitHub, Bitbucket, Azure Repos. Containerize applications using Docker, ACR and deploy to Kubernetes,AKS. Automate infrastructure provisioning and deployment processes using Terraform/ARM templates. Implement monitoring and alerting solutions for Azure services ensuring high availability and performance. Expert in integrating multiple CI, CD , CT and security tools(Artifactory, SonarQube, Snyk) in the Pipeline to perform build and deployment in Azure environment. Collaborate with infra...

Role Overview: You will be responsible for utilizing your excellent SQL skills to work with relational databases and schemas. Your main tasks will include creating stored procedures from scratch, debugging production SQL errors, identifying, testing, and promoting fixes to SQL scripts. Additionally, you will be required to have experience with Microsoft Azure, specifically Azure Data Factory for creating, running, and troubleshooting pipelines, Azure Data Lake, and working with DevOps for releases and pipelines. Communication with external stakeholders, engineers, and end-users will also be a part of your role. Key Responsibilities: - Utilize excellent SQL skills to work with relational data...

TCS Walkin Dear Candidate, Greetings from TATA CONSULTANCY SERVICES LIMITED!!! Thank you for exploring career opportunities with Asia's largest IT company. Exciting # Job Opportunities for # Experienced Professionals Required Skill# Experience- Azure Data Engineer Experience Range# 04Yrs to 10Yrs. Interview Location # Hyderabad venue- TCS Deccan Park, Plot No.1, Hitech City Main Rd, Software Units Layout, HUDA Techno Enclave, Madhapur, Hyderabad, Telangana 500081 Work Location # Hyderabad Date of Interview 17th January 2025 (Saturday) Interested candidate please share an updated copy of resume & EP REFERENCE ID with amitj.ram@tcs.com by asap- with following details. Total years of Exp: Email...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Expert level skills writing and optimizing complex SQL and Python is a mustExperience with complex data modelling, ETL design, and using large databases in a business environmentExperience with large scale on-prem to clo...

7 to 10 + years of IT experience in Data and Analytics 5+ years of experience in Azure Data Lake, Azure Data Factory, Azure Data Bricks ,Azure Synapse Analytics, Azure Storage Explorer Hands-on experience on Azure functions Azure synapse is must Should have project experience in Azure Data Lake / Blob (Storage purpose) Sound knowledge in Data Bricks Logic Apps Proficient in creating Data Factory pipelines for on-cloud ETL processing; copy activity, custom Azure development etc. Strong working knowledge of SQL and the ability to write, debug and optimize queries. Knowledge of cloud stack (Azure) for cloud-based components of the process. Experience in some of the cloud-based capabilities: dat...

Role & responsibilities Experience using Databricks and proficiency in Microsoft Azure platform (incl. ADF and ADLS). Experience querying databases and strong programming skills: PySpark, Python, SQL, etc. Strong knowledge of data concepts and tools. Knowledge of distributed systems (e.g., Apache Spark or Databricks) Knowledge of Delta Lake and Lakehouse architecture Experience with multiple data programming languages (Spark-SQL, PySpark, Pandas) Experience with On-premises databases such as SQL server, Oracle etc. Experience with version control (e.g., Git), DevOps, CI/CD Preferred candidate profile

Position Overview : We are looking for an experienced DevOps Candidate who specializes in Azure DevOps CI/CD Pipeline and possesses knowledge of Azure data services such as Azure Data Factory (ADF), Azure Data Lake (ADL), and Azure Databricks (ADB). The ideal candidate will have a proven track record of designing, implementing, and managing CI/CD pipelines for different technologies like java .NET applications. In this role, you will play a key role in optimizing our development and deployment processes, ensuring scalability, reliability, and performance of our Azure-based platforms. Key Responsibilities: Design, implement, and manage CI/CD pipelines using Azure DevOps. Experience in any ver...

Greetings from HCL! Currently Hiring for "Azure" JD: Skill Proven hands-on experience designing and implementing data models for analytics and reporting on Microsoft Azure in enterprise environments Experience with one or more of: Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Gen2, Azure Databricks, Cosmos DB Strong knowledge of data modelling techniques (3NF, dimensional modelling, data vault) and experience selecting appropriate patterns. experience with data ingestion and transformation tools such as Azure Data Factory, Synapse Pipelines or Databricks Strong SQL skills; experience optimizing SQL for analytical workloads Knowledge of big data processing (Spark), Python/Scala...

Role & responsibilities Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT. Proficiency with Azure Cloud data environments highly desired. Excellent verbal communication skills. Good problem-solving skills. Attention to detail. Proficiency with Data Warehousing principals and design Preferred candidate profile Notice Period: ...

Role: Databricks with Python Experience range: 5-10years Location: Bangalore NOTE: Relevant Databricks experience must be 5 years WALK-IN Drive on 17th Jan in Bangalore Venue: Tata Consultancy Services Limited Bangalore -Brigade Bhuwalka Icon ITPL Main Road Whitefield, Pattandur Agrahara Bangalore-560066 Karnataka, India Job description: Must Have: Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with st...

Key Skills: Cloud Architect, Azure Databricks, Azure Data lake, Security, BW, Data modeling Roles and Responsibilities: Design and implement cloud architecture solutions using Azure Data Lake and Azure Databricks. Collaborate with cross-functional teams to define and refine project requirements. Ensure the security and integrity of cloud-based systems. Develop data models and manage data workflows to optimize performance. Provide technical leadership and guidance to junior engineers. Stay updated with the latest industry trends and technologies related to cloud architecture. Skills Required: Strong experience in Cloud Architecture, preferably on Microsoft Azure Hands-on expertise with Azure ...

We are looking for Azure Data Engineer - Experience - 5-13 Years Location - Bangalore, Hyderabad, Pune, Kolkata, Noida Preferred company - Candidate should be from consulting background Interested candidate can apply on the below link - https://careers.ey.com/job-invite/1642416/ Role & responsibilities The main objective of the role is to support cloud and on-prem platform analytics and data engineering projects initiated across engagement teams. The role will primarily involve conceptualizing, designing, developing, deploying and maintaining complex technology solutions which help EY solve business problems for the clients. This role will work closely with technical architects, product and ...

Desired Candidate Profile Strong understanding of cloud-based technologies including Azure Data bricks, Delta Lake, Azure ADF, Azure Synapse Analytics. 8-10 years of experience in software development with expertise in Python programming language. Experience working on big data processing projects involving large datasets.

Skills Required: Azure Data Factory Azure Databricks Azure Data Lake Azure Synapse SQL Python Spark RDD Pyspark AWS (Good to have)

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with PySpark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Data bricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience w...

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with Pyspark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Databricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience wi...

Mandatory Skills: Azure Databricks,Snowflake

Mandatory Skills: Azure Databricks,Snowflake

Desired Candidate Profile Strong understanding of cloud-based technologies including Azure Data bricks, Delta Lake, Azure ADF, Azure Synapse Analytics. 8-10 years of experience in software development with expertise in Python programming language. Experience working on big data processing projects involving large datasets.

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with Pyspark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Databricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience wi...

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with Pyspark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Databricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience wi...

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with PySpark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Data bricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience w...

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with PySpark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Data bricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience w...

Mandatory Skills: Azure Databricks,Snowflake