4809 Azure Databricks Jobs - Page 8

Job Description: Experience in Building and maintaining ETL / ELT pipelines for large data sets, complex data processing, transformations, business logics, cost monitoring & performance optimization, and feature engineering processes. Must Have skills: Extensive experience with Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS), Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment. Extensive Experience with SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage. Experience with CI/CD, Version control tools like GitHub, Azure DevOps. Experience with Version control tools Experience with Azure cloud platf...

Role: Azure Data Engineer Location: Chennai/Pune/Mumbai/Bangalore Experience: 4 to 9 years Notice: Immediate Joiners Key skills: Azure ADB + Pyspark+ ADF + SQL + Snowflake + Python + DBT Job Description: Min 4 years in Azure Databricks on development projects Should be 100% hands on in Pyspark coding Should have strong SQL expertise in writing advanced/complex SQL queries DWH experience is a must for this role Experience in programming using Python is an advantage Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements Should be able to understand system architecture which involves Data Lakes, Data Warehouses and...

Your role at ZEISS Digital: You will play a strategic and architectural role in shaping the future of Data & Analytics and Business Intelligence function, actively contributing to the success of ZEISS global digital and AI transformation. In this architect-level function, you will enable business units to identify, design, and scale enterprise-grade Predictive Analytics and GenAI solutions. You will be responsible not only for solution delivery, but also for defining GenAI architecture, standards, and long-term technical direction across India and global initiatives. You will work closely with global stakeholders, platform teams, and cross-functional partners to design scalable, secure, and ...

JD Celebal Technologies Databricks Solutions Architect About the Role: As a Solutions Architect (SA) within Celebal Technologies team, you will engage with clients to address their big data challenges using the Databricks platform. You will be responsible for designing and delivering data engineering, data science, and cloud technology projects that integrate client systems, ensuring customers maximize the value from their data. Your role will also include providing training and handling technical tasks related to project completion. This is a billable position, and you will need to deliver excellent customer service while working closely with the regional Manager/Lead to meet project specif...

SUMMARY W issen Technology is Hiring for Lead Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge...

RESTful,the good-to-have About tsworks: tsworks is a leading technology innovator, providing transformative products and services designed for the digital-first world. Our mission is to provide domain expertise, innovative solutions and thought leadership to drive exceptional user and customer experiences. Demonstrating this commitment , we have a proven track record of championing digital transformation for industries such as Banking, Travel and Hospitality, and Retail (including e-commerce and omnichannel), as well as Distribution and Supply Chain, delivering impactful solutions that drive efficiency and growth. We take pride in fostering a workplace where your skills, ideas, and attitude ...

Role & responsibilities Work Location - ~CHENNAI~BANGALORE~HYDERABAD~ Skill Required - Digital : Microsoft Azure~Digital : Python~Digital : Machine Learning~Digital : Artificial Intelligence(AI) Experience Range 6 to 8 Job Description – .Must have skills - Hands-on experience- Azure Git version control, Docker Deployment of software applications at a production scale to Azure Kubernetes- Azure Databricks Managing cluster creation, Unity catalogue, and permissionsACLs- Elastic search, Kibana Experience in indexing and managing large volumes of data- Deployment and managing ML models in Azure Machine Learning Studio and Azure Databricks- Azure DevOps pipelines and releases Interested candidate...

JD Title : Azure Data Architect Experience level : 8 Years to 14 Years Requirements: Design and implement end-to-end data solutions on Microsoft Azure, including data lakes, data warehouses, and ETL/ELT processes. Develop scalable and efficient data architectures that support large-scale data processing and analytics workloads. Ensure high performance, security, and compliance within Azure data solutions. Know various techniques (lakehouse, warehouse) and have experience implementing them. Evaluate and choose appropriate Azure services such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake Storage, Azure Databricks (configuring, costing, etc), Unity Catalog, and Azure Data Fact...

About the Role : We are seeking a Databricks Data Engineer with hands-on experience in designing, building, and optimizing data pipelines and lakehouse architectures. The role involves working on Databricks-based data migration projects, ensuring efficient data ingestion, transformation, and delivery across diverse platforms. Key Responsibilities Data Engineering & Implementation • Design and build scalable data pipelines on Databricks using Spark, SQL, and Python/Scala. • Develop and optimize data ingestion workflows using tools like ADF, DMS, or equivalent. • Implement medallion architecture (bronze, silver, gold) for efficient data organization and lineage tracking. Databricks Development...

Role & responsibilities Implement various data platform functionalities and structures using Microsoft Azure PaaS offerings e.g. Azure Data Factory, Databricks, Logic Apps, Functions, Event Hubs, and various storage offerings. • Lead cross-functional technical discussions that drive decisions and actionable implementation approaches • Design conceptual, logical and physical data architectures with various 3rd party solution delivery partners to meet our clients technical, security, and business requirements • Provide technical implementation plans to deploy Azure infrastructure leveraging modern CI/CD best practices • Evangelize and help advancement DevOps across the data platform teams • Pl...

Role & responsibilities Exp - 5+ Location - Bangalore/Hyderabad/ Chennai Implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services Strong experience using Logic Apps, Functions & Data Factory Strong experience of development using Microsoft Azure as well as experience of developing integrations for large, complex pieces of software. Strong understanding of the technical side of CI / CD Strong understanding of Agile Designing and implementing a data warehouse on Azure using Azure HDInsight, Azure Data Factory, ADLS, Databricks, SQL Server, SQL DWH, Analytics Service, Event Hubs, KeyVault and other Azure services Des...

Experience Required: 7+Years Mode of work: Hybrid (Bangalore Only) Skills Required: Classical Machine Learning, Statistical analysis and and Data Science , Generative AI, Python, SQL Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 2nd week of January) Required Qualification: 7+ years of experience in data science or a related field, with a strong emphasis on machine learning and predictive modeling . Proficiency in programming languages such as Python Deep understanding of statistical analysis, machine learning algorithms, and data mining techniques Required Skills & Qualifications: Proven experience in classical machine learning , statistical modeling , and data ...

Role & responsibilities Requirements 4 - 10 years of hands-on experience in designing, developing and implementing data engineering solutions. Strong SQL development skills, including performance tuning and query optimization. Good understanding of data concepts. Proficiency in Python and a solid understanding of programming concepts. Hands-on experience with PySpark or Spark Scala for building data pipelines. Ensure data consistency and address ambiguities or inconsistencies across datasets. Understanding of streaming data pipelines for near real-time analytics. Experience with Azure services including Data Factory, Functions, Databricks, Synapse Analytics, Event Hub, Stream Analytics and D...

Role : Senior QA Engineer ETL & Data Warehouse Testing (Azure) Location: All EXL Location Work Mode: Hybrid Role Summary Mid-level Test Engineer with 2–5 years of experience in ETL and Data Warehouse testing on Azure-based data platforms. Skilled in hands-on testing of data pipelines, ensuring data accuracy, and supporting analytics and reporting solutions through manual and automated testing. Key Responsibilities Perform ETL and Data Warehouse testing for Azure-based data pipelines Design and execute test cases for data ingestion, transformation, and storage Conduct functional, integration, and regression testing Validate data accuracy, completeness, and reconciliation using SQL queries Exe...

1) Strong design and data solutioning skills. 2) PySpark hands-on experience with complex transformations and large dataset handling experience. 3) Good command and hands-on experience in Python. Experience working with following concepts, packages, and tools, a. Object oriented and functional programming b. NumPy, Pandas, Matplotlib, requests, pytest c. Jupyter, PyCharm and IDLE d. Conda and Virtual Environment. 4) Working experience must with Hive, HBase or similar. 5) Azure Skills a. Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases b. Azure DevOps c. Azure AD Integration, Service Principal, Pass-thru login etc. d. Networking vnet, ...

Skill -Azure Data Engineer. Experience -6 to 10 yrs. Location --Bangalore. Desired Competencies (Technical/Behavioral Competency) Must-Have Strong design and data solutioning skills 2) PySpark hands-on experience with complex transformations and large dataset handling experience 3) Good command and hands-on experience in Python. Experience working with following concepts, packages, and tools, a. Object oriented and functional programming b. NumPy, Pandas, Matplotlib, requests, pytest c. Jupyter, PyCharm and IDLE d. Conda and Virtual Environment 4) Working experience must with Hive, HBase or similar 5) Azure Skills a. Must have working experience in Azure Data Lake, Azure Data Factory, Azure ...

Professional & Technical Skills: - Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform. - Good To Have Skills: Experience with Python (Programming Language). - Strong understanding of data modeling techniques and best practices. - Experience with data integration tools and methodologies. - Familiarity with cloud-based data storage solutions and architectures. Additional Information: - The candidate should have minimum 7.5 years of experience in Databricks Unified Data Analytics Platform. - This position is based at our Bengaluru office. - A 15 years full time education is required.Role & responsibilities Preferred candidate profile

Hi Folks, Greeting from Raad7 Informatics...!! We are having an urgent opening for Senior AI Engineer_AI Pipelines, ADB, LLM for Bangalore_Hybrid. Role & responsibilities Overview We are seeking a senior-level engineer to build and support production-grade data and AI applications on Azure Databricks . This role is hands-on and focused on designing scalable pipelines, integrating ML and Generative AI models, and deploying reliable solutions in Azure cloud environments. Responsibilities Design, develop, and deploy end-to-end data and AI pipelines using Azure Databricks . Build robust ETL/ELT workflows using PySpark and SQL for large-scale data processing. Integrate Databricks with Azure servi...

Job Role - Azure Data Engineer Location - Navi Mumbai / Pune & Bangalore Experience - 05 - 08 Years Job Purpose Azure Data Engineer & Power BI Developer with experience in Big Data Tools and Technologies Skilled in designing and implementing scalable data pipelines, working with cloud-based data solutions, and insights through Power BI reports and dashboards Work with Azure Data Factory (ADF) and Databricks to design, develop, and maintain data pipelines and data platforms. Build operational and automated dashboards , reports with help of Power BI and other reporting tools Responsible for day-to-day tasks related to data engineering, data modeling, ETL (Extract Transform Load), data warehous...

Job Title: Principal Data Engineer, Logistics Employment Type: Full Time Experience: 12+ Years About the Role: We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking. You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment. Responsibilities Collaborate with business and technology stakeholders to gather and understand data needs Translate functional requireme...

Role Title: Azure Data Engineer Experience: 4-8 years Location: Noida/ Bangalore Key Responsibility We are looking for enthusiastic Data Engineers who could perform the following responsibilities: - • Responsible for implementing a robust data estate using Microsoft Azure Stack. • Responsible for creating reusable and scalable data pipelines. • Responsible for developing and deploying Big Data BI Solutions across industries and functions. • Responsible for the development and deployment of new data platforms. • Responsible for creating reusable components for rapid development of data platform. • Responsible to create high-level architecture and data modeling. • Responsible to guide and ment...

Job Description Your Role and Responsibilities Lead technology design discussions, propose architecture solutions, and drive technology decisions. Experienced in designing and delivering enterprise-level highly available solutions . Work closely with project management teams to effectively monitor the progress of implementation. Collaborate with the Pre-sales team on RFPs . Provide detailed specifications for proposed solutions. Experience in migrating applications to the cloud. Skilled in creating Data Lake and Data Warehouse solutions. Ability to implement solutions as per technical requirements. Expertise in identity, authentication, security, privacy, and compliance , including Active Di...

Must have Expert in Python, Pyspark and SQL Azure Databricks, Unity Catalog, Delta live tables Data Modelling & Medallion Architecture ETL pipeline design Azure Data Factory Azure DevOps Np: Immediate - 15 days

HI, Greetings for the day !!! We at HCL are looking for Azure Data Engineers + Exp in ETL Location: Hyderabad and Noida Face to Face interview is Mandatory If interested reach us on srikanth.domala@hcltech.com Provide us with the details below: Total years of exp: Exp in Azure Data Bricks: Exp in ETL: Exp in SQL: Availability for Face-to-Face Interview: Current CTC: Expected CTC: Current location: Preferred location: JD as below: As a Databricks Engineer at HCLTech, you will play a pivotal role in crafting and optimizing Microsoft Azure solutions to meet dynamic client needs. This position offers the opportunity to leverage your expertise in Azure technologies to drive impactful projects tha...

Role & responsibilities Skills Required: Digital: Microsoft Azure, Digital: Databricks, Azure Data Factory Experience Range in Required Skills: 10 & Above Years Job Description: Azure data Engineer, databricks, Adf Data Engineer JD • Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. • Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. • Creating architecture for data solutions with high performance characteristics • Bringing data and analytics products to production • Implement CI/CD pipelines for data solutions • Build dashboards for data stewards and business reporting • Design &...