3649 Azure Databricks Jobs - Page 16

Role Overview: As a Marketing Intelligence Analyst at Arrow Electronics, you will be an integral part of the Global Components Digital Analytics team. Your role will involve leveraging data analytics and visualization tools to deliver statistical insights, owning key business data, identifying gaps in tracking systems, and leading long-term analytical projects to drive strategic decision-making. This is a great opportunity to shape a data-driven culture and make a significant impact. Key Responsibilities: - Build dashboards, troubleshoot tracking issues, and perform deep-dive analyses - Leverage data analytics and visualization tools like Adobe Customer Journey Analytics, Azure Databricks, S...

What We Expect Data Engineering & Pipeline Management Design, manage, monitor, and maintain data pipelines and ETL processes using PySpark, Azure DataBricks, SQL Server Studio and Azure Data Factory, Ensure data flows are reliable, scalable, and optimized for performance, Validate data processes through automated testing and monitoring, Continuous Integration, Deployment & Reliability Perform deployments using CI/CD pipelines in Azure DevOps, aligned with team practices, Ensure continuous availability, reliability, and scalability of connected systems, Support performance, uptime, disaster recovery, and capacity growth, Operational Support & Collaboration Serve as Level 3 support for digital...

Role & responsibilities Must have experience 10+ years in DWH/Big Data background (preferably in Telco domain) Proven expertise with Azure Data Bricks & basic understanding of Informatica mappings. Technical Skills: Advanced proficiency in Python and SQL for data manipulation and pipeline development. Deep understanding of data modeling for OLAP, OLTP, and dimensional data models. Experience with ETL/ELT tools like Azure Data Factory or Informatica. Familiarity with Azure DevOps for CI/CD pipelines and version control. Must have good experience (5+ years) with Infomatica PoweCenter Must have good experience in Databricks on Azure (3-4 years) Good to have experience in Lakebridge Must have Or...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Must Have Skills :- Azure Synapse, Data Modelling, Streaming Analytics, Databricks Code Optimization, Pyspark, Event Hub, Databricks, Devops, Python Job Description :- Hands-on experience with Microsoft Azure and Databricks. Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the Medallion Architecture. Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse. Advanced programming, unit testing, and debugging skills in Python and SQL. Hands-on experience with Azure-native services such as: Azure Data Factory, ADLS Gen2, Azure SQL ...

Looking for Sr Data Engineer to design, build and optimize data pipeline, model. This role involves troubleshooting data issue, collaborate with stakeholder and supporting data-driven insight. Graduate in Computer Science or related field is required Provident fund

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Support enhancements to the MDM and Performance platform Develop ETL Pipelines Troubleshoot issues Resolve production issues Required Candidate profile 5+ years in Python and advanced SQL including profiling, refactoring Experience with Airflow or DBT Experience with Snowflake Experience with RAG pipeline will be a plus

We are hiring a Senior Azure Data Engineer to build scalable data pipelines using Azure Databricks, PySpark, and Spark Pools. The role involves transforming raw data into insights, integrating cloud data platforms, and deploying machine learning models. Candidates should have 5+ years of data engineering experience and strong skills in Python, PySpark, Azure Data Lake, and Blob Storage. Experience with ML tools like MLlib or TensorFlow is preferred. The role demands strong problem-solving and communication skills, with added value for those familiar with CI/CD, Git, Docker, or Power BI.

Location: Bangalore/ Pune Experience: 5 to 9 Years NP: Immediate We are hiring a Senior Azure Data Engineer to build scalable data pipelines using Azure Databricks, PySpark, and Spark Pools. The role involves transforming raw data into insights, integrating cloud data platforms, and deploying machine learning models. Candidates should have 5+ years of data engineering experience and strong skills in Python, PySpark, Azure Data Lake, and Blob Storage. Experience with ML tools like MLlib or TensorFlow is preferred. The role demands strong problem-solving and communication skills, with added value for those familiar with CI/CD, Git, Docker, or Power BI.

Role & responsibilities Azure AI Data Engineer Experience : 5+ Years Job Location : Hyderabad/Bangalore Azure AI Data Engineer, Pyhton, SQL, Azure, AI, Generative AI Azure data and AI concepts Develop and manage data lakes and data warehouses using Azure Data Lake Storage Gen2 and Azure SQL/Data Warehouse. Build and deploy machine learning models using Azure Machine Learning, Mlflow Integrate AI capabilities using Azure Cognitive AI Services, Azure OpenAI Implement real-time data streaming and analytics using Azure Stream Analytics and Event Hubs Azure OpenAI in Foundry Models Azure AI Document Intelligence Understanding of LLM pipelines, including data preprocessing for GenAI models Experie...

The ideal candidate will have experience in developing and implementing data integration solutions using Azure Databricks, PySpark, and Azure Data Factory. The role requires strong technical expertise in Azure Cloud, Spark SQL, and ADLS. Location Kochi Responsibilities Design, develop, and implement data integration solutions using Azure Databricks, PySpark, and Azure Data Factory. Collaborate with cross-functional teams to identify business requirements and develop data integration solutions. Develop and maintain high-quality code, ensuring scalability, performance, and reliability. Troubleshoot and resolve technical issues related to data integration and Azure Databricks. Stay up-to-date w...

Skills Azure Services: Azure SQL Database, Azure Data Factory, Azure Data Lake, Fair knowledge on Azure Databricks, Azure Synapse Analytics, etc. Programming Languages: T-SQL, Fair knowledge on PySpark. Data Modeling: ERD, Dimensional Modeling ETL Tools: Azure Data Factory, Fair Knowledge of SSIS Big Data Technologies: Fair knowledge on Hadoop and Spark Performance Tuning and Troubleshooting Version Control: Git, Azure DevOps Responsibilities Proficient T-SQL developer in developing complex queries, stored procedures and skilled in performance tuning and ensuring database integrity and security. Designed and implemented Azure-based data solutions, by reducing data processing and optimizing c...

Project description The project involves building, deploying, and maintaining scalable Azure Cloud infrastructure and CI/CD pipelines to support cloud-native applications. The engineer will automate provisioning, manage application services, and ensure performance, security, and compliance across environments. Responsibilities Deploy and manage Azure infrastructure and services ensuring reliable and streamlined deployments. Implement CI/CD workflows using Azure DevOps, GitLab, and Ansible. Automate infrastructure provisioning using Infrastructure as Code (IaC) tools like Terraform. Configure and manage Azure App Services, Azure Functions, and AKS clusters for scalability and availability. Mo...

Project description You will be working in a global team that manages and performs a global technical control.You'll be joining Wealths Management team which is looking after record management data foundation and operates a set of in-house developed tooling.As an IT engineer you'll play an important role in ensuring the development methodology is followed, and lead technical design discussions with the architects. Our culture centers around partnership with our businesses, transparency, accountability and empowerment, and passion for the future. Responsibilities Responsibilities Build and maintain Power BI dashboards with a focus on performance and usability. Use Microsoft Fabric to integrat...

We are looking for experienced Azure Data Engineers with 8- 10 years of hands-on experience to join our team in Vijayawada This is a permanent, work-from-office position Key Skills Required: Strong experience in Azure Data Factory, Azure Databricks, Azure Synapse, Azure Fabric, and Data Lake Hands-on experience in Infrastructure setup and data pipeline orchestrationExpertise in SQL, ETL pipelines, and Data Modeling Experience working with Lakehouse and Medallion Architecture (BronzeSilverGold layers) Good understanding of cloud data architecture, data governance, and security best practices Strong analytical, problem-solving, and communication skills Ability to collaborate with cross-functio...

Overview DataOps L3 The role will leverage & enhance existing technologies in the area of data and analytics solutions like Power BI, Azure data engineering technologies, ADLS, ADB, Synapse, and other Azure services. The role will be responsible for developing and support IT products and solutions using these technologies and deploy them for business users Responsibilities 5 to 10 Years of IT & Azure Data engineering technologies experience Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet. Experience in creatin...

Job Title: Data Architect Job Summary: We are seeking a highly skilled Data Architect to design and implement scalable, secure, and high-performance data solutions on Microsoft Azure. This role requires deep technical expertise in Azure data services, data modeling, and modern data architectures (lakehouse, warehouse, etc.), with a strong focus on supporting analytics and business intelligence initiatives. Key Responsibilities: • Design and implement end-to-end data solutions on Microsoft Azure, including data lakes, data warehouses, and ETL/ELT pipelines. • Develop scalable and efficient data architectures to support large-scale data processing and analytics workloads. • Define and enforce ...

Role Summary: A Python + Azure Executive role typically encompasses a leadership position focused on leveraging Python programming within the Microsoft Azure cloud platform. Key Responsibilities: Strategic Planning & Vision: Defining and executing the technical strategy for Python-based solutions on Azure, aligning with overall business objectives. Team Leadership & Mentorship: Leading, mentoring, and developing a team of engineers or data scientists, fostering a culture of innovation and continuous improvement. Solution Architecture & Design: Architecting and overseeing the design and implementation of scalable, robust, and cost-effective solutions using Python and various Azure services. T...

Role Summary: A Python + Azure Executive role typically encompasses a leadership position focused on leveraging Python programming within the Microsoft Azure cloud platform. Key Responsibilities: Strategic Planning & Vision: Defining and executing the technical strategy for Python-based solutions on Azure, aligning with overall business objectives. Team Leadership & Mentorship: Leading, mentoring, and developing a team of engineers or data scientists, fostering a culture of innovation and continuous improvement. Solution Architecture & Design: Architecting and overseeing the design and implementation of scalable, robust, and cost-effective solutions using Python and various Azure services. T...

Role Summary: A Python + Azure Executive role typically encompasses a leadership position focused on leveraging Python programming within the Microsoft Azure cloud platform. Key Responsibilities: Strategic Planning & Vision: Defining and executing the technical strategy for Python-based solutions on Azure, aligning with overall business objectives. Team Leadership & Mentorship: Leading, mentoring, and developing a team of engineers or data scientists, fostering a culture of innovation and continuous improvement. Solution Architecture & Design: Architecting and overseeing the design and implementation of scalable, robust, and cost-effective solutions using Python and various Azure services. T...

Role Summary: A Python + Azure Executive role typically encompasses a leadership position focused on leveraging Python programming within the Microsoft Azure cloud platform. Key Responsibilities: Strategic Planning & Vision: Defining and executing the technical strategy for Python-based solutions on Azure, aligning with overall business objectives. Team Leadership & Mentorship: Leading, mentoring, and developing a team of engineers or data scientists, fostering a culture of innovation and continuous improvement. Solution Architecture & Design: Architecting and overseeing the design and implementation of scalable, robust, and cost-effective solutions using Python and various Azure services. T...

Role Summary: A Python + Azure Executive role typically encompasses a leadership position focused on leveraging Python programming within the Microsoft Azure cloud platform. Key Responsibilities: Strategic Planning & Vision: Defining and executing the technical strategy for Python-based solutions on Azure, aligning with overall business objectives. Team Leadership & Mentorship: Leading, mentoring, and developing a team of engineers or data scientists, fostering a culture of innovation and continuous improvement. Solution Architecture & Design: Architecting and overseeing the design and implementation of scalable, robust, and cost-effective solutions using Python and various Azure services. T...

Role Summary: A Python + Azure Executive role typically encompasses a leadership position focused on leveraging Python programming within the Microsoft Azure cloud platform. Key Responsibilities: Strategic Planning & Vision: Defining and executing the technical strategy for Python-based solutions on Azure, aligning with overall business objectives. Team Leadership & Mentorship: Leading, mentoring, and developing a team of engineers or data scientists, fostering a culture of innovation and continuous improvement. Solution Architecture & Design: Architecting and overseeing the design and implementation of scalable, robust, and cost-effective solutions using Python and various Azure services. T...