3649 Azure Databricks Jobs - Page 6

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, ETL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and det...

Azure Data Engineer 3+ Years PAN India An excellent opportunity to join a leading global analytics organization where innovation meets impact. This role is perfect for professionals with hands-on experience in Azure Data Factory, Databricks, and ETL processes, who are passionate about solving complex business challenges through data-driven insights. Location: PAN India Your Future Employer: You will be working with a prestigious organization known for its commitment to diversity, equality and inclusion. They offer a dynamic work environment, opportunities for career growth, and a supportive team culture. Responsibilities: Design, develop, and maintain ETL pipelines using Azure Data Factory, ...

Role Overview: We are seeking an experienced Azure Machine Learning Specialist to lead the design and deployment of advanced predictive models for a leading UK university. The role focuses on developing high-accuracy student number forecasting systems using Azure ML, Python, and Databricks, integrating multiple data sources into automated, scalable pipelines. Candidate will collaborate with the Data & Analytics and Planning teams to build, train, and validate models in line with the universitys data governance and security standards. Key Responsibilities: 1. Data Analysis and Model Development Conduct detailed audits of CRM, application, and enrolment datasets in Azure to assess data quality...

Role Overview: As a Senior Data Engineer with 9 to 13 years of experience, your primary responsibility will be to design, develop, and deploy data processing solutions using Azure Databricks. You will collaborate with data engineers, architects, and business analysts to gather and analyze requirements. Additionally, you will develop, optimize, and manage complex data pipelines and workflows to ensure data quality, integrity, and security across various data sources. Troubleshooting and resolving performance issues related to Databricks solutions will also be a key part of your role. Documenting technical specifications and providing technical guidance and mentorship to junior developers will...

Role Overview: You are an enthusiastic and data-driven Associate Data Visualization Specialist joining the data & insights team. Your role involves crafting clear, interactive, and impactful visual stories from large datasets to drive smarter decisions across the business. You will work collaboratively with business users and technical teams to create intuitive dashboards and reports using tools such as Power BI, Tableau, and Azure Databricks. Key Responsibilities: - Create compelling and easy-to-understand dashboards and visualizations using Power BI or Tableau. - Translate raw data into clear stories that guide business decisions and highlight opportunities. - Ensure consistency, accuracy,...

You are being hired for the role of Azure Microsoft Fabric at Ashra Technologies with 7+ years of experience. The job location options include Pune, Mumbai, Chennai, and Bangalore. **Key Responsibilities:** - Hands-on experience with Microsoft Fabric, including Lakehouse, Data Factory, and Synapse. - Strong expertise in PySpark and Python for large-scale data processing and transformation. - Deep knowledge of Azure data services such as ADLS Gen2, Azure Databricks, Synapse, ADF, Azure SQL, etc. - Experience in designing, implementing, and optimizing end-to-end data pipelines on Azure. - Understanding of Azure infrastructure setup like networking, security, and access management is beneficial...

Job Description: As a Python Developer with strong proficiency in SQL, PySpark, Azure Databricks, and Azure Data Factory, you will play a crucial role in developing and maintaining data pipelines and analytics solutions. Your key responsibilities will include: - Developing and optimizing Python scripts for data processing and analysis - Writing complex SQL queries to extract and manipulate data from databases - Implementing data workflows using PySpark in Azure Databricks - Building ETL pipelines in Azure Data Factory Qualifications required for this role: - Strong proficiency in Python programming language - Experience working with SQL for data manipulation - Hands-on experience with PySpar...

As a Senior Azure Data Engineer, you will be a crucial part of the team responsible for designing and implementing cutting-edge data solutions on the Azure platform within the Financial Services domain. **Key Responsibilities:** - Design, develop, and implement complex data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks. - Develop and maintain high-performance data solutions including data lakes, data warehouses, and data marts on Azure. - Work with large and complex datasets, implementing efficient data distribution and integration strategies. - Utilize Azure Databricks and Spark (Scala/Python) for data processing, transformation, and analysis. - Impleme...

As an experienced Data Engineer, your role will involve building and optimizing scalable data pipelines, designing modular transformations, ensuring data governance, and enabling analytics across lakehouse and warehouse architectures. You will need to operate in multi-cloud environments, apply engineering best practices, and collaborate with cross-functional teams to deliver high-quality, governed, and production-ready data solutions. **Key Responsibilities:** - Design and implement ETL/ELT pipelines using Azure Databricks (PySpark, SQL, Delta Lake) or Snowflake (SQL, dbt). - Build metadata-driven ingestion frameworks to integrate data from relational databases, APIs, and flat files (CSV, JS...

You are seeking a skilled Azure Data Engineer to join the dynamic team. You should have extensive experience in data engineering, working with Azure cloud services, and designing and implementing scalable data solutions. Your role will involve developing, optimizing, and maintaining data pipelines and architectures to ensure data quality and availability across various platforms. - Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. - Build and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB. - Collaborate with data scientists, analysts, and business stakeholders...

Role** Azure Data Engineer Required Technical Skill Set** Azure DataBricks, Pyspark. ADLS, Synapse Desired Experience Range** 4+ Yrs Exp Location of Requirement Pune, Hyderabad Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) • 3+ years of relevant experience in Pyspark and Azure Databricks. • 1+ year of exp in Synapse Analytics • Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources. • Good experience in SQL or native SQL query languages. • Strong experience in implementing Databricks notebooks using Python. • Good experience in Azure Data Factory, ADLS, Storage Services, ...

Roles and Responsibilities A Databricks Platform Administrator is a crucial role responsible for the effective design, implementation, maintenance, and optimization of the Databricks Lakehouse Platform within an organization. This individual ensures the platform is scalable, performant, secure, and aligned with business objectives, providing essential support to data engineers, data scientists, and analysts. Key Responsibilities: 1. Provision and configure Databricks workspaces, clusters, pools, and jobs across environments. 2. Create catalogs, schemas, access controls, and lineage configurations. 3. Implement identity and access management using account groups, workspace-level permissions, ...

Database design and architecture using KDB+/q and knowledge of python or C++/Java with minimum of 2+ years of experience. Equities Algorithmic trading stack, transaction data and FIX protocol. market, transaction and reference data for various products like Equities, FX, Futures, FX, Indices, options etc. Different market data vendors API and experience working with their data. High capacity/low latency infrastructure like solace. Software development, build and deployment management using tools like JIRA, Git, Jenkins, Geneos (ITRS) and scripting languages. pre- and post- trade analytics like Transaction Cost analysis (TCA) reports. Mandatory Competencies Database - Other Databases - KDB Be...

We are seeking a Senior Software Engineer (ETL) with 10-12 years of experience to join our ETL Development team. This role will report to the Engineering Manager and the candidate will be involved in the planning, design, and implementation of our centralized data warehouse solution for data acquisition, Ingestion and large data processing and automation/optimization across all the company products. About the Role: Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data pipeline solutions. Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data warehous...

Job Summary: We are seeking a skilled developer with strong expertise in Azure Data Bricks (ADB) and SQL to design, develop, and optimize data solutions that drive business intelligence and analytics. The ideal candidate should be proficient in data modeling, ETL processes, and performance tuning of large-scale datasets. Key Responsibilities: Develop, implement, and optimize data pipelines using Azure Data Bricks and SQL-based solutions . Work closely with data engineers, analysts, and stakeholders to translate business needs into scalable data models. Perform data extraction, transformation, and loading (ETL) from multiple sources into data lakes and warehouses. Optimize complex SQL queries...

Total Experience - 1-2 Years Rotational Shifts As a Platform Ops Data Engineer , you will play a pivotal role in supporting our internal Data Enterprise initiatives. Your primary responsibilities will include designing, building, and optimizing ETL workflows and pipelines to ensure efficient data processing and analytics. This role involves developing reusable scripts, automation solutions, and integrations using modern tools (e.g., Fivetran, Hightouch) to streamline reporting and data analysis processes. You will have the autonomy to explore and understand business operations, identify opportunities for improvement, and implement innovative technical solutions that enhance overall data plat...

Role Design, Build & Optimize Scalable Data Solutions and End-to-End Pipelines Responsibilities Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. Develop and maintain data models, ETL/ELT processes ensuring high performance, reliability, scalability and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrit...

Your role and responsibilities The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Required technical and professional expertise Able to write complex SQL queries ; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

Relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. Exposure to basic issues in working within a Cloud (Azure) environment. Advanced working SQL knowledge and experience working with relational/non-Relational databases, query. Exposure to Jira and Confluence required

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Databricks, Microsoft Azure Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather r...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Databricks, PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. Your typical day will involve creating innovative solutions to address various business needs and collaborating with team members...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : PostgreSQL, Python (Programming Language), Docker (Software) Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application requirements are met, overseeing the development process, and...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in pro...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Python (Programming Language) Good to have skills : Microsoft Azure Active Directory, Microsoft Azure Databricks, Large Language Models Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business ob...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creat...