4854 Azure Databricks Jobs - Page 35

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

What you'll do Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture. Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables. Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks Deve...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to lead the engagement effort of providing high-quality and value-adding consulting solutions to customers at different stages- from problem definition to diagnosis to solution design, development and deployment. You will review the proposals prepared by consultants, provide guidance, and analyze the solutions defined for the client business problems to identify any potential risks and issues. You will identify change Management requirements and propose a structured approach to client for mana...

Position: Azure Data Architect Experience: 12 to 15 Years Tech Stack: Azure Databricks (Data Fabric is a Plus) Role Overview: Seeking a highly skilled Azure Data Architect with deep expertise in Databricks to lead enterprise data modernization and migration projects. The ideal candidate will serve as a hands-on technical leaderdefining architecture, guiding delivery teams, and ensuring alignment between client strategy and technical implementation. Key Responsibilities: Lead data modernization and migration projects, from architecture design to deployment and optimization. Architect scalable, secure, and efficient data platforms leveraging Azure Databricks and Azure Data Services. Provide te...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions. Collaborate with cross-functional teams to gather requirements and design scalable data architectures that meet business needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases. Implement machine learning models using PySpark on Databricks for predictive analytics applications. Desired Candidate Profile 5-10 years of experience as an ADF developer with expertise in big data technologies such as Hadoop, Spark, Kafka. Strong under...

Work Location: - ~ CHENNAI~BANGALORE~ Experience: - 6 to 8 Skill Required: Azure data Engineer, Databricks, ADF Role Description: Design, develop, and optimize data pipelines using Azure Data Factory (ADF) and Databricks for scalable data processing and transformation. Collaborate with cross-functional teams in an Agile environment to deliver end-to-end data solutions for business analytics. Implement and maintain efficient ETL/ELT workflows to integrate data from multiple sources into Azure environments like Data Lake and Synapse Analytics .

Experience Level: 6+ Years Loc: Bangalore/Chennai/Pune/Kolkata/Gurugram Role & responsibilities Bachelor's and/or masters degree in computer science or equivalent experience. Must have total 6+ yrs. of IT experience and experience in Data warehouse/ETL projects. Deep understanding of Star and Snowflake dimensional modelling. Strong knowledge of Data Management principles Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture Should have hands-on experience in SQL, Python and Spark (PySpark) Candidate must have experience in AWS/ Azure stack Desirable to have ETL with batch and streaming (Kinesis). Experience in building ETL / data warehouse transformation ...

Qualifications & Experience Bachelors degree in Computer Science, Information Systems, Statistics, or related field. 510 years of experience in data quality, data engineering, analytics operations. Strong command of SQL , Python , and PySpark for data validation and troubleshooting. Hands-on exposure to Databricks for building and running data pipelines. Working knowledge of reconciliation processes, data profiling, and DQ metrics.

About the Role We are seeking an experienced senior Power BI developer/architect with 10+ years of experience in data analytics, visualization, and business intelligence. The ideal candidate will design, develop, and manage end-to-end Power BI solutions to transform complex data into actionable insights. The role involves collaborating with cross-functional teams to define business requirements, architect scalable BI models, and ensure high data quality, performance, and security. A strong background in data engineering, SQL, DAX, Azure, and governance best practices is essential. Key Responsibilities Lead the design, development, and deployment of Power BI reports, dashboards, and data mode...

Job Title: Data Engineer Experience: 5+ Years Location: Chennai/Hyderabad/Mumbai/Pune/Bangalore (Hybrid) Key Responsibilities: Python Proficiency: Demonstrate a strong command of Python programming language, actively contributing to the development and maintenance of data engineering solutions. Data Engineering Expertise: Set up and maintain efficient data pipelines, ensuring smooth data flow and integration across systems. Experience with SQL and Data Warehouse/ Data Lakes is required. Contribute to the establishment and maintenance of Data Lakes, implementing industry best practices. Execute data scrubbing techniques and implement data validation processes to ensure data integrity and qual...

Role & responsibilities Develop and manage data pipelines on Microsoft Azure/Fabric for internal and external data sources. Ensure data pipelines are optimized for reliability and scalability. Ensure the scalability, security, and performance of our cloud architecture while aligning with business goals. Ensure adherence to security best practices in cloud operations Preferred candidate profile Hands-on experience with Azure storage platforms preferably, Microsoft Fabric/Databricks. Hands-on experience in developing PySpark codes for data processing, transformation, and loading. Hands-on experience in developing backend API frameworks using .Net 8. Deployment of coding artefacts using Azure D...

Job Requirement Position : Azure Data Expert Exp 5-8 yrs Emp type – Remote Overall Responsibilities Develop and manage data pipelines on Microsoft Azure/Fabric for internal and external data sources. Ensure data pipelines are optimized for reliability and scalability. Ensure the scalability, security, and performance of our cloud architecture while aligning with business goals. Ensure adherence to security best practices in cloud operations. Technical Responsibilities Mandatory Skills: Hands-on experience with Azure storage platforms preferably, Microsoft Fabric/Databricks. Hands-on experience in developing PySpark codes for data processing, transformation, and loading. Hands-on experience i...

Dear Candidate, Greetings from LTIMindtree! Brief Description of Role Job Summary: We are seeking an experienced and strategic Data to design, build, and optimize scalable, secure, and high-performance data solutions. You will play a pivotal role in shaping our data infrastructure, working with technologies such as Databricks, Azure Data Factory, Unity Catalog, and Spark, while aligning with best practices in data governance, pipeline automation, and performance optimization. Key Responsibilities: Design and develop scalable data pipelines using Databricks and Medallion Architecture (Bronze, Silver, Gold layers). • Architect and implement data governance frameworks using Unity Catalog and re...

Greeting from Future Focus Infotech!!! We have multiple opportunities Databricks Developer Exp: 5+yrs Skills : Azure Databricks, ADF Good to have Databricks Certification Location : Pan India Job Type- This is a Permanent position with Future Focus Infotech Pvt Ltd & you will be deputed with our client. A small glimpse about Future Focus Infotech Pvt Ltd. (Company URL: www.focusinfotech.com) If you are interested in above opportunity, send updated CV and below information to reema.b@focusinfotech.com Kindly mention the below details. Total Years of Experience: Current CTC: Expected CTC: Notice Period : Current location: Available for interview on weekdays: Pan Card : Thanks & Regards, Reema ...

Role Overview: At Capgemini Invent, you will be working as an inventive transformation consultant, blending strategic, creative, and scientific capabilities to deliver cutting-edge solutions tailored to client's challenges. Your role will involve proficiency in various technologies such as MS Fabric, Azure Data Factory, Azure Synapse Analytics, and more. You will integrate Fabric capabilities for seamless data flow, governance, and collaboration across teams while utilizing strong programming skills in Python, PySpark, Scala, or Spark SQL/TSQL for data transformations. Key Responsibilities: - Proficiency in MS Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Databricks Lakehouses, ...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

Subject: Exciting Opportunity at Celebal Technologies(SME Application Support Engineer) Apply Now! Hi Candidate, Greetings from Celebal Technologies ! We are currently hiring for the below position and came across your profile, which seems to match our requirements. Please go through the job details and share your updated resume if interested. Position: SME Application Support Engineer Experience: 6 to 12 years Location: Only Mumbai Notice Period: Immediate Job Description 6–10 years of experience in Big Data / Cloud Data Platform Support. SME of Databricks platform (clusters, jobs, repos, MLflow, warehouse) Expertise in experience in UNIX, SQL, Shell Scripting. Expertise in experience in Sp...

1. Design the end-to-end Test Strategy and Test plans for project deliveries and get signoffs from stakeholders 2. Able to drive enterprise-wide Automation Frameworks suited for Enterprise data platforms with data being fed by different business entities 3. Having good hands-on experience with Microsoft Azure along with Data Platform Testing. Should have azure Data Bricks, ADF, ADLS and Medallion Architectures based product testing experience 4. Should have hands-on knowledge of Python based testing frameworks i.e. PySpark/Py-Test and Python Data Quality libraries 5. Must have experience with Automaton framework design in Azure, CICD integration in pipelines and maintaining the overall Test ...

Azure Data Engineer Permanent Chennai / Bangalore / Hyderabad Exp Range: 5 to 9 years(Relevancy of min 5 years in Data engineering) Location( Current & Preferred): Chennai/ Bangalore / Hyderabad Level : SDE( Senior Data Engineer) EXPERTISE AND QUALIFICATIONS * 5+ years of overall technical experience, with a minimum of 2 years of hands-on experience with Microsoft Azure and Databricks. * Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the MedallionArchitecture. * Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse. * Adva...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job Role & responsibilities: - Understanding operational needs by collaborating with specialized teams Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc Designing and implementing agile, scalable, and cost efficiency solution on cloud data services. Lead a team of developers, implement Sprint planning and executions to ensure timely deliveries Technical Skill, Qualification & experience required:- 5-10 years of experience in Azure Cloud Data Engineering, Azure Databricks, datafactory , Pyspark, SQL,Python Hands on experience in Data Engineer, Azure Databricks, Data factory, Pyspark, SQL Proficient in Cloud Services Az...

Job role & responsibilities:- Understanding operational needs by collaborating with specialized teams Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc Build and support scalable and cost efficiency solution using multiple data services. Support on analysing data pipelines utilizing Azure data stack capabilities Close coordination with Command Centre which performs BAU monitoring and L1 Support Deep dive of failed pipelines to formulate root cause analysis, L2/L3 support Coordinate with Development team on analysis of incidents Technical skills, Qualification and experience required:- 5-7 years of experience in Azure ...

We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, GCP). - Build and manage data warehouse solutions, schema evolution, and data versioning. - Implement and manage workflow orchestration u...