3649 Azure Databricks Jobs - Page 38

As an Azure Databricks & Data lakes expert, your role will primarily involve utilizing your skills and competencies in areas such as data pipeline design, data quality, machine learning model development, data integration, data security, and more. Your proficiency in Databricks platform and secondary skillset in Oracle or MS SQL DB will be crucial for the successful execution of your responsibilities. Here's a breakdown of what will be expected from you: **Key Responsibilities:** - Designing and developing advanced data pipelines - Ensuring data quality and governance throughout the processes - Developing and maintaining machine learning models - Implementing data integration processes effec...

Job Title: Azure Devops Engineer Experience Range in Required Skills: 6 - 8yrs (Relevant Exp: 6+years only considered) Work Location: ~PUNE~CHENNAI~BANGALORE~ Immediate Joiners or Serving Notice Period till 25th to 30th Oct Skill Required: Digital : Microsoft Azure~Digital : DevOps~Digital : Databricks~Oracle Application Development Framework (ADF) Essential Skills: 1) Strong knowledge in ADF (Azure Data factory) 2) Experience with Azure data bricks , PySpark/Scala 3) Azure SQL 4) Implement CI/CD pipelines for data solutions

Experience: 5+ Years Location: Bangalore (Hybrid) Notice Period: Immediate to serving notice period JD: We are looking for a skilled Data Engineer to work on end-to-end data engineering and data science use cases. Ideal candidates must have strong experience in Databricks (Spark), SQL and Python or Scala on the Azure data platform. Key Responsibilities Design, build and maintain scalable ETL/ELT pipelines using Azure Data Factory , Azure Databricks and Spark. Develop and optimize data workflows using SQL and Python/Scala for large-scale processing. Implement performance tuning and optimization strategies for pipelines and Spark jobs. Support feature engineering and model deployment workflows...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Key Responsibilities: 1. Integrate, transform, and consolidate data from various structured and unstructured data systems into structures that are suitable for building analytics solutions by creating datawarehouse/Datamart in Azure Synapse Analytics. 2. Should have strong experience in writing SQL Scripts, Stored Procedures & Views, along with other objects in Azure Synapse SQL pool development. 3. Design and build modern pipelines using Azure Synapse Workspace. 4. Optimization of existing processes. Functional Skills/Competencies: Essential Skills: 1. 3 to 6 Years of Experience on Azure Synapse Analytics (Dedicated SQL Pool) 2. Strong Knowledge on MS SQL Server 3. Knowledge on SSIS or any ...

Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.) Permanent Payroll - Anlage Infotech Client - Orion Innovation Location- Kochi - Chennai - Coimbatore - HYBRID (2/3 days in a week) Role & responsibilities - Key Responsibilities: Lead the design and implementation of robust data pipelines and architectures using Azure Databricks, ADF, and PySpark. Provide technical leadership and mentoring to a team of data engineers. Drive the adoption of best practices in data engineering, coding standards, and data quality assurance. Collaborate with cross-functional teams including data science, product, business, and analytics to define and deliver data-driven solut...

Role & responsibilities Around 6+ years of experience in data engineering or cloud computing data development Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory Work with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms. Build data lake and data warehouse solutions using AWS S3, Azure Data Lake Collaborate with data scientists, analysts, and application developers to support advanced analytics, reporting, and ML workflows Implement job orchestration, monitoring, and error handling for reliable pipeline execution. Maintenance and support of Data Pipeline. D...

Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.) Permanent Payroll - Anlage Infotech Client - Orion Innovation Location- Kochi - Chennai - Coimbatore - HYBRID (2/3 days in a week) Role & responsibilities Bachelors or Masters degree in Computer Science, Engineering, Information Systems, or a related field. 5+ years of hands-on experience in data engineering roles. Strong expertise in: Azure Databricks Azure Data Factory PySpark Experience working with Azure Data Lake Storage (ADLS) and Delta Lake. Strong SQL skills for data extraction and transformation. Experience with version control tools like Git and CI/CD practices. Familiarity with orchestration, ...

We are hiring Lead design, development & delivery of Azure-based data analytics solutions.Drive data modeling, warehousing, visualization (Power BI).Mentor teams, optimize ETL, ensure quality, and innovate using Python, ML, and big data technologies.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Able to write complex SQL queries Having experience in Azure ...

The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Able to write complex SQL queries ; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. - Ability to provide solutions that are forward-thinking in data engineering and analytics space. - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues. - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs. - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members. - Orchestrate the data pipelines in scheduler via Airflow. Skills An...

SAP MDG, SAP BW on Hana, SAP Business Objects, Power BI, Azure Data Lake, Azure Databricks 28LPA-4c 35LpPA 4D WFO-. Location Hyderabad, ap. Varangal. blr. Notice Immediate 30 Days Skills: SAP MDG, SAP BW on HANA, SAP Business Objects, Power BI, Azure Data Lake, Azure Databricks Summary: Lead solution design and delivery across SAP and Azure platforms. Blend functional and technical expertise to drive data transformation, reporting, and analytics. Operate at a strategic level with hands-on capability across BI and cloud tools.

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Power Business Intelligence (BI), Microsoft Azure DatabricksMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform compone...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Power Business Intelligence (BI), Microsoft Azure DatabricksMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform compone...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Modern Data Platform Good to have skills : NA Educational Qualification : Regular 15 years of education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solving discussions and contribute to the ov...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Power Business Intelligence (BI), Microsoft Azure DatabricksMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform compone...

Role & responsibilities Skills : Azure Databaricks Preferred candidate profile Looking for 5to 12 Yrs Location: Mumbai, Indore & Kolkatta Interview mode F-F Inperson 11Oct 25 Notice Period : 0-30Days Interested Candidates share your cv at Muktai.S@alphacom.in

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill : Azure data engineer (Pyspark , databricks , adf) Exp range: 7 yrs to 10 yrs Location: Hyderabad, Kolkata, Bangalore, Pune, Chennai, Delhi Notice period 45 Pls find the Job Description below. Experience in Pyspark and Azure Databricks. • Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources. • Good experience in SQL or native SQL query languages. • Strong experience in implementing Databricks notebooks using Python. • Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions. Required Technica...

Role Description: As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise You will also work with the secur...

Desired Qualifications: 8+ years of experience in software development, scripting, and/or automation, with a strong focus on Conversational AI and Intelligent Automation. 2+ years of hands-on experience building LLM-based GenAI applications using frameworks like LangChain, LlamaIndex, and vector databases . Solid experience in Python programming and modern front-end technologies (e.g., Angular, React, Streamlit). Proficiency in cloud services, especially AWS and Microsoft Azure ; experience with Copilot stack or OpenAI integrations. Strong understanding of NLP concepts, dialog systems, prompt engineering , and multi-turn conversational design. Experience with database design and querying (Mo...

Dear Candidate, Greetings from LTIMindtree! Major Skills worked on(with Combinations): Relevant skills worked to support Major skills: Brief Description of Role Job Summary: We are seeking an experienced and strategic Data to design, build, and optimize scalable, secure, and high-performance data solutions. You will play a pivotal role in shaping our data infrastructure, working with technologies such as Databricks, Azure Data Factory, Unity Catalog , and Spark , while aligning with best practices in data governance, pipeline automation , and performance optimization . Key Responsibilities: Design and develop scalable data pipelines using Databricks and Medallion Architecture (Bronze, Silver...