4854 Azure Databricks Jobs - Page 6

As an Azure Data Engineer, your role involves building and implementing robust data pipelines using the Microsoft Stack. You should possess sound skills and hands-on experience with various Azure services such as Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, and Azure Analysis Services. Key Responsibilities: - Develop and implement Data Factory Pipelines for on-cloud ETL processing. - Build Tabular Models in Azure Analysis Services. - Utilize advanced SQL knowledge for data manipulation. - Utilize MSBI Suite (ETL, Reporting, Analytics, Dashboards) including SSIS, SSAS, SSRS, and Power BI. Qualifications Required: - Experience in building data pipelines using Microsoft...

As an AI/ML Product Designer at our company, your role involves designing and building AI/ML products at scale to enhance customer Understanding & Sentiment analysis, recommend customer requirements, suggest optimal inputs, and improve the efficiency of processes. You will collaborate with product owners and business stakeholders to achieve these goals. Key Responsibilities: - Lead a team of junior and experienced data scientists - Lead and participate in end-to-end ML project deployments, including feasibility analysis, design, development, validation, and application of state-of-the-art data science solutions - Push the boundaries of data science applications by utilizing data mining, visu...

As an Azure Data Factory Architect at Birlasoft, you will be responsible for designing, implementing, and managing scalable and secure data solutions on the Microsoft Azure cloud platform. Your role will involve a deep understanding of data transformation, data cleansing, data profiling, data architecture principles, cloud technologies, and data engineering practices to build an optimal data ecosystem for performance, scalability, and cost efficiency. - Design and implement robust, scalable, and secure data architectures on Azure - Define end-to-end data solutions, including data ingestion, storage, transformation, processing, and analytics - Translate business requirements into technical so...

Full Stack / Backend Developer (10+ yrs): Strong in C#, .NET, Angular 17, Azure (Functions, Cosmos DB, App Insights), SQL Server. Experience in Manufacturing domain, DevOps & Agile. IoT/Python is a plus.

At Leapwork, our vision is to break down the barriers between humans and computers through the worlds most accessible automation platform. We are the leading global AI-powered visual test automation solution, enabling some of the world’s largest enterprises to adopt, scale, andmaintainautomation–inunder30 days. In today’s environment, where efficiency, automation, and cost optimization are essential to enterprise growth, we are uniquely positioned to deliver impact. In 2023, Microsoft, the world’s largest and most recognizable software company, recognised Leapwork as a truly innovative and disruptive product, leading to a strategic partnership that continues to be a major growth catalyst. Th...

Job description Hiring for Pyspark Develper Mandatory Skills: Pyspark, Python, Big data, ETL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detail...

Role & responsibilities Participate in requirements gathering, database design, testing and production deployments. Analyse system/application requirements and design innovative solutions. Translating business requirements to technical specifications data streams, data integrations, data transformations, databases, data warehouses & data validation rules. Design and develop SQL Server database objects (i.e., tables, views, stored procedures, indexes, triggers, constraints, etc.) Understand design and develop apache spark notebooks in Azure databricks. Analyze and design data flow, data lineage mapping and data models. • Optimize, scale and reduce the cost of analytics data platforms for mult...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Data Engineer, you bring experience in applying advanced concepts and technologies in production environments.Your expertise and skills make you an ideal candidate to lead and deliver cutting-edge data solutions. Roles and Responsibilities- Experience with Infrastructure as Code (IaC), preferably using Terraform.- Proficiency in C...

Role & responsibilities Strong understanding of Azure cloud services, resource management, and pricing models. Solid knowledge of ADF, ADLS,Synapse Analytics Proficiency in using Azure Data Bricks Experince in AI cloud

Role & responsibilities Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions Preferred candidate profile

Locations - Indore / Noida / Bengaluru / Pune /Gurgaon Job Description 2 to 5 years of hands-on experience as a Data Engineer Strong experience with Databricks and Apache Spark Proficiency in Python for data engineering and ETL development Experience building and managing ETL pipelines Experience with cloud platforms ( AWS / Azure / GCP ) at least one Familiarity with Delta Lake and optimized data storage formats Understanding of Generative AI fundamentals (LLMs, embeddings, RAG concepts) Good to Have Hands-on experience with GenAI frameworks (Lang Chain, Lang graph, etc.) Experience working with vector databases (PGVector, Pinecone, Chroma, etc.) Knowledge of data orchestration tools (Airfl...

We are seeking a Data Modeler to design, develop, and maintain conceptual, logical, and physical data models that support business needs. The ideal candidate will work closely with data engineers, architects, BA and business stakeholders to ensure data consistency, integrity, and performance across various systems. Key Responsibilities: Design and develop conceptual, logical, and physical data models based on business requirements. Collaborate with business analysts, data engineers, and architects to ensure data models align with business goals. Optimize database design to enhance performance, scalability, and maintainability. Define and enforce data governance standards, including naming co...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

The ETL Data Architect will be responsible for designing, developing, and implementing robust and scalable data architectures and ETL solutions. This role requires deep expertise in Databricks for data processing and Lakehouse architecture, Kimball dimensional modelling for data warehousing, and Power BI and Microsoft Fabric for data visualization and analytics platform implementation As an ETL Architect, you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals Your ...

Position Description: .Job Title: Azure Data EngineerPosition: SE/SSEExperience: 4- 7 YearsCategory: Software Development/ EngineeringShift: Timing/rotation etc. detailsMain location: India, Karnataka, BangalorePosition ID: J0925-1483Employment Type: Full TimeEducation Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.Position Description: We are seeking an experienced Azure Data Engineer to design, build, and maintain scalable data solutions on the Microsoft Azure platform. The ideal candidate has strong experience with Azure data services, data warehousing, ETL/ELT development, and cloud data architecture. You will w...

Azure Databricks Python Azure Data Engineer Exp: 3 to 12 yrs

Role Overview: As an Azure Databricks Analyst at Indium, you will analyze data in ADF and provide technical expertise to team members. You are expected to design ETL/ELT processes using the latest market technology with minimal guidance. It is crucial to have a strong understanding of Data Warehousing concepts, proficiency in Complex SQL, and excellent communication skills. Collaborating with multiple stakeholders and workstreams to offer expertise in data management is a key aspect of your role. Independence in owning assigned tasks and proficiency in Agile execution methodology are crucial. Responding to client inquiries regarding data and insights will also be part of your responsibilitie...

As a Databricks Developer, you will be responsible for designing and implementing efficient data ingestion pipelines from multiple sources, both relational and non-relational. Your role will involve integrating end-to-end data pipelines to ensure the quality and consistency of data from different source systems to target data repositories. You will also be involved in processing performance analysis and code optimization. Key Responsibilities: - Design and implement efficient data ingestion pipelines - Integrate end-to-end data pipelines - Ensure data quality and consistency - Analyze processing performance and optimize code - Implement and optimize Spark jobs, data transformations, and proc...

You are an accomplished and dynamic Data Engineering Lead responsible for driving the design, development, and delivery of cutting-edge data solutions. Your role involves overseeing the design and development of robust data pipelines and systems, managing and mentoring a team of 5 to 7 engineers, and playing a critical role in architecting innovative solutions tailored to client needs. You will lead by example, fostering a culture of accountability, ownership, and continuous improvement while delivering impactful, scalable data solutions in a fast-paced consulting environment. - Architecture & Delivery: - Lead the end-to-end architecture of data pipelines leveraging Azure Databricks, Delta L...

As an ideal candidate for this role, you should have strong hands-on experience with Microsoft Azure in enterprise-scale deployments. You must possess expert-level experience with Azure Databricks in production environments and advanced SQL skills with experience in modern data warehouses. Additionally, you should have proven experience in designing and supporting large-scale batch and streaming pipelines. Your deep hands-on experience with ETL/ELT architectures using Spark and Azure Data Factory is crucial for this position. Proficiency in Python for distributed data processing is also required. Your role will involve working with various Azure services such as Azure Data Lake, Blob Storage...

As a Senior Azure Data Engineer Lead with 8-12 years of experience, you will be responsible for architecting and designing scalable, secure, and high-performing data solutions on the Microsoft Azure platform. Your role will involve collaborating with cross-functional teams to ensure alignment with business goals and technical requirements. Your deep expertise in Azure Databricks and proven leadership skills will be crucial in guiding and mentoring the team. Key Responsibilities: - Lead the design and implementation of scalable, secure, and high-performing data solutions on Azure - Build and optimize end-to-end data pipelines using Azure Databricks, Azure Data Factory, and other Azure data se...

As a Lead QA Engineer specializing in ETL & Data Warehouse Testing on Azure, your role will involve leading QA initiatives for complex data pipelines to ensure high-quality data delivery for analytics and reporting solutions. Key Responsibilities: - Lead QA strategy for ETL and Data Warehouse testing specifically on Azure platform - Design and execute test cases for data ingestion, transformation, and storage processes - Perform functional, integration, and regression testing to ensure data quality - Validate data accuracy and reconciliation using advanced SQL queries - Implement automated data testing utilizing Python and PySpark - Conduct hands-on testing for pipelines developed on Azure D...

As a Databricks Engineer at NTT DATA in Delhi, Delhi (IN-DL), India (IN), you will have the following responsibilities: - Proven, hands-on experience with Azure Data Factory and end-to-end pipeline development. - Strong experience with Azure Databricks, building notebooks/jobs, and optimizing workloads. - Advanced Python skills for data processing, unit testing, and scripting automation. - Strong SQL skills: designing and writing mid-to-complex queries, stored procedures, functions, and optimizing query performance (T-SQL). - Experience with SQL Server schema design, and working knowledge of SSIS packages (developing, debugging, maintaining). - Familiarity with Azure DevOps for source contro...