4809 Azure Databricks Jobs - Page 4

As a Senior Data Engineer at our company, you will play a crucial role in designing, developing, and optimizing scalable data pipelines and applications using Apache Spark and Databricks. Your responsibilities will include: - Designing, developing, and implementing scalable data pipelines and applications with a focus on adhering to industry best practices. - Performing in-depth performance tuning and optimization of Spark applications within the Databricks environment. - Troubleshooting complex issues related to data ingestion, transformation, and pipeline execution. - Collaborating with cross-functional teams to deliver end-to-end data solutions. - Continuously evaluating and adopting new ...

Role - Databricks Exp - 4 to 6 Yrs Location - Kolkata, Bangalore JD Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks . Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources. Build and optimize data workflows using Databricks notebooks , PySpark , and SparkSQL for both batch and streaming data. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights. Monitor, troubleshoot, and resolve issues in data workflows and pipelines. Implement data governance, security, and privacy best practices. Contribu...

Required Azure Data Engineer And Azure Devops Experience- 3 to 5 salary- 10lpa to 15lpa Need Immediate joiner communication should be excellent

We are seeking a talented and experienced Lead Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will design, develop, and maintain scalable data pipelines and systems to support the ingestion, transformation, and analysis of large datasets. The role requires a deep understanding of data workflows, cloud platforms (Azure), and strong problem-solving skills to ensure efficient and reliable data delivery. Key Responsibilities Data Ingestion an...

Role Overview: You will be responsible for designing and implementing scalable, secure, and robust data solutions using Microsoft Azure. Your expertise in cloud data architecture, data engineering, and data governance will be crucial in leading the end-to-end Azure-based data architecture for enterprise-scale applications and analytics platforms. Key Responsibilities: - Design end-to-end Azure-based data architecture for enterprise-scale applications and analytics platforms. - Lead data platform strategy, including data lake, data warehouse, and real-time processing solutions. - Define best practices for data ingestion, transformation, storage, and consumption using Azure services. - Collabo...

As an Azure Data Engineer, your role involves building and implementing robust data pipelines using the Microsoft Stack. You should possess sound skills and hands-on experience with various Azure services such as Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, and Azure Analysis Services. Key Responsibilities: - Develop and implement Data Factory Pipelines for on-cloud ETL processing. - Build Tabular Models in Azure Analysis Services. - Utilize advanced SQL knowledge for data manipulation. - Utilize MSBI Suite (ETL, Reporting, Analytics, Dashboards) including SSIS, SSAS, SSRS, and Power BI. Qualifications Required: - Experience in building data pipelines using Microsoft...

As an AI/ML Product Designer at our company, your role involves designing and building AI/ML products at scale to enhance customer Understanding & Sentiment analysis, recommend customer requirements, suggest optimal inputs, and improve the efficiency of processes. You will collaborate with product owners and business stakeholders to achieve these goals. Key Responsibilities: - Lead a team of junior and experienced data scientists - Lead and participate in end-to-end ML project deployments, including feasibility analysis, design, development, validation, and application of state-of-the-art data science solutions - Push the boundaries of data science applications by utilizing data mining, visu...

As an Azure Data Factory Architect at Birlasoft, you will be responsible for designing, implementing, and managing scalable and secure data solutions on the Microsoft Azure cloud platform. Your role will involve a deep understanding of data transformation, data cleansing, data profiling, data architecture principles, cloud technologies, and data engineering practices to build an optimal data ecosystem for performance, scalability, and cost efficiency. - Design and implement robust, scalable, and secure data architectures on Azure - Define end-to-end data solutions, including data ingestion, storage, transformation, processing, and analytics - Translate business requirements into technical so...

Full Stack / Backend Developer (10+ yrs): Strong in C#, .NET, Angular 17, Azure (Functions, Cosmos DB, App Insights), SQL Server. Experience in Manufacturing domain, DevOps & Agile. IoT/Python is a plus.

At Leapwork, our vision is to break down the barriers between humans and computers through the worlds most accessible automation platform. We are the leading global AI-powered visual test automation solution, enabling some of the world’s largest enterprises to adopt, scale, andmaintainautomation–inunder30 days. In today’s environment, where efficiency, automation, and cost optimization are essential to enterprise growth, we are uniquely positioned to deliver impact. In 2023, Microsoft, the world’s largest and most recognizable software company, recognised Leapwork as a truly innovative and disruptive product, leading to a strategic partnership that continues to be a major growth catalyst. Th...

Job description Hiring for Pyspark Develper Mandatory Skills: Pyspark, Python, Big data, ETL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detail...

Role & responsibilities Participate in requirements gathering, database design, testing and production deployments. Analyse system/application requirements and design innovative solutions. Translating business requirements to technical specifications data streams, data integrations, data transformations, databases, data warehouses & data validation rules. Design and develop SQL Server database objects (i.e., tables, views, stored procedures, indexes, triggers, constraints, etc.) Understand design and develop apache spark notebooks in Azure databricks. Analyze and design data flow, data lineage mapping and data models. • Optimize, scale and reduce the cost of analytics data platforms for mult...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Data Engineer, you bring experience in applying advanced concepts and technologies in production environments.Your expertise and skills make you an ideal candidate to lead and deliver cutting-edge data solutions. Roles and Responsibilities- Experience with Infrastructure as Code (IaC), preferably using Terraform.- Proficiency in C...

Role & responsibilities Strong understanding of Azure cloud services, resource management, and pricing models. Solid knowledge of ADF, ADLS,Synapse Analytics Proficiency in using Azure Data Bricks Experince in AI cloud

Role & responsibilities Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions Preferred candidate profile

Locations - Indore / Noida / Bengaluru / Pune /Gurgaon Job Description 2 to 5 years of hands-on experience as a Data Engineer Strong experience with Databricks and Apache Spark Proficiency in Python for data engineering and ETL development Experience building and managing ETL pipelines Experience with cloud platforms ( AWS / Azure / GCP ) at least one Familiarity with Delta Lake and optimized data storage formats Understanding of Generative AI fundamentals (LLMs, embeddings, RAG concepts) Good to Have Hands-on experience with GenAI frameworks (Lang Chain, Lang graph, etc.) Experience working with vector databases (PGVector, Pinecone, Chroma, etc.) Knowledge of data orchestration tools (Airfl...

We are seeking a Data Modeler to design, develop, and maintain conceptual, logical, and physical data models that support business needs. The ideal candidate will work closely with data engineers, architects, BA and business stakeholders to ensure data consistency, integrity, and performance across various systems. Key Responsibilities: Design and develop conceptual, logical, and physical data models based on business requirements. Collaborate with business analysts, data engineers, and architects to ensure data models align with business goals. Optimize database design to enhance performance, scalability, and maintainability. Define and enforce data governance standards, including naming co...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

The ETL Data Architect will be responsible for designing, developing, and implementing robust and scalable data architectures and ETL solutions. This role requires deep expertise in Databricks for data processing and Lakehouse architecture, Kimball dimensional modelling for data warehousing, and Power BI and Microsoft Fabric for data visualization and analytics platform implementation As an ETL Architect, you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals Your ...

Position Description: .Job Title: Azure Data EngineerPosition: SE/SSEExperience: 4- 7 YearsCategory: Software Development/ EngineeringShift: Timing/rotation etc. detailsMain location: India, Karnataka, BangalorePosition ID: J0925-1483Employment Type: Full TimeEducation Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.Position Description: We are seeking an experienced Azure Data Engineer to design, build, and maintain scalable data solutions on the Microsoft Azure platform. The ideal candidate has strong experience with Azure data services, data warehousing, ETL/ELT development, and cloud data architecture. You will w...

Azure Databricks Python Azure Data Engineer Exp: 3 to 12 yrs

Role Overview: As an Azure Databricks Analyst at Indium, you will analyze data in ADF and provide technical expertise to team members. You are expected to design ETL/ELT processes using the latest market technology with minimal guidance. It is crucial to have a strong understanding of Data Warehousing concepts, proficiency in Complex SQL, and excellent communication skills. Collaborating with multiple stakeholders and workstreams to offer expertise in data management is a key aspect of your role. Independence in owning assigned tasks and proficiency in Agile execution methodology are crucial. Responding to client inquiries regarding data and insights will also be part of your responsibilitie...

As a Databricks Developer, you will be responsible for designing and implementing efficient data ingestion pipelines from multiple sources, both relational and non-relational. Your role will involve integrating end-to-end data pipelines to ensure the quality and consistency of data from different source systems to target data repositories. You will also be involved in processing performance analysis and code optimization. Key Responsibilities: - Design and implement efficient data ingestion pipelines - Integrate end-to-end data pipelines - Ensure data quality and consistency - Analyze processing performance and optimize code - Implement and optimize Spark jobs, data transformations, and proc...