2404 Azure Databricks Jobs - Page 29

Job Summary The Data Scientist at the manager level will leverage data analytics tools to extract value from large datasets and support Jindal Group's business unit heads in data-driven decision-making. The role involves using data mining techniques, statistical analysis, and machine learning to create predictive and prescriptive models. The Data Scientist will also assist Jindal Group's data and analytics team in implementing analytics tools and techniques, and contribute to the development of the organization's data strategy. Key Responsibilities 1. Utilize data analytics tools for data mining and extract information from large data sets. 2. Perform exploratory data analysis to identify pa...

Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark Build Data Transformation in ADB Convert Scala Pgms to Py Spark Pgms Understand the SCALA program in DataBricks ADF Secondary Skills: Azure data lake gen 2 Synapse analytics (dedicated SQL pool) Exp in delta Lake Pyspark Nice to Have : Tidal Scheduler , Exp in Healthcare Domain

Python backend developer with experience in creating web applications. Good at fast API framework, async processing with redis cache, unit test the code, production log code, docker, micro-services, mongo DB, blob storage

Primary skills : Python, Databricks, SQL Secondary : ADLS. Kubernetes/Docker This is a L3 support position. We are looking for 1 support resource in offshore (India) for the PHX engine with hands on experience (2-3 years). Below are the skill sets >> SQL ADLS/Delta tables Kubernetes/Docker Python Databricks GitHub Actions DuckDB Shift required from 1 pm to 10 PM IST.

Data Engineers with experience in Azure Data Factory and more importantly MS Fabric Building ETL/ELT pipelines in ADF 3Years+ Experience Fabric Data Factory Completed at least one full successful deployment Data warehouse Architecture Sound appreciation of best practice Developing Pipelines and pulling in from a range of source including APIs and SQL Server Whilst we have BI Developers on and offshore at the moment who have developed the current estate, I think we will need additional resource for around 3 years and more technical strength on the data warehousing in the cloud to build out our go to platform What we have in place at the moment is absolutely fine for dealing with the BAU BI de...

We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Azure Data Engineer Location: Remote Work Timings: 2:00 PM 11:00 PM IST No of Openings: 3 Please Note: This is a pure Azure-specific role . If your expertise is primarily in AWS or GCP , we kindly request that you do not apply . Key Responsibilities: Design, develop, and maintain data pipelines using Azure Data Factory / Synapse Data Factory to orchestrate and automat...

You should hold a Bachelors or higher degree in Computer Science or a related discipline, or possess equivalent qualifications with a minimum of 4+ years of work experience. Additionally, you should have at least 1+ years of consulting or client service delivery experience specifically related to Azure Microsoft Fabric. Your role will involve 1+ years of experience in developing data ingestion, data processing, and analytical pipelines for big data. This includes working with relational databases like SQL server and data warehouse solutions such as Synapse/Azure Databricks. You must have hands-on experience in implementing data ingestion, ETL, and data processing using various Azure services...

As an MLOps Engineer, you will be responsible for researching and implementing MLOps tools, frameworks, and platforms for Data Science projects. You will work on enhancing MLOps maturity within the organization by introducing modern, agile, and automated approaches to Data Science. Conducting internal training and presentations on the benefits and usage of MLOps tools will be part of your responsibilities. Your key responsibilities will include model deployment, monitoring, and retraining, along with managing deployment, inference, monitoring, and retraining pipelines. You will be involved in drift detection, experiment tracking, MLOps architecture, and REST API publishing. To excel in this ...

As a Senior Azure Data Engineer, you will be responsible for designing, building, and optimizing scalable data pipelines for large-scale data processing using Python and Apache Spark. Your role will involve leveraging Azure Databricks for big data processing, working with PySpark to analyze large datasets, and utilizing Azure Data Factory for seamless data integration across cloud environments. Additionally, you will implement and maintain solutions using Azure Data Lake Storage for big data analytics and transformation. Your key responsibilities will include writing efficient and reusable Python code, working with core Azure data services like Azure SQL Database and Azure Synapse Analytics,...

As a Data Modeler at our organization, you will be responsible for designing, developing, and maintaining conceptual, logical, and physical data models that align with our business needs. Working closely with data engineers, architects, business analysts, and stakeholders, you will play a critical role in ensuring data consistency, integrity, and performance across multiple systems. Your key responsibilities will include: - Designing and developing conceptual, logical, and physical data models based on business requirements. - Collaborating with business analysts, data engineers, and architects to ensure that data models support our business goals. - Optimizing database design to improve per...

Position: Data Engineer Analytics & Reporting Pipelines Experience Required: 5-8 years Location: Manjeera Trinity, Hyderabad Timings: 5:30 PM 2:30 AM (US Shift Timings ) Employment Type: Full-Time About the Role We are seeking a Data Engineer to design, build, and optimize data pipelines and reporting modules for a next-generation AI-driven enterprise platform. The ideal candidate will have hands-on experience in ETL development, analytics, and secure data integrations, with expertise in Power BI and exposure to no-code/low-code tools for building lightweight reporting interfaces. Key Responsibilities Design, build, and maintain ETL pipelines for structured and unstructured data. Develop dat...

Need Immediate Joiners. This is a hands-on leadership role For - Technical Delivery Managers, Technical Project Managers, Technical Architects, Solution Architects, Practice Manager, Practice Lead, Practice Head, Data Engineering Manager, Associate Director Delivery, who wants to take this role. We are looking for a highly skilled and motivated Associate Director/ Director Data Engineering & Solution Architecture to support the strategic delivery of modern data platforms and enterprise analytics solutions. This is a hands-on leadership role that bridges technology and business, helping design, develop, and operationalize scalable cloud-based data ecosystems. You will work closely with client...

At PwC, you will be part of the audit and assurance team focusing on conducting independent and objective assessments of financial statements, internal controls, and other assurable information to enhance credibility and reliability for various stakeholders. Your responsibilities will include evaluating compliance with regulations, assessing governance and risk management processes, and related controls. Additionally, if you are involved in data, analytics, and technology solutions, you will assist clients in developing solutions to build trust, drive improvement, and identify, monitor, and predict risks. Your role will require utilizing advanced analytics, data wrangling technology, and aut...

Design, build, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse, and Databricks. Develop, optimize data models for reporting and analytics in Power BI. Create and maintain dashboards and reports to support business decision-making. Required Candidate profile Strong experience with Azure Data Factory, Synapse Analytics, and Databricks, Power BI (data modeling, DAX, visualization best practices). Strong SQL for querying, transformation, and optimization.

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure DevOps Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding the team in implementing effective solutions. You will also engage i...

Consult with clients and propose architectural solutions to help move & improve infra from on-premises to cloud or help optimize cloud spend from one public cloud to the other. Be the first one to experiment on new age cloud offerings, help define the best practice as a thought leader for cloud, automation & Dev-Ops, be a solution visionary and technology expert across multiple channels. Good understanding of cloud design principles, sizing, multi-zone/cluster setup, resiliency and DR design. Solution Architect or similar certifications from Azure is must. Good business judgment, a comfortable, open communication style, and a willingness and ability to work with customers and teams. Strong c...

•Experience with ETL testing. •Ability to create data bricks notebooks to automate the manual tests •Ability to create and run Test pipelines and interpret the results. •Ability to test complex reports and write queries to check each metrics Required Candidate profile •Experience in Azure Databricks and SQL queries - ability to analyse data in a Data Warehouse environment. •Ability to test complex reports and write queries to check each metrics. Python & pyspark

Job Title: Senior Data Engineer Azure Databricks Experience: 7+ Years Location: Navi Mumbai (On-site) Job Overview: We are looking for a highly skilled Senior Data Engineer with expertise in Azure Databricks, big data technologies, and cloud-based data architectures. The ideal candidate will have hands-on experience building scalable data pipelines and platforms for high-volume batch and real-time processing, preferably in the manufacturing or energy sector. Key Responsibilities: • Design and implement robust data pipelines using Azure Databricks, Spark, and other Azure data services. • Collaborate with architects, data scientists, and business teams to understand requirements and translate ...

We await your innovation at TCS: Hiring Databricks architect Greetings from TCS!! Dear Candidate, I hope you're doing well! I came across your profile and was impressed by your extensive experience which aligns to our current hiring for Databricks architect Interview Mode: Virtual Required Experience: 10-16 years Work location: PAN INDIA JD: Hands on Experience in ADF, Azure Databricks, Pyspark, Azure Data Factory, Unity Catalog, Data migrations, Data Security Good to have - Spark SQL, Spark Streaming, Kafka Hands on in Databricks on AWS, Apache Spark, AWS S3 (Data Lake), AWS Glue, AWS Redshift / Athena, AWS Data Catalog, Amazon Redshift, Amazon Athena, AWS RDS, AWS Glue, AWS EMR (Spark/Hado...

Azure Databricks Lead (Sr. Data Engineer) Who we are Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, youll be at the heart of this AI revolution. Youll work with teams that push the boundaries of what-is-possible and build solutions that energize and inspire. We are headquartered in the Silicon Valley and have our delivery centers across the globe. Role Overview: We are seeking street-smart and technically strong Senior Data Engineers / Leads who can take ownership of desig...

YoE: 5+ (Senior) / 7+ (Expert) Very good experience with Azure and their data stack (Azure Data Factory, Azure Databricks, Data Lakes in Azure, PowerBI, Azure Synapse) Good experience interacting with customers and stakeholders alike Very good experience leading initiatives and supporting other teams Roles and Responsibilities As a Senior Software Engineer, you will be responsible for designing, developing, and implementing high-quality software solutions. You will work closely with cross-functional teams to deliver scalable and efficient applications that meet business needs. This role requires a strong focus on the software development lifecycle and best practices

Job Role - Data Engineer Location - Navi Mumbai / Bangalore / Noida / Gurugram Job Purpose Azure Data Engineer & Power BI Developer with experience in Big Data Tools and Technologies Skilled in designing and implementing scalable data pipelines, working with cloud-based data solutions, and insights through Power BI reports and dashboards Work with Azure Data Factory (ADF) and Databricks to design, develop, and maintain data pipelines and data platforms. Build operational and automated dashboards , reports with help of Power BI and other reporting tools Responsible for day-to-day tasks related to data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analyti...

Bachelors or masters degree in Computer Science, IT, or related field. 5+ years of data engineering experience, including 1+ years on Azure Data Platform. Strong proficiency in Azure Data Factory, Azure Fabric, and Notebooks (PySpark/Python/SQL). Expertise in Delta Lake, Parquet, and modern data lakehouse architectures. Experience with Azure Synapse Analytics, Databricks (if applicable), and data visualization tools such as Power BI. Skilled in SQL, Python, and PySpark for large-scale data transformations. Experience implementing CI/CD for data pipelines and notebooks using Azure DevOps or Git. Knowledge of data governance, security best practices, and compliance frameworks. If youre ready t...

We are seeking an experienced AI Lead with a minimum of 10 years of industry experience in the field of Artificial Intelligence. The ideal candidate will have a proven track record of successfully leading and delivering multiple projects in Machine Learning, Deep Learning, and Natural Language Processing (NLP). Additionally, they should possess sound knowledge in Generative AI and Large Language Models (LLMs). Responsibilities: Project Leadership: Lead end-to-end AI projects, from conception to delivery, ensuring alignment with business objectives and stakeholder requirements. Technical Expertise: Serve as a subject matter expert in AI, providing guidance and support to the team in the devel...

Job Profile: Work in Azure stack Azure Data bricks, Azure Synapse, ADLS, Azure SQL DB, Azure Data Factory, CosmoDB, Analysis Services, Event Hub etc.. Hands on in data processing using Azure Data bricks, complex data transformation using Pyspark or Python and building end to end data pipeline using Azure Data bricks job scheduling using Oozie or Airflow or any other ETL scheduler Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala. designing & delivering data analytics solutions using Azure Cloud native services. Requirements Analysis and Solution Architecture Design, Data modelling, ETL, data integration and data...