2404 Azure Databricks Jobs - Page 39

As a member of the Platform engineering team at PepsiCo, you will be the key techno-functional expert responsible for leading and overseeing the Platforms & operations. Your role will involve driving a strong vision for how Platforms engineering can proactively create a positive impact on the business. You will be the empowered Leader of a team of Platform engineers who focus on building Platform products for platform optimization, cost optimization, and developing tools for Platform ops and Data Ops on the PepsiCo Data Lake. Your responsibilities will also include enabling exploration and access for analytics, visualization, machine learning, and product development efforts across the compa...

As a Data Engineer with 7+ years of experience, you will be responsible for working with large-scale distributed data processing systems. Your expertise in data modeling, testing, quality assurance, access control, and storage management will be crucial for the success of the projects. Proficiency in Python, SQL, and experience with Databricks and DBT are mandatory for this role. In this position, you will be implementing cloud data technologies such as GCP, Azure, or AWS. Your knowledge of improving the data development lifecycle and reducing lead times will be highly valued. Experience with agile delivery methodologies is a plus. Location for this role includes Trivandrum, Bangalore, and K...

As an Azure Data Engineer, you will be responsible for deploying and maintaining fully automated data transformation pipelines using Azure Data Factory, Pyspark, Azure DevOps, and Azure Delta Lake. Your role will involve designing data products and pipelines that are resilient, modular, flexible, scalable, reusable, and cost-effective in support of data architecture design. Your key responsibilities will include designing, developing, and maintaining data pipelines and ETL processes using Microsoft Azure services such as Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric. You will also be utilizing Azure data storage accounts like Azure Data Lake Storage Gen 2 & Azure Blob...

We are conducting an in-person hiring drive for the position of Data Engineer (Azure Data Bricks) in Pune & Bengaluru on 2nd August 2025. The Interview Locations are as follows: Pune: Persistent Systems, 9a, Aryabhata-Pingala, 12, Kashibai Khilare Path, Marg, Erandwane, Pune, Maharashtra 411004. Bangalore: Persistent Systems, The Cube at Karle Town Center Rd, Dada Mastan Layout, Manayata Tech Park, Nagavara, Bengaluru, Karnataka 560024. We are looking for an experienced Azure Data Engineer to join our growing team. The ideal candidate will have a strong background in working with Azure Databricks, DBT, Python/PySpark, SQL. You will work closely with our engineers and business teams to ensure...

You are invited to join ArcelorMittal, a global leader in steel and mining, with a presence in over 60 countries and a workforce of 158,000+ individuals dedicated to revolutionizing the steel industry. As a Senior Engineer - SAP BW, you will play a pivotal role in bridging legacy enterprise systems with modern data platforms like Azure, contributing to the company's commitment to smarter low-carbon steel production. To excel in this role, you should bring at least 6 years of experience in data engineering, particularly in SAP BW and Azure data platforms. Your responsibilities will encompass designing, developing, and maintaining data models within SAP BW, constructing Azure-based data pipeli...

You are a Staff Software Engineer (ETL) with 8-10 years of experience looking to join R1's ETL Development team. In this role, you will play a crucial part in designing, developing, and leading the implementation of ETL processes and data architecture solutions. Reporting to the Engineering Manager, you will be responsible for planning, designing, and implementing a centralized data warehouse solution for data acquisition, ingestion, large data processing, and automation/optimization across all company products. Your key responsibilities will include leading the design and architecture of ETL processes and data integration solutions, developing and maintaining ETL workflows using tools like ...

As a Principal Information Architect at Fractal, you will play a crucial role in serving as the Overall Portfolio Technical Architect. Your responsibilities include leading and defining the architecture to ensure alignment with account standards and best practices. You will assess the current technology landscape, lead project implementations, resolve issues, troubleshoot, and maintain project communication plans. Your role also involves reviewing systems under development, coordinating coding activities, and ensuring adherence to company policies, standards, and technologies. Collaboration with the Scrum Master will be essential to align project plans, ensure compliance with application arc...

As a Data Software Engineer, you will be responsible for utilizing your 5-12 years of experience in Big Data & Data-related technologies to contribute to the success of projects in Chennai and Coimbatore in a Hybrid work mode. You should possess an expert level understanding of distributed computing principles and a strong knowledge of Apache Spark, with hands-on programming skills in Python. Your role will involve working with technologies such as Hadoop v2, Map Reduce, HDFS, Sqoop, Apache Storm, and Spark-Streaming to build stream-processing systems. You should have a good grasp of Big Data querying tools like Hive and Impala, as well as experience in integrating data from various sources ...

The Sr. Data Engineer position at a top retail analytics client in Germany requires designing and optimizing data pipelines using Azure Data Factory & DBT. You will be responsible for managing PostgreSQL, Azure Databricks, PySpark, Azure Storage, Logic Apps, and CI/CD. Collaboration with DevOps team is essential for this role. The ideal candidate should have 5 to 8 years of experience in Data Engineering with expertise in PostgreSQL or any SQL-based databases. Hands-on experience with Azure Data Factory (ADF) is a must. Experience with Azure Databricks and PySpark would be an added advantage. Familiarity with Azure Storage (Blob, ADLS) and Logic Apps is desirable. Knowledge of Git for versio...

You are seeking a skilled and experienced Tosca Automation Test Engineer to join our team. The ideal candidate will have a strong background in software automation testing, with a focus on web applications, client/server applications, azure cosmos DB, azure microservices, and packaged applications. Responsibilities: - Design, develop, and maintain automated test scripts using the Tosca Automation framework. - Work closely with cross-functional teams to identify requirements, create test plans, and ensure high-quality deliverables. - Utilize expertise in Tosca Model-based framework, including Test Data Services, TBOX modules, Test case design, Test Case Templates, Requirements, DEX Agents, an...

You are invited to join our team as a Data Engineer specializing in Azure Data Bricks, with in-person hiring sessions scheduled for the 2nd of August 2025 in Pune and Bengaluru. The interview locations are as follows: Pune: Persistent Systems, 9a, Aryabhata-Pingala, 12, Kashibai Khilare Path, Marg, Erandwane, Pune, Maharashtra 411004. Bangalore: Persistent Systems, The Cube at Karle Town Center Rd, Dada Mastan Layout, Manayata Tech Park, Nagavara, Bengaluru, Karnataka 560024. As a Data Engineer with 4+ years of experience, you will play a vital role in our team, focusing on designing, implementing, and managing scalable data pipelines using Azure Databricks, DBT, Python/PySpark, and SQL. You...

You should have 5-12 years of experience in Big Data & Data related technologies. Your expertise should include a deep understanding of distributed computing principles and strong knowledge of Apache Spark. Proficiency in Python programming is required, along with experience using technologies such as Hadoop v2, Map Reduce, HDFS, Sqoop, Apache Storm, and Spark-Streaming for building stream-processing systems. You should have a good understanding of Big Data querying tools like Hive and Impala, as well as experience in integrating data from various sources such as RDBMS, ERP, and Files. Knowledge of SQL queries, joins, stored procedures, and relational schemas is essential. Experience with No...

At EY, you will have the opportunity to shape a career as unique as you are, supported by a global network, inclusive culture, and cutting-edge technology to help you reach your full potential. Your individual perspective and voice are valued to contribute to the continuous improvement of EY. By joining us, you can create an outstanding experience for yourself while contributing to a more efficient and inclusive working world for all. As a Data Engineering Lead, you will work closely with the Data Architect to design and implement scalable data lake architecture and data pipelines. Your responsibilities will include designing and implementing scalable data lake architectures using Azure Data...

You will be responsible for designing, developing, and maintaining scalable data pipelines using Azure Databricks. Your role will involve building and optimizing ETL/ELT processes for structured and unstructured data, collaborating with data scientists, analysts, and business stakeholders, integrating Databricks with Azure Data Lake, Synapse, Data Factory, and Blob Storage, developing real-time data streaming pipelines, and managing data models/data warehouses. Additionally, you will optimize performance, manage resources, ensure cost efficiency, implement best practices for data governance, security, and quality, troubleshoot and improve existing data workflows, contribute to architecture a...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Our Technology team builds innovative digital solutions rapidly and at scale to deliver the next generation of Financial and Non-Financial services across the globe. The Position is a senior technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure, platform engineering, platform operations, and product...

As a dedicated professional at Leighton Asia, you will be responsible for spearheading the development of end-to-end Azure integration solutions in alignment with CIMIC's OneIT Target Reference Architecture. Your key responsibilities will include ensuring compliance with CIMIC's Security Standards, constructing data and integration solutions that adhere to CIMIC's Target Reference Architecture, as well as hands-on development and unit testing of the solutions. You will play a crucial role in following CIMIC's path to production environments, providing technical support during test phases, and conducting handover sessions to transition solutions to BAU Support. Additionally, you will be invol...

You will be responsible for developing and maintaining scalable data processing systems using Apache Spark and Azure Databricks. This includes implementing data integration from various sources such as RDBMS, ERP systems, and files. You will design and optimize SQL queries, stored procedures, and relational schemas. Additionally, you will build stream-processing systems using technologies like Apache Storm or Spark-Streaming, and utilize messaging systems like Kafka or RabbitMQ for data ingestion. Performance tuning of Spark jobs for optimal efficiency will be a key focus area. Collaboration with cross-functional teams to deliver high-quality data solutions is essential in this role. You wil...

As a skilled individual, you will be responsible for designing, developing, and implementing data pipelines using Azure Data Factory. Your primary objective will be to efficiently extract, transform, and load data from diverse sources into Azure Data Lake Storage (ADLS). Additionally, you may have the opportunity to work with Azure Databricks, Python, and PySpark to enhance your capabilities in this role.,

You should have 5-12 years of experience in Big Data & Data related technologies, with expertise in distributed computing principles. Your skills should include an expert level understanding of Apache Spark and hands-on programming with Python. Proficiency in Hadoop v2, Map Reduce, HDFS, and Sqoop is required. Experience in building stream-processing systems using technologies like Apache Storm or Spark-Streaming, as well as working with messaging systems such as Kafka or RabbitMQ, will be beneficial. A good understanding of Big Data querying tools like Hive and Impala, along with integration of data from multiple sources including RDBMS, ERP, and Files, is necessary. You should possess know...

As a Data Scientist, you will be responsible for analyzing complex data using statistical and machine learning models to derive actionable insights. You will use Python for data analysis, visualization, and working with various technologies such as APIs, Linux OS, databases, big data technologies, and cloud services. Additionally, you will develop innovative solutions for natural language processing and generative modeling tasks, collaborating with cross-functional teams to understand business requirements and translate them into data science solutions. You will work in an Agile framework, participating in sprint planning, daily stand-ups, and retrospectives. Furthermore, you will research, ...

We are seeking a Senior Data Engineer who is proficient in Azure Databricks, PySpark, and distributed computing to create and enhance scalable ETL pipelines specifically for manufacturing analytics. Your responsibilities will include working with industrial data to support real-time and batch data processing needs. Your role will involve constructing scalable real-time and batch processing workflows utilizing Azure Databricks, PySpark, and Apache Spark. You will be responsible for data pre-processing tasks such as cleaning, transformation, deduplication, normalization, encoding, and scaling to guarantee high-quality input for downstream analytics. Designing and managing cloud-based data arch...

Your Responsibilities Implement business and IT data requirements through new data strategies and designs across all data platforms (relational, dimensional, and NoSQL). Collaborate with solution teams and Data Architects to implement data strategies, build data flows, and develop logical/physical data models. Work with Data Architects to define and govern data modeling and design standards, tools, best practices, and related development for enterprise data models. Engage in hands-on modeling, design, configuration, installation, performance tuning, and sandbox POC. Proactively and independently address project requirements and articulate issues/challenges to reduce project delivery risks. Y...

You are an exceptional, innovative, and passionate individual seeking to grow with NTT DATA, a trusted global innovator of business and technology services. As a Systems Integration Senior Analyst based in Hyderabad, Telangana (IN-TG), India (IN), you will join a forward-thinking organization that values inclusivity and adaptability. Your role will involve the following hands-on experiences: - At least 5 years of overall experience, with a minimum of 2 years in Azure Databricks. - Proficiency in Python/Pyspark. - Strong hands-on experience in SQL, including MS SQL Server, SSIS, Stored Procedures, and Views. - Experience in ETL Testing, with a good understanding of all testing concepts. - Fam...

The ideal candidate for this position should have 8-12 years of experience and possess a strong understanding and hands-on experience with Microsoft Fabric. You will be responsible for designing and implementing end-to-end data solutions on Microsoft Azure, which includes data lakes, data warehouses, and ETL/ELT processes. Your role will involve developing scalable and efficient data architectures to support large-scale data processing and analytics workloads. Ensuring high performance, security, and compliance within Azure data solutions will be a key aspect of this role. You should have knowledge of various techniques such as lakehouse and warehouse, along with experience in implementing t...

You are a seasoned Delivery Lead specializing in Azure Integration Services with over 12 years of experience. Your role involves managing and delivering enterprise-grade Azure projects, including implementation, migration, and upgrades. As a strategic leader, you should have in-depth expertise in Azure services and a proven track record of successfully managing enterprise customers and driving project success across Azure Integration and Data platforms. Your key responsibilities include leading end-to-end delivery of Azure integration, data, and analytics projects, ensuring scope, timeline, and budget adherence. You will plan and manage execution roadmaps, define milestones, handle dependenc...