23086 Pyspark Jobs - Page 33

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

Role & responsibilities Azure Databricks, PowerApps, power automate, Synapse analytics, Pyspark, python

Job Description At Oracle Health, we put humans at the heart of every conversation. Our mission is to create a human-centric healthcare experience powered by unified global data. As a global leader we’re looking for a Data Engineer with BI to join an exciting project for replacing existing Data warehouse systems with the Oracle's own data warehouse to manage storage of all the internal corporate data to provide insights that will help our teams to make critical business decisions Join us and create the future! Responsibilities Career Level - IC3 Roles and Responsibilities Proficient in writing and optimising SQL queries for data extraction Translate client requirements to technical design th...

What you'll do In your new role, youll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform. Youll also be: Producing complex and critical software rapidly and of high quality which adds value to the business Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning Collaborating to optimise our software engineering capability Designing, producing, testing and implementing our working software solutions Working across the life cycle, from requirements analysis and desig...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. Why PWC At PwC, you will be part of a ...

Must have: Databricks (Strong), Azure Data Engineering, pyspark, Python, SQL

Job Description Circle K (Part of Alimentation Couche-Tard group) is a global leader in the convenience store and fuel space, it has a footprint across 31 countries and territories. At the Circle K Business Centre in India, we are #OneTeam using the power of data analytics to drive our decisions and strengthen Circle K’s global capabilities. We make it easy for our customers all over the world – we partner with the business to empower the right decisions and deliver effectively, while rapidly unlocking value for our customers across the enterprise. Our team in India is an integral part of our talent ecosystem that helps advance us on our journey to becoming a data-centric company. The future...

Job Description Circle K (Part of Alimentation Couche-Tard group) is a global leader in the convenience store and fuel space, it has a footprint across 31 countries and territories. At the Circle K Business Centre in India, we are #OneTeam using the power of data analytics to drive our decisions and strengthen Circle K’s global capabilities. We make it easy for our customers all over the world – we partner with the business to empower the right decisions and deliver effectively, while rapidly unlocking value for our customers across the enterprise. Our team in India is an integral part of our talent ecosystem that helps advance us on our journey to becoming a data-centric company. The future...

Dear Candidate, Greetings from TCS !!! We are looking for Pyspark developers. Interested candidates share your resume to s.janani4@tcs.com Role: Pyspark developer Experience : 5 to 8 years Location: Chennai / Hyderabad / Kolkata / Delhi / Pune / Bangalore

About Position: We are hiring Sr. Data Engineer with Pyspark, SQL, ETL Data Engineer. Role: Senior Data Engineer Location: Pune, Bangalore Experience: 5 to 8 Years Job Type: Full Time Employment What You'll Do: Candidate should have 5+ years of experience in Data Engineering Must have experience in Pyspark, SQL, ETL, data pipelines, AWS, Python Nice to Have – Life science domain experience (Pharma), Dremio, Redshift, Nifi ingestion, BI Tools (Tableau/PowerBI) Designing, creating, testing and maintaining the complete data management & processing systems. Working closely with the stakeholders & solution architect. Ensuring architecture meets business requirements. Building highly scalable, rob...

About Position: We are hiring MS Fabric Architect with hands on experience on Architect, MS Fabric, SQL, Azure, Python, Pyspark. Role: MS Fabric Architect Location: Pune, Bangalore Experience: 15 to 18 Years Job Type: Full Time Employment What You'll Do: Strong knowledge of Life Science domain, especially in CRO business is a plus. Excellent knowledge of languages like Python, SQL, Pyspark, Azure MS Fabric skills, Databricks is a plus. Proven record of working as delivery lead, engaging with customer architects/ business stakeholders and delivery personnel, owning smooth deliveries Should have worked as technical architect and delivered complex, critical, secure, available, and scalable proj...

Description : We are a technology consulting firm operating in Cloud Data Engineering and Analytics, helping enterprise customers build reliable, scalable data platforms and analytics products. Our teams deliver end-to-end data lakes, real-time streaming pipelines, and production-grade ML feature stores using Databricks and modern cloud data tooling. Role & Responsibilities : - Design, build, and maintain scalable batch and streaming ETL pipelines on Databricks using Delta Lake and Delta Live Tables (DLT). - Develop and optimize Spark/PySpark jobs for performance, cost-efficiency, and reliability; tune cluster sizing and autoscaling policies. - Implement data quality, observability, lineage ...

Dear Candidates, We’re Hiring! 🚀 Job Title: Azure Data Engineer Experience: 2-8 Years Location: Bangalore, PAN India Employment Type: Full-Time Job Description: We are seeking a skilled and motivated Azure Data Engineer with 2-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Databricks , Azure Data Services , and data engineering practices. You will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing data workflows, and ensuring the integrity and availability of data for analytics and business intelligence. Key Responsibilities: 1) Design and Development: Design, develop, and deploy scalable data pi...

We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry experience. The ideal candidate will have a proven track record of working on live projects. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related technologies. Key Responsibilities: ● Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. ● Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. ● Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. ● Develop an...

Summary Position Summary Enterprise Performance Our Enterprise Performance team is at the forefront of enterprise technology, working across finance, supply chain, and IT operations to support the delivery of holistic performance improvement and digital transformation. We support Deloitte client service teams of strategic advisors and architects, differentiated by our industry depth to help collaborate with leading insights providers and leverage your experience in strategy, process design, technology enablement, and operational services to enable the heart of business solutions. Position Summary Level: Consultant or equivalent As an experienced Consultant at Deloitte Consulting Services, yo...

About the Role: We are seeking a Senior Data Engineer to drive the development of our next-generation Data Lakehouse architecture. You will be responsible for designing, building, and optimizing massive-scale, low-latency data pipelines that support real-time analytics and Machine Learning applications. Key Responsibilities: - Design and build highly optimized, production-grade ETL/ELT pipelines using Apache Spark (PySpark/Scala) to process petabytes of data. - Architect and manage the Data Lakehouse using open-source technologies like Delta Lake or Apache Hudi for ACID transactions and data quality. - Integrate and process real-time data streams using technologies such as Apache Kafka or Ki...

5 - 7 Years 5 Openings Trivandrum Role description Job Title: Data Engineer Exp-5+yrs Location-Trivandrum, Kochi, Chennai, Pune Job Summary We are seeking a skilled Data Engineer to design, build, and maintain data pipelines and data models that support analytical and business intelligence needs. The ideal candidate will have hands-on experience with Python or SQL , Google Cloud Platform (GCP) , and a strong understanding of data management, quality, and security best practices . Key Responsibilities Build and maintain moderately complex data pipelines , ensuring data flow, transformation, and usability for analytical projects. Design and implement data models , optimizing for performance an...

Job Description R3- Senior Manager, Frontend Data Stewardship Engineer The Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Be part of an organisation driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products. Drive innovation and execution excellence. Be a part of a team with passion for using data, analytics, and insights to drive decision-making, and which creates custom software, allowing us to tackle s...

About Gap Inc. Our past is full of iconic moments — but our future is going to spark many more. Our brands — Gap, Banana Republic, Old Navy and Athleta — have dressed people from all walks of life and all kinds of families, all over the world, for every occasion for more than 50 years. But we’re more than the clothes that we make. We know that business can and should be a force for good, and it’s why we work hard to make product that makes people feel good, inside and out. It’s why we’re committed to giving back to the communities where we live and work. If you're one of the super-talented who thrive on change, aren't afraid to take risks and love to make a difference, come grow with us. Abo...

Important Note (Please Read Before Applying) 🚫 Do NOT apply if: You have less than 5 years or more than 10 years of experience You lack hands-on AWS & Python experience You are on a notice period longer than 30 days You are looking for a remote-only position You are from a non–data engineering background (e.g., support, testing, BI-only roles) ✅ Apply ONLY if you meet ALL criteria above. Random or irrelevant applications will not be processed. Job Title: Data Engineer Location: Hyderabad Experience: 5+years Employment Type: Permanent Notice Period: Immediate Joiners Only CTC: Up to 25 LPA About the Company Our client is a trusted global innovator of IT and business services, present in 50+ c...

About Position: We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc., Role: Data Engineer Location: All Persistent Locations Experience: 6 to 10 Years Job Type: Full Time Employment What You'll Do: Design, build, and maintain data pipelines to move and process large datasets efficiently. Work closely with cross-functional teams to ensure data accuracy, reliability, and availability. Optimize data workflows to enhance performance and scalability. Use AWS services and big data tools to handle real-world data challenges. Write and maintain clean, reusable code using Python, Java, and SQL. Implement best practices for data security, quality, and governa...

Position:- Cloud Data Architect (Azure & AWS) Technology- Cloud Data Architect, Azure, AWS AWS Glue, S3, Redshift, and EMR, Data Factory, Data Lake, Synapse, and Databricks Experience 10+ years Work Location - Navi Mumbai Job Description Deep expertise in Azure and AWS data ecosystems to lead end-to- end solutioning covering data ingestion, transformation, governance, security, and analytics platform design Solution Architecture & Delivery Design, architect, and implement modern cloud-native data platforms on Azure and AWS tailored to client needs Build data lakehouse solutions using Azure Synapse, Databricks, AWS Redshift, Glue, EMR, and Delta Lake Lead the development of ETL/ELT pipelines ...

Job Description: Position: GCP Data Engineer Location: Bangalore Experience: 5-8 Years Employment Type: Full-time Notice Period - Immediate - 15 Days Interested candidates can share their updated resume on ericatoscano@kpmg.com Are you a data enthusiast with a passion for building scalable data solutions on the cloud? Join our team as a GCP Data Engineer and help us design, develop, and operationalize cutting-edge data frameworks that power intelligent decision-making. Key Responsibilities: Design and develop data ingestion , real-time processing , and transformation frameworks using open-source tools. Work hands-on with technologies like Kafka , Apache Spark (SQL, Scala, Java) , Python , Ha...

Develop and deploy end-to-end Machine Learning models using Python, Classical ML algorithms, and scalable Databricks workflows (PySpark, MLflow, Delta Lake). Lead GenAI initiatives including LLM fine-tuning, RAG pipelines, prompt engineering, and vector database integrations. Build robust data pipelines, perform feature engineering, and optimize models for performance and production readiness. Collaborate with cross-functional teams to translate business problems into ML/GenAI solutions with measurable outcomes. Conduct advanced statistical analysis, experimental design, and model evaluation to ensure accuracy and reliability. Drive best practices in MLOps, automation, and documentation for ...

Job Title Data Engineer Job Description Data Engineer at Operational Awareness Warehouse team within Digital Service Platform (DSP) Job Location Pune Vanderlande provides baggage handling systems for 600 airports around the globe, capable of moving over 4 billion pieces of baggage around the world per year. For the parcel market our systems handle 52 million parcels per day. All these systems generate data. Do you see a challenge in building data-driven services for our customers using that data? Do you want to contribute to the fast-growing Vanderlande Technology Department on its journey to become more data driven? If so, then join our Digital Service Platform stream! Your Position As a da...