23086 Pyspark Jobs - Page 20

About The Role Project Role : Test Automation Lead Project Role Description : Lead the transformation of testing into a continuous and efficient end-to-end quality engineering function through the use of quality processes, tools, and methodologies significantly improving control, accuracy and integrity. Evolve more predictive and intelligent testing approaches based on automation and innovative testing products and solutions. Must have skills : AWS BigData Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Test Automation Lead, you will lead the transformation of testing into a continuous and efficient e...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Airflow Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating efficient data pipelines, ensuring the integrity...

SUMMARY Wissen Technology is Hiring for Databricks Developer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qua...

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. Responsibilities Include, But Not Limited To Design, develop, and deploy machine learning models for predictive, prescriptive, and generative tasks using advanced statistical, ML, Deep Learning and analytical techniques. Architect and lead the end-to-end development of ML & Agentic workflows from concept to production. Build and operationalize agentic workflows capable of autonomous decision-ma...

About Position: As a Data Analyst Reporting & Data Analytics, you will drive insights by analyzing and rationalizing enterprise reports. You'll collaborate with cross-functional teams to understand reporting needs and translate them into technical solutions. Leveraging tools like SQL, PySpark, Power BI, and Databricks, you'll ensure data accuracy and impactful visualizations. Your role bridges business requirements with data engineering to enable informed decision-making. Role: Data Analyst Location: Mumbai Experience: 4 to 7 Years Job Type: Full Time Employment What You'll Do: Develop and optimize SQL and PySpark queries to extract, transform, and analyze data from Databricks and other data...

Job Description : Requirements: A minimum of 5+ years of experience in managing and developing solutions on the Azure data platform. Extensive experience with Azure Data Factory, SQL Server database design, and ETL processes. Primary Skills : Proven experience in Microsoft Fabric for data integration, orchestration, and analytics. Strong proficiency in PySpark for scalable data transformation and processing. Expertise in Azure Databricks and Spark SQL for advanced ETL and data modeling. Strong hands-on knowledge of Azure Synapse Analytics for warehousing and analytical workloads. Proficiency in SQL and relational databases, with focus on performance tuning and query optimization. Solid under...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Data Engineer/Backend Developer with deep knowledge on Databricks or MS Fabric, you will design, develop, and maintain scalable data pipelines and systems using Databricks/Fab...

Position Description Company Profile: Were Hiring at CGI for our GCC Right Here in Hyderabad! Join us at the intersection of technology, finance, and innovation You will be working to support the PNC Financial Services Group, one of the top-tier financial institutions in the U S Youll help shape digital solutions for a global enterprise?from the ground up, This is more than a job Its your opportunity to: Work on cutting-edge technologies Collaborate with global teams Build a career with purpose and impact Ready to build the future of bankingLets talk, Job Title: Lead Analyst Lead Bigdata Developer with Python, PySpark & SQL Position Title: Lead Analyst Lead Bigdata Developer with Python, PyS...

Role: PySpark Engineer Experience Required: Minimum 5-10 Years Work Location: Hyderabad (5 Days Work from Office) Job Type: Contract to Hire (1 Year/ Renewable) Notice Period: Immediate to 30 Days max Required skill sets and expertise: 5+ years of experience in PySpark, Big Data technologies, Data Warehousing. Strong Python programming experience. Domain: Experience working within a financial institution is strongly preferred. Job Type: Contractual / Temporary Contract length: 12 months Pay: ₹600,000.00 - ₹2,500,000.00 per year Application Question(s): Are you open for 1 Year Renewable Contract Role & ready to work 5 Days from office in Hyderabad? What is your Current Location? What is your ...

Role: QA Automation Tester Experience Required: Minimum 5+ Years Work Location: Hyderabad (5 Days Work from Office) Job Type: Contract to Hire (1 Year/ Renewable) Notice Period: Immediate to 30 Days max Required skill sets and expertise: Experience in Data Platform testing including Data Validation, comparison and scenario execution. Must be able to perform Automation using PySpark and write Python scripts. Data testing (large datasets), Recovery testing. Job Type: Contractual / Temporary Contract length: 12 months Pay: ₹500,000.00 - ₹2,500,000.00 per year Application Question(s): Are you open for 1 Year Renewable Contract Role & ready to work 5 Days from office in Hyderabad? What is your Cu...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transforma...

Role & responsibilities Total Experience > 6 Years with 4 Years of relevant Experience Should have working experience . Development: Python(preferred) or Pyspark or Scala & with Spark Framework Cloud: AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS) DevOps & IaC tooling : Terraform, CI/CD pipelines, Git Python (preferred) or PowerShell scripting SonarQube and Veracode. Proficiency with automated testing tools (e.g. Pytest, Scalates). Knowledge of RESTful and microservice architectures.

Principal Digital Solutions Consultant - BAN00TN Company : Worley Primary Location : IND-KR-Bangalore Job : Digital Solutions Schedule : Full-time Employment Type : Employee Management Level : Individual Contributor Job Posting : Nov 17, 2025 Unposting Date : Dec 17, 2025 Reporting Manager Title : Senior General Manager : We deliver the world’s most complex projects. Work as part of a collaborative and inclusive team. Enjoy a varied & challenging role. Building on our past. Ready for the future Worley is a global professional services company of energy, chemicals and resources experts headquartered in Australia. Right now, we’re bridging two worlds as we accelerate to more sustainable energy...

Site Name: Bengaluru Luxor North Tower Posted Date: Nov 17 2025 Job Summary The Cyber Security organization at GSK is seeking a highly skilled and experienced Principal Data Engineer to focus on cyber data analytics . This role is integral to enabling data-driven insights for our metrics and data science teams, ensuring the secure and efficient handling of data within the Microsoft Azure ecosystem , particularly Databricks . The Principal Data Engineer will play a key role in designing and managing data workflows for ingestion, transformation, and preparation while collaborating with senior stakeholders and mentoring junior team members. This role is focused on ensuring high-quality, scalabl...

Job requisition ID :: 92047 Date: Nov 17, 2025 Location: Bengaluru Designation: Consultant Entity: Deloitte Touche Tohmatsu India LLP Technology and Transformation - EAD-ADMM-Data Integration| Consultant- Bengaluru Your potential, unleashed. India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond. At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matte...

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi! Job Title: Architect – Data (Azure Databricks) Experience: 10+ Years Location: Bangalore - Hybrid About the Role: We are seeking a highly experienced Data Architect with deep expertise in Azure Databricks and the broader Azure data ecosystem to lead the design and implementation of scal...

Minimum 8+ years of working experience in Technology (application development and production support) and Minimum 5+ years of experience in developing & supporting ETLs and using Python/Scala in Databricks/Spark platform.

Description: Senior Data Engineer (Spark & Lakehouse) Location: Remote, India (Preferred: Bangalore/Pune) Experience: 6+ Years Domain: Data Engineering / Big Data About the Role: We are seeking a Senior Data Engineer to drive the development of our next-generation Data Lakehouse architecture. You will be responsible for designing, building, and optimizing massive-scale, low-latency data pipelines that support real-time analytics and Machine Learning applications. Key Responsibilities: - Design and build highly optimized, production-grade ETL/ELT pipelines using Apache Spark (PySpark/Scala) to process petabytes of data. - Architect and manage the Data Lakehouse using open-source technologies ...

We are a technology consulting firm operating in Cloud Data Engineering and Analytics, helping enterprise customers build reliable, scalable data platforms and analytics products. Our teams deliver end-to-end data lakes, real-time streaming pipelines, and production-grade ML feature stores using Databricks and modern cloud data tooling. Role & Responsibilities : - Design, build, and maintain scalable batch and streaming ETL pipelines on Databricks using Delta Lake and Delta Live Tables (DLT). - Develop and optimize Spark/PySpark jobs for performance, cost-efficiency, and reliability; tune cluster sizing and autoscaling policies. - Implement data quality, observability, lineage and monitoring...

Job Requirements At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster. Role Overview We are seeking an experienced Fabric Data Engineer with strong hands-on skills in Fabric pipelines, ADLS Gen...

Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical day will involve collaborating with team members to ensure the successful implementation of software solu...

Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. At Delphi Consulting Pvt. Ltd. , we foster a thriving environment with a hybrid work model that lets you prioritize what matters most. Interviews and onboarding are conducted virtually, reflecting our digital-first mindset . We specialize in Data, Advanced Analytics, AI, Infrastructure, Cloud Security , and Application Modernization , delivering impactful solutions that drive smarter, efficient futures for our clients. About the Role: We are looking for an experienced and highly skilled Senior Azure Data Engineer to join our team. ...