23086 Pyspark Jobs - Page 42

About the Role We are seeking a Lead GCP Data Engineer to design, build, and optimize scalable data platforms and pipelines on Google Cloud Platform (GCP) . Youll lead a team of data engineers, drive data architecture decisions, and ensure the reliability and performance of our data infrastructure supporting analytics, AI/ML, and business intelligence initiatives. Key Responsibilities Lead the design and implementation of end-to-end data pipelines using GCP services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer, etc.). Architect and optimize data lake and data warehouse solutions for scalability and performance. Define and implement data ingestion, transformation, and integration st...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

Data Eng Mandatory Skills Required : ADB, ADF, Deltalake/Datalake and Pyspark, Data Modelling and Optimization, Unity Catalog Experience Required: 6+ years of relevant experience Location : Bengaluru/Trivandrum Notice Period : Immediate joiners to 30 days Key Responsibilities Design, develop, and implement end-to-end data pipelines across various sources and destinations. Lead and support data migration initiatives from legacy to modern data platforms. Develop robust ETL/ELT workflows using Azure Data Factory. Write clean, efficient, and scalable code in Python or PySpark for data transformation and automation. Utilize SQL for complex querying, data manipulation, and performance tuning. Coll...

Cognizant Hiring For Big data Engineer!!! Years of Experience: 8-12 Years Skills: Big Data Engineer with primary skills - Pyspark, Azure Synapse, ADF, Bigdata, SQL Job Location: PAN India Interview Mode: Video discussion

TECHNICAL SKILLS : Python, SQL, Data Warehouse concept, Data Modeling GCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions) Docker, Kubernetes, Github Microservices and Serverless Architecture Designing scalable, secure, and cost-optimized cloud solutions Infrastructure as Code (IaC) using Terraform Cloud security principles and identity & access management (IAM) Python, SQL, Data Warehouse concept, Data Modeling GCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions) Docker, Kubernetes, Github Microservices and Serverless Architecture Designing scalable, secure, and cost-optimiz...

hackajob is collaborating with UnitedHealth Group to connect them with exceptional tech professionals for this role. Data Analyst Requisition Number: 2299804 Job Category: Business & Data Analytics Primary Location: Hyderabad, Telangana, IN Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities ...

Big Data Engineer Location: Pune/Nagpur (WFO) Experience Required: 8+ Years **Long term onsite to Abu Dhabi** Job Summary : We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability. Key Responsibilities: • Design, develop, and maintain data pipelines using PySpark and related Big Data technologies. • Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem. • Write efficient HiveQL and SQL queries to handle large-scale datasets. • Perform performance tuning and optimization of...

4+ years of experience in data analytics role using Pyspark, Python & SQL Proficient in Excel and PPT and can work hands-on

Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins. Why join Coupa? 🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend. 🔹 Collaborative Culture: We value collaboration and teamwork, and our cult...

Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins. Why join Coupa? 🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend. 🔹 Collaborative Culture: We value collaboration and teamwork, and our cult...

About Business Unit: Powerful predictors of the future - our Analytics team seamlessly blends data science and business intelligence to provide unparalleled foresight for our platform offerings. They turn insights into actionable results for our clients by collaborating with senior team members and staying ahead of market trends, powered by our data assets. By using new-age analytic tools and emerging technologies, the team cultivates a dynamic learning environment for curious minds to thrive. Who we are looking for? At Epsilon, our people use real human insights to find solutions that empower some of the biggest brands in the world. Our team is now growing, and we are on the lookout for ded...

EY GDSData and Analytics - D and A – Azure Data Engineer We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your key responsibilities Develop & deploy azure databricks in a cloud environment using Azure Cloud services ETL design, development, and deployment to Cloud Service Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams Design and optimize model codes for faster execution Skills and attributes for success 3 to 8 years of Experience in...

Hi Hope you are doing good, This is Rahul from Aveto Consulting, we have a vacancy for the Data Engineer – Remote, Let me know your Interest. Job title: Data Engineer – Digital & Analytics Platform (GA4 + Cloud + BI Enablement) Location: Remote Duration -6months Contract Only immediate joiner (Within 20days) Years of experience - 6 to 8years Overview Data Engineer who combines engineering precision with analytical curiosity. The Data Engineer will design and automate pipelines that integrate digital behavior data (GA4 / clickstream) with transactional and operational data into a unified analytics layer. The role requires strong understanding of BigQuery, Databricks , and ELT automation frame...

JOB DESCRIPTION SOLUTION ARCHITECT Experience Level: Senior Level Experience Required: 10+ Years About Us: Celebal Technologies is a leading Solution Service company that provide Services the field of Data Science, Big Data, Enterprise Cloud & Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As part of our commitment to staying ahead in the industry, we are seeking a talented and experienced Data & AI Engineer with strong Azure cloud competencies to join our dynamic team. Overview: As a Data Architect you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tool...

Hi, Exp: 7-12 Years Must have skills ML , AWS , Python , MI Ops Secondary skills Pyspark , Air flow , Jenkins , cloud formation, Deep learning If interested please share resume at deepika.eaga@quesscorp.com

Job Title: Senior Data Analyst / Data Analytics Specialist Location: EXL Services Experience Level: 4+ Years Industry: Banking / Financial Services Department: Data Management Job Overview We are seeking a highly skilled and experienced Data Analyst/Data Analytics Specialist to join our company. This role is ideal for someone with a strong background in Python, PySpark, SQL, Tableau, and advanced data analytics, including experience with classification and regression algorithms. The ideal candidate will have a solid understanding of the banking domain mainly Home Equity, be an excellent communicator, and possess a passion for transforming data into actionable insights. Key Responsibilities D...

About mPrompto At mPrompto, we’re redefining how businesses engage with their customers by building an AI-powered Conversion Co-Pilot. Our mission is to help brands optimize customer journeys, increase conversions, and deliver personalized experiences to their customers on their web properties. We’re a fast-growing B2B tech startup with strong founders backed by engineering and AI/ML expertise — and we’re looking for a passionate Full-Stack Engineer who is excited to build innovative AI-driven products at scale. About the Role As a Full-Stack Engineer , you will play a pivotal role in building the core mPrompto platform from backend services and data pipelines to frontend interfaces and AI-i...

Looking for 5+ Years of experience notice period- immediate to 60 days Skill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow

Designation: Assistant Manager - Data Science. Level: L3 Experience: 5 to 10 years. Location: Chennai, Tamil Nadu , India. Job Description: We are looking for a skilled Data Scientist and Data Engineer to join our team, which is a mix of Data Science and Data Engineering professionals. The ideal candidate will have hands-on experience with large-scale data processing, ETL/ELT pipeline development, and cloud-based data architectures, along with a strong foundation in analytics, statistical modeling, and machine learning. This role is ideal for someone who thrives in a fast-paced, data-rich environment, and is passionate about leveraging modern data science and engineering tools to enable data...

Job Description Job Title: Pyspark Lead Developer Req Id: 111187 City: Pune State/Province: Maharashtra Posting Start Date: 11/13/25 Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thriv...

Location: Bangalore - Karnataka, India - EOIZ Industrial Area Job Family: Artificial Intelligence & Machine Learning Worker Type Reference: Regular - Permanent Pay Rate Type: Salary Career Level: T3(B) Job ID: R-49648-2025 Description & Requirements Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.5+ yrs. experience in data engineering roles.3+ years of experience in DWH/ETL Domain using AWS tech stack such as Redshift, S3, Glue, Lambda and IAM.Proficiency in PySpark/Python/SQL and designing data models and data standards.Deep understanding of ETL/ELT processes, data warehousing concepts, and big data technologies.Experience building & managing data...

A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to lead the engagement effort of providing high-quality and value-adding consulting solutions to customers at different stages- from problem definition to diagnosis to solution design, development and deployment. You will review the proposals prepared by consultants, provide guidance, and analyze the solutions defined for the client business problems to identify any potential risks and issues. You will identify change Management requirements and propose a structured approach to client for managing the change using multiple communication mechanisms. You will also coach and create a vision for ...

Job Title: Data Developer (Python/PySpark/Big Data Platforms) We are looking for a skilled Data Developer to design, build, and maintain efficient and scalable ETL/ELT data pipelines. The ideal candidate will have hands-on experience with Python or PySpark, data integration, and modern big data platforms. You will work closely with data engineers, analysts, and stakeholders to ensure reliable and high-quality data delivery across systems. Key Responsibilities Design, develop, and maintain efficient and scalable ETL/ELT data pipelines using Python or PySpark. Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver technical data solutions. P...

Description Strong proficiency in Python for data processing and ETL Advanced SQL skills, including query optimization, indexing, joins, and analytical functions Hands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearch Proficiency in Apache Spark/PySpark and working with data lakes Experience with ETL and data ingestion tools such as Apache NiFi Familiarity with messaging and streaming platforms like Kafka, RabbitMQ, and ActiveMQ Experience with workflow orchestration frameworks such as Apache Airflow Exposure to cloud platforms (AWS, GCP, or Azure) and their data services (S3, Redshift, BigQuery, Dataproc, etc.) Understanding of data warehousing, data modeling, and performance...

About The Role We are looking for a Machine Learning Scientist to join our Payments Machine Learning team and make meaningful contributions to our mission to streamline and optimize Uber's global payment experiences. In this role, you will be able to use your strong quantitative skills in the fields of machine learning, statistics, economics, operations research to improve the Uber Payments experience. Example projects we work on include optimizing transaction routing and automated retry strategies to improve payment authorization success rates and rider/eater conversion. We are looking for experienced candidates with a passion for solving new and difficult problems with data. In this role, ...