15947 Pyspark Jobs - Page 39

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Job Title - Data Engineer Location - Pune Let me tell you about the role A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technolo...

Design, develop, and deploy ML models in production Recommendation systems, pattern recognition, NLP, or time series modelling Production-grade Python, Java, or C/C++ Large-scale software architecture APIs and model versioning systems Azure ML CI/CD

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. American Express Function Description: Launched in 2012, Amex Offers is a digital advertising platform that connects Merchants and brands with the tens of millions...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Join Our Team and let's lead the way together. Function Description: Launched in 2012, Amex Offers is a digital advertising platform that connects Merchants and br...

Role Requirement: Credit Risk Job Summary: We are seeking a skilled professional with around 5 years of experience in credit risk assessment and analytics. The ideal candidate will possess strong analytical skills and the ability to present findings to senior business and analytics stakeholders effectively. The successful candidate will engage in comprehensive reviews across the first, second, and third lines of defense while utilizing analytical skills to model and assess product performance. Additionally, the candidate will have strong business knowledge, banking domain experience, and any experience in collections strategy will be an added advantage. Key Responsibilities: Deep understandi...

KPI Partners is seeking a skilled and experienced Senior Azure Data Engineer to join our dynamic team. As a key member of our engineering department, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. Your expertise will play a crucial role in transforming our data into actionable insights, contributing to our mission of delivering high-quality business intelligence solutions to our clients. Key Responsibilities: - Design and implement robust data pipelines using Azure Data Factory, Azure Databricks, and Azure SQL Database. - Work with large datasets to ingest, process, and analyze data from various sources. - Utilize Azure services for...

JD: Hands on experience in Design, develop & maintain data pipelines using PySpark & Python . First round of interview would be coding test related Python and pyspark . Provident fund

Overview Apply Data Warehouse and Cloud techniques to build data pipelines to provide data from different sources for our business, customer and Data Science team. This role offers many exciting challenges and opportunities: Emphasis is on managing end-to-end delivery of Data Contribute to how analytical approach is structured for specification of analysis Contribute insights from conclusions of analysis that integrate with initial hypothesis and business objective. Independently address complex problems Participate in design of analysis and modelling approach with managers and modelers This is a role that requires exceptional programming skills, proven technical leadership, ability to colla...

Job Description Summary Cushman & Wakefield is seeking a motivated Azure Data Engineer to join the Data Engineering & Analytics team. In this early-career role, you will support the design, development, and optimization of data pipelines on Azure to drive key business initiatives. Working under the guidance of senior engineers and architects, youll gain hands-on experience with modern data tools while contributing to high-impact, enterprise-scale projects. This is an excellent opportunity for professionals eager to grow their skills in a collaborative, client-centric environment that values innovation and data-driven decision-making. About The Role: Design, develop, and manage scalable cloud...

Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETL Interested candidates can share their resume with the following details to navaneetha@suzva.com Current CTC Expected CTC Location

WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients, and communities. Working at WPP means being part of a global network of more than 100,000 talented people dedicated to doing extraordinary work for our clients. We operate in over 100 countries, with corporate headquarters in New York, London and Singapore. WPP is a world leader in marketing services, with deep AI, data and technology capabilities, global presence and unrivalled creative talent. Our clients include many of the biggest companies and advertisers in the world, including approximately 300 of the Fortune Global 500. Our people are the key to our succ...

Job Role: AWS Data Engineer Experience Required: 5 to 10 years Shift time: 2pm to 11pm IST (Hybrid) Location: Chennai, Pune, Bangalore, Hyderabad Job Description: Seeking a developer who has good Experience in Athena, Python code, Glue, Lambda, DMS , RDS, Redshift Cloud Formation and other AWS serverless resources . Can optimize data models for performance and efficiency. Able to write SQL queries to support data analysis and reporting Design, implement, and maintain the data architecture for all AWS data services. Work with stakeholders to identify business needs and requirements for data-related projects Design and implement ETL processes to load data into the data warehouse Good Experienc...

PURPOSE OF THE JOB: The purpose of the job is to develop through iterative process data Integration and analytics solutions. Develop data products answering to Projects/Customer needs, from the data ingestion to ML productization. You will Build data analytics solutions, developing Data applications (Data ingestion, Cleaning, data processing, etc.) to provide state-of-the-art advanced analytic and quantitative tools and modelling techniques to derive business insights, solve complex business problems and improve decisions. Reporting to the Data Architect, the role will develop, support and advice on the day-to-day Data platform, Data processing and Data analytics requirements of Business are...

What can you expect? As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines and AI Based solution using Databricks. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Youll work on cutting-edge cloud and hybrid data projects, transforming raw data into meaningful insights and AI Analytics. Youll be hands-on from day one, collaborating closely with architects and business stakeholders. What is in it for you? Hybrid way of working Diversify your experience and learn new skills Opportunity to work with stakeholders glo...

About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 300+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll be out in the open water, shaping the future with brilliant minds. At ProcDNA, innovation isn't just encouraged; it's ingrained in our DNA. Ready to join our epic growth journey? What we are looking for Youll be driving the adoption of the latest technologies in our solutions, bringing in thought leadership to guide clients on complex dat...

Role & responsibilities Write and execute queries GCP Big query and execute along with analysis in ETL and DB testing, Data migration, Report validations Expert in writing/understanding complex SQL queries Building high test strategy to match design specifications , standards, and user requirements and testing components in an iterative manner through an Agile process. Design and execute test cases in a Big Data environment Preferred candidate profile Must-Have Hands-on experience in ETL and DB testing, Data migration, Report validations GCP Big Query knowledge Pyspark /Python experience Expert in writing/understanding complex SQL queries Advanced knowledge if Bigdata concepts and technologi...

Job Title: MLOps Engineer Location: Ghansoli, Navi Mumbai Experience: 4–8 Years Notice Period: Immediate joiners preferred or within 15 days Job Description: We are seeking a skilled MLOps Engineer with hands-on experience in Azure, Databricks, and DevOps to design, automate, and maintain ML pipelines and production-ready models. The ideal candidate will have strong experience in ML pipeline automation, cloud infrastructure, model governance, and monitoring to ensure scalable, robust, and compliant ML solutions. Key Responsibilities: ML Pipeline Design & Automation Build and maintain CI/CD & CT (Continuous Training) pipelines for ML models using Azure DevOps and Databricks Asset Bundles . Au...

Kindly find the Job Description Below. Job Title:Technical Lead- Data Engineer Location: Bangalore Years of Experience: 8+ years of experience Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer. As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. We are looking for a skilled Data Engineer with 6+ years of experience in big da...

We are seeking a highly skilled and experienced Data Scientist to join our team based in Bangalore. As a Data Scientist, you will play a critical role in developing and implementing AI/ML solutions. You will be responsible for utilizing your expertise in Python, SQL, and various frameworks like Scikit Learn, TensorFlow, and PyTorch to deliver production-grade AI/ML projects. The ideal candidate will have 2+ years of experience in Data Science, AI/ML, and a solid understanding of mathematical and statistical concepts. Experience in the US Healthcare domain and knowledge of Big Data and data streaming technologies are desirable. Primary Responsibilities: Develop and implement AI/ML solutions u...