23086 Pyspark Jobs - Page 28

Role Overview: Join EY, a globally connected powerhouse of diverse teams, to shape your future with confidence and build a better working world. As a Data Architect within the Data Analytics and AI team, you will play a pivotal role in enabling clients to derive significant value from their information assets by embedding innovative data analytics solutions. Your passion for leveraging data to solve complex problems and drive business outcomes will drive growth by developing client relationships and delivering exceptional customer experiences. Key Responsibilities: - Lead and mentor project teams across Microsoft Fabric, including data engineers, data architects, and Power BI developers, to ...

Role: Senior Data Engineer (Python, PySpark, SQL, AWS) Experience: 6–10 years Location: Hyderabad Work Mode: Hybrid (3 days/week in-office) Join Time: Immediate Must-Have Technical Skills: Strong programming skills in Python and/or Scala Hands-on experience with Apache Spark for big data processing on AWS cloud Proficiency with AWS services such as S3, Glue, Redshift, EMR, Lambda Strong SQL skills for data transformation and analytics Experience in Infrastructure as Code (IaC) using Terraform Expertise in setting up and managing CI/CD pipelines with Jenkins Responsibilities: Design, build, and optimize scalable data pipelines on AWS Implement data ingestion, transformation, and integration s...

Job Description Job Title: Data Engineer - PySpark, Python, SQL, Git, AWS Services – Glue, Lambda, Step Functions, S3, Athena. Job Description: We are seeking a talented Data Engineer with expertise in PySpark, Python, SQL, Git, and AWS to join our dynamic team. The ideal candidate will have a strong background in data engineering, data processing, and cloud technologies. You will play a crucial role in designing, developing, and maintaining our data infrastructure to support our analytics. Preferred Skills: Knowledge of data warehousing concepts and data modeling. Familiarity with big data technologies like Hadoop and Spark. AWS certifications related to data engineering. Join our team and ...

AWS Data Engineering Senior Solution Architect (Financial Domain) 📍 Location: Mumbai or Bangalore (India) 🕓 Experience: 10+ Years (5+ Years on AWS) 🏦 Domain: Banking, Insurance, FinTech, Capital Markets Key Responsibilities Architecture & Delivery Architect end-to-end AWS data platforms using S3, Redshift, Glue, EMR, Athena, Lambda, Lake Formation . Design scalable data lakes, real-time analytics solutions, and secure financial data ecosystems. Create reference architectures, best practices, and reusable solution frameworks. Client & Stakeholder Leadership Lead client workshops to gather business, data, and regulatory requirements. Translate business needs into detailed technical architectur...

You will be a part of the Analytics and Information Management (AIM) team at Citi's North America Consumer Bank - Data Science and Modeling team. Here is a breakdown of your role: **Role Overview:** You will work with large and complex data sets to evaluate, recommend, and support the implementation of business strategies. Your specialization will be in marketing and GEN AI. It is important to appropriately assess risk when making business decisions and adhere to compliance with laws and regulations. **Key Responsibilities:** - Work with large and complex datasets using tools like Python, PySpark, SQL, Hive, etc., to build Deep learning/generative AI solutions - Design, fine-tune, and implem...

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organisations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location: Pune , Chennai Mode Of W...

As a Consultant, Performance Analytics at Mastercard, your role involves translating data into insights by leveraging Mastercard and customer data to design, implement, and scale analytical solutions for customers. You will utilize qualitative and quantitative analytical techniques and enterprise applications to synthesize analyses into clear recommendations and impactful narratives. Key Responsibilities: - Provide creative input on projects across a range of industries and problem statements - Contribute to the development of analytics strategies and programs for regional and global clients by leveraging data and technology solutions to unlock client value - Collaborate with Mastercard team...

As a Data Engineer at Tanla, you will be responsible for developing, deploying, monitoring, and maintaining ETL Jobs and all data engineering and pipeline activities. Your expertise in SQL queries and DB solutions will be crucial for designing and constructing enterprise procedure constructs. Here is a breakdown of your key responsibilities: - Design and construct enterprise procedure constructs using any ETL tool, preferably PentahoDI - Provide accurate work estimates and manage efforts across multiple lines of work - Design and develop exception handling and data cleansing/standardization procedures - Gather requirements from various stakeholders related to ETL automation - Design and crea...

As a Senior Data Architect specializing in Google Cloud Platform (GCP), you will be responsible for engaging with clients, developing insightful content, and presenting solutions to diverse audiences. Your key responsibilities will include: - Understanding customers' data platform, business, and IT priorities to design data solutions that drive business value - Architecting, developing, and implementing robust, scalable, and secure data engineering, integration, and warehousing solutions in GCP platform - Assessing and validating non-functional attributes to ensure high levels of performance, security, scalability, maintainability, and reliability - Guiding technical teams in best practices ...

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location : Pune Mode Of Work : Hyb...

As an Azure Data Stack Senior Associate at Spaulding Ridge, you will be responsible for building and managing data solutions on Azure and Snowflake platforms. Your role will involve designing, developing, and optimizing data pipelines, implementing data models, and enabling advanced analytics and machine learning capabilities. Key Responsibilities: - Design and develop scalable data pipelines using Azure Data Factory, PySpark, and Snowflake. - Implement and manage Azure Synapse Analytics and Snowflake for data warehousing and analytics. - Configure and optimize Azure Data Lake Storage (ADLS) for structured and unstructured data. - Build and maintain Snowflake schemas, manage data sharing, an...

As an AI Incubator Data Scientist at Barclays, you will lead the evolution of the digital landscape, driving innovation and excellence by leveraging cutting-edge technology to enhance customer experiences. You will work within the Data Science team, particularly in the AI incubator, focusing on driving commercial value from data across the Corporate Bank. Your role will involve collaborating with senior stakeholders, developing machine learning models, applying AI to deliver commercial value, and leveraging AWS services for data transformation and AI product development. **Key Responsibilities:** - Build relationships with senior stakeholders to identify opportunities for adding value throug...

Role Overview: You will be responsible for designing and implementing data solutions using technologies such as PySpark, Spark SQL, and Power BI. As a Lead Python Data Engineer, you will play a key role in building and optimizing scalable data pipelines while ensuring data governance, security, and compliance in cloud environments. Key Responsibilities: - Utilize PySpark to build and optimize scalable data pipelines, including Spark SQL, DataFrames, and Datasets. - Work with Azure Databricks (Unity Catalog) to manage Delta tables, workflows, and script in Python. - Design and model data for Data Warehousing and Visualization projects through Semantic Layers. - Write complex SQL queries and b...

As a Data Engineer, you will be responsible for designing, developing, and optimizing end-to-end data pipelines using Databricks, PySpark, Delta Lake, and Azure components. Your key responsibilities include: - Building new pipelines from scratch and enhancing existing ones for scalability and performance. - Applying ETL design principles, data modeling, and governance standards. - Collaborating in an agile/scrum environment and delivering production-ready code. - Working with Azure services like ADLS, ADF, and Synapse. - Troubleshooting, debugging, and optimizing existing data pipelines. Your technical expertise should include: - 5-8 years of strong experience in Data Engineering with a focu...

You have a job opportunity where you will be required to have strong proficiency in Python for data processing and ETL tasks. Additionally, you need to possess advanced SQL skills, including query optimization, indexing, joins, and analytical functions. Hands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearch will be beneficial for this role. Your key responsibilities will include: - Working with Apache Spark/PySpark and handling data lakes effectively - Utilizing ETL and data ingestion tools such as Apache NiFi efficiently - Familiarizing yourself with messaging and streaming platforms like Kafka, RabbitMQ, and ActiveMQ - Implementing workflow orchestration using frameworks li...

As a Data Engineer specializing in Data bricks - Data bricks Integration, your role will involve designing, developing, and maintaining data pipelines to extract data from Oracle Symphony via APIs. You will then process and store this data in the Databricks Lakehouse platform and integrate it into Oracle EPM for Enterprise Performance Management. Your expertise in data integration, ETL/ELT, APIs, and Databricks will be crucial as you work closely with business stakeholders, architects, and analysts to ensure seamless data flow, transformation, and availability for financial planning, reporting, and analytics. Key Responsibilities: - Design and implement end-to-end pipelines from Oracle Symph...

Role Overview: As a Business Data Analyst with SQL skills and a data background, you will be responsible for offshore delivery from a technical perspective. Your role will involve guiding and mentoring data developers. You are expected to have a strong knowledge and experience with reporting packages, databases (SQL etc), and statistics. Your analytical skills will be crucial in collecting, organizing, analyzing, and disseminating significant amounts of information with attention to detail and accuracy. Additionally, you will work on integrating data from Compass, LMS, and Dynamics 365 while ensuring data lineage, governance, and quality compliance. Your expertise in Azure Data Factory, Data...

Job Description: You will be responsible for analyzing data using Databricks and Spark/PySpark in the Chennai location. Key Responsibilities: - Analyze large datasets to provide insights and make data-driven decisions - Develop and maintain data pipelines using Databricks and Spark/PySpark - Collaborate with cross-functional teams to ensure data quality and accuracy - Generate reports and visualizations to communicate findings effectively Qualifications Required: - Bachelor's degree in Computer Science, Statistics, or related field - Proficiency in using Databricks and Spark/PySpark for data analysis - Strong analytical and problem-solving skills - Excellent communication and teamwork abilit...

About Gap Inc. Our past is full of iconic moments — but our future is going to spark many more. Our brands — Gap, Banana Republic, Old Navy and Athleta — have dressed people from all walks of life and all kinds of families, all over the world, for every occasion for more than 50 years. But we’re more than the clothes that we make. We know that business can and should be a force for good, and it’s why we work hard to make product that makes people feel good, inside and out. It’s why we’re committed to giving back to the communities where we live and work. If you're one of the super-talented who thrive on change, aren't afraid to take risks and love to make a difference, come grow with us. Abo...

You have at least 8 years of working experience in Technology, focusing on application development and production support. Additionally, you possess a minimum of 5 years of experience in developing and supporting ETLs using Python, Databricks, and Pyspark. Your expertise includes working with Python, Spark, and Hive, as well as a solid understanding of data warehousing and data modeling techniques. You are also familiar with industry-wide visualization and analytics tools like Tableau and R. Furthermore, you demonstrate strong data engineering skills on the AWS cloud platform. Moreover, you have experience with streaming frameworks such as Kafka. You have at least 8 years of working experien...

Role Overview: Cisco ThousandEyes is a Digital Assurance platform that enables organizations to ensure flawless digital experiences across all networks, including those not owned by the organization. As a Site Reliability Engineering (SRE) Technical Leader on the Network Assurance Data Platform (NADP) team, you will be responsible for ensuring the reliability, scalability, and security of cloud and big data platforms. Your role will involve collaborating with cross-functional teams to design, influence, build, and maintain SaaS systems at a multi-region scale. Key Responsibilities: - Design, build, and optimize cloud and data infrastructure to ensure high availability, reliability, and scala...

As a Data Engineer in the Financial Crime Compliance (FCC) domain, your role is crucial in building and maintaining scalable, secure, and performant data infrastructure to support AML, KYC, transaction monitoring, and regulatory reporting workflows. Your collaboration with compliance analysts, product teams, and data scientists will ensure the availability of clean, reliable, and timely data for advanced analytics and operational reporting within the FCC space. **Key Responsibilities:** - **Data Pipeline Development:** Design, develop, and manage data pipelines for ingesting, transforming, and delivering financial and customer data. - **Domain-Specific Data Modeling:** Develop data models to...

Role Overview: Experian India is seeking a Product Engineer to join the Credit Bureau Technology team. As a Product Engineer, you will be involved in designing, developing, and maintaining scalable data pipelines and systems using AWS services. Your role will also include implementing data processing solutions, developing backend services and APIs, collaborating with cross-functional teams, and ensuring data quality and integrity. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and systems using AWS services - Implement data processing solutions using PySpark and Python - Develop and maintain backend services and APIs using Java - Collaborate with cross-function...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : PySpark Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation. As a Cust...

Why Join Iris? Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry ? Do you want to grow in an award-winning culture that truly values your talent and ambitions ? Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story . About Us At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transpo...