23086 Pyspark Jobs - Page 32

About The Role Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a BI Engineer, you will develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Your typical day will involve collaborating with various teams to ensure the integration of security and data privacy protection...

About The Role Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a BI Engineer, you will engage in the development, migration, deployment, and maintenance of data-driven insights and knowledge engine interfaces. Your typical day will involve collaborating with various teams to ensure that the solutions you create drive adoption and informed decisio...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education , Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with team members to ...

About The Role Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a BI Engineer, you will engage in the development, migration, deployment, and maintenance of data-driven insights and knowledge engine interfaces. Your typical day will involve collaborating with various teams to ensure that the solutions you create drive adoption and informed decisio...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – MS Fabric – Senior The opportunity We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT proces...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Description For Data Scientist Objectives and Purpose The Lead Data Scientist is responsible for applying expertise and best practices in full-stack data science capabilities including advanced data analytics, statistical modeling (AI/ML), MLOps, data engineering, and data visualization to develop data-driven solutions to enable business ...

Embark on an exciting journey into the realm of data engineering and architecture with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. As a Data Architect you will be at the heart of the organization and support our clients to take control of their data and get value out of it by defining a reference architecture for our customers. This means that you will work closely with business leaders and information management teams to define and implement a roadmap on data architecture, data management, business intelligence or analytics solutions.. Minimum Qualifications: Translate business requirements into data requests, reports and dashboards. Stro...

Lead – Supply Chain Analytics Hub Location: Gurugram, India (initial) → Kuala Lumpur, Malaysia (future transition) Are you a data-driven supply chain leader ready to drive digital transformation across a global FMCG network? Nestlé is seeking a Supply Chain Analytics Lead to build and scale our Analytics Hub, driving end-to-end data and digital solutions from India, with a transition to our Malaysia Hub. About The Role This leadership role sits at the intersection of technology, analytics and supply chain strategy, driving innovation and visibility across Nestlé’s global network. You’ll lead a team of data scientists, analysts and programmers to deliver advanced analytics tools, create scala...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

Job Description DataEngineer/BI developer -ETL and ELT pipelines using AzureDataFactory and MicrosoftFabric, SQL , Chennai/Pune India R25_0018536|IN Who you are: You have sound judgement, keen eye for details and tenacity for solving difficult problems. Strong analytical skills and use of data for sound decision-making. You bring a positive energy to the team and thrive on strong collaboration. You strive for constant improvement in both you and the team You are someone others look to for solving difficult problems, bounce ideas off and providing an alternate viewpoint. You actively keep informed of industry developments to make use of new and emerging tools and technologies You will be invo...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – MS Fabric – Senior The opportunity We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT proces...

Job Description Azure Data Engineer (Python | PySpark | Gen AI) Experience: 10–14 Years Location: Bangalore / Chennai Notice Period: Immediate to 15 Days (preferred) Role Overview: We are looking for a highly skilled Azure Data Engineer with strong hands-on experience in Python, PySpark, Azure data ecosystem , and basic knowledge of Generative AI . The ideal candidate should have deep expertise in building scalable data pipelines, implementing modern data platforms, and supporting AI-driven data initiatives. Key Responsibilities: Design, develop, and optimize data pipelines using Azure Data Factory, Databricks, Python, and PySpark . Build and maintain ETL/ELT workflows for large-scale data p...

Role Description Job Description We are looking for a skilled Big Data QA Engineer to join our team and ensure the quality and reliability of our data processing pipelines. This role involves designing and executing both automated and manual tests for batch workflows, validating data integrity across transformation stages, and maintaining a robust Python-based test automation framework. The ideal candidate will have hands-on experience with AWS services, big data formats, and a strong understanding of testing methodologies in a data-centric environment. Preferred Skills And Experience Design, develop, and execute automated and manual batch test cases for data processing pipelines. Validate d...

Role Description Role Proficiency: Performs tests in strict compliance independently guides other testers and assists test leads Outcomes Construct test scenarios based on customer user stories or requirements Construct systematic test cases from scenarios for applications based on customer user stories or requirements Execute systematic test cases from scenarios for applications based on customer user stories or requirements Ensure that new or revised components or systems perform to expectation. Ensure meeting of standards; including usability performance reliability or compatibility. Document Test results and report defects Facilitate changes in processes/practices/procedures based on les...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – MS Fabric – Senior The opportunity We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT proces...

Job Title- Data Engineer Exp- 4 - 9 yrs Location- Jaipur / Remote Immediate joiners preferred Job Summary: We are looking for a skilled Data Engineer with at least 3 years of hands-on experience in data engineering, specializing in Databricks and DBT (Data Build Tool) . The ideal candidate will be responsible for building and optimizing data pipelines, transforming raw data into structured formats, and collaborating with data analysts and scientists to support data-driven decision-making. Key Responsibilities: Design, build, and maintain scalable and reliable data pipelines using Databricks and DBT . Develop and maintain ETL/ELT processes to ingest, transform, and load data from various sour...

Role & responsibilities Job Description : Sr. GCP Data Engineer Experience : 5 to 13 Years Work location : Chennai, Bangalore, Hyderabad, Pune-Hybrid Shift Timing : 2 to 11 PM I nterview proces s : L1 and L2 round Job description: 5+ years experience Should have experience in GCP BigQuery, DataProc(PySpark) Good to have experience on Informatica Preferred candidate profile Share your update resume on Nikita.solunke@ascendion.com and Do revert with below mentioned details. 1) Total year of experience- 2) Relevant year of experience- 3) Current CTC- 4) Expected CTC- 5) Notice Period- 6) Current Location- 7) Preferred Location-

Role Description Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintai...

Role Description Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintai...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – MS Fabric – Senior The opportunity We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT proces...

Trusted by many of the largest companies globally, Accertify is the leading digital platform assessing risk across the entire customer journey, from Account Monitoring and Payment Risk to Refund Fraud and Dispute Management. Accertify helps maximize revenues and user experience while minimizing loss and customer friction. We offer ultra-fast decision-making and precise control, ensuring our customers are always confidently in the driver’s seat and ready to #MoveAtTheSpeedOfRight. Be in the driver’s seat of your career as a Decision Science Analyst with the industry leader- and build a career you can trust. As part of the Accertify Fraud Decision Sciences team, you will be responsible for bui...

ETL Specialist – Mumbai Experience: 5–6 Years Location: Mumbai (Onsite) Job Description We are hiring an ETL Specialist with strong skills in PySpark, Python, SQL, Hive, Kafka, and GCP BigQuery . The candidate will build and maintain scalable ETL/ELT pipelines, manage big data processing, and work with streaming and batch workloads. Key Responsibilities Develop ETL/ELT pipelines using PySpark, Python, SQL . Handle data ingestion/transformation from Hive, Kafka, GCP . Orchestrate pipelines using Apache Airflow . Work on large-scale big data systems. Implement data quality checks and monitoring. Collaborate with data/analytics teams for business use cases. Optimize workflows for performance an...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

Technical Req: Shift -No 1. Understand the functional requirements and convert the same