15947 Pyspark Jobs - Page 44

Department: Quality Assurance Employment Type: Full Time Location: India Description Shape the Future of Work with Eptura At Eptura, we're not just another tech company—we're a global leader transforming the way people, workplaces, and assets connect. Our innovative worktech solutions empower 25 million users across 115 countries to thrive in a digitally connected world. Trusted by 45% of Fortune 500 companies, we're redefining workplace innovation and driving success for organizations around the globe. Job Description We are seeking a detail-oriented and experienced QA Engineer to join our team, specializing in ETL testing and data validation. In this role, you will design and execute compr...

Note: Please do not apply if your salary expectations are higher than the provided Salary Range and experience less than 3 years. If you have experience with Travel Industry and worked on Hotel, Car Rental or Ferry Booking before then we can negotiate the package. Company Description: Our company is involved in promoting Greece for the last 25 years through travel sites visited from all around the world with 10 million visitors per year such www.greeka.com, www.ferriesingreece.com etc Through the websites, we provide a range of travel services for a seamless holiday experience such online car rental reservations, ferry tickets, transfers, tours etc….. Role Description: We are seeking a highl...

Role Description Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes...

If you're ready to lead with ownership and precision, and have a knack for turning vision into reality, the Home Lending Data Testing team is looking for a Product Manager to spearhead customer-centric development, inspiring groundbreaking solutions, and shaping the future with your strategic vision, influence, and execution. **Key Responsibilities:** - Lead a team of automation engineers to contribute to strategic data automation planning and tactical build/execution of data testing across a diverse application suite. - Mentor and inspire a team of data automation engineers and leads, fostering a culture of innovation and excellence. - Design and develop high-volume, low-latency tools to su...

As a Lead Data Engineer at the company located in Indore, Madhya Pradesh, you will be an integral part of the dynamic team, leveraging your extensive experience and expertise in PySpark, Azure Data Bricks, Azure Data Factory, SQL, and Power BI. Your primary responsibility will involve designing, constructing, and managing scalable data solutions vital for various projects. Your role will encompass data architecture, pipeline development, and ensuring data governance across initiatives. - Lead the creation and enhancement of robust data pipelines using Azure Data Factory and PySpark - Build scalable data solutions and workflows within Azure Databricks - Write efficient SQL queries for data ma...

Who You'll Work With Driving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture - doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward. In return for your drive, determination, and curiosity, we'll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleagues—at all levels—will invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you'll receive apprenticeship, coaching, and...

Analyst GNS Bespoke Consulting with the Global Strategy, Operations & Performance team, GMNS At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Global Merchant & Network Services (GMNS), the merchant and bank partn...

As a Data Engineer, your role is crucial for ensuring the smooth operation of the Data Platform in Azure/AWS Databricks. You will be responsible for the continuous development, enhancement, support, and maintenance of data availability, data quality, performance enhancement, and stability of the system. **Key Responsibilities:** - Designing and implementing data ingestion pipelines from various sources using Azure Databricks - Ensuring the efficient and smooth running of data pipelines and adhering to security, regulatory, and audit control guidelines - Driving optimization, continuous improvement, and efficiency in data processes **Qualifications Required:** - Minimum of 5 years of experien...

As a Full Stack Developer at Kognosdata, you will be part of a dynamic team where learning is at the core of our culture. Every team member is encouraged to grow together by taking on hands-on challenges, utilizing a wide range of technology stacks, and engaging in open collaboration. Real-time mentorship and knowledge sharing are key aspects of our close-knit environment. Here, enhancing your skills is not an option but an integral part of the job. **Key Responsibilities:** - Collaborate with development teams and product managers to create software solutions - Design efficient client-side and server-side architectures for optimal performance - Develop user-friendly front-end applications w...

Role Overview: As an AWS Senior Data Engineer at our company, you will be responsible for building scalable data solutions on the AWS cloud platform, working with large datasets, and optimizing data pipeline efficiency. Your role will involve designing, developing, and maintaining data pipelines and ETL processes using AWS services such as Glue, Lambda, and Redshift. You will collaborate with business and analytics teams to deliver reliable, production-ready data solutions while implementing best practices in data modeling, governance, and security. Troubleshooting and resolving performance bottlenecks in data systems will also be a part of your responsibilities. Key Responsibilities: - Desi...

As a Lead Data Engineer at Mastercard, you will be a key player in the Mastercard Services Technology team, responsible for driving the mission to unlock the potential of data assets by innovating, managing big data assets, ensuring accessibility of data, and enforcing standards and principles in the Big Data space. Your role will involve designing and building scalable, cloud-native data platforms using PySpark, Python, and modern data engineering practices. You will mentor and guide other engineers, foster a culture of curiosity and continuous improvement, and create robust ETL/ELT pipelines that integrate with various systems. - Decompose complex problems into scalable components aligned ...

As a Senior Product Delivery Vice President in the WLS AI Delivery team, you will ensure the stable and scalable delivery of AI solutions. You will work with cross-functional teams, build key relationships, and enable the product to continuously deliver value. Your passion for the mission of delivering intelligent solutions that address customer needs and assist employees will be crucial. - Define and oversee the product vision, roadmap, and development plans, ensuring alignment with business growth targets and risk management objectives - Drive the entire product lifecycle, from ideation and planning through execution and future enhancements - Mentor product teams on industry best practices...

As a skilled Data Engineer with 5+ years of experience, you will be responsible for designing, implementing, and maintaining robust, scalable data architectures on AWS. Your expertise in PySpark and experience with AWS cloud data services such as S3, Glue, and Redshift will be crucial in enabling seamless data flows and efficient ETL pipelines across the cloud infrastructure. Key Responsibilities: - Design, implement, and maintain scalable and robust data architectures on AWS. - Utilize AWS services like S3, Glue, and Redshift for data storage, processing, and analytics. - Develop and implement ETL processes using PySpark for data extraction, transformation, and loading into AWS storage solu...

Role Overview: You will join NTT DATA as a Business Consulting-Technical Analyst with expertise in ETL and GCP using PySpark. Your main responsibility will be designing, implementing, and optimizing data pipelines on GCP using PySpark for efficient and scalable data processing. Additionally, you will build and maintain ETL workflows for extracting, transforming, and loading data into various GCP services. Key Responsibilities: - Design, implement, and optimize data pipelines on GCP using PySpark for efficient and scalable data processing. - Build and maintain ETL workflows for extracting, transforming, and loading data into various GCP services. - Leverage GCP services like BigQuery, Cloud S...

You are being considered for the positions available at CMS Computers Limited in Mumbai (Bhandup) on a Work From Office basis. Below are the job details: **Data Analytics / BI Position:** - **Experience Required:** 2-3 years - **Location:** Mumbai (Bhandup) WFO - **Note:** Immediate to 15 days notice period will be considered - Seeking candidates with 2-3 years of experience in Investment, real estate, taxation, finance, and accounts. **CA Requirement:** - **Experience Required:** 8+ years - **Location:** Mumbai (Bhandup) WFO - **Note:** Immediate to 15 days notice period will be considered - The role involves leading the data Analytics / BI domain and requires skills in: - Python experience...

Role Overview: As a Data Engineer at our company, you will play a crucial role in simplifying our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. Your main goal will be to ensure commercial success while prioritizing customer safety and data security. You will be responsible for driving customer value by solving complex business problems and implementing the most suitable tools to build data solutions. Additionally, you will engage with the data engineering community to deliver opportunities and build a scalable data architecture. Key Responsibilities: - Build advanced automation for data engineering pipelines by eliminating manua...

As a highly experienced MIS Reporting Lead with expertise in the Credit Card and Lending industry and proficiency in SAS, Python, PySpark, and Tableau, your role will involve: - Leading the end-to-end development and delivery of MIS reports and dashboards for US Personal Bank Credit card and Lending business. - Partnering with business stakeholders to understand requirements and provide actionable insights through automated reporting solutions. - Interpreting data to identify trends, patterns, and anomalies to support strategic decision-making. - Maintaining and optimizing SAS-based reporting processes and migrating to Python/PySpark on Big Data platforms. - Designing interactive Tableau das...

Role Overview: At PwC, as a Senior Associate in the Data Science - Conversational AI domain, you will focus on leveraging data to drive insights and make informed business decisions. You will be part of the Digital Contact Solutions team within the Analytics Consulting practice, working on high-end analytics consulting engagements and providing business recommendations to project teams. Your role will involve developing proposals, translating business needs into data science solutions, interacting with clients, conducting analysis using advanced analytics tools, and coaching junior team members. Additionally, you will be responsible for writing and deploying production-ready code, making pre...

Role Overview: As a member of the Classical ML+NLP+Gen AI - L4 team at Tredence, you will be involved in tasks such as Model Fine-tuning, Model Pre-training, Named Entity Recognition, Prompt Engineering, Pyspark, Python, Regular expressions, SQL, Supervised ML, Tokenization, Transformer Models, Transformers, Unstructured Data Pre-processing, and Unsupervised ML. Key Responsibilities: - Model Fine-tuning - Model Pre-training - Named Entity Recognition - Prompt Engineering - Working with Pyspark, Python, Regular expressions, SQL - Implementing Supervised ML techniques - Handling Tokenization - Utilizing Transformer Models for data processing - Working with Unstructured Data Pre-processing - Im...

Role Overview: In this role, you will coordinate the understanding and integration of various datasets and design analytical solutions to support critical business needs. This includes conducting business opportunity assessments, customer segmentation and targeting, identifying HCP and patient opportunities, analyzing patient and prospective data, conducting smart business experiments (test and learn), market simulations, and modeling patient flow. You will collaborate closely with cross-functional stakeholders from Marketing, Medical, Market Access, Sales, Forecasting, and other Commercial Operations teams. Key Responsibilities: - Coordinate the understanding and integration of various data...

In this role as a Senior Associate at PwC, you will be working as part of a team of problem solvers, assisting in solving complex business issues from strategy to execution. Your responsibilities as a PwC Professional at this management level will include: - Using feedback and reflection to develop self-awareness, personal strengths, and address development areas. - Delegating tasks to others to provide stretch opportunities and coaching them to deliver results. - Demonstrating critical thinking and the ability to bring order to unstructured problems. - Utilizing a broad range of tools and techniques to extract insights from current industry or sector trends. - Reviewing your work and that o...

As a Senior Python Engineer at NTT DATA in Bangalore, Karnataka (IN-KA), India, you will be a valuable member of the C3 Data Warehouse team. You will play a crucial role in developing the next-gen data platform that consolidates data from various technology systems into a centralized data platform, enabling reporting and analytics solutions for the Technology Risk functions at Morgan Stanley. **Key Responsibilities:** - Develop components in Python for the unified data pipeline framework - Establish best practices for optimal Snowflake usage - Assist in testing and deployment using standard frameworks and CI/CD tooling - Monitor query performance and data loads - Provide guidance during QA &...

As an experienced AWS Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using AWS services. Your role will involve working with big data technologies, modern ETL tools, and cloud-native platforms to deliver efficient, secure, and high-performing data solutions. Key Responsibilities: - Build and optimize scalable data pipelines using AWS Glue, Redshift, and Lambda. - Develop ETL/ELT workflows using Python, PySpark, and Spark. - Integrate diverse data sources into centralized data platforms. - Design and maintain data models, warehouse solutions, and schemas. - Ensure performance tuning, data quality, and security best pract...

You are a highly experienced MIS Reporting Lead with deep domain expertise in the Credit Card and Lending industry and strong technical proficiency in SAS, Python, PySpark, and Tableau. Your responsibility will be to lead the design, development, and automation of management reporting solutions, and support strategic initiatives through insightful data analytics. - Lead the end-to-end development and delivery of MIS reports and dashboards supporting US Personal Bank Credit card and Lending business across various functions. - Partner with business stakeholders to understand requirements and deliver actionable insights through automated reporting solutions. - Interpret data to identify trends...

As a Customer Success Manager (CSM) at Loyalytics, your role will involve working closely with our large retail clients globally to help them maximize the value of their data assets. Your responsibilities will include: - Conducting campaign analysis, marketing analytics, and CRM consulting - Demonstrating strong attention to detail, excellent organizational skills, and proficiency in project management - Utilizing hands-on experience in data analysis, segmentation, and customer profiling - Proficiency in SQL, Databricks, PySpark, and Python - Knowledge of A/B testing, personalization, and CRM performance measurement - Effectively communicating insights to both technical and non-technical sta...