15947 Pyspark Jobs - Page 16

Pyspark SparkSQL SQL and Glue. ii. AWS cloud experience iii. Good understanding of dimensional modelling iv. Good understanding DevOps CloudOps DataOps CI/CD & with a SRE mindset v. Understanding of Lakehouse and DW architecture vi. strong analysis and analytical skills vii. understanding of version control systems specifically Git viii. strong in software engineering APIs Microservices etc. Soft skills i. written and oral communication skills ii. ability to translate business needs to system. Location - Hyderabad,Kolkata,Peth,Pune

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

Job Title - + + Management Level: Location: Kochi, Coimbatore, Trivandrum Must have skills: Python/Scala, Pyspark/Pytorch Good to have skills: Redshift Job Summary You’ll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured unstructured) from various t...

Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact. Job Overview What do we do? The TTS Analytics team provides analytical insights to the Product, Pricing, Client Experience and Sales functions within the global Treasury & Trade Services business. The team works on business problems focused on driving acquisitions, cross-sell, revenue growth & improvements in client experience. The team extracts relevant insights, identifies business opportunities, converts busine...

Achieving our goals starts with supporting yours. Grow your career, access top-tier health and wellness benefits, build lasting connections with your team and our customers, and travel the world using our extensive route network. Come join us to create what’s next. Let’s define tomorrow, together. Description At United, we have some of the best aircraft in the world. Our Technical Operations team is full of aircraft maintenance technicians, engineers, planners, ground equipment and facilities professionals, and supply chain teams that help make sure they’re well taken care of and ready to get our customers to their desired destinations. If you’re ready to work on our planes, join our Tech Op...

Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact. Job Overview Analytics and Information Management (AIM) Citi AIM was established in 2003 and is located across multiple cities in India – Bengaluru, Chennai, Pune and Mumbai. It is a global community that objectively connects and analyzes information, to create actionable intelligence for our business leaders. It identifies fact-based opportunities for revenue growth in partnership with the businesses. The functio...

Job Description: Job Description Role and Responsibilities: • Emphasis is on end-to-end delivery of analysis • Extremely comfortable working with data, including managing large number of data sources, analyzing data quality, and pro-actively working with client’s data/ IT teams to resolve issues Hands on experience on Machine Learning algorithms such as Logistic Regression, Random Forest, XG Boost • Use variety of analytical tools (Python, SQL, PySpark etc.) to carry out analysis and drive conclusions • Reformulate highly technical information into concise, understandable terms for presentations Candidate Profile: • Required skills: Python, SQL, Hive, PySpark, Hadoop, Machine Learning, Credi...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? The Analyst will be part of the Global Spend Insights & Analytics team, supporting the development and maintenance of Glo...

Job Description: About the Role: We are seeking a results-driven and detail-oriented data analyst to support data-driven decision-making within banking risk operations. This role involves working closely with stakeholders to provide actionable insights, enhance strategies, and drive operational efficiencies using tools such as SQL, Python, and advanced analytics. Key Responsibilities: Analyze large volumes of data to identify trends, patterns, and performance drivers. Collaborate with different teams to support and influence decision-making processes. Perform root cause analysis and recommend improvements to optimize processes Design and track key KPIs Ensure data integrity and accuracy acro...

Role : Mid level Data Engineer Experience : 8-12 Years Mandatory Skill: Azure + Python + Databricks/Spark+ SQL Location: Bangalore/Hyderabad Notice Period: less than 60 Days Job Description: Skills: Azure, Python, SQL, Kafka, NoSQL, .NET C# At least 8-10 years of experience in development of data solutions using Azure cloud platform Strong programming skills in Python Good understanding Massively parallel processing (MPP) systems, experience building Datawarehouse/DataMart on Azure Synapse SQL pools (SQL DW) Strong SQL skills and experience writing complex yet efficient SPROCs/Functions/Views using T-SQL Solid understand of spark architecture and experience with performance tuning big data w...

Overview: As a data engineering manager, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impact...

About Chubb Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: www.chubb.com. About Chubb India ...

Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: We are looking for a highly experienced and technically proficient Generative AI Data Architect (AWS) with deep expertise in data architecture principles, data modeling techniques and methodologies, and enterprise-scale AI/ML systems. The ideal candidate should have 10-13 years of experience in designing and managing c...

Sr. AI/ML- Full time/ CTH Years of experience: 5 + years (with minimum 4 years of relevant experience) Key Skills: GenAI, Machine Learning, MLflow, Python, Pyspark, SQL, AWS, FastAPI, Databricks, AWS, LLM, RDS, Gitlab - (Mandate) Notice period- Immediate to 30 days ONLY Work mode- WFO (Chennai or Hyderabad) Job Types: Full-time, Permanent Pay: ₹800,000.00 - ₹1,000,000.00 per year Work Location: In person

About us Bain & Company is a global consultancy that helps the world’s most ambitious change makers define the future. Across 65 offices in 40 countries, we work alongside our clients as one team with a shared ambition to achieve extraordinary results, outperform the competition and redefine industries. Since our founding in 1973, we have measured our success by the success of our clients, and we proudly maintain the highest level of client advocacy in the industry. In 2004, the firm established its presence in the Indian market by opening the Bain Capability Center (BCC) in New Delhi. The BCC is now known as BCN (Bain Capability Network) with its nodes across various geographies. BCN is an ...

Who is ERM? ERM is a leading global sustainability consulting firm, committed for nearly 50 years to helping organizations navigate complex environmental, social, and governance (ESG) challenges. We bring together a diverse and inclusive community of experts across regions and disciplines, providing a truly multicultural environment that fosters collaboration, professional growth, and meaningful global exposure. As a people-first organization, ERM values well-being, career development, and the power of collective expertise to drive sustainable impact for our clients—and the planet. Introducing our new Global Delivery Centre (GDC) Our Global Delivery Centre (GDC) in India is a unified platfor...

Job Description: Job Summary: We are looking for an experienced Azure Databricks Architect who has a strong background in designing and implementing end-to-end data solutions on Azure Cloud. The ideal candidate should have expertise in Databricks, Azure Data Factory, Azure DevOps, Power BI, Unity Catalog, and data governance, cataloging, and modelling. The Azure Databricks Architect will work closely with our data engineering, data science, and business stakeholders to design and implement scalable, secure, and efficient data architectures that meet our business requirements. Key Responsibilities: 1. Design and implement scalable, secure, and efficient data architectures on Azure Cloud using...

Calling all innovators – find your future at Fiserv. We’re Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world. We connect financial institutions, corporations, merchants, and consumers to one another millions of times a day – quickly, reliably, and securely. Any time you swipe your credit card, pay through a mobile app, or withdraw money from the bank, we’re involved. If you want to make an impact on a global scale, come make a difference at Fiserv. Job Title Specialist, Data Architecture Experience on SSIS/SQL(4-7) years and will be responsible for the development of ETL and Reporting solutions Strong Knowledge of SSIS packages, ...

Stellantis is seeking a passionate, innovative, results-oriented Information Communication Technology (ICT) Manufacturing AWS Cloud Architect to join the team. As a Cloud architect, the selected candidate will leverage business analysis, data management, and data engineering skills to develop sustainable data tools supporting Stellantiss Manufacturing Portfolio Planning. This role will collaborate closely with data analysts and business intelligence developers within the Product Development IT Data Insights team. Job responsibilities include but are not limited to: Having deep expertise in the design, creation, management, and business use of large datasets, across a variety of data platform...

Position: Python Developer No. of Position: 2 Location: Ahmedabad // Hyderabad (Hybrid) Key Responsibilities: Develop Python-based solutions using Git/Poetry for code and library management. Work with data processing libraries such as Pandas, Polars, and others. Deploy and manage data pipelines on Databricks and Azure Blob Storage. Monitor and troubleshoot pipelines, logs, and cloud resources. Required Skills & Qualifications: Proficiency in Python , including experience with Git/Poetry for code and dependency management. Expertise in data processing libraries such as Pandas, PySpark, Dataframes, Polars, or equivalent. Familiarity with Azure cloud services , Databricks , and Azure Blob Stora...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be pa...

Responsibilities: Key Responsibilities: 1. Design and implement data pipelines for seamless data ingestion. 2. Utilize AWS technologies, including S3, Glue, and Lambda, for effective data management. 3. Collaborate with cross-functional teams to enhance data processes using Python, PySpark, and SQL. 4. Implement CI/CD deployments for streamlined development processes. 5. Understand Data Warehouse concepts to ensure efficient data storage and retrieval. 6. Orchestrate data workflows using AWS Step Functions and Apache Airflow. 7. Able to create data pipeline using AWS services and Snowflake with DBT. 8. Able to utilize Snowflake concepts to streamline data processing and reduce bottlenecks of...

We are looking for a skilled Data Engineer with 7 to 10 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. The ideal candidate will have expertise in data engineering, Azure cloud, Snowflake, and Snowflake ELT methodologies. Roles and Responsibility Design and develop scalable data pipelines using Azure cloud and Snowflake. Implement ETL processes on Azure and manage data management tasks. Develop automation scripts using Python, Scala, or other languages. Collaborate with cross-functional teams to ensure seamless data integration. Ensure data integrity and accuracy during migration efforts. Optimize data processing workflows for improved efficiency. Job Require...

We are looking for a skilled professional with expertise in Pyspark, Python, and SQL to join our team. The ideal candidate should have 6-9 years of experience. Roles and Responsibility Design, develop, and implement data processing pipelines using Pyspark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Python and SQL. Troubleshoot and resolve technical issues efficiently. Participate in code reviews and contribute to improving overall code quality. Stay updated with industry trends and emerging technologies. Job Requirements Strong proficiency in Pyspark, Python, and SQL. Experience working with big...

We are looking for skilled Hadoop Developers with 5-10 years of experience to join our team in Bangalore, Kolkata, Hyderabad, and Pune. The ideal candidate should have strong proficiency in Hadoop, Scala, Spark, and SQL. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Spark and Scala. Troubleshoot and resolve complex technical issues related to Hadoop. Participate in code reviews and ensure high-quality code standards. Stay updated with the latest trends and technologies in Hadoop development. Job...