23086 Pyspark Jobs - Page 29

Position: Data Engineer – Core Python (MT610FT RM 3738) Job Summary We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team. The ideal candidate will have 6 to 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization. Skills Core Python + good to have PySpark Responsibilities Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation. Collaborate with da...

Hiring Part-Time Data Engineer (23 hrs/day, flexible). Work with US teams to build Airflow pipelines, ETL/ELT, Python, SQL, dbt, PySpark, AWS, Snowflake. Must know backfilling & orchestration. Pay 15k–18k/month. Remote.

Who We Are With Citi’s Analytics & Information Management (AIM) group, you will do meaningful work from Day 1. Our collaborative and respectful culture lets people grow and make a difference in one of the world’s leading Financial Services Organizations. The purpose of the group is to use Citi’s data assets to analyze information and create actionable intelligence for our business leaders. We value what makes you unique so that you have opportunity to shine. You also get the opportunity to work with the best minds and top leaders in the analytics space. What The Role Is The role of Assistant Vice President – Data/Information Mgt Sr Analyst will be part of AIM team based out of Chennai, India...

This is a data engineer position - a programmer responsible for the design, development implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable, and secure manner in coordination with the Data & Analytics team. The overall objective is defining optimal solutions to data collection, processing, and warehousing. Must be a Spark Java development expertise in big data processing, Python and Apache spark particularly within banking & finance domain. He/She designs, codes and tests data systems and works on implementing those into the internal infrast...

Senior AI/ML Engineer Experience: 3 - 5 Years Exp Salary : Competitive Preferred Notice Period : 30 Days Shift : 10:00AM to 7:00PM IST Opportunity Type: Office , Ahmedabad, Gujarat Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : AI/ML frameworks, Big Data, MLOps, Python LinkMD AI (One of Uplers' Clients) is Looking for: Senior AI/ML Engineer who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you. Role Overview Description Role: Senior AI/ML Engineer Mode...

Responsibilities I Mandatory skill: AWS, Advanced python Role Description: AWS Cloud Software Engineer. Responsible to develop, test and maintain applications in AWS Cloud Services with established processes while building holistic understanding of the underlying applications and domain. Build, test and support Data integration scripts using Python in overall program/module framework. Experience Level : 4 - 6 years Location: Pune Skills: Should have relevant work experience with :- 3+ Years’ experience migrating applications to AWS, prefer experience with serverless technologies Has background of either strong Data warehousing/ETL OR application development using oops concepts, Java/C# Must ...

Company Description Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com Job Description We are look...

A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to lead the engagement effort of providing high-quality and value-adding consulting solutions to customers at different stages- from problem definition to diagnosis to solution design, development and deployment. You will review the proposals prepared by consultants, provide guidance, and analyze the solutions defined for the client business problems to identify any potential risks and issues. You will identify change Management requirements and propose a structured approach to client for managing the change using multiple communication mechanisms. You will also coach and create a vision for ...

What You’ll Do: "The Centre for Intelligent Power located at Eaton India’s Innovation Centre in Pune and Eaton’s global headquarters in Dublin, applies data science to transform all aspects of our company. We’re working on solving the technical challenges of today’s digital world, while developing ground-breaking technology that’s going to power the next generation of futuristic products and services. We’re continuing to expand our organization and we are excited to announce that we are recruiting a Senior Data Scientist to join our team. The Senior Data Scientist will collaborate with Eaton product groups to develop new data-science based product features. The features will primarily addres...

What You’ll Do The Sr Data Engineer will play a vital role for Digital Finance and Innovation (DFI) team wherein the candidate will contribute in terms of creating the advanced version of Core Finance Data Hub for finance business. The candidate will be responsible for data management, data pipeline creation, ensuring data quality & integrity, support data analytics, ensure performance and scalability of current and future data models. This role will be part of DFI wherein the person need to closely work with group’s data architecture & data platform team, product owner team and project management team to ensure we develop DFI finance data platforms in accordance with group’s best practices....

Job description Hiring for Pyspark Develper Mandatory Skills: Pyspark, Python, SQL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed functio...

Educational Requirements Bachelor of Engineering,BTech,BCA,MTech,MCA Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to provide best fit architectural solutions for one or more projects. You would also provide technology consultation and assist in defining scope and sizing of work You would implement solutions, create technology differentiation and leverage partner technologies. Additionally, you would participate in competency development with the objective of ensuring the best-fit and high quality technical solutions. You would be a key contributor in creating thought leadership within th...

Company Description WNS (Holdings) Limited (NYSE: WNS), is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics expertise to co-create innovative, digital-led transformational solutions with clients across 10 industries. We enable businesses in Travel, Insurance, Banking and Financial Services, Manufacturing, Retail and Consumer Packaged Goods, Shipping and Logistics, Healthcare, and Utilities to re-imagine their digital future and transform their outcomes with operational excellence.We deliver an entire spectrum of BPM services in finance and accounting, procurement, customer interaction services and human resources levera...

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

SUMMARY Wissen Technology is Hiring for Databricks Developer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting - e...

Lead Data Engineer Location: Banglore/Pune (Hybrid) Mode: Hybrid Shift Timing: 2 PM to 11 PM Experience: 7-12 years. 3+ years in cloud data platforms and Databricks. Purpose: We are seeking a hands-on Technical Lead to drive the ingestion of high-volume mainframe RPC data into Databricks , enabling scalable machine learning workflows. This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and functions. Key Responsibilities Mainframe Data Ingestion: Design and implement scalable pipelines to extract, parse, and ingest RPC logs and technical attributes from mainframe systems into Delta Lake o...

SUMMARY Working knowledge on big data technologies should be more than 6. Increase the no. of years for Sr profiles Excellent working knowledge on SQL Proficient with spark and any one or both programming language e.g. Scala and/or Python Demonstrated working knowledge with kafka, Airflow, DBT, Flink, Apache Iceberg, Datadog Experience with snowflake will be a big positive Experience with CI/CD framework implementation in conjunction with any popular code repository like Github

Role Description: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs Drive technical discussion with client architect and team members Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications: Bachelor's and/or master's degree in computer science or equivalent experience. Good understandin...

Job Description We are looking for a candidate with 5+ years of experience in a Data Engineer role and has attained bachelor's degree in technology and has experienced with Agile/Scrum development process and methodologies. Experience as a Data Engineer with strong track record of designing and implementing data solutions. Experience in programming language as Python, Pyspark with airflows Experience with cloud data warehousing technologies, such as Snowflake and Redshift. Experience with Cloud platforms such as AWS, Azure or Google Cloud Platform. Experience with AWS cloud services, such as S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda. Experience with containerization and orchestration te...

Join us as a Software Engineer, Tableau And PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutions Its a chance to hone your existing technical skills and advance your career while building a wide network of stakeholders We're offering this role at associate level What you'll do In your new role, youll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform. Youll also be: Producing complex and critical sof...

About Position: We are hiring Sr. Data Engineer with Pyspark, SQL, ETL Data Engineer. Role: Senior Data Engineer Location: Pune, Bangalore Experience: 5 to 8 Years Job Type: Full Time Employment What You'll Do: Candidate should have 5+ years of experience in Data Engineering Must have experience in Pyspark, SQL, ETL, data pipelines, AWS, Python Nice to Have Life science domain experience (Pharma), Dremio, Redshift, Nifi ingestion, BI Tools (Tableau/PowerBI) Designing, creating, testing and maintaining the complete data management & processing systems. Working closely with the stakeholders & solution architect. Ensuring architecture meets business requirements. Building highly scalable, robus...

As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment.The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities : Responsible to manage end to end feature development and resolve challenges faced in implementing the same Learn new tec...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical day will involve collaborating with team members to ensure the successful implementation o...