15896 Pyspark Jobs - Page 11

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Required Skills Jira, Snowflake, Kafka, analytical, outcomes based, insights dri...

We are looking forward to hire Python Professionals in the following areas : Job description: Experience required: 7+ years Required skills: Strong Python fundamentals: Thorough understanding of Python syntax, data structures, object-oriented programming, and design patterns. Technical : Proficiency in Python, PySpark, REST API, Flask, Microservices Architecture Database management: Experience with relational databases (MySQL, PostgreSQL) and database interaction using SQL. Version control: Familiarity with Git for code management. Testing practices: Knowledge of unit testing frameworks (e.g., pytest). Data analysis libraries: Basic understanding of Pandas and NumPy for data manipulation. Cl...

Architect, design, and implement scalable and performant Databricks-based data pipelines, including batch and streaming workloads. Optimize Databricks Lakehouse architecture including Delta Lake, Unity Catalog, and Photon for cost efficiency, data reliability, and query performance at scale. Define and implement advanced data models and ontologies to support complex analytics and AI/ML workflows. Design and tune complex Spark applications (PySpark and/or Scala) for high-volume data processing, including structured streaming and incremental processing. Implement orchestration workflows (e.g., Databricks Workflows, Azure Data Factory, or similar) to automate data pipelines with robust monitori...

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

This role will be part of the Treasury Applications Platform team, we are currently modernizing our platform, migrating it to GCP. You will contribute towards making the platform more resilient and secure for future regulatory requirements and ensuring compliance and adherence to Federal Regulations. Preferably a BS or MS degree in computer science, computer engineering, or other technical discipline 8+ years of software development experience Ability to effectively interpret technical and business objectives and challenges and articulate solutions Experience with managing large teams and balance multiple priorities. Willingness to learn new technologies and exploit them to their optimal pot...

Design and implement an end-to-end data solution architecture tailored to enterprise analytics and operational needs. Build, maintain, and optimize data pipelines and transformations using Python, SQL, and Spark . Manage large-scale data storage and processing with Iceberg, Hadoop, and HDFS . Develop and maintain dbt models to ensure clean, reliable, and well-structured data. Implement robust data ingestion processes , integrating with third-party APIs and on-premise systems. Collaborate with cross-functional teams to align on business goals and technical requirements. Contribute to documentation and continuously improve engineering and data quality processes. Qualifications 4+ years of expe...

Experience on SSIS/SQL(4-7) years and will be responsible for the development of ETL and Reporting solutions Strong Knowledge of SSIS packages, design principles & best practices. Experience with requirements gathering, technical analysis, and writing technical specifications Candidate must have strong database fundamentals. Must have good knowledge of Data Warehousing & Data Modelling Concepts. Good communication skills are required. Capability to work in a distributed team environment with minimal supervision is required for this profile. The position doesnt require working in shifts, however flexibility to overlap with US hours is required. Should have good knowledge in writing SQL comman...

Greetings!!! Urgent we are looking Lead Data Scientist for Product Development Company at Bangalore. Exo : 5+ years Role : SSE / Lead Skills : Python, PySpark, SQL, Machine Learning and Deep Learning Algorithms Mode of Work : Hybrid ( 2 Days in office ) - Bangalore Please share your updated resume on balbeer.singh@talent21.in with below details : - Years of Exp in Data Scientist : Exp in Python Coding : Exp in PySpark : Exp in Machine Learning : Exp in SQL : C CTC : E CTC : Notice period : C Location : P Location : Current Company :

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Required Skills PySpark, communication, Openshi...

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Required Skills PySpark, communication, Openshi...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Role & responsibilities- GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech Lead Exp - 4 to 15 yrs Locations - Pan India Work Mode - Hybrid Notice Period - Immediate to 30 Days & Serving notice period

Role & responsibilities- GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech Lead Exp - 4 to 15 yrs Locations - Pan India Work Mode - Hybrid Notice Period - Immediate to 30 Days & Serving notice period

Role & responsibilities- GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech Lead Exp - 4 to 15 yrs Locations - Pan India Work Mode - Hybrid Notice Period - Immediate to 30 Days & Serving notice period

hackajob is collaborating with UnitedHealth Group to connect them with exceptional tech professionals for this role. Senior Data Scientist Requisition Number: 2309674 Job Category: Business & Data Analytics Primary Location: Noida, Uttar Pradesh, IN Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the com...

Job Summary The Databricks Architect is responsible for designing, implementing, and optimizing scalable data solutions using the Databricks platform. This role involves working closely with cross-functional teams to deliver high-performance, secure, and reliable data architecture that support advanced analytics, machine learning, and business intelligence Key Responsibilities Design Databricks-based data architectures and models to meet business requirements Develop event-driven and scalable GenAI application architectures Refactor and rehost legacy applications onto cloud platforms Design, develop, and optimize data pipelines and ETL processes using Azure Databricks (PySpark /Spark SQL). I...

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Required Skills Jira, Snowflake, Kafka, analytical, outcomes based, insights dri...

Job Description Job Title – Manager, Data Science The Purpose of This Role This role involves working with senior stakeholders in understanding and identifying the business requirements and needs in the areas of Machine Learning and Artificial Intelligence. Scanning the fast paced external and internal environments in these areas, developing futuristic ideas that would benefit the firm and leading implementation of AI solutions to bring those ideas to life. Specific experience in AI areas like Natural Language Processing/Generation, Generative AI, Deep Learning, Reinforcement learning etc. is required. How Your Work Impacts The Organization Individual in this role is expected to work with mu...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology Your Role And Responsibilities An AI Data Scientist at IBM is not just a job title – it’s a mindset. You’ll leverage the watsonx,AWS Sagemaker,Azure Open AI platform to co-create AI value with clients, focusing on technology patterns to enhance repeatability and delight clients. We are seeking an experienced and innovative ...

Role: Senior Data Engineer Work Location: Hyderabad Experience: 4+ Years Employment Type: Full-Time Work mode : Hybrid Notice period: Immediate - 15 days About the Role We are looking for a highly skilled Data Engineer with 4+ years of experience in building scalable data pipelines, transforming large datasets, and working with modern data platforms. The ideal candidate is proficient in Python , SQL , Apache Spark , and Google Cloud Platform (GCP) , and demonstrates strong communication and collaboration skills. You will play a key role in designing and developing data engineering solutions that enable data-driven decision-making across the organization. Key Responsibilities Design, build, a...

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge. As part of our Analytics and Insights Consumption team, you’ll an...

Greetings!!! Job Description: Development 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Exp Level: 5 - 8 years...

Greetings!!! Job Description: Development 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Exp Level: 5 - 8 years...

Greetings!!! Job Description: Development 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Exp Level: 5 - 8 years...