15802 Pyspark Jobs - Page 7

Responsibilities: Design, develop, and maintain scalable data solutions using Azure Data Factory, Databricks, PySpark, Python, and SQL . Optimize pipelines, ensure data quality, and enable insights with Microsoft Fabric.

Overview Data Ops Capability Deployment - Analyst is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new solutions/frameworks/techniques and the improvement of processes and workflow for Enterprise Data function. Integrates subject matter and industry expertise within a defined area. Requires in-depth understanding of how areas collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the function and overall business. The primary purpose of this role is to perform data analytics and data analysis across different asset classes, and to build data science/Tooling capabilities within the te...

Exp Range: 5 to 10 years. Mandatory Skill - Databricks, Python, Pyspark, Apache Airflow(Mandate), Sql, AWS/Azure. Experience in developing cloud-based a minimum of 5 years of core MS Azure/AWS and Databricks.

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast. Job S...

hackajob is collaborating with UnitedHealth Group to connect them with exceptional tech professionals for this role. Associate Data Engineering Manager - Azure Databricks, SQL Primary Location: Hyderabad, Telangana, IN Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help u...

Skill: Azure Data Engineer Total Experience Required: 4 to 8 years Location: Mumbai/Pune/Bangalore/Gurgaon Overview: We are seeking a highly skilled and motivated Data Engineer to join our growing data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data lake solutions using Azure Data Services, Apache Spark, and Big Data technologies. This role requires strong hands-on experience in data integration, transformation, and storage using tools such as Azure Synapse, Azure Data Factory, Databricks, SQL Server, and PySpark. The successful candidate will work closely with data scientists, analysts, and business stakeh...

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Required Skills Jira, Snowflake, Kafka, analytical, outcomes based, insights dri...

We are looking forward to hire Python Professionals in the following areas : Job description: Experience required: 7+ years Required skills: Strong Python fundamentals: Thorough understanding of Python syntax, data structures, object-oriented programming, and design patterns. Technical : Proficiency in Python, PySpark, REST API, Flask, Microservices Architecture Database management: Experience with relational databases (MySQL, PostgreSQL) and database interaction using SQL. Version control: Familiarity with Git for code management. Testing practices: Knowledge of unit testing frameworks (e.g., pytest). Data analysis libraries: Basic understanding of Pandas and NumPy for data manipulation. Cl...

Architect, design, and implement scalable and performant Databricks-based data pipelines, including batch and streaming workloads. Optimize Databricks Lakehouse architecture including Delta Lake, Unity Catalog, and Photon for cost efficiency, data reliability, and query performance at scale. Define and implement advanced data models and ontologies to support complex analytics and AI/ML workflows. Design and tune complex Spark applications (PySpark and/or Scala) for high-volume data processing, including structured streaming and incremental processing. Implement orchestration workflows (e.g., Databricks Workflows, Azure Data Factory, or similar) to automate data pipelines with robust monitori...

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

This role will be part of the Treasury Applications Platform team, we are currently modernizing our platform, migrating it to GCP. You will contribute towards making the platform more resilient and secure for future regulatory requirements and ensuring compliance and adherence to Federal Regulations. Preferably a BS or MS degree in computer science, computer engineering, or other technical discipline 8+ years of software development experience Ability to effectively interpret technical and business objectives and challenges and articulate solutions Experience with managing large teams and balance multiple priorities. Willingness to learn new technologies and exploit them to their optimal pot...

Design and implement an end-to-end data solution architecture tailored to enterprise analytics and operational needs. Build, maintain, and optimize data pipelines and transformations using Python, SQL, and Spark . Manage large-scale data storage and processing with Iceberg, Hadoop, and HDFS . Develop and maintain dbt models to ensure clean, reliable, and well-structured data. Implement robust data ingestion processes , integrating with third-party APIs and on-premise systems. Collaborate with cross-functional teams to align on business goals and technical requirements. Contribute to documentation and continuously improve engineering and data quality processes. Qualifications 4+ years of expe...

Experience on SSIS/SQL(4-7) years and will be responsible for the development of ETL and Reporting solutions Strong Knowledge of SSIS packages, design principles & best practices. Experience with requirements gathering, technical analysis, and writing technical specifications Candidate must have strong database fundamentals. Must have good knowledge of Data Warehousing & Data Modelling Concepts. Good communication skills are required. Capability to work in a distributed team environment with minimal supervision is required for this profile. The position doesnt require working in shifts, however flexibility to overlap with US hours is required. Should have good knowledge in writing SQL comman...

Greetings!!! Urgent we are looking Lead Data Scientist for Product Development Company at Bangalore. Exo : 5+ years Role : SSE / Lead Skills : Python, PySpark, SQL, Machine Learning and Deep Learning Algorithms Mode of Work : Hybrid ( 2 Days in office ) - Bangalore Please share your updated resume on balbeer.singh@talent21.in with below details : - Years of Exp in Data Scientist : Exp in Python Coding : Exp in PySpark : Exp in Machine Learning : Exp in SQL : C CTC : E CTC : Notice period : C Location : P Location : Current Company :

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Required Skills PySpark, communication, Openshi...

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile. Required Skills PySpark, communication, Openshi...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Responsibilities: Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies. Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions. Architect serverless applications using AWS Lambda for event-driven computing. Build and maintain real-time or batched data pipelines Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis. Implement event-driven architectures for efficient communication between various AWS services. Write and optimize PySpark code for the data processes to transform and load data. Ensure security and compliance with AWS best practices, including VPC, IA...

Role & responsibilities- GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech Lead Exp - 4 to 15 yrs Locations - Pan India Work Mode - Hybrid Notice Period - Immediate to 30 Days & Serving notice period

Role & responsibilities- GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech Lead Exp - 4 to 15 yrs Locations - Pan India Work Mode - Hybrid Notice Period - Immediate to 30 Days & Serving notice period

Role & responsibilities- GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech Lead Exp - 4 to 15 yrs Locations - Pan India Work Mode - Hybrid Notice Period - Immediate to 30 Days & Serving notice period

hackajob is collaborating with UnitedHealth Group to connect them with exceptional tech professionals for this role. Senior Data Scientist Requisition Number: 2309674 Job Category: Business & Data Analytics Primary Location: Noida, Uttar Pradesh, IN Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the com...

Job Summary The Databricks Architect is responsible for designing, implementing, and optimizing scalable data solutions using the Databricks platform. This role involves working closely with cross-functional teams to deliver high-performance, secure, and reliable data architecture that support advanced analytics, machine learning, and business intelligence Key Responsibilities Design Databricks-based data architectures and models to meet business requirements Develop event-driven and scalable GenAI application architectures Refactor and rehost legacy applications onto cloud platforms Design, develop, and optimize data pipelines and ETL processes using Azure Databricks (PySpark /Spark SQL). I...

Required Skills: 5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Required Skills Jira, Snowflake, Kafka, analytical, outcomes based, insights dri...

Job Description Job Title – Manager, Data Science The Purpose of This Role This role involves working with senior stakeholders in understanding and identifying the business requirements and needs in the areas of Machine Learning and Artificial Intelligence. Scanning the fast paced external and internal environments in these areas, developing futuristic ideas that would benefit the firm and leading implementation of AI solutions to bring those ideas to life. Specific experience in AI areas like Natural Language Processing/Generation, Generative AI, Deep Learning, Reinforcement learning etc. is required. How Your Work Impacts The Organization Individual in this role is expected to work with mu...