23086 Pyspark Jobs - Page 24

Job Title: Azure Data Engineer Industry & Sector: Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology sectors. Location: India (On-site) Role & Responsibilities Design, build and operate end-to-end Azure data solutions: ingestion, transformation, storage, and serving layers to meet latency and SLAs. Develop and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark), ensuring data quality and idempotent processing. Im...

Job Title: Azure Data Engineer Industry & Sector: Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology sectors. Location: India (On-site) Role & Responsibilities Design, build and operate end-to-end Azure data solutions: ingestion, transformation, storage, and serving layers to meet latency and SLAs. Develop and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark), ensuring data quality and idempotent processing. Im...

We are hiring Developers /Admins for a leading MNC for permanent roles. Open positions: Python, PySpark, SQL, GCP Python Full Stack Developers Java, Spring Boot, Microservices ServiceNow Developers / Admins DevOps Databricks Admins

Job Title: Azure Data Engineer Industry & Sector: Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology sectors. Location: India (On-site) Role & Responsibilities Design, build and operate end-to-end Azure data solutions: ingestion, transformation, storage, and serving layers to meet latency and SLAs. Develop and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark), ensuring data quality and idempotent processing. Im...

Job Title: Azure Data Engineer Industry & Sector: Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology sectors. Location: India (On-site) Role & Responsibilities Design, build and operate end-to-end Azure data solutions: ingestion, transformation, storage, and serving layers to meet latency and SLAs. Develop and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark), ensuring data quality and idempotent processing. Im...

Greetings from Tata Consultancy Services!!! TCS is conducting Weekday Virtual drive for the role of Azure Data Engineer Years of experience: 6 to 10 yrs Location: Hyderabad Notice Period: 0 to 60 days Date of Interview: 19,20,21st Nov 2025 Time of Interview: 10 AM to 2 PM Interview Mode: Virtual Job description: Relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Az...

Greetings From Tata Consultancy Services!!! Role: Big Data Developer (Hive, Pyspark) Years of Experience: 6 to 10 yrs Location: Chennai, Hyderabad, Bengaluru, Pune Notice Period: 0- 60 days Date of Interview: 21st Nov 2025 Mode of Interview: Virtual Drive (Cisco or Webex) Time Of Interview: 10.00AM To 2.00PM Job Description: Roles & Responsibilities: Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. Should be able to develop, tweak queries and work on performance enhancement. Solid understanding of object-oriented programming and HDFS concepts The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in prod...

4 to 6 Years Bangalore Having 5 + years of experience in Nifi, snowflakes , Databricks and python Primary skill on Nifi is Mandatory along with good pyspark/Python hands on experience. Create pipeline in Snowflake and should be aware of the functions in Snowflake Good communication skills is mandatory Should be flexible with WFO guidelines if there is an ask from the customer Job Location: Bangalore Apply for this position Full Name * Email * Phone * Cover Letter * Upload CV/Resume *Allowed Type(s): .pdf, .doc, .docx By using this form you agree with the storage and handling of your data by this website. *

Greetings From Tata Consultancy Services!!! Role: Big Data Developer (Hive, Pyspark) Years of Experience: 4 to 10 yrs Location: Chennai, Hyderabad, Bengaluru Notice Period: 0- 90 days Date of Interview: 21st Nov 2025 Mode of Interview: Virtual Drive (Cisco or Webex) Time Of Interview: 5.00PM To 7.00PM Job Description: Roles & Responsibilities: Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. Should be able to develop, tweak queries and work on performance enhancement. Solid understanding of object-oriented programming and HDFS concepts The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production ...

Greetings from Tata Consultancy Services!!! TCS is conducting Weekday Virtual drive for the role of Azure Data Engineer Years of experience: 6 to 10 yrs Location: Hyderabad Notice Period: 0 to 60 days Date of Interview: 19,20,21st Nov 2025 Time of Interview: 10 AM to 2 PM Interview Mode: Virtual Mode Ex-TCSers are not applicable Job description: Relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Ser...

Location - LTIM Pan India Experience - 5+to 12+ yrs Generic JD- Mandatory Skills - Data Science, Gen AI, Python, RAG and Azure/AWS/GCP, AI/ML, NLP Secondary - (Any) Machine Learning, Deep Learning, ChatGPT, Langchain, Prompt, vector stores, RAG, llama, Computer vision, Deep learning, Machine learning, OCR, Transformer, regression, forecasting, classification, hyper parameter tunning, MLOps, Inference, Model training, Model Deployment JD_ More than 6 years of experience in Data Engineering, Data Science and AI / ML domain Excellent understanding of machine learning techniques and algorithms, such as GPTs, CNN, RNN, k-NN, Naive Bayes, SVM, Decision Forests, etc. Experience using business intel...

Greetings from Tata Consulting Services TCS is Hiring for Big Data Developer Experience : 4-10 years Location: Chennai/Hyderabad/Bangalore Please find the JD below Required Technical Skill - Pyspark, Hadoop,Hive

Primary skills:Technology->Cloud Platform->Azure Development & Solution Architecting Requirements: Experience in Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF). Experience in designing, developing, and maintaining data pipelines and data streams. Experience in moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Experience in working with stakeholders to understand their data needs and provide solutions. Experience in collaborating with other teams to ensure data quality and consistency. Experience in developing and maintaining data models and data dictionaries. Experience in developing and maintaining ETL processes. Experience ...

You will be responsible for designing, developing, and maintaining scalable and efficient data processing pipelines using PySpark and Python. Your key responsibilities will include: - Building and implementing ETL (Extract, Transform, Load) processes to ingest data from various sources and load it into target destinations. - Optimizing PySpark applications for performance and troubleshooting existing code. - Ensuring data integrity and quality throughout the data lifecycle. - Collaborating with cross-functional teams, including data engineers and data scientists, to understand and fulfill data needs. - Providing technical leadership, conducting code reviews, and mentoring junior team members...

Profile : Senior Data Engineer (Azure) Experience Required : 6+ Years Work Mode : Hybrid Location : Gurgaon, Pune, Jaipur, Bangalore, Bhopal Employment Type : Full-time About The Role We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Azure ecosystem to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining enterprise-scale data solutions on Azure, working with cutting-edge cloud technologies and big data platforms. Key Responsibilities Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Migration Service, Data Pipeline. Provisioning, configuring, ...

Role Overview: As a Data Engineer at our company, you will be responsible for designing, developing, and maintaining our data infrastructure to support analytics. You will play a crucial role in turning data into actionable insights and contribute to our mission. Key Responsibilities: - Utilize expertise in PySpark, Python, SQL, Git, and AWS to work on data engineering and data processing tasks. - Design and develop data warehousing solutions and data models. - Collaborate with the team to implement big data technologies like Hadoop and Spark. - Maintain and optimize AWS services such as Glue, Lambda, Step Functions, S3, and Athena. - Stay updated with the latest trends in data engineering a...

You will be responsible for developing and implementing credit risk models, monitoring portfolio quality, and performing periodic alignments of the models to fit business requirements. - Develop and maintain credit risk models, covering the customer life cycle engagement, including acquisition, fraud, portfolio/debt management, and cross-sell/upsell. - Identify trends, patterns, and correlations that influence credit risk decisions. - Evaluate various data sources, including but not limited to bureau data, alternate data, and customer digital footprints, to enhance the decision-making process and enhance credit model designs. - Collaborate with cross-functional teams to integrate models into...

Role Overview: As an Integration Architect, you will be responsible for continuously investing in learning and staying up-to-date with the latest trends in Data Governance, Analytics, and Data Science approaches, solutions, frameworks, technology offerings, and best practices. Your role will involve a combination of technical expertise and strong business acumen. Key Responsibilities: - Minimum 4 years of experience with Data Governance including MDM tools, data cataloging, lineage tools, and data quality monitoring - Minimum 3 years of experience in Python, PySpark, and SQL development - 2 years of experience in building data quality monitoring tables in Databricks and presenting results in...

As a Data Engineer at JPMorgan Chase within the Employee Platforms team, you will be responsible for executing creative software and data solutions, developing secure high-quality production code and data pipelines, and identifying opportunities to automate remediation of recurring issues. You will work closely with business stakeholders to understand requirements, design appropriate solutions, and implement robust monitoring and alerting systems to optimize performance and throughput. Additionally, you will design and implement scalable data frameworks for workforce data analytics and share best practices with Platform and Architecture teams. Key Responsibilities: - Execute creative softwar...

As a Senior Python Data Engineer with 4+ years of experience, you will play a crucial role in designing, building, and optimizing reliable data platforms and analytics solutions by partnering with product, analytics, and business teams. Your expertise in Azure Databricks, PySpark, Spark SQL, and Power BI will be essential in ensuring the success of our projects in a fast-paced and collaborative environment. **Key Responsibilities:** - Design and implement scalable ETL/ELT pipelines on Azure Databricks using PySpark/Spark SQL. - Model data for semantic layers to power BI and analytics use cases. - Build and maintain Power BI datasets, reports, and dashboards, utilizing DAX, data modeling, and...

As a skilled Data Developer, you will be responsible for designing, building, and maintaining efficient and scalable ETL/ELT data pipelines. Your expertise in Python or PySpark, data integration, and modern big data platforms will be essential in ensuring reliable and high-quality data delivery across systems. You will collaborate closely with data engineers, analysts, and stakeholders to meet the organization's data needs. Key Responsibilities: - Design, develop, and maintain efficient and scalable ETL/ELT data pipelines using Python or PySpark. - Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver technical data solutions. - Perform d...

As an Architect with over 12 years of experience in Data Modeling/Data Warehousing and 5+ years in Snowflake, your role will involve leading Snowflake optimizations, setting up and configuring Snowflake components, and implementing cloud management frameworks. Your proficiency in Python, PySpark, SQL, and experience with cloud platforms (AWS, Azure, GCP) are essential for this position. **Key Responsibilities:** - Work on Snowflake optimizations at both the warehouse and database levels. - Setup, configure, and deploy Snowflake components, including Databases, Warehouses, and Roles. - Setup and monitor data shares and Snow Pipes for Snowflake projects. - Implement Snowflake Cloud management ...

As a Data Engineer with a strong background in Python, you will be responsible for designing, developing, and maintaining robust data pipelines and ETL processes to support data ingestion and transformation. Your role will involve collaborating with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions. Additionally, you will implement data models and architectures to support analytics and reporting needs while optimizing data storage and retrieval processes for performance and scalability. Ensuring data quality and integrity through rigorous testing and validation processes will be crucial, along with monitoring and troubleshooti...

Role Overview: As an AI Data Engineer, your main responsibility will be to build scalable, high-quality data pipelines that support advanced analytics and AI/ML models. You will play a crucial role in transforming raw data into reliable datasets that are ready for AI applications. If you find satisfaction in working with data and turning it into valuable insights, this role is tailored for you. Key Responsibilities: - Design, build, and maintain end-to-end data pipelines specifically for AI/ML workloads - Develop high-quality datasets suitable for modeling by transforming, cleaning, and enriching raw data - Manage feature stores and assist ML engineers with feature engineering - Collaborate ...

In your role as a Machine Learning Engineer, you will be responsible for developing and deploying end-to-end Machine Learning models using Python, Classical ML algorithms, and scalable Databricks workflows such as PySpark, MLflow, and Delta Lake. Your key responsibilities will include: - Leading GenAI initiatives, which involve tasks such as LLM fine-tuning, RAG pipelines, prompt engineering, and vector database integrations. - Building robust data pipelines, performing feature engineering, and optimizing models for performance and production readiness. - Collaborating with cross-functional teams to translate business problems into ML/GenAI solutions with measurable outcomes. - Conducting ad...