49893 Spark Jobs - Page 5

Job Description Join our AWS Data Engineer Walkin drive on 13th Dec'25 Years of Exp : 5-10 Years Primary Skillset: AWS,Python,SQL,Pyspark, Databricks and Data Modelling -Knowledge. Walkin Drive : 13th Dec'25 Time : 10.30 AM-3.00PM Registration Link For Walkin Drive: https://agilisium.zohorecruit.com/jobs/Careers/589705000033514003/Data-Engineer?source=CareerSite Venue: World Trade Center 1st floor of Tower B, 5/142, Rajiv Gandhi Salai, Perungudi, Chennai, Tamil Nadu 600096 Job Description: Proven experience as a Data Engineer (typically 5-10 years, depending on level). Strong hands-on experience with Python for data engineering tasks. Proficiency in SQL (writing complex queries, performance ...

Position Summary: Job Title: Senior Data Engineer Location: India Project: Enterprise Data Hub (EDH) About the Role We are seeking a highly skilled and hands-on Senior Data Engineer to join our EDH initiative. This role demands deep expertise in building scalable data pipelines and automation frameworks using Databricks and the Azure ecosystem. The ideal candidate will have a strong engineering mindset, leadership experience, and a passion for solving complex data challenges. Location: Mumbai - India What will your job entail Key Responsibilities Design, develop, and optimize scalable data pipelines using Databricks and Apache Spark Implement job orchestration and automation using tools like...

Greetings!!! TCS is hiring... Role: GCP Data Enginee EXP: 6 - 8 YEARS LOCATION: Bengaluru Notice Period- 30 DAYS Mandatory Skills Excellent communication ( both oral and written ) and documentation Hands-on experience in the complete eco-system of any one/more of the various Hadoop distributions such as MapR ( preferred ) and/or Hortonworks and/or Cloudera and/or Apache Hadoop , with specialization in tools such as Spark (Core and SQL) , Hive and NoSql Databases such as HBase and/or Cassandra and/or MongoDB Hands-on experience in the various services of Google Cloud Platform ( GCP ) cloud such as CloudStorage, DataFlow, DataProc, CI/CD, BigQuery , Spanner, BigTable, Composer, Pub/Sub, Hyper-...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities: * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform * Experience in d...

Role Description As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the se...

Role Description As a Technical Lead - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the s...

Job Summary NetApp is developing a portfolio of data-centric storage platforms and services to help the world’s leading organizations harness their data in new and interesting ways. In support of that mission, we are rapidly growing our Keystone team. The Keystone Service team is responsible for cutting-edge technologies that enable NetApp’s Pay as you go offering. Keystone Service helps customers manage data on prem or in the cloud and have invoices that are charged in a subscription manner As a Senior Data Engineer in the NetApp’s Keystone organization, you will be responsible for leading and executing our most challenging and complex projects. You will be responsible for decomposing compl...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your day will involve collaborating with team members to ensure the successful implementation of sof...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your day will involve collaborating with team members to ensure the successful implementation of sof...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your day will involve collaborating with team members to ensure the successful implementation of sof...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Job Description Job Title: Sales Development Representative Location: Bangalore Experience Range: 3-5 Years As a Sales Development Representative , you are the first link in our sales process and the driving force behind our growth. You will directly reach out to potential clients, convince them of the value of our services, and ensure we can move forward with the right leads. You lay the foundation for long-term client relationships and play a crucial role in the success of our sales team. What You ll Do: Cold calling - Contact prospects and spark their interest in our IT services. Qualifying leads - Identify customers needs and determine if they are a good fit for our services. Building re...

The job includes all parts of software development lifecycle: refining product vision, gathering requirements, software system design, coding, testing, release and support. As our team is spread around the globe, you will work collaboratively with other team members from different locations. Develop software that is well-crafted & steadily adds business value, as part of a community of professionals Engage with internal and external customers for requirements, change requests and incidents to help define application specifications Own one or more components of software architecture in immediate environment Be part of an agile team, share knowledge, do code reviews, pro-active communication D...

About The Role Strong knowledge of Spark, Scala, Python, and PySpark. Strong in SQL concepts. Good to have knowledge of Big Data technologies like Hive, Sqoop, Pig, Kafka, Flume. Experience with version control tools such as SVN and GitHub, as well as production deployment processes. Basic knowledge in the following skill sets: SQL Server Linux Shell Scripting Data Warehousing concepts Job Details Location Chennai Job Function IT Infrastructure Services Role Lead Desired Skills Python, Scala, Spark, SQL, Apache Spark Desired Candidate Profile Qualifications: Bachelor of Engineering

Responsibilities: Build and manage data pipelines using Medallion Architecture (Bronze, Silver, Gold layers). Ingest and process raw data using Spark and AWS EMR. Automate data transformations using DBT. Optimize Elasticsearch clusters and queries. Work with AWS services for data storage and orchestration. Skills: Elasticsearch (ELK stack) Must Spark, Python, ETL AWS (S3, Lambda, EMR) DBT for data transformation Apache Airflow or similar orchestration tools Kubernetes (preferred)

About The Role Project Role : Custom Software Engineer Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs and quality standards. You wil...

About The Role Project Role : Custom Software Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your day will involve collaborating with team members to ensure the successful implementation of software...

Senior AWS Big Data Engineer/Lead Job Description Senior AWS Big Data Engineer/Lead required at PAN India locations. Experience Range: 9 to 15 Years Key Technical Skills Relevant experience of 9-15 years in this role. Deep expertise in building data pipelines on AWS Cloud. Hands-on implementation knowledge to develop, build, and deploy data pipelines on AWS. Proficient in PySpark (Python + Spark) and code development. Working knowledge of AWS services such as EMR, Lambda, S3, etc. Knowledge of AWS data services including Data Lake, Glue, Athena. Knowledge of CI/CD and Airflow is an advantage. Location Mumbai Job Function Consultancy Role Engineer Desired Skills AWS | Python | Integration Qua...

About The Role Project Role : Custom Software Engineer Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs and quality standards. You wil...

Job Summary The NetApp Keystone team develops cutting-edge technologies that power NetApp’s pay-as-you-go subscription services, enabling customers to manage data seamlessly on-premises or in the cloud. As a software engineer in this organization, you will work on complex projects, breaking down challenging requirements into simple, scalable solutions while applying engineering best practices. This role offers the opportunity to tackle unsolved customer issues, influence feature improvements across engineering teams, learn storage as a subscription service, and collaborate with peers to deliver an exceptional customer experience. Job Requirements 5+ years’ experience in Data Engineering and ...

Role Description: We are looking for highly motivated expert Senior Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-stru...

Position: Scala / Databricks Engineer (Big Data & Spark) Analyze and understand the current Apache Spark platform codebase, including performance nuances. Optimize and fine-tune Spark jobs for efficiency and high performance. Work with large-scale distributed systems for big data processing and analytics. Implement best practices for data storage, processing, and retrieval. Design, build, and maintain ETL pipelines and data workflows. Handle Apache Hadoop development and implementation responsibilities. Collaborate with data science teams to implement analytics pipelines. Define and support data governance , versioning, and security processes. Ensure data privacy compliance in coordination w...

Role: Data Engineer Experience: 6-9 Years Location: Bangalore/Pune Notice Period: Immediate Joiners Only Technical and professional skills: We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: 6+ years of experience in Cloud Data Engineering. Proficient in Cloud Services Azure Build ETL and data movement solutions. Migrate data from traditional database systems to Cloud environment Strong hands-on experience for working with Streaming dataset Building Complex Notebook in Databricks to achieve business Transformations. Hands-on Experience in Data Refinement using Pyspark and Spark SQL Familiarity with building dataset u...

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL,Azure Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python , Azure and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineer...

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL,AWS Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python , AWS and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineering ...