Get alerts for new jobs matching your selected skills, preferred locations, and experience range. Manage Job Alerts
6.0 - 11.0 years
6 - 9 Lacs
bengaluru
Work from Office
As a Techie, Do you face these challenges while pursuing opportunities? Navigating numerous job platforms. Enduring lengthy interview processes. Tedious negotiation phases. Ambiguity about project quality. Getting entangled in unsatisfactory work cultures. Wavering job security. What are we looking for ? Actively seeking experienced senior developers in #Spark and #Kafka who are open to working in the PST timezone. Ideal candidates should possess a minimum of 6 years of hands-on experience with Spark, Kafka, #java, Postgres, and a track record of successfully delivering 3-4 Spark projects.
Posted 1 month ago
10.0 - 13.0 years
12 - 16 Lacs
bengaluru
Work from Office
Data Strategy & Data Governance Manager Join our team in Technology Strategy for an exciting career opportunity to enable our most strategic clients to realize exceptional business value from technology Practice: Technology Strategy & Advisory, Capability Network I Areas of Work: Data Strategy I Level: Manager | Location: Bangalore/Gurgaon/Mumbai/Pune/Chennai/Hyderabad/Kolkata | Years of Exp: 10 to 15 years Explore an Exciting Career at Accenture Do you believe in creating an impact? Are you a problem solver who enjoys working on transformative strategies for global clients? Are you passionate about being part of an inclusive, diverse and collaborative culture? Then, this is the right place ...
Posted 1 month ago
8.0 - 13.0 years
5 - 9 Lacs
mumbai
Work from Office
Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly skilled and experienced ETL Lead with a strong background in Data Warehousing, ETL processes, and Big Data technologies. The ideal candidate should have hands-on experience with Cloudera tools, excellent SQL/PLSQL skills, and the ability to lead a team while working closely with clients in the Banking/Insurance domain. Roles & Responsibil...
Posted 1 month ago
4.0 - 9.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
3.0 - 5.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
3.0 - 5.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
3.0 - 5.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
5.0 - 10.0 years
22 - 27 Lacs
bengaluru
Work from Office
Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...
Posted 1 month ago
3.0 - 5.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
3.0 - 5.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
3.0 - 5.0 years
12 - 16 Lacs
kochi
Work from Office
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...
Posted 1 month ago
4.0 - 9.0 years
10 - 15 Lacs
pune
Work from Office
Application Developer - Cloudera Data Platform Role & responsibilities Serve as a Subject Matter Expert (SME) in the Cloudera Data Platform, providing technical leadership and guidance to the team. Collaborate and manage the team to ensure performance and project success. Engage with multiple teams, offering input and support on key project decisions. Deliver solutions to complex problems, both within your immediate team and across broader groups. Facilitate knowledge sharing sessions to enhance overall team capabilities. Monitor project progress and ensure timely delivery of application features and milestones. Preferred candidate profile Must-Have: Proficiency in Cloudera Data Platform. St...
Posted 1 month ago
4.0 - 9.0 years
15 - 30 Lacs
bengaluru
Work from Office
Overview We're looking for a motivated Senior Data Engineer to manage the transformation of data pipelines from Hadoop to BigQuery. You should have strong experience in Google Cloud Platform (GCP), BigQuery, and Dataproc, as well as proficiency in Linux/Unix environments. Experience with Spark, Scala or Python and shell scripting Responsibilities Mandatory Skills: Experience in pipeline migration from Hadoop to BigQuery. Proficiency with GCP, BigQuery, and Dataproc. Strong skills in Linux/Unix environments. Knowledge of Spark, Scala or Python. Advanced Experience with SQL (Any Query Language), shell scripting Strong Analytical skills Finetech & data migration exp. is an added advantage Requi...
Posted 1 month ago
6.0 - 9.0 years
6 - 10 Lacs
hyderabad, pune
Work from Office
We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment. Roles and Responsibility Design, develop, and implement big data solutions using Hive and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems with high performance and reliability. Troubleshoot and resolve complex technical issues related to big data systems. Participate in code reviews and contribute to the improvement of the o...
Posted 1 month ago
5.0 - 10.0 years
6 - 10 Lacs
hyderabad
Work from Office
1. Understanding the NBA requirements. 2. Provide Subject matter expertise in relation to Pega CDH from technology perspective. 3. Participate actively in the creation and review of the Conceptual Design, Detailed Design, and estimations. 4. Implementing the NBAs as per agreed requirement/solution 5. Supporting the end-to-end testing and provide fixes with quick TAT. 6. Deployment knowledge to manage the implementation activities. 7. Experience in Pega CDH v8.8 multi app or 24.1 and retail banking domain is preferred. 8. Good communication skills
Posted 1 month ago
3.0 - 6.0 years
5 - 9 Lacs
chennai
Work from Office
We are looking for a skilled Hadoop Developer with 3 to 6 years of experience to join our team in Chennai. The ideal candidate will have expertise in Scala, SQL, Unix, and Hive & Spark. Roles and Responsibility Design, develop, and implement scalable data processing solutions using Hadoop technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Scala and Spark. Troubleshoot and resolve complex technical issues related to Hadoop applications. Participate in code reviews and contribute to improving overall code quality. Stay up-to-date with the latest trends and technologies in Hadoop developmen...
Posted 1 month ago
3.0 - 5.0 years
5 - 9 Lacs
bengaluru
Work from Office
Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...
Posted 1 month ago
5.0 - 10.0 years
4 - 8 Lacs
bengaluru
Work from Office
Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...
Posted 1 month ago
6.0 - 10.0 years
30 - 35 Lacs
bengaluru
Work from Office
Design and implement an end-to-end data solution architecture tailored to enterprise analytics and operational needs. Build, maintain, and optimize data pipelines and transformations using Python, SQL, and Spark . Manage large-scale data storage and processing with Iceberg, Hadoop, and HDFS . Develop and maintain dbt models to ensure clean, reliable, and well-structured data. Implement robust data ingestion processes , integrating with third-party APIs and on-premise systems. Collaborate with cross-functional teams to align on business goals and technical requirements. Contribute to documentation and continuously improve engineering and data quality processes. Qualifications 4+ years of expe...
Posted 1 month ago
6.0 - 11.0 years
5 - 9 Lacs
hyderabad, pune, chennai
Work from Office
Job Details: Skill: Scala,hadoop,java, Job type: contract to hire Job Description: - 10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this inclu...
Posted 1 month ago
6.0 - 11.0 years
5 - 8 Lacs
bengaluru
Work from Office
Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .
Posted 1 month ago
5.0 - 10.0 years
6 - 10 Lacs
hyderabad
Hybrid
Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract
Posted 1 month ago
7.0 - 10.0 years
18 - 30 Lacs
pune, bengaluru
Work from Office
Responsibilities : Onboarding and updating data deliveries on our Hadoop Datalake • Developing frameworks to process and deploy new data delivery methods or file formats (JSON, XML, CSV, ProtoBuf, Avro, Parquet, etc) • Creating views and tables for our users with optimal performance for their use case • Experience of connecting and interfacing with systems via APIs • Support both Development and Operations teams in quickly solving complex issues that are hindering the team and/or stakeholders • Coordinating with source teams producing data and also consumers using this data for their use cases • Supporting in the design, building, and testing of new services and extending existing services o...
Posted 1 month ago
7.0 - 10.0 years
2 - 5 Lacs
bhubaneswar, chennai, bengaluru
Work from Office
We are looking for a skilled Hadoop Admin with 7 to 12 years of experience, located in Hyderabad, Bangalore, Chennai, and Bhubaneshwar. The ideal candidate will have hands-on experience in building EKS clusters, Spark on EKS, AWS (EMR, S3, RDS), Python as programming skills, Shell scripting, and any CI/CD. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement scalable data processing pipelines using Spark and Airflow instances. Integrate Ranger and Hive Metastore services in EKS for secure data storage and access. Collaborate with cross-functional teams to identify and resolve technical issues. Develop and impleme...
Posted 1 month ago
5.0 - 10.0 years
3 - 6 Lacs
kolkata, hyderabad, bengaluru
Work from Office
We are looking for skilled Hadoop Developers with 5-10 years of experience to join our team in Bangalore, Kolkata, Hyderabad, and Pune. The ideal candidate should have strong proficiency in Hadoop, Scala, Spark, and SQL. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Spark and Scala. Troubleshoot and resolve complex technical issues related to Hadoop. Participate in code reviews and ensure high-quality code standards. Stay updated with the latest trends and technologies in Hadoop development. Job...
Posted 1 month ago
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Accenture
123151 Jobs | Dublin
Wipro
40198 Jobs | Bengaluru
EY
32154 Jobs | London
Accenture in India
29674 Jobs | Dublin 2
Uplers
24333 Jobs | Ahmedabad
Turing
22774 Jobs | San Francisco
IBM
19350 Jobs | Armonk
Amazon.com
18945 Jobs |
Accenture services Pvt Ltd
18931 Jobs |
Capgemini
18788 Jobs | Paris,France