15749 Hadoop Jobs - Page 15

Position Summary: Perform DataLake(Azure Databricks) operations on healthcare data from multiple sources. To succeed in this role, the candidate should be analytical and excellent communicator. Experience in the healthcare industry is a plus. Experience integrating data from disparate sources in MS SQL and DataLake Environment. You will be responsible towards working with different stakeholders to accomplish business and operation goals. Key Duties & Responsibilities: Data processing (ETL) using MSSQL, DataLake (Azure Databricks), Python, Scala, GitHub with T-SQL stored procedures, views, and other various database objects; import and export processing; data conversions; business process wor...

About the Opportunity Job TypeApplication 20 June 2025 Title Data Scientist, Risk Data Analytics Department Data Value Location Gurgaon Reports To Associate Director, Risk Data Analytics Level 5 Were proud to have been helping our clients build better financial futures for over 50 years. How have we achieved thisBy working together - and supporting each other - all over the world. So, join our Data Value team and feel like youre part of something bigger. About Global Risk The Global Risk team in Fidelity covers the management oversight of Fidelitys risk profile, including key risk frameworks, policies and procedures and oversight and challenge processes. The team partner with the businesses ...

About this role: Wells Fargo is seeking a Lead Software Engineer. In this role, you will: Lead complex technology initiatives including those that are companywide with broad impact Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technology solutions for technology engineering disciplines Design, code, test, debug, and document for projects and programs Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technica...

Key Responsibilities : Design, develop, and maintain scalable data pipelines using modern ETL/ELT tools and frameworks Implement efficient data models and warehousing solutions to support business intelligence initiatives Write high-quality, documented code for data integration, transformation, and automation Design and optimize database schemas and query performance Develop and maintain data quality monitoring systems and procedures Implement data governance practices and ensure data security compliance Troubleshoot complex data pipeline issues and performance bottlenecks Collaborate with stakeholders to gather requirements and translate them into technical specifications Create and maintai...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : Python (Programming Language), Amazon Web Services (AWS), Machine LearningMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutio...

We are looking for a skilled Data Engineer with AWS to join our team in Bangalore. The ideal candidate will have 4 to 6 years of experience and a strong background in data architecture, including data modeling, data mining, and data ingestion. Roles and Responsibility Design and implement data architectures, including data modeling, data mining, and data ingestion. Develop ETL scripts using languages such as Python, Node.js, SQL, and other databases. Integrate batch, near real-time, and real-time data from various sources. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing data validation and testing proc...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

We are looking for a skilled Apache Spark Developer with 4 to 10 years of experience to join our team in Pune. The ideal candidate will have expertise in developing data lake solutions using Scala/Python and coding experience using Spark. Roles and Responsibility Design, develop, and implement data lake solutions using Scala/Python. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems using Spark. Optimize data storage and retrieval processes for performance and efficiency. Troubleshoot and resolve technical issues related to data processing and analysis. Participate in code reviews and contribute to...

We are looking for a skilled GCP Data Engineer with 5-10 years of experience to join our team in Pune, Bangalore, and Hyderabad. The ideal candidate will have a strong background in data analytics tools and techniques. Roles and Responsibility Design and develop scalable data pipelines using GCP-based data analytics tools. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures using Big Query, Cloud Composer, and Data Fusion. Ensure data quality and integrity by implementing robust testing and validation procedures. Work closely with DevOps teams to ensure seamless deployment and operation of data systems. ...

We are looking for a skilled professional with 6 to 11 years of experience in Databricks and Snowflake to join our team in Pune, Bangalore, Chennai, and Coimbatore. The ideal candidate will have a strong background in data processing and analytics. Roles and Responsibility Design and develop scalable data pipelines using Azure Data Factory and Azure Data Bricks Spark. Collaborate with cross-functional teams to integrate data from various sources into Snowflake. Develop and maintain complex SQL queries to optimize database performance. Implement data ingestion techniques using Azure tools such as Sqoop and Hadoop. Work on orchestration tools to ensure seamless data flow across the organizatio...

We are looking for a skilled Hadoop Admin with 4 to 9 years of experience. The ideal candidate will have expertise in Hadoop administration, CDP distribution, Dataflow, and Big data platform. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement data pipelines using Kafka and Nifi profiles. Develop and execute Linux shell scripts for automation and monitoring. Collaborate with cross-functional teams to resolve technical issues and improve processes. Ensure compliance with security best practices and industry standards. Troubleshoot and optimize HBase databases for improved query performance. Job Requirements Stron...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

We are looking for a skilled Senior Data Engineer with 5 to 10 years of experience to join our team in Gurugram. The ideal candidate will have expertise in building Data Lakes, Data Warehouses using Big data & cloud stack, and data modeling. Roles and Responsibility Design and develop scalable data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and databases. Ensure data quality and integrity through data validation and testing procedures. Implement Agile development methodologies to ensure timely delivery of projects. Optimize data storage and retrieval processes for improved...

We are looking for a skilled professional with 7-10 years of experience to join our team as a Stream Sets expert in Bangalore. Roles and Responsibility Design, develop, and implement Stream Sets solutions to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain Unix scripts for automation and troubleshooting. Administer and maintain StreamSets instances, including installation, patching, and upgrading. Troubleshoot and resolve technical issues related to StreamSets. Provide technical support and training to end-users on StreamSets applications. Job Requirements Strong knowledge of StreamSets administration, s...

We are looking for a skilled professional with expertise in Databricks, Hadoop, Python, SQL, and Pyspark to join our team. The ideal candidate should have 6-9 years of experience. Roles and Responsibility Design and develop scalable data pipelines using Databricks and Hadoop. Collaborate with cross-functional teams to integrate data from various sources. Develop and maintain large-scale data warehouses using SQL and Pyspark. Troubleshoot and resolve complex technical issues related to data processing. Optimize data storage and retrieval processes for improved efficiency. Ensure data quality and integrity by implementing robust testing and validation procedures. Job Requirements Strong profic...

We are looking for a skilled PySpark Lead with 5-8 years of experience to join our team in Bangalore. The ideal candidate will have expertise in designing and developing ETL/ Data Engineering Pipelines using PySpark. Roles and Responsibility Design and develop scalable data pipelines using PySpark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data pipeline performance and efficiency by analyzing system metrics and identifying areas for improvement. Provide technic...

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Responsibilities: Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes. Create the data integration and data diagram documentation. Lead the data validation, UAT and regression test for new data asset creation. Create and maintain data models, including schema design and optimization. Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency. Qualifications and Skills: Strong knowledge on Python and Pyspark Expectation is to...

We are looking for a skilled professional with expertise in Scala to join our team. The ideal candidate should have 7 to 10 years of experience and be based in Bangalore, Chennai, Pune, Hyderabad, GNDc, Coimbatore, or Mumbai. Roles and Responsibility Design, develop, and test software applications using Scala. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Implement machine learning algorithms and data warehousing solutions. Ensure high-quality code and adhere to industry standards. Participate in code reviews and contribute to the improvement of the overall codebase. Job Requirements...

We are looking for a skilled Business System Analyst with 5 to 12 years of experience to join our team in Pune, Bangalore, and Chennai. Roles and Responsibility Collaborate with cross-functional teams to gather requirements and develop business solutions. Analyze data using tools such as Azure, Databricks, Pyspark/Python, SQL, Power BI, Tableau, and Azure Data Factory. Develop and maintain backlogs and data maps to support business operations. Work closely with stakeholders to identify business needs and develop solutions. Utilize strong analytical skills to drive business growth and improvement. Stay up-to-date with industry trends and emerging technologies. Job Requirements Strong combinat...

We are looking for a skilled Data Engineer with 4 to 6 years of experience to join our team in Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, and Gurgaon. The ideal candidate will have expertise in SQL, ADF, ETL, Databricks, PySpark, GENAI, Azure AI Cognitive, and Data Engineering. Roles and Responsibility Design and develop data pipelines using various tools and technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and architectures. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows for improved performance and efficie...

We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive. Roles and Responsibility Design and develop scalable data pipelines using PySpark and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring high performance and reliability. Troubleshoot and resolve complex technical issues related to data processing and analysis. Implement automated testing and val...

We are looking for a skilled professional with 4 to 7 years of experience in the field, located in Chennai. The ideal candidate should have expertise in Google BigQuery, SQL, Python, Apache Airflow, and Oracle to BigQuery DWH migration and modernization. Roles and Responsibility Design and develop scalable data pipelines using Google BigQuery, DataProc, and GCS. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data warehouses using Oracle DB and PL/SQL. Implement data quality checks and validation processes to ensure data integrity. Optimize database performance and troubleshoot issues as needed. Work closely with stake...

We are looking for a skilled AI Lead with expertise in Google Cloud Architecture to join our team. The ideal candidate will have 9+ years of experience and be based in Pan India, including Hyderabad, Chennai, Bangalore, Pune, Mumbai, Gurgaon, or Delhi. Roles and Responsibility Design and implement scalable and efficient AI solutions using Google Cloud Architecture. Develop and deploy machine learning models using Python, R, or Java. Collaborate with cross-functional teams to integrate AI models into existing systems. Conduct research and stay updated on the latest AI technologies and trends. Develop and maintain technical documentation for AI projects. Troubleshoot and resolve complex techni...

We are looking for a skilled Data Engineer with 6 to 11 years of experience to join our team in Bangalore. The ideal candidate will have expertise in SQL, ETL, data modeling, and programming languages such as Python, C++, C#, Scala, etc. Roles and Responsibility Design and develop scalable data pipelines using Big Data/MPP analytics platforms. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale databases and data systems. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Participate in code reviews and cont...