15749 Hadoop Jobs - Page 8

Job Overview: We are seeking an experienced and motivated Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, PySpark, SQL, Hive, and cloud platforms such as AWS or Azure. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems to support our data analytics and business intelligence initiatives. Key Responsibilities: Data Architecture & Design: Design and implement scalable data architectures, pipelines, and workflows to handle large volumes of structured and unstructured data. Big Data Processing: Develop and maintain data processing frameworks using PySpark to handl...

Job Overview: We are seeking an experienced and motivated Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, PySpark, SQL, Hive, and cloud platforms such as AWS or Azure. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems to support our data analytics and business intelligence initiatives. Key Responsibilities: Data Architecture & Design: Design and implement scalable data architectures, pipelines, and workflows to handle large volumes of structured and unstructured data. Big Data Processing: Develop and maintain data processing frameworks using PySpark to handl...

5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile.

5-8 years' experience candidate as back end - data engineer. Strong experience in SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile.

5-8 years' experience candidate as back end - data engineer. Strong experience in Hadoop,Spark and SQL. Strong knowledge and experience Python and PySpark. Experience in AWS. Experience in Docker and Openshift. Hands on experience with REST Concepts. Design and Develop business solutions on the data front. Experience in implementation of new enhancements and also handling defect triage. Candidate must have strong analytical abilities . Skills/ Competency Additionally Preferred Jira, Bit Bucket Experience on Kafka. Experience on Snowflake. Domain knowledge in Banking. Analytical skills.. Excellent communication skills Working knowledge of Agile.

Scala & Spark - Intermediate/Advanced level is a mandate. Data structures and algorithms in Scala. Minimum 4+ years of experience in Scala/Spark. 4. Need to have a big-data background

We are looking for a skilled professional with expertise in PERL scripting and Linux Shell Scripting to join our team on an immediate contract basis. The ideal candidate will have 6-18 years of experience. Roles and Responsibility Maintain and enhance scripting applications developed in PERL and Linux Shell scripting. Develop new scripting application/tools in PERL and Linux Shell scripting. Collaborate with cross-functional teams to identify and prioritize project requirements. Design, develop, and test PERL scripts and Linux Shell scripts. Troubleshoot and resolve technical issues related to PERL scripts and Linux Shell scripts. Ensure high-quality deliverables and adhere to industry stand...

We are looking for a skilled Data Engineer with 6-15 years of experience to design, develop, and maintain data pipelines using Snowflake, DBT, and AWS. The ideal candidate will have a strong background in data modeling, ETL processes, and data warehousing. Roles and Responsibility Design, develop, and maintain data pipelines using Snowflake, DBT, and AWS. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Optimize and troubleshoot existing data workflows to ensure efficiency and reliability. Implement best practices for data management and governance. Stay updated with the latest industry trends and technologies to continuously improve our data inf...

This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics. About the Role The Engineer will work closely with product partner, data analyst, report developers, architects, data scientists and other engineers on data initiatives and will be involved in designing our next generation of data platform architecture to support increasing data demands. Responsibilities Design, build and maintain scalable and reliable data pipelines to process large volumes of structures, semi-structured and un-structured data from diverse sources. Develop ETL processes to ingest, transform and load dat...

Role & responsibilities: Big data engineer Bigdata Hadoop + Scala + Spark

JD:- Total Yrs. of Experience* 6+ Relevant Yrs. of experience* 6+ Detailed JD *(Roles and Responsibilities) 6+ years experience in Kafka, Spark, Scala ,Pyspark Strong knowledge of implementing and maintaining scalable streaming and batch data solutions with high throughput and strict SLA. Extensive experience of working in production with Kafka, Spark and Kafka Stream including best practices, observability, optimization, performance tuning. Knowledge of Python and Scala including best practices, architecture, dependency management Collaborate with cross-functional teams to understand data requirements and integrate data from multiple sources, ensuring data consistency and quality Mandatory ...

Job Description Key Responsibilities Design and develop scalable and efficient big data solutions to process and analyze large datasets. Build and optimize ETL/ELT pipelines for data ingestion, transformation, and storage. Work with Apache Spark, Hadoop, Kafka, and other big data frameworks to develop high-performance data processing solutions. Implement and maintain data lakes, data warehouses, and real-time streaming solutions. Optimize query performance, data storage, and data retrieval mechanisms. Ensure data security, governance, and compliance with industry standards. Collaborate with data scientists, analysts, and business teams to provide data-driven insights.

Big Data - Senior Python + Spark Developer Location : Bangalore Experience : 7-12 years Interview Process : L1 : Online interview with external panel Weekday/Weekend L2 : Face-to-face at Tech Mahindra Job Responsibilities : Develop and maintain Python and Spark applications Write clean, efficient, and reusable Python code Work with Pandas and Polars for data processing Implement Spark Core, Spark SQL, and Spark Streaming Collaborate with teams and guide junior developers Handle performance tuning and troubleshooting Skills Required : Strong Python and Spark programming skills Experience with Pandas and Polars Knowledge of Hadoop ecosystem Good problem-solving and teamwork skills Interested c...

We are looking for a skilled Lead Data Engineer with 10-15 years of experience to lead our team in designing, implementing, and optimizing scalable data solutions using Azure data services. The ideal candidate will have a strong background in data engineering best practices, data modeling, and ETL processes. Roles and Responsibility Lead and mentor a team of Azure Data Engineers, providing technical guidance and support. Design, implement, and optimize scalable data solutions using Azure data services such as Azure Databricks, Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics. Ensure data engineering best practices and data governance are followed. Collaborate with cross-fu...

We are looking for a skilled Data Scientist with 6 to 15 years of experience to join our team in Bangalore, Mysore, and Pune. The ideal candidate will have expertise in machine learning, deep learning, and data visualization. Roles and Responsibility Develop and implement predictive models using Python, R, and SQL. Analyze large datasets to extract insights and trends. Design and deploy data visualizations using Power BI and Tableau. Collaborate with cross-functional teams to integrate data science solutions. Work on big data projects using Spark and Hadoop. Apply machine learning techniques to solve complex problems. Job Requirements Strong proficiency in programming languages such as Pytho...

Job type Contract to HIRE Primary Skills 6-8yrs of Experience in working as bigdata developer/supporting environemnts Strong knowledge in Unix/BigData Scripting Strong understanding of BigData (CDP/Hive) Environment Hands-on with GitHub and CI-CD implementations. Attitude to learn / understand ever task doing with reason Ability to work independently on specialized assignments within the context of project deliverable Take ownership of providing solutions and tools that iteratively increase engineering efficiencies. Excellent communication skills & team player Good to have hadoop, Control-M Tooling knowledge. Good to have Automation experience, knowledge of any Monitoring Tools. Role You wil...

Primary Skill Python, Spark, Unix, Hive, Hadoop - Big Data Technologies Good to Have -- Hive, Big data Components Exp 5- 12 Yrs Senior Developer – 8+ years of experience Strong proficiency in programming with hands-on experience with relevant frameworks/libraries. Experience with PySpark and Pandas/Polars for data manipulation. Solid understanding of Test-driven Development and best coding practices. Experience with API architecture, microservices and Kubernetes. Familiarity with CI/CD pipelines and Azure DevOps. Excellent cross-team collaboration and communication skills. Experience with orchestration tools like Airflow and reporting tools such as Superset .

We are looking for a skilled professional with 12-16 years of experience to join our team as an Azure Data Engineer in Bengaluru. The ideal candidate will have expertise in writing terraform code to deploy Azure Data Services on the Azure Platform. Roles and Responsibility Design, develop, and implement data pipelines using Azure Data Factory. Deploy and manage Azure DataLake and Azure Databricks services. Develop and maintain terraform templates and modules for data infrastructure. Collaborate with cross-functional teams to ensure seamless integration of data systems. Troubleshoot and resolve issues related to data quality and performance. Ensure compliance with security and governance stan...

Role & responsibilities 6+ years in data analysis with a strategic mindset and data engineering background. Strong proficiency in SQL Hands-on experience with Tableau , Power BI , or Domo Familiarity with AWS , Hive , Snowflake , Presto ( Big data - Hadoop - Mandate ) Ability to define and track KPIs across Sales, Consumer Behaviour, and Supply Chain Bonus: Experience in Retail or eCommerce domains

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data trans...

ANSR is hiring for one of its clients. About T-Mobile: T-Mobile US, Inc. (NASDAQ: TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flagship brands, T-Mobile and Metro by T-Mobile. Customers benefit from an unmatched combination of value, quality, and exceptional service experience. About TMUS Global Solutions: TMUS Global Solutions is a world-class technology powerhouse accelerating the company’s global digital transformation. With a culture built on growth, inclusivity, and global collaboration, the teams here drive innovation at scale, powered by bold thinking. TMUS India Private Limited is a s...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Type: Contract Description: GCPdata engineer Big Query SQL Python Talend ETL ProgrammerGCPor Any Cloud technology. Experienced in GCP data engineer Big Query SQL Python Talend ETL Programmer GCPor Any Cloud technology. Good experience in building the pipeline of GCP Components to load the data into Big Query and to cloud storage buckets. Excellent Data Analysis skills. Good written and oral communication skills Self-motivated able to work independently

Strong experience - Execute, complete, debug and enhance ETL using SQL, Python, SAS (EG & SMC), O365, Excel etc. Ability to present data in a graphical or pictorial format based on requirements using NABs visualisation tools such as Power BI. Demonstrable experience in data pipeline design and build and understand how to deal with various data types and missing data. Secondary skills: Over 2 years working experience in in one or more of the following functions: collections, fraud, lending operations and payments in financial institution/banking industry. Understand financial services data and able to understand data models and relationships to compile reporting and metrics.