401 Oozie Jobs - Page 3

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

We are in search of strong Senior Data Engineer(Experience 8-12 years) who is technically passionate, solution-focused, and able to contribute to design, development, test automation and hardening (security, stability, deployment) of our in-house-developed components. As a Data Engineer you will: Design and implement complex new functionality with a strong focus on reliability, performance, and large data sets. Influence technology choices and architecture of newly built components and services. Should be aware of ETL development and various stages of ETL pipeline. Must be very good with SQL, able to write complex queries, stored procedures. Must be good with database and should be able to d...

Inginit is looking for Data engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the qualit...

You will be joining one of the elite units of Infosys Strategic Technology Group (STG) led by the Unit Technology Officer (CTO) as a full stack architect. As part of the Power Programmer initiative in Global Delivery, your primary responsibility will be to build a team of Full Stack Developers. This team will focus on executing complex engineering projects, developing platforms, and creating marketplaces for clients by leveraging cutting-edge technologies. Your role as a full stack architect will require you to stay ahead of the technology curve and continuously enhance your skills to become a Polyglot developer. You will be expected to proactively address end customer challenges by dedicati...

Diverse Lynx is looking for Big Data developer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain big data solutions to meet business requirements and support data-driven decision making Work with stakeholders to understand their data needs and determine how to best use big data technologies to meet those needs Design and implement scalable, high-performance big data architectures, using technologies such as Hadoop, Spark, and NoSQL databases Extract, transform, and load large data sets into a big data platform for analysis and reporting Write complex SQL queries and develop custom scripts to process big data Collaborate with data scientists, data...

Role: Scala Data Engineer Location: Bangalore (Hybrid, 3 days office/week) Experience: 4 6 years Employment Type: Full-Time Key Responsibilities: Develop, maintain, and optimize data pipelines using Scala & Spark Work with HDFS, Hive, Yarn to manage large datasets efficiently Build and manage workflows with Oozie Apply unit testing practices to ensure code quality and reliability Collaborate with Data & AI team to deliver scalable solutions Skills Required: Strong programming skills in Scala & Spark Hands-on with HDFS, Hive, Oozie, Yarn Solid experience in Unit Testing Good understanding of data engineering best practices Candidate Details (to be shared while applying): Total Experience Rele...

Roles and Responsibilities: Working with clients to understand their data. Based on the understanding you will be building the data structures and pipelines. You will be working on the application from end to end collaborating with UI and other development teams. You will be working with various cloud providers such as Azure & AWS. You will be engineering data using the Hadoop/Spark ecosystem. You will be responsible for designing, building, optimizing and supporting new and existing data pipelines. Orchestrating jobs using various tools such Oozie, Airflow, etc. Developing programs for cleaning and processing data. You will be responsible for building the data pipelines to migrate and load ...

You are a skilled and proactive Python / PySpark Developer sought to join the data engineering or analytics team. Your responsibilities will include building scalable data pipelines, performing large-scale data processing, and collaborating with data scientists, analysts, and business stakeholders. You will design, develop, and optimize ETL data pipelines using PySpark on big data platforms (e.g., Hadoop, Databricks, EMR). Writing clean, efficient, and modular code in Python for data processing and integration tasks is essential. Working with large datasets to extract insights, transform raw data, and ensure data quality will be part of your daily tasks. Collaborating with cross-functional t...

As an MLOps Engineer at our company, you will be responsible for developing scalable applications and platforms in an agile environment. You will manage various aspects of project management, including requirements gathering, metadata collection, classification, security clearance, data pipeline template development, and data pipeline monitoring and support. Your role will involve designing, developing, deploying, and maintaining production-grade scalable data transformation, machine learning, and deep learning code and pipelines. You will be in charge of managing the ETL and machine learning model lifecycle, including development, deployment, monitoring, maintenance, and updates of data and...

DAV Sr. Secondary school, Mogappair is looking for TGT1 - Tamil Teacher to join our dynamic team and embark on a rewarding career journey A Teacher is responsible for delivering lessons and facilitating learning in a classroom setting This includes planning and delivering lessons, assessing student progress, creating a positive and engaging learning environment, and communicating with students, parents, and other stakeholders The ideal candidate should have a strong understanding of the subject matter they are teaching and the ability to effectively communicate complex ideas to students Additionally, excellent interpersonal and organizational skills, a commitment to student learning and deve...

About the Role Were seeking a GCP Data Analyst with deep expertise in BigQuery, strong SQL and Python skills, and a sharp analytical mindset to support both data validation initiatives and ongoing analytics work. This role is ideal for someone who can navigate large datasets, build robust queries, and identify inconsistencies with precision and insight. The analyst will work across a variety of data workflows, from validating metrics during system migrations to supporting day-to-day data analysis and reporting needs. Youll leverage advanced BigQuery featuressuch as authorized views, materialized views, UDFs, partitioning strategies, and time series analysisto ensure data integrity and surfac...

About the Role We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams. Key Responsibilities: Design and develop...

Were Hiring: Tech Lead – Big Data Technologies Location: Pune | Work Mode: Work from Office (WFO) Company: Leading MNC | Immediate Joiners Preferred Are you a Big Data expert with 6–9 years of experience and a passion for leading high-impact projects? We’re looking for a Tech Lead skilled in: Hadoop, Spark, Hive, Kafka, Sqoop, Oozie, Flume Java/Scala, SQL/NoSQL (PostgreSQL, MongoDB) System monitoring tools (Grafana, Ganglia), scripting & automation Role involves end-to-end ownership of data pipeline architecture, code reviews, performance tuning, and leading a talented team.

Wipro Limited is a leading technology services and consulting company dedicated to creating innovative solutions that cater to the most complex digital transformation needs of clients. With a comprehensive portfolio of capabilities in consulting, design, engineering, and operations, Wipro assists clients in achieving their boldest ambitions and developing sustainable, future-ready businesses. Employing over 230,000 individuals and business partners spread across 65 countries, Wipro is committed to ensuring the success of its customers, colleagues, and communities in an ever-evolving world. The role's primary purpose is to facilitate process delivery by overseeing the daily performance of the...

Job Title: Big Data Developer Location: Navi Mumbai, India Exp : 5+ Years Department: Big Data and Cloud Job Summary: Smartavya Analytica Private Limited is seeking a skilled Hadoop Developer to join our team and contribute to the development and maintenance of large-scale Big Data solutions. The ideal candidate will have extensive experience in Hadoop ecosystem technologies and a solid understanding of distributed computing, data processing, and data management. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experienc...

Description: 1. Data engineer with 6+ years of hands on experience working on Big Data Platforms 2. Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. 3. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing 4. Good experience in any one programming language -Scala/Python , Python preferred. 5. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc 6. Experience in using Kafka or any other message brokers 7. Configuring, monitoring and scheduling of jobs usin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Diverse Lynx is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the q...

Diverse Lynx is looking for Big Data Developer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain big data solutions to meet business requirements and support data-driven decision making Work with stakeholders to understand their data needs and determine how to best use big data technologies to meet those needs Design and implement scalable, high-performance big data architectures, using technologies such as Hadoop, Spark, and NoSQL databases Extract, transform, and load large data sets into a big data platform for analysis and reporting Write complex SQL queries and develop custom scripts to process big data Collaborate with data scientists, data...

Looking for a skilled Big Data Engineer to join our team at Hexaware Technologies Ltd. The ideal candidate will have experience in the IT Services & Consulting industry and possess skills in big data engineering. Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies in big data. Job Requirements Strong understa...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...

We are seeking a highly skilled Data Engineer with expertise in ETL techniques, programming, and big data technologies. The candidate will play a critical role in designing, developing, and maintaining robust data pipelines, ensuring data accuracy, consistency, and accessibility. This role involves collaboration with cross-functional teams to enrich and maintain a central data repository for advanced analytics and machine learning. The ideal candidate should have experience with cloud-based data platforms, data modeling, and data governance processes. Location - Bengaluru,Doddakannell, Karnataka, Sarjapur Road

We are seeking a skilled Big Data Developer with 3+ years of experience to develop, maintain, and optimize large-scale data pipelines using frameworks like Spark, PySpark, and Airflow. The role involves working with SQL, Impala, Hive, and PL/SQL for advanced data transformations and analytics, designing scalable data storage systems, and integrating structured and unstructured data using tools like Sqoop. The ideal candidate will collaborate with cross-functional teams to implement data warehousing strategies and leverage BI tools for insights. Proficiency in Python programming, workflow orchestration with Airflow, and Unix/Linux environments is essential. Location: Remote- Delhi / NCR,Banga...

We are seeking a skilled Big Data Developer with 3+ years of experience to develop, maintain, and optimize large-scale data pipelines using frameworks like Spark, PySpark, and Airflow. The role involves working with SQL, Impala, Hive, and PL/SQL for advanced data transformations and analytics, designing scalable data storage systems, and integrating structured and unstructured data using tools like Sqoop. The ideal candidate will collaborate with cross-functional teams to implement data warehousing strategies and leverage BI tools for insights. Proficiency in Python programming, workflow orchestration with Airflow, and Unix/Linux environments is essential. Locations : Mumbai, Delhi / NCR, Be...