612 Oozie Jobs - Page 3

Key skills: Spark, Scala Experience: 6 to 12 years Location: AIA Hyderabad Job description Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve pe...

We are looking for a skilled Tech Lead - Data Engineer with 7-11 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. Roles and Responsibility Design, develop, and implement data engineering solutions using various technologies. Lead a team of data engineers to ensure timely project delivery. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data systems and architectures. Ensure data quality, integrity, and security. Stay updated with industry trends and emerging technologies. Job Requirements Strong knowledge of data engineering principles and practices. Experience w...

Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...

We are looking for a skilled Team Lead - Data Engineer with 6-8 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in data engineering and excellent leadership skills. Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Lead a team of data engineers to deliver high-quality results. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical documentation for data systems and processes. Troubleshoot and resolve complex technical issues related to data engineering. Mentor and guide ...

We are looking for a skilled PySpark Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing scalable data processing architectures using PySpark. Roles and Responsibility Design and develop scalable data processing architectures using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain large-scale data pipelines using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data processing workflows for performance, scalability, and reliability. Mentor junior...

We are looking for a skilled Senior Pyspark Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark. Roles and Responsibility Design, develop, and deploy large-scale data processing pipelines using Pyspark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain complex data transformations and data quality checks. Optimize pipeline performance and troubleshoot issues. Ensure compliance with industry standards and best practices. Participate in code reviews and contribute to improving overall code quality. Job Requiremen...

We are looking for a skilled Senior Big Data Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in big data development and analysis. Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies. Job Requirements Strong understanding of big data concepts, including Hadoop, ...

We are looking for a skilled Team Lead with 6-8 years of experience to join our team in the Big Data domain. The ideal candidate will have a strong background in leading teams and driving business growth through data-driven insights. Roles and Responsibility Develop and implement big data strategies to drive business growth and improvement. Lead cross-functional teams to design, develop, and deploy big data solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Design and implement data governance frameworks to ensure data quality and integrity. Develop and maintain technical documentation for big data systems and processes. Provide training...

We are looking for a skilled Big Data Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing large-scale data systems. Roles and Responsibility Design and develop scalable big data architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for big data systems and processes. Ensure compliance with industry standards and best practices for big data management. Provide technical leadership and guidance to junior team members on big data technologies. Participate in ...

As a skilled and proactive Python / PySpark Developer at our company, you will join our data engineering or analytics team. Your primary responsibility will be to build scalable data pipelines, perform large-scale data processing, and collaborate with data scientists, analysts, and business stakeholders. Key Responsibilities: - Design, develop, and optimize ETL data pipelines using PySpark on big data platforms (e.g., Hadoop, Databricks, EMR). - Write clean, efficient, and modular code in Python for data processing and integration tasks. - Work with large datasets to extract insights, transform raw data, and ensure data quality. - Collaborate with cross-functional teams to understand busines...

Overall Exp: 6+ Years Relevant Exp: 4 years Location: Bangalore (Hybrid) Notice Period: Immediate Joiner JD: Languages: Scala , Python (Optional ) Big Data Orchestration: Airflow , Spark on Kubernetes , Yarn , Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms) Proficient in developing automated frameworks for unit & integration testing. Proficient with Kubernetes, Docker, Helm and related container technologies. Proficient in deploying and managing Sp...

Your role and responsibilities As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in impl...

JD:- Total Yrs. of Experience* 6+ Relevant Yrs. of experience* 6+ Detailed JD *(Roles and Responsibilities) 6+ years experience in Kafka, Spark, Scala ,Pyspark Strong knowledge of implementing and maintaining scalable streaming and batch data solutions with high throughput and strict SLA. Extensive experience of working in production with Kafka, Spark and Kafka Stream including best practices, observability, optimization, performance tuning. Knowledge of Python and Scala including best practices, architecture, dependency management Collaborate with cross-functional teams to understand data requirements and integrate data from multiple sources, ensuring data consistency and quality Mandatory ...

Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources (4) Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS Data modeling for Data conversion Resources (4) Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Data Engineer - Knows HR Knowledge , all other requirement from Functional Area given by UBER

Spark, Scala, Bigdata Team Management: Lead and manage a team of technical professionals Data Engineer and Application Developers, ensuring effective collaboration and productivity, Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery, Status Reporting: Prepare and present detailed status reports on ongoing projects to stakeholders, highlighting progress, risks, and mitigation plans, Issue Resolution: Proactively identify and resolve any technical challenges or roadblocks faced by the team, ensuring smooth project execution, Project Management: Oversee the entire project lifecycle, from planning to execution...

VIS Chennai is looking for Tamil Teacher to join our dynamic team and embark on a rewarding career journey Collaborate with cross-functional teams to achieve strategic outcomes Apply subject expertise to support operations, planning, and decision-making Utilize tools, analytics, or platforms relevant to the job domain Ensure compliance with policies while improving efficiency and outcomes Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before applying.

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code in Python Collaborate w...

We are looking for a skilled professional with 6-9 years of experience to lead and manage key projects, drive institutional fraud-related projects, and provide expertise on fraud and financial crime risk management. The ideal candidate will have a strong background in managing Falcon upgrades, AML updates, and merchant fraud migrations. Roles and Responsibility Lead and manage key projects like the Falcon upgrade across retail, institutional, and merchant sectors. Manage Falcon upgrades and drive institutional fraud-related projects. Provide expertise on fraud and financial crime risk management. Collaborate with financial institutions to develop effective fraud detection and prevention stra...

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

At least 8 + years of experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc . At least 3 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines . Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc . Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools ) Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineering efficiencies . Design should help embed standard pr...

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Job Title: - GCP Data Engineer with Big Query ( AIA Kolkata ) Location: - AIA Kochi Minimum 6 to 9 years of experience Mandatory Skills: GCP Services – Big Query, Cloud SQL, Data flow Around 7+ years of experience in development in Data warehousing projects in GCP platforms, Good understanding of dimensional modelling Expertise in MySQL & SQL/PL GCP & BigQuery knowledge is must, GCP certification is added advantage Good experience in Cloud Composer, DAGs , airflow REST API development experience Good in analytical and problem solving, efficient communication Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the de...

Loc: Manyata Tech Park Exp: 2-5 yrs, AI/ML Engineer Skills Required: ? Exp. with Data engineering & Data/ML pipelines for Analytics & AI/ML Models ? Working with large sets of structured & unstructured data from disparate sources ? Foundational acquaintance of Data Science & AI/ML models ? SQL, Python, Spark, PySpark ? Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) ? Analytics database like Druid, Data visualization/exploration tools like Superset ? Understanding of cloud platforms (AWS, Azure, or GCP) ? GIT Secondary Skills (desired/preferred): ? Apache Airflow, Apache Oozie, Nifi ? GCP cloud exp, Big Query, GCP Big Data Ecosystem ? Trino/Presto ? Familiar with forecasting algo...

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. : - Key Skills: - Azure Data Factory (primary) - AzureDatabricksSpark (PySpark, SQL) Must-Have Skills: - Cloud certification in Azure Data Engineer - Azure Data Factory, AzureDatabricksSpark (PySpark or Scala), SQL, Data Ingestion, Curation - Semantic Modeling/Optimization of data model for Rahona - Experience in Azure ingestion from on-prem sources like mainframe, SQL server, Oracle - Experience in Sqoop/Hadoop - Proficiency in Microsoft Excel for metadata files - Certification in Azure/AWS/GCP...