612 Oozie Jobs - Page 5

* 7+ years experience in data eng, data platforms & analytics, 10+ years of consulting experience ? Completed Data Engineering Professional certification & required classes ? Minimum 6-8+ projects delivered with hands-on experience in development on databricks ? Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with deep expertise in at least one ? Deep experience with distributed computing with Spark with knowledge of Spark runtime internals ? Familiarity with CI/CD for production deployments ? Working knowledge of MLOps ? Current knowledge across the breadth of Databricks product and platform features ? Familiarity with optimizations for performance and scalability

4 Years Data Engineering Experience 5 years of consulting experience Completed Data Engineering Professional certification & required classes Minimum 2-3 projects delivered with hands-on experience in Databricks Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark on Databricks Experience in Spark and or Hadoop, Flink, Presto, other popular big data engines Familiarity with Databricks multi-hop pipeline architecture

What are we looking for? Seeking for a strong data analyst who can perform independent. Good to have Prior experience in banking domain is plus and understanding the finance various data transactions. Should be strong in the below: Python Pyspark SQL Airflow Trino Hive Offshore Cordination LLD Agile Scrum Linux Openshift Kubernentes Superset Optional skill set: Linux Openshift Kubernentes Superset Same Posting Description for Internal and External Candidates

Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control an...

Key Responsibilities: Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions. Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler. Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow automation. Develop custom plugins and extensions for DolphinScheduler as needed. Monitor and optimize job execution, resource allocation, and workflow efficiency. Maintain best practices for CI/CD, version control,...

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implem...

Location Chennai and Hyderbad preferred but customer is willing to take resources from Hyderabad Experience 5 to 8 yrs ( U3 ). Exp - 5- 10 Yrs Location - Hyderabad / Chennai Location Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Famil...

Description Detailed JD RTIM Pega CDH 8.8 Multi App Infinity 24.1 Java Restful API oAuth 1. Understanding the NBA requirements and the complete CDH architecture 2. Review of the Conceptual Design Detailed Design and estimations. 3. Reviewing and contributing to the deployment activities and practices 4. Contributing to overall technical solution and putting it to practise. 5. Contributing to the requirement discussion with the Subject matter expertise in relation to Pega CDH 6. Experience in Pega CDH v8.8 multi app or 24.1 and retail banking domain is preferred. 7. Conducting peer code reviews 8. Excellent communications skills Named Job Posting? (if Yes - needs to be approved by SCSC) Addit...

Description Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Ruby;automation;Python Languages RequiredENGLISH Role Rarity To Be Defined

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Job Role Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for me...

Project description LUXOFT is one of the major software services companies world-wide. We deliver professional software services in multiple business verticals such as finance, automotive, and digital transformation. Supporting large vehicle manufacturers in the area of development, production and aftersales is LUXOFT's ambition. The software inside a vehicle was traditionally expected to be a very controlled and self-contained environment. Equipping cars with perception and machine intelligence changes a lot in the overall picture of the vehicle manufacturer. LUXOFT's goal is to empower our customers, with deep domain knowledge and smart solutions, to develop cars of the future. Great mecha...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakehold...

About The Role Data Engineer Databricks & PySpark Location: Bangalore Experience: 69 years Your Role As a Data Engineer, you will play a key role in designing and implementing scalable data solutions using Databricks, PySpark, and other modern data technologies. Youll collaborate with cross-functional teams to deliver high-performance data pipelines and contribute to the success of data-driven initiatives. In this role, you will: Develop and optimize data pipelines using Databricks , PySpark , and Python . Write efficient and scalable SQL queries for data extraction and transformation. Collaborate with data architects and analysts to understand business requirements. Integrate data workflows...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About Happiest Minds:** Happiest Minds is a leading digital transformation and technology services company, empowered by the mission of enhancing the happiness of our customers, employees, and society at large. We provide cutting-edge solutions leveraging advanced technologies to drive meaningful outcomes for our clients. Location: Manyata Tech Park. JD: Need someone with GCP + Looker / LookML experience Strong knowledge of data processing in GCP , Spark Deep understanding of Big Query architecture, best practices, and performance optimization. Experience with DataProc for running Hadoop/ Spark jobs on GCP. Proficiency in LookML for building data models and metrics. Knowledge of building rep...

Role Overview: You will be a part of the Maps team in Hyderabad, working in a dynamic environment that emphasizes flexibility, work-life balance, continuous learning, and leadership mentoring. The team follows a hybrid work policy, giving you the flexibility to perform at your best. Fun is also a priority, with opportunities for games, events, and outings to ensure an engaging work environment. Key Responsibilities: - Analyze, visualize, process, manage, and curate data on a large scale - Combine disparate signals such as data analytics, community engagement, and user feedback to enhance the Maps Platform - Design and implement complex algorithms for resolving map errors - Review solutions w...

As a Technical Specialist, you will contribute to the development and enhancement of Network Management applications for Optical Transport, SDH/SONET, and Photonic/WDM networks. Your role will involve designing, coding, and maintaining high-quality software solutions that enable seamless network configuration, fault supervision, and performance monitoring. With expertise in Core Java, Spring, Kafka, Zookeeper, Hibernate, Python, and React, you will develop scalable applications while integrating advanced algorithms to optimize network management. You will also work with RDBMS, PL-SQL, Linux, Docker, and database concepts, with domain knowledge in OTN and Photonic network management as a valu...

Overview This position is for Manager Data Engineering in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. will lead a software development team focused on our core services someone who combines deep technical experience with great people management skills and can help elevate our teams and our approach to engineering. We are building a culture that fosters innovation, built on a foundation of inclusion and diversity. We are looking for a candidate that has proven experience in coding, architecture leadership, and leading engineers in a fast-paced...

Title and Summary Lead Data EngineerOverview We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Our team within Mastercard Services: The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to mak...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

NDR Operations & Analysis Monitor NDR alerts, anomalies, and threat detections. Investigate suspicious network traffic patterns and escalate incidents as required. Perform root cause analysis and support incident response activities. Create reports and dashboards for threat visibility and management review. Collaborate with SOC and other security teams for triage and resolution. Administration & Tool Management configure, and integrate the NDR solution with SIEM, SOAR, EDR, and firewalls. Perform user access management, policy updates, and rule tuning. Maintain system health (patching, upgrades, backup/restore, performance optimization). Define and implement detection use cases and custom si...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...