612 Oozie Jobs - Page 8

We are looking for a skilled professional with 7-10 years of experience to join our team as a Stream Sets expert in Bangalore. Roles and Responsibility Design, develop, and implement Stream Sets solutions to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain Unix scripts for automation and troubleshooting. Administer and maintain StreamSets instances, including installation, patching, and upgrading. Troubleshoot and resolve technical issues related to StreamSets. Provide technical support and training to end-users on StreamSets applications. Job Requirements Strong knowledge of StreamSets administration, s...

We are looking for a skilled Data Engineer with 4 to 6 years of experience to join our team in Bangalore, Chennai, Hyderabad, Pune, Mumbai, Noida, and Gurgaon. The ideal candidate will have expertise in SQL, ADF, ETL, Databricks, PySpark, GENAI, Azure AI Cognitive, and Data Engineering. Roles and Responsibility Design and develop data pipelines using various tools and technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and architectures. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows for improved performance and efficie...

We are looking for a skilled Lead Data Engineer with 5 to 10 years of experience to join our team in Bangalore. The ideal candidate will have expertise in Data Engineering, Python, SQL, AWS, Spark, Hadoop, and Big Data processing frameworks. Roles and Responsibility Design and develop large-scale data pipelines using various data engineering tools and technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data architectures and data warehouses. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Mentor...

What youll do: Undertake primary ownership in driving self and team effort across all phases of a project lifecycle. Translate business requirements into technical terms and drive team effort to design, build and manage technology solutions that solve business problems. Apply appropriate development methodologies (e.g. agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA procedures, unit testing) to ensure successful and timely completion. Partner with Project lead/ Program lead in delivering projects and assist in project management responsibility like - project plans, people management, staffing and risk mitigation. Collaborate with other team members acr...

Skills : Experienced in MS*Server, SSIS, and Talend Knowledge on Databricks, Snowflake, Teradata, Oracle, Google Big Query, Hadoop, and related stacks, diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases. Notice Period: immediate-30 days Education BE BTech, ME MTech, BCA,

Skills: Complex Databricks implementations,Architect level certification from Databricks, Python, Scala and SQL,Strong depth in Lakehouse Architecture with Delta Tables, Expertise in Spark ecosystems, Data frame API, spark streaming, Data set API, RDD APIs & Spark SQL.,Expertise Notice Period: Immediate -45 days

Education: Bachelors degree in Computer Science, Engineering, or a related field. A Masters degree is preferred. Experience: Minimum of 4+ years of experience in data engineering or a similar role. Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pnadas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

About The Role Role Purpose This pivotal role is designed to bridge the gap between advanced technological frameworks and pragmatic business solutions, ensuring client needs are met with precision and efficiency. The successful candidate will leverage expertise in cloud data engineering to design, develop, and maintain scalable data infrastructure aligning with strategic business objectives. This position calls for a proficient professional capable of translating complex requirements into innovative data solutions that drive operational excellence and business value across diverse industries. As a vital contributor within our Data Analytics & AI vertical, you will engage with dynamic teams a...

Job Summary: The Associate Data Engineer works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. For the SaaS Integration team, the resource will contribute to the design, development, and maintenance of API integrations across enterprise SaaS platforms including Reltio, OneTrust, and Adobe CDP. This will include developing and maintaining RESTful APIs to integrate internal systems with Reltio (MDM), OneTrust (Privacy & Compliance), and Adobe CDP (Customer Data Platform), participating in technical design reviews and contributing to solution architecture discussions and collaborating with product...

About The Role : Job TitleAVP - Local Regulatory Reporting LocationPune, India Role Description This role is for technical experienced role responsible for hands on development as an IC role. Hands on coding & unit testing of software applications. The candidate is expected to work closely with Business Product Owner and Lead Software Development to ensure good quality, maintainable, scalable and high performing software applications are delivered to users. The candidate should be coming from a strong technical background with able to do coding/configuration changes independently. Should be hands on and be able to work independently requiring minimal technical/tool guidance. Work closely wit...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Alteryx Good to have skills : Hadoop AdministrationMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. Your typical day will involve collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into functional specifications. You will eng...

Position Overview We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments. Required Skills and Qualifications Experience : 7+ years of professional experience in PySpark development. Technical Skills : Strong proficiency in PySpark Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing. Proven experience in building and optimizing complex ETL pipeline using PySpark Experience with var...

Req ID: 340021 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job DutiesKey Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application ...

KPMG India is looking for Consultant - PySpark to join our dynamic team and embark on a rewarding career journey Undertake short-term or long-term projects to address a variety of issues and needs Meet with management or appropriate staff to understand their requirements Use interviews, surveys etc. to collect necessary data Conduct situational and data analysis to identify and understand a problem or issue Present and explain findings to appropriate executives Provide advice or suggestions for improvement according to objectives Formulate plans to implement recommendations and overcome objections Arrange for or provide training to people affected by change Evaluate the situation periodicall...

The Senior Spark Tech Lead will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle. Should be able to work as a Scrum Master Responsibilities Direct Responsibilities Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures. Develop ...

Job Description Job Title: Software/Data Engineer AWS Role Overview We are seeking a skilled Data Engineer to develop and maintain a high-performance streaming data platform for a leading healthcare CRM product You will work across technologies like Python, SQL, NodeJS, Kafka, and cloud-native services, contributing to scalable, efficient, and robust data solutions, Key Responsibilities Design, develop, and maintain scalable data pipelines and streaming systems, Work with Python, SQL, Scala, NodeJS, and various data stores (relational, NoSQL, Kafka), Analyze healthcare and marketing datasets using SQL, Refactor and optimize existing codebases for performance improvements, Collaborate closely...

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

Role Overview: You are a highly experienced Big Data Engineer with a strong background in Python, Java, or Scala. Your main responsibility is to design, build, and maintain scalable data pipelines and data lake architectures. You excel in managing and delivering on complex data engineering projects, providing you with an excellent opportunity to contribute to scalable data solutions in a collaborative environment. Key Responsibilities: - Develop robust data engineering solutions using technologies like Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie. - Collaborate with cross-functional teams to ensure high data quality and governance. - Utilize cloud platforms such as AWS, Azure...

As a PySpark Developer at our company, you will be responsible for developing and maintaining data processing pipelines using PySpark, Apache Spark's Python API. You will collaborate with data engineers, data scientists, and other stakeholders to design and implement scalable and efficient data processing solutions. Key Responsibilities: - Designing, developing, and maintaining PySpark data processing pipelines for processing structured and unstructured data - Collaborating with data engineers and data scientists to understand data requirements and design efficient data models and transformations - Optimizing and tuning PySpark jobs for performance, scalability, and reliability - Implementin...

Work Location: Pan India Experience: 12+yrs Responsibility: Provide top-quality solution design and execution Provide support in defining the scope and sizing of work Align the organizations big data solutions with their Client initiatives as requested Engage with clients to understand strategic requirements Responsible for translating business requirements into technology solutions Work with domain experts to put together a delivery plan with and stay on track Utilize Big Data technologies to design, develop, and evolve scalable and fault-tolerant distributed components Organize all meetings with customers and ensure prompt resolution of gaps and roadblocks Stay current on latest technology...

Core skill - Hive, Impala, SQL, Pyspark, Hadoop, Cloudera Data Platform Job Description: 5+ yrs of relevant experience in Big data technologies like Hive, Impala, Oozie Has 5+ yrs of relevant experience in Spark Scala. Has good knowledge on advanced SQL . Should have experience working with Shell. Good to have : Should have worked on performance tuning of Spark jobs, Hive/Impala queries. Should have basic understanding of visualization tools like tableau.

5+ yrs of relevant experience in Big data technologies like Hive, Impala, Oozie Has 5+ yrs of relevant experience in Spark Scala. Has good knowledge on advanced SQL . Should have experience working with Shell. Good to have : Should have worked on performance tuning of Spark jobs, Hive/Impala queries. Should have basic understanding of visualization tools like tableau.

Development and supporting applications on SOLR/ Elastic Search Technology Platform and Engine configuration. Integrating SOLR/Elastic Search Search with Music Platforms with PHP and Node JS based applications. Implementation and Support Experience. Configuring and supporting the SOLR Platform implementation, Support Business users in fine tuning the existing implementation and maintaining rules. Incorporate enhancements for new features. Code and test(Unit and System Test) application components. Need knowledge and experience with the latest data technologies and frameworks such as ZooKeeper, MongoDB, NoSQL. Machine learning is something which is a very important skill to know to do this jo...