895 Hdfs Jobs - Page 12

Job Description When you join Honeywell, you become a member of our global team of thinkers, innovators, dreamers, and doers who make the things that make the future. That means changing the way we fly, fueling jets in an eco-friendly way, keeping buildings smart and safe and even making it possible to breathe on Mars. Working at Honeywell isn't just about developing cool things. That's why all our employees enjoy access to dynamic career opportunities across different fields and industries. We offer amazing opportunities for career growth with a world-class team of diverse experts. Are you ready to help us make the future Join a team that is elevating our strategy to drive advanced analytic...

Job Title: Informatica BDM Location: Pan India Years of experience: 4 to 7 Years Informatica BDM (Big Data Management) Developers to support our Aviva Data Modernization program. We are currently facing a critical delivery timeline and have been unable to secure available BDM resources, which is impacting project delivery. Weve already explored options across the D&A teams but havent had any success so far. It would be a great help if we could onboard immediate BDM developers internally to ensure we meet our project commitments. Below are the details of the proposed role: Key Responsibilities: Design, develop, and maintain ETL workflows using Informatica BDM for big data processing. Integrat...

Title: SRE & Devops Engineer (Big Data) You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization. You'll partner with vendors and the infrastructure engineering team for security and service availability You'll fix production issues with engineering teams, researchers, data scientists, including performance and functional issues Diagnose and solve customer technical problems Participate in training customers and prepare reports on customer issues Be responsible for customer service improvements and recommend product improvements Write support documentation You'll design and implement zero-d...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

Educational Requirements Bachelor of Engineering,BTech,BCA,MTech,MCA Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to provide best fit architectural solutions for one or more projects. You would also provide technology consultation and assist in defining scope and sizing of work You would implement solutions, create technology differentiation and leverage partner technologies. Additionally, you would participate in competency development with the objective of ensuring the best-fit and high quality technical solutions. You would be a key contributor in creating thought leadership within th...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

Job Summary: We are seeking a skilled and detail-oriented Big Data Engineer with over 5 years of IT experience, including at least 3 years specializing in Big Data application development using the Hadoop ecosystem and Cloud platforms (AWS/Azure) . The ideal candidate will have strong expertise in PySpark , ETL pipeline development , data integration , and workflow orchestration to build scalable and efficient data solutions. Key Responsibilities: Design, develop, and optimize Big Data pipelines using PySpark , Hive , Sqoop , and Spark SQL . Implement ETL processes for ingesting, transforming, and loading large-scale structured and unstructured data from diverse sources (JSON, Parquet, Avro,...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Job Duties: Snowflake - working experience on Sql, Stored Procedure,Task & Stream, Snowpipe,Stages and External Tables, Time Travel and Cloning Azure Cloud - Azure Data Factory for ETL processes and pipeline designs CICD- Github and AzureDevops deployments DBT(not mandatory as Exxon newly implementing) Data Engineer Grade 8 Job Function: Strategic Consulting Job Family: Data and Analytics Consul...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Job Duties: Snowflake - working experience on Sql, Stored Procedure,Task & Stream, Snowpipe,Stages and External Tables, Time Travel and Cloning Azure Cloud - Azure Data Factory for ETL processes and pipeline designs CICD- Github and AzureDevops deployments DBT(not mandatory as Exxon newly implementing) Data Engineer Grade 8 Job Function: Strategic Consulting Job Family: Data and Analytics Consul...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Key Responsibilities: A day in the life of an Infoscion As part of the Infosys delivery team your primary role would be to interface with the client for quality assurance issue resolution and ensuring high customer satisfaction You will understand requirements create and review designs validate the architecture and ensure high levels of service offerings to clients in the technology domain You will participate in project estimation provide inputs for solution delivery conduct technical risk planning perform code reviews and unit test plan reviews You will lead and guide your teams towards developing optimized high quality code deliverables continual knowledge management and adherence to the ...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Key Responsibilities: Driving end-to-end pricing governance for the exception approval process, ensuring transparency, compliance, and alignment with business poli...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using th...

Job Title: Big Data Developer (Manager) Location: Pune Experience: 3-5 years Job Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools. Key Responsibilities: Design, develop, and maintain big data solutions using Java and Apache Spark. Develop and manage APIs for data ingestion, processing, and extraction. Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions. Optimize and tune big data workflows for perfor...

Enroll N Pro is looking for Hadoop to join our dynamic team and embark on a rewarding career journey Collaborate with cross-functional teams to achieve strategic outcomes Apply subject expertise to support operations, planning, and decision-making Utilize tools, analytics, or platforms relevant to the job domain Ensure compliance with policies while improving efficiency and outcomes Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before

Role : Data Engineer Experience : 4 - 6 years Location : Navi Mumbai Set up, configure, and maintain HDFS, Spark, and Druid clusters. Monitor cluster health, performance, and resource utilization. Manage disk allocations, node scaling, and failover strategies. Design and implement scalable ETL workflows for batch and streaming data. Optimize data ingestion and transformation processes. Implement monitoring solutions for data pipelines and clusters. Troubleshoot performance bottlenecks and ensure high availability. Use tools like Prometheus, Grafana, or custom dashboards for observability. Develop and maintain Kafka producers/consumers for real-time data streaming. Ensure reliable message del...

7+ years of experience in Big Data with strong expertise in Spark and Scala Mandatory Skills Big Data Primarily Spark and Scala Strong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys, Good to Have Agile Methodology and Banking Expertise Strong Communication Skills Not limited to Spark batch, need Spark streaming experience No SQL DB Experience HBase/Mongo/Couchbase

Title : BigData Developer Location : Bangalore Position type : Full time Requirement: No Remote: All 5 days work from office. Working experience of Hadoop, Hive SQLs, Spark, Bigdata Eco System Tools. • Should be able to tweak queries and work on performance enhancement. • The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing. • The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

This is a remote position. Job Title: Informatica BDM Developer Location: Remote (Saudi Shift) Experience: 5+ Years Notice Period: Immediate Joiners Only Role Overview We are looking for an experienced Informatica BDM (Big Data Management) Developer to design, develop, and optimize data integration workflows across modern data platforms. The ideal candidate will have strong hands-on expertise in ETL development, data pipelines, and big data integration using Informatica BDM, with working knowledge of Hadoop or cloud ecosystems. Key Responsibilities Design, develop, and maintain ETL/ELT workflows using Informatica BDM for data ingestion, transformation, and loading. Integrate data from struct...

As a Big Data Analyst at Socit Gnrale, your role will involve analyzing, organizing, and processing raw data using Bigdata technologies and Scala. You will be responsible for performing data validation, cleaning, and transformation using Big data technologies, Spark, and Scala. Additionally, you will be required to ingest and manage data in HDFS/Hive, analyze data using Spark, and produce meaningful insights for the business team. Your tasks will also include combining raw information from different sources, exploring ways to enhance data quality and reliability, and developing code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles. Key Respon...

As a Data Governance Architect at Tiger Analytics, your role involves a mix of hands-on work, customer interaction, and technical team management. Your primary responsibility will be to design, architect, deploy, and maintain big data-based data governance solutions. Specifically, you will: - Manage the technical aspects throughout the entire lifecycle of big data-based data governance projects, including requirement analysis, platform selection, architecture design, and deployment. - Scale the solutions within a cloud-based infrastructure. - Collaborate with business consultants, data scientists, engineers, and developers to create data solutions. - Explore innovative technologies for solvi...