1460 Mapreduce Jobs - Page 15

Job Description The Lead Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and development of big data solutions. Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop or Snowflake Responsible for delivering data as a service framework Responsible for moving all legacy workloads to cloud platform Work with data scientist to build Client pipelines using heterogeneous sour...

Senior Data Engineer (C2H) 7+ years Hyderabad (Hybrid) Need Immediate joiners Only Key skills : Strong Software Engineering experience with proficiency in at least one of the following programming languages: Java, Scala, Python or equivalent. Distributed data technologies (e.g. Hadoop, MapReduce, Spark, Kafka, Flink etc) for building efficient, large-scale ‘big data’ pipelines. Implement data ingestion pipelines both real time and batch using best practices. Experience with building stream-processing applications using Apache Flink, Kafka Streams or others. Experience with Cloud Computing platforms like Azure,Amazon AWS, Google Cloud.

Position Overview Job Title : BigData-Hadoop/Scala Engineer, AVP Location : Pune, India Role Description A Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected, with maintainability and ease of testing built in from the outset, and that they can be integrated successfully into the end-to-end business process flow. They will have gained significant experience through multiple implementations and have begun to develop both depth and breadth in a number of engineering competencies. They have extensive knowledge of design and architectural patte...

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

9 - 12 Years 1 Opening Trivandrum Role description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes: Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data o...

dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First. Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world's most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First. dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola,...

Role Description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data or design data fetching and dashboar...

About The Role Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert req...

Responsibilities: * Design, develop & maintain data pipelines using Python, Hadoop, Spark & PostgreSQL. * Collaborate with cross-functional teams on ETL projects & Git version control. Health insurance Provident fund

Join us as a Test Automation Engineer at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. To be successful as a Test Automation Engineer you should have experience with: ETL Tools: Proficiency with enterprise ETL platforms like Abinitio primarily, Informatica PowerCenter, IBM DataStage, Talend, SSIS, or Matillion Scripting/Pro...

SUMMARY Summary We are seeking experienced Palantir Foundry Professionals to join our team in Bangalore. The ideal candidate will have a strong background in Palantir Foundry, with a minimum of 5 years of relevant experience. This role requires a deep understanding of data integration, application development, and cloud-based deployment. The successful candidate will be responsible for troubleshooting and optimizing application performance, and will work closely with our team to deliver high-quality solutions. Responsibilities Develop and implement data integration solutions using Palantir Foundry Design and deploy cloud-based applications using Agile methodologies Troubleshoot and optimize ...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

Title: Senior Data Engineer / ETL Engineer Location: Pune / Hyderabad / Mohali Job Summary: As a Senior Data Engineer / ETL Engineer, you will be instrumental in designing, developing, and optimizing data processing systems that support our organization's data initiatives. Your expertise in Bigdata and Google Cloud Platform (GCP) will be essential in building robust ETL pipelines that transform raw data into actionable insights. You will collaborate with cross-functional teams to ensure that data is accurate, accessible, and valuable for decision-making. Responsibilities: Design and Develop ETL Processes: Lead the design and implementation of ETL processes using all kinds of batch/streaming ...

Job Description 1 Role - AWS Lead 2Required Technical Skill Set - Excellent knowledge of VPC, AWS Direct Connect, AWS's utility computing services (such as Amazon Elastic Compute Cloud (EC2), Amazon Simple Storage Service (S3), Amazon DynamoDB, Amazon Elastic MapReduce, and Amazon CloudFront) concepts. Experience in Cloud security Solutions. 3Good to have Technical Skill Set - DNS, DHCP, Networking Concepts, Data Base Administration 3Desired Experience Range - 10-12 Years 4Location of Requirement - New Delhi Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) Design and deploy dynamically scalable, highly available, fault-tolerant, and rel...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

Role Description Role Proficiency: Leverage expertise in a technology area (e.g. Informatic Transformation Terradata data warehouse Hadoop Analytics); responsible for System Architecture. Outcomes Implement any two of either/or data extract and transformation or a data warehouse(ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse ) or implement data analysis solution implement data reporting solutions or implement cloud data tools in any one of the cloud provider(AWS/AZURE/GCP) Understand business workflows and related data flows and develop strategies for data acquisitions data transformation data modelling data storage; applying business intelligence on da...

As a skilled Senior Engineer at Impetus Technologies, you will utilize your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, developing high-quality code, and optimizing data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collabora...

Role Overview: As an Associate Product Support Engineer focused on Hadoop distributed systems, your primary responsibility will be to provide technical support to enterprise clients. You will troubleshoot and resolve issues within Hadoop environments to ensure the stability and reliability of customers" infrastructures. Collaborating with experienced engineers, you will work closely with clients to understand their problems and deliver effective solutions with empathy and professionalism. Key Responsibilities: - Address customer issues related to Hadoop clusters and core components such as HDFS, YARN, MapReduce, and Hive. - Perform basic administrative tasks including installation, configura...

Educational Requirements Bachelor of Engineering Service Line Equinox Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Technology Leads and Project Managers. You would...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing opti...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 5 years of experience in Pyspark, Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline creation , deployment , Maintenance and debugging Experience in scheduling and monitoring Jobs and creating tools for automation At least 4 years of experience with Scala and Python required. Proficient knowledge of SQL with any RDBMS....

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. Your typical day will involve collaborating with team members to develop innovative solutions and enhance application functionality. Roles & Responsibilities:- Expected to perform independently and become an SME...