1460 Mapreduce Jobs - Page 12

Role Description As a Technical Lead - Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big d...

Role Description As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining securi...

(ReactJS UI, Postgres Data Modeling, Spark Analytics work). Team lead with experience leading agile dev teams, guiding them and being a role model to developers in the team (lead by example) Must be highly hands-on lead, writing code, leading team, reviewing other developers code, working closely with the architect to implement the proposed design 5+ years of experience writing enterprise grade Java or Python code (should be highly proficient) Solid understanding of data structures and fundamental algorithms (sort, select, search, queue) Solid understanding of distributed computing and/or massively parallel processing concepts and frameworks (at least one): Spark, Kafka, MapReduce, Impala 2+...

Overview About BU The Architecture Team plays a pivotal role in the end-to-end design, governance, and strategic direction of product development within Epsilon People Cloud (EPC). As a centre of technical excellence, the team ensures that every product feature is engineered to meet the highest standards of scalability, security, performance, and maintainability. Their responsibilities span across architectural ownership of critical product features, driving techno-product leadership, enforcing architectural governance, and ensuring systems are built with scalability, security, and compliance in mind. They design multi cloud and hybrid cloud solutions that support seamless integration across...

Big Data Architect Skills Required 4 Years experience in Big data Architect Proficient in Spark, Scala, Hadoop MapReduce/HDFS, PIG, HIVE, AWS cloud computing Hands-on experience in tools like: EMR, EC2, Pentaho BI, Impala, ElasticSearch, Apache Kafka, Node.js, Redis, Logstash, statsD, Ganglia, Zeppelin, Hue, KETTLE Sound experience in Machine learning, Zookeeper, Bootstrap.js, Apache Flume, FluentD, Collectd, Sqoop, Presto, Tableau, R, GROK, MongoDB, Apache Storm, HBASE Hands-on experience in development - Core Java & Advanced Java Job Requirement: Bachelors degree in Computer Science, Information Technology, or MCA 4 Years of experience in Relevant Role Good analytical and problem solving a...

The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities: Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3. Use Spark on AWS for data transformation and processing across large datasets. Develop and maintain efficient data workflows with SQS for task queueing and orchestration. Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration. Ensure high-performance data storage, retrieval, and analytics across Redshift, DynamoDB, and Ath...

UiPath Robotic Automation Process India Pvt Ltd is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological a...

Design, develop, and maintain scalable big data pipelines and architectures. Work with large datasets from various sources and transform them for analysis. Implement and optimize ETL processes using big data tools. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. Monitor and troubleshoot data pipelines for performance and reliability issues. Manage and maintain big data platforms (e.g., Hadoop, Spark, Kafka). Ensure data quality, security, and compliance with company policies. Continuously evaluate and adopt new big data technologies and best practices.

Join us as a Data Engineer Youll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making Well look to you to drive the build of effortless, digital first customer experiences If youre ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity youre looking for We're offering this role at vice president level What you'll do As a Data Engineer, youll be looking to simplify our organisation by developing innovative data driven solutions through data pipelines, modelling and ETL design, inspiring to be commercially successful while keeping our customers, and the banks data, safe and se...

Job Title: Senior Engineering (Data Engineering) Location: Gurgaon Experience Required: 3+ Years Employment Type: Full-Time Department: Data & Analytics About the Role We are looking for a passionate and experienced Big Data Engineer for driving the design and development of core platform frameworks with the mega knowledge of Spark, Python/Scala and Kafka Streams that enable the delivery and construction processes for the Data Management, Data Discovery and Analytics group, and using emerging big data technologies. This is a hands-on leadership role requiring both technical expertise and people management skills to guide a growing team and ensure delivery of high-impact data solutions. Key R...

As a Senior Engineer at Impetus Technologies, you will be responsible for designing, developing, and deploying scalable data processing applications using Java and Big Data technologies. Your role will involve collaborating with cross-functional teams to gather requirements, develop high-quality code, and optimize data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows utilizing frameworks like Hadoop and Spark. - C...

As a Techie, Do you face these challenges while pursuing opportunities? Navigating numerous job platforms. Enduring lengthy interview processes. Tedious negotiation phases. Ambiguity about project quality. Getting entangled in unsatisfactory work cultures. Wavering job security. What are we looking for ? Actively seeking experienced senior developers in #Spark and #Kafka who are open to working in the PST timezone. Ideal candidates should possess a minimum of 6 years of hands-on experience with Spark, Kafka, #java, Postgres, and a track record of successfully delivering 3-4 Spark projects.

Position Summary This Requisition is for the Employee Referrals Campaign This is a Leadership role for a person who will be responsible for leadingand managing a team of Managers and senior managers working on multiple project streams for a client. They would be applying domain knowledge for better business decision-making, especially in the areas ofAnalytics/Technology/Product Engineering/Product Management. Job Responsibilities Leadership – Lead & guide the team independently or with little support to implement & deliver complex project assignments. Logical Thinking – Able to think analytically, use a systematic and logical approach to analyze data, problems, and situations. Must be able t...

Roles and Responsibility Design and implement data pipelines using Google Cloud Platform services. Develop and maintain large-scale data architectures and systems. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Troubleshoot and resolve complex technical issues related to data engineering. Job Requirements Strong understanding of Google Cloud Platform services and technologies. Experience with data modeling, design, and architecture. Excellent problem-solving skills and attention to det...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, MySQL, Python (Programming Language), PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions that align with business objectives, and ensuring that applications a...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, MySQL, Python (Programming Language), PySpark Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you’ll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American . As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customer's digital lives. Here, you can work alongside ...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, MySQL, Python (Programming Language), PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions that align with business objectives, and ensuring that applications are optimized fo...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Primary Skills: Core Java, Spring Boot, Java2/EE, Microsservices Hadoop Ecosystem (HBase, Hive, MapReduce, HDFS, Pig, Sqoop etc) Spark Good to have Python Preferred technical and professional experience None

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Key Responsibilities: Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Dataproc, BigQuery, Pub/Sub, and Cloud Storage. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver efficient solutions. Implement ETL/ELT workflows, data ingestion, transformation, and validation processes. Optimize performance and cost-efficiency of data processing jobs and cloud resources. Troubleshoot and resolve data pipeline issues and production incidents. Ensure data quality, governance, and compliance standards are met. Automate data w...

Overview We're looking for a motivated Senior Data Engineer to manage the transformation of data pipelines from Hadoop to BigQuery. You should have strong experience in Google Cloud Platform (GCP), BigQuery, and Dataproc, as well as proficiency in Linux/Unix environments. Experience with Spark, Scala or Python and shell scripting Responsibilities Mandatory Skills: Experience in pipeline migration from Hadoop to BigQuery. Proficiency with GCP, BigQuery, and Dataproc. Strong skills in Linux/Unix environments. Knowledge of Spark, Scala or Python. Advanced Experience with SQL (Any Query Language), shell scripting Strong Analytical skills Finetech & data migration exp. is an added advantage Requi...

KPMG India is looking for Celonis Data Engineer - Manager to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that wi...

We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment. Roles and Responsibility Design, develop, and implement big data solutions using Hive and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems with high performance and reliability. Troubleshoot and resolve complex technical issues related to big data systems. Participate in code reviews and contribute to the improvement of the o...