1460 Mapreduce Jobs - Page 5

We are looking for a skilled Hadoop Developer with 3 to 6 years of experience to join our team in Chennai. The ideal candidate will have expertise in Scala, SQL, Unix, and Hive & Spark. Roles and Responsibility Design, develop, and implement scalable data processing solutions using Hadoop technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Scala and Spark. Troubleshoot and resolve complex technical issues related to Hadoop applications. Participate in code reviews and contribute to improving overall code quality. Stay up-to-date with the latest trends and technologies in Hadoop developmen...

Should be capable of developing/configuring data pipelines in a variety of platforms and technologies Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools) Can demonstrate strong experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc. Experience with GCP (particularly Airflow, Dataproc, Big Query) is an advantage Have experience with creating solutions which power AI/ML models and generative AI Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineerin...

We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India. Roles and Responsibility Design and develop scalable big data systems using Pyspark and Azure Data Bricks. Implement and manage workflows for efficient data processing. Collaborate with cross-functional teams to integrate data from various sources. Develop and maintain large-scale data pipelines and architectures. Optimize system performance and troubleshoot issues. Ensure data quality and integrity through data validation and testing procedures. Job Requirements S...

We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment. Roles and Responsibility Design, develop, and implement big data solutions using Hive and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems with high performance and reliability. Troubleshoot and resolve complex technical issues related to big data systems. Participate in code reviews and contribute to the improvement of the o...

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

We are looking for a skilled Tech Lead - Data Engineer with 7-11 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. Roles and Responsibility Design, develop, and implement data engineering solutions using various technologies. Lead a team of data engineers to ensure timely project delivery. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data systems and architectures. Ensure data quality, integrity, and security. Stay updated with industry trends and emerging technologies. Job Requirements Strong knowledge of data engineering principles and practices. Experience w...

Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

We are looking for a skilled Team Lead - Data Engineer with 6-8 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in data engineering and excellent leadership skills. Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Lead a team of data engineers to deliver high-quality results. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical documentation for data systems and processes. Troubleshoot and resolve complex technical issues related to data engineering. Mentor and guide ...

We are looking for a skilled PySpark Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing scalable data processing architectures using PySpark. Roles and Responsibility Design and develop scalable data processing architectures using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain large-scale data pipelines using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data processing workflows for performance, scalability, and reliability. Mentor junior...

We are looking for a skilled Senior Pyspark Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark. Roles and Responsibility Design, develop, and deploy large-scale data processing pipelines using Pyspark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain complex data transformations and data quality checks. Optimize pipeline performance and troubleshoot issues. Ensure compliance with industry standards and best practices. Participate in code reviews and contribute to improving overall code quality. Job Requiremen...

We are looking for a skilled Project Manager with 10-20 years of experience to lead our Big Data team in India. The ideal candidate will have a strong background in managing large-scale projects and leading teams. Roles and Responsibility Manage and deliver high-quality results on complex Big Data projects. Lead and motivate a team of professionals to achieve project goals. Develop and implement project plans, resource allocation, and risk management strategies. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure timely delivery of projects while maintaining quality standards. Identify and mitigate potential risks and issues impacting project succe...

We are looking for a skilled Senior Big Data Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in big data development and analysis. Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies. Job Requirements Strong understanding of big data concepts, including Hadoop, ...

We are looking for a skilled Team Lead with 6-8 years of experience to join our team in the Big Data domain. The ideal candidate will have a strong background in leading teams and driving business growth through data-driven insights. Roles and Responsibility Develop and implement big data strategies to drive business growth and improvement. Lead cross-functional teams to design, develop, and deploy big data solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Design and implement data governance frameworks to ensure data quality and integrity. Develop and maintain technical documentation for big data systems and processes. Provide training...

We are looking for a skilled Tech Lead - Big Data with 7-11 years of experience to join our team in India. Roles and Responsibility Design and implement big data solutions using various technologies. Lead the development team in building scalable and efficient big data systems. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure high-quality code and adhere to industry standards. Mentor junior team members and provide technical guidance. Job Requirements Strong experience in big data technologies such as Hadoop, Spark, and NoSQL databases. Proven track record of le...

We are looking for a skilled Big Data Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing large-scale data systems. Roles and Responsibility Design and develop scalable big data architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for big data systems and processes. Ensure compliance with industry standards and best practices for big data management. Provide technical leadership and guidance to junior team members on big data technologies. Participate in ...

Role Overview: You will be responsible for the product design process from the prototype phase to volume production at Machinellium Mavericks Projects and Consultants Inc. As a hardware developer, your main duties will include designing, implementing, maintaining, and improving electrical products for various purposes. Key Responsibilities: - Utilize CAD design tools effectively - Implement constraint driven design methodologies - Work with FPGAs and distributed computing technologies like Hadoop/MapReduce - Design PCB stackups and high power multiphase and single phase VRDs - Perform competitive product assessments logically - Develop and implement test plans - Determine hardware specificat...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Your role and responsibilities As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in impl...

JD:- Total Yrs. of Experience* 6+ Relevant Yrs. of experience* 6+ Detailed JD *(Roles and Responsibilities) 6+ years experience in Kafka, Spark, Scala ,Pyspark Strong knowledge of implementing and maintaining scalable streaming and batch data solutions with high throughput and strict SLA. Extensive experience of working in production with Kafka, Spark and Kafka Stream including best practices, observability, optimization, performance tuning. Knowledge of Python and Scala including best practices, architecture, dependency management Collaborate with cross-functional teams to understand data requirements and integrate data from multiple sources, ensuring data consistency and quality Mandatory ...

JD:- Total Yrs. of Experience* 6+ Relevant Yrs. of experience* 6+ Detailed JD *(Roles and Responsibilities) 6+ years experience in Kafka, Spark, Scala ,Pyspark Strong knowledge of implementing and maintaining scalable streaming and batch data solutions with high throughput and strict SLA. Extensive experience of working in production with Kafka, Spark and Kafka Stream including best practices, observability, optimization, performance tuning. Knowledge of Python and Scala including best practices, architecture, dependency management Collaborate with cross-functional teams to understand data requirements and integrate data from multiple sources, ensuring data consistency and quality Mandatory ...

What youll do: We seek Software Engineers with experience building and scaling services in on-premises and cloud environments. As a Principal Software Engineer in the Epsilon Attribution/Forecasting Product Development team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop. Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure along with building, scheduling and maintaining workflows. Perform data integration and transformation, troubleshoot issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine/forecasting engine. Strong wri...

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description Serve as an analytics expert in designing, ...

Hi, We have positions for Data Scientist role - Airoli - WFO (5 DAYS) JD: Key Responsibilities: Develop and maintain data pipelines using Hadoop ecosystem. Build and maintain Spark SQL applications for big data processing and analysis. Use Tableau to visualize data, create dashboards, and extract insights from Hadoop data. Optimize data processing performance, including query optimization and data storage strategies. Collaborate with other engineers and stakeholders to understand data requirements and deliver solutions. Troubleshoot and resolve issues related to data processing and visualization. Stay up to date with the latest technologies and best practices in the field. A Hadoop Administr...