1460 Mapreduce Jobs - Page 14

We are looking for a skilled professional with 5-10 years of experience to join our team in Bangalore, Hyderabad, Chennai, Pune, Noida, and Gurgaon. The ideal candidate will have expertise in GCP Hadoop ecosystem and be able to handle batch data processing on the Hadoop ecosystem. Roles and Responsibility Design and develop scalable data pipelines using GCP Hadoop ecosystem. Process large datasets using Scala Spark, Hive, and other relevant tools. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for data processing systems. Troubleshoot and resolve issues related to data processing and system performance. Op...

We are looking for a skilled Hadoop professional with 7-14 years of experience to join our team in Pune and Hyderabad. The ideal candidate will have expertise in Hadoop, Spark, Kafka, Data Visualization, scripting languages in Python and R, SQL and NoSQL, Agile methodology, ETL / ELT data pipelines. Roles and Responsibility Design and develop scalable Hadoop applications using Spark and Kafka. Create data visualizations using tools like Splunk, Qlik, and Grafana. Develop and maintain ETL/ELT data pipelines using Agile methodology. Collaborate with cross-functional teams to identify and prioritize project requirements. Troubleshoot and resolve technical issues related to Hadoop applications. ...

We are looking for skilled Hadoop Developers with 5-10 years of experience to join our team in Bangalore, Kolkata, Hyderabad, and Pune. The ideal candidate should have strong proficiency in Hadoop, Scala, Spark, and SQL. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Spark and Scala. Troubleshoot and resolve complex technical issues related to Hadoop. Participate in code reviews and ensure high-quality code standards. Stay updated with the latest trends and technologies in Hadoop development. Job...

We are looking for a skilled Data Engineer with 4 to 7 years of experience to join our team in Bangalore. The ideal candidate will have expertise in Python, SQL, AWS, Spark, and Big Data processing frameworks. Roles and Responsibility Design and develop scalable data pipelines using Python, Scala, or Java. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Hadoop and Big Data processing frameworks. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data storage and retrieval processes for improved performance and efficiency. Participate in code reviews t...

We are looking for a skilled professional with 7-10 years of experience to join our team as a Stream Sets expert in Bangalore. Roles and Responsibility Design, develop, and implement Stream Sets solutions to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain Unix scripts for automation and data processing. Conduct RCA analysis to troubleshoot issues and optimize system performance. Set up SSL certificates and manage key management systems. Provide technical support and training to junior team members. Job Requirements Strong knowledge of StreamSets administration, Unix scripting, and RCA analysis. Experien...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description This role will be based in Bangalore, India. At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the...

Company Description LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. Were also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture thats built on trust, care, inclusion, and fun where everyone can succeed. Job Description We are looking for a passionate, entrepreneurial engineering leader to join the Bangalore engineering team. In this role, you will be part of LinkedIn's India initi...

We are looking for a skilled Pyspark Data Engineer with 3 to 5 years of experience. The ideal candidate will have expertise in Hadoop, Spark/Pyspark, Hive, YARN, Scala development, and data modeling. This position is based in Pune and Hyderabad. Roles and Responsibility Design and develop scalable data pipelines using Pyspark and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and architectures. Ensure data quality and integrity by implementing robust testing and validation procedures. Participate in code reviews and contribute to improving overall code quality. Troubleshoot and resolve complex tech...

We are looking for a skilled professional with 5-9 years of experience to join our team as an Hadoop-Spark specialist. The ideal candidate will have a strong background in big data processing and analytics. Roles and Responsibility Design, develop, and implement scalable big data solutions using Hadoop and Spark. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and optimize performance issues in big data systems. Ensure data quality and integrity through data validation and testing procedures. Stay updated with industry trends and emerging technologies in ...

We are looking for skilled Hadoop Developers with 7-10 years of experience to join our team in Bangalore and Hyderabad. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and optimize system performance issues. Ensure data quality and integrity through data validation and testing procedures. Participate in code reviews and contribute to improving overall code quality. Job Requirements Strong proficiency in Hadoop, Scala, Spark, and SQL. Experience working with big ...

We are looking for a skilled Databricks & AWS Lead with 7-14 years of experience to join our team in Pune, Mumbai, Chennai, Hyderabad, Bangalore, and Noida. The ideal candidate will have expertise in Databricks and AWS, Unity Catalog, Spark, SQL, and Python. Roles and Responsibility Design and implement data pipelines using Databricks and AWS. Develop and maintain big data technologies and data warehousing solutions. Create CI/CD pipelines using Jenkins or GitLab CI/CD. Collaborate with cross-functional teams to identify and prioritize project requirements. Troubleshoot and resolve technical issues related to Databricks and AWS. Ensure data quality and integrity by implementing data validati...

We are looking for a skilled professional with expertise in StreamSets and Unix Scripting to join our team. The ideal candidate will have 5-10 years of experience in the relevant field. Roles and Responsibility Design, develop, and implement StreamSets solutions to meet business requirements. Troubleshoot and resolve technical issues related to StreamSets. Collaborate with cross-functional teams to ensure seamless integration of StreamSets with other systems. Develop and maintain Unix scripts for automation and data processing tasks. Perform root cause analysis (RCA) to identify and resolve complex technical issues. Install, patch, upgrade, administer, script, and maintain StreamSets cluster...

We are looking for a highly skilled MLOps professional with 0 to 30 days of experience to join our team in Bangalore, Hyderabad, Pune, Chennai, and Kolkata. The ideal candidate will have expertise in MLOps, including Azure/AWS/GCP, Pyspark, and Bigdata. Roles and Responsibility Design and implement scalable data pipelines using MLOps tools. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale machine learning models and algorithms. Ensure seamless integration of MLOps solutions with existing systems and infrastructure. Troubleshoot and resolve complex technical issues related to MLOps. Stay up-to-date with industry trends a...

We are looking for a skilled Data Engineer with 6 to 11 years of experience to join our team in Bangalore. The ideal candidate will have expertise in SQL, ETL, data modeling, and programming languages such as Python, C++, C#, or Scala. Roles and Responsibility Design and develop scalable data pipelines using Big Data/MPP analytics platforms. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale databases and data systems. Ensure data quality and integrity through data validation and testing procedures. Optimize data processing workflows for improved performance and efficiency. Troubleshoot and resolve technical issues relate...

We are looking for a skilled Hadoop Admin with 4 to 9 years of experience. The ideal candidate will have expertise in Hadoop administration, CDP distribution, Dataflow, and Big data platform. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement data pipelines using Kafka and Nifi profiles. Develop and execute Linux shell scripts for automation and monitoring. Collaborate with cross-functional teams to resolve technical issues and improve processes. Ensure compliance with security best practices and industry standards. Troubleshoot and optimize HBase databases for improved query performance. Job Requirements Stron...

We are looking for a skilled professional with 7-10 years of experience to join our team as a Stream Sets expert in Bangalore. Roles and Responsibility Design, develop, and implement Stream Sets solutions to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain Unix scripts for automation and troubleshooting. Administer and maintain StreamSets instances, including installation, patching, and upgrading. Troubleshoot and resolve technical issues related to StreamSets. Provide technical support and training to end-users on StreamSets applications. Job Requirements Strong knowledge of StreamSets administration, s...

We are looking for a skilled Data Engineer with 6 to 11 years of experience to join our team in Bangalore. The ideal candidate will have expertise in SQL, ETL, data modeling, and programming languages such as Python, C++, C#, Scala, etc. Roles and Responsibility Design and develop scalable data pipelines using Big Data/MPP analytics platforms. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale databases and data systems. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Participate in code reviews and cont...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

Job Description YOUR IMPACT Are you passionate about developing mission-critical, high quality software solutions, using cutting-edge technology, in a dynamic environment? OUR IMPACT We are Compliance Engineering, a global team of more than 300 engineers and scientists who work on the most complex, mission-critical problems. We build and operate a suite of platforms and applications that prevent, detect, and mitigate regulatory and reputational risk across the firm. have access to the latest technology and to massive amounts of structured and unstructured data. leverage modern frameworks to build responsive and intuitive UX/UI and Big Data applications. Compliance Engi neering is looking to ...

What youll do: Undertake primary ownership in driving self and team effort across all phases of a project lifecycle. Translate business requirements into technical terms and drive team effort to design, build and manage technology solutions that solve business problems. Apply appropriate development methodologies (e.g. agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA procedures, unit testing) to ensure successful and timely completion. Partner with Project lead/ Program lead in delivering projects and assist in project management responsibility like - project plans, people management, staffing and risk mitigation. Collaborate with other team members acr...

Skills : Experienced in MS*Server, SSIS, and Talend Knowledge on Databricks, Snowflake, Teradata, Oracle, Google Big Query, Hadoop, and related stacks, diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases. Notice Period: immediate-30 days Education BE BTech, ME MTech, BCA,

Skills: Complex Databricks implementations,Architect level certification from Databricks, Python, Scala and SQL,Strong depth in Lakehouse Architecture with Delta Tables, Expertise in Spark ecosystems, Data frame API, spark streaming, Data set API, RDD APIs & Spark SQL.,Expertise Notice Period: Immediate -45 days

Education: Bachelors degree in Computer Science, Engineering, or a related field. A Masters degree is preferred. Experience: Minimum of 4+ years of experience in data engineering or a similar role. Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pnadas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

You will be working on building an innovative online education system that adapts to each individual student. Your responsibilities will include: - Passion and enthusiasm for building scalable systems that analyze huge data sets and make actionable recommendations - Proven ability to identify relationships within large, not obviously related data sets - Ability to work with incomplete or imperfect data - Familiarity with linear algebra and manipulating data using matrix algorithms - Ability to build and interpret probabilistic models of complex, high-dimensional systems - Experience with quantitative analysis utilizing Python - Experience with database technologies such as SQL - Solid progra...