1460 Mapreduce Jobs - Page 20

Responsible for designing, developing, and optimizing data processing solutions using a combination of Big Data technologies. Focus on building scalable and efficient data pipelines for handling large datasets and enabling batch & real-time data streaming and processing. Responsibilities: > Develop Spark applications using Scala or Python (Pyspark) for data transformation, aggregation, and analysis. > Develop and maintain Kafka-based data pipelines: This includes designing Kafka Streams, setting up Kafka Clusters, and ensuring efficient data flow. > Create and optimize Spark applications using Scala and PySpark: They leverage these languages to process large datasets and implement data trans...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

About the Team When 5% of Indian households shop with us, its important to build resilient systems to manage millions of orders every day. Weve done this with zero downtime! ?? Sounds impossible? Well, thats the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over perfection and see failures as opportunities to become better. Weve taken steps to inculcate a strong Founders Mindset across our engineering teams, making us grow and move fast. We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. As a Database Engineer II, you will be part of self-starters wh...

Role Description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data or design data fetching and dashboar...

ADB- DE: Primary: Azure, Databricks,ADF, Pyspark/Python Secondary:Datawarehouse, Must Have 10+ Years of IT experience in Datawarehouse and ETL Hands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/Python Ability to understand Design, Source to target mapping (STTM) and create specifications documents Flexibility to operate from client office locations Able to mentor and guide junior resources, as needed Nice to Have Any relevant certifications Banking experience on RISK & Regulatory OR Commercial OR Credit Cards/Retail"

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

Your Role Should have extensively worked onMetadata, Rules & Memberlists inHFM. VB Scripting knowledge is mandatory. Understand and communicatethe consequences of changes made. Should have worked on Monthly/Quarterly/Yearly Validations. Should have worked on ICP accounts, Journals and Intercompany Reports. Should have worked on Data Forms & Data Grids. Should able to work on FDMEE Mappings. Should be fluent with FDMEE Knowledge. Should have worked on Financial Reporting Studio Your Profile Performing UAT with business on the CR's. Should have a to resolve business about theirHFMqueries(if any). Agile process knowledge will be an added advantage What youll love about working here You can shap...

Description Data engineer with 8+ years of hands on experience working on Big Data Platforms Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing Good experience in any one programming language -Scala/Python , Python preferred. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc Experience in using Kafka or any other message brokers Configuring, monitoring and scheduling of jobs using Oozie and/or Airflow...

Description Data engineer with 8+ years of hands on experience working on Big Data Platforms Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing Good experience in any one programming language -Scala/Python , Python preferred. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc Experience in using Kafka or any other message brokers Configuring, monitoring and scheduling of jobs using Oozie and/or Airflow...

Description Data engineer with 8+ years of hands on experience working on Big Data Platforms Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing Good experience in any one programming language -Scala/Python , Python preferred. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc Experience in using Kafka or any other message brokers Configuring, monitoring and scheduling of jobs using Oozie and/or Airflow...

Description Data engineer with 4 to 6 years of hands on experience working on Big Data Platforms Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing Good experience in any one programming language -Scala/Python , Python preferred. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc Experience in using Kafka or any other message brokers Configuring, monitoring and scheduling of jobs using Oozie and/or Air...

About the Role PubMatic is looking for a sharp analytical individual to work as a Data Analyst in the Finance Reporting & Insights function. People with a penchant for extracting the truth out of numbers and summarizing it for the finance and operations teams would be the best fit for the role. What You'll Do The Data Analyst will be responsible for collecting and analyzing tremendous data sets using tools such as Microsoft Excel, Access, SQL and Hive databases and presenting them in easy-to-understand formats, creating dashboards and visualizations in BI tools. The Data Analyst will be expected to retrieve data from publishers, ad networks & aggregators UI and develop spreadsheets and Excel...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Job Role Very good Understanding of current work and the tools and technologies being used. Comprehensive knowledge and clarity on Bigquery, ETL, GCS, Airflow/Composer, SQL, Python. Experience working with Fact and Dimension tables, SCD. Minimum 3 years" experience in GCP Data Engineering. Java/ Pytho...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Bengaluru, Karnataka, India; Gurugram, Haryana, India . Minimum qualifications: Bachelor's degree in Computer Science, or equivalent practical experience. 6 years of experience with software development in one or more programming languages (e.g., Python, C++, Java). Experience in one or more areas of Artificial Intelligence/Machine Learning, such as: Deep Learning, Natural Language Processing (NLP), Computer Vision, Recommendation Systems, Reinforcement Learning, Large Language Models (LLMs), or related fields. Preferred qualifications: 2 years of experience in buildin...

3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Cloud Storage, Terraform, Tekton , Cloudrun , Cloud scheduler, Astronomer/Airflow, Pub/sub, Kafka, Cloud Spanner streaming etc) 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc) 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)KeywordsPython Development,Python,Bigquery,Pandas,Dataproc,Pyspark,Data Flow,Kafka,Cloud Storage,Terraform,Oops,Cloud Spanner,Hadoop,Java,Hive,Spark,Mapreduce,Big Data,Gcp,Aws,Javascript,Mysql,Postgresql,Sql Server,Oracl...

3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Cloud Storage, Terraform, Tekton , Cloudrun , Cloud scheduler, Astronomer/Airflow, Pub/sub, Kafka, Cloud Spanner streaming etc) 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc) 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)Keywordsdataproc,pyspark,data flow,kafka,cloud storage,terraform,oops,cloud spanner,hadoop,java,hive,spark,mapreduce,big data,gcp,aws,javascript,mysql,postgresql,sql server,oracle,bigtable,software development,sql*,pytho...

As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in implementing the same Learn new te...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Bengaluru, Karnataka, India; Gurugram, Haryana, India . Minimum qualifications: Bachelor's degree in Computer Science, or equivalent practical experience. 6 years of experience with software development in one or more programming languages (e.g., Python, C++, Java). Experience in one or more areas of Artificial Intelligence/Machine Learning, such as: Deep Learning, Natural Language Processing (NLP), Computer Vision, Recommendation Systems, Reinforcement Learning, Large Language Models (LLMs), or related fields. Preferred qualifications: 2 years of experience in buildin...

Role: Data scientist I Location: Bengaluru What you’ll do We’re MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we’re all united in the vision to lead the programmatic industry and make it better. As a Data scientist I in our data science department, you’ll have the chance to: Build an end-to-end data-driven / AI / ML / Statistics based Ad-Tech solutions that positions MiQ as the leading programmatic partner for advertisers across the lifecycle of a marketing campaign Look for opportunities to build solutions that would differentiate MiQ from competitors by researchin...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Hyderabad, Telangana, India; Bengaluru, Karnataka, India . Minimum qualifications: Bachelor's degree in Computer Science or related technical field, or equivalent practical experience. Experience building data and AI solutions and working with technical customers. Experience designing cloud enterprise solutions and supporting customer projects to completion. Ability to communicate in English fluently to support client relationship management in this region. Preferred qualifications: Experience working with Large Language Models, data pipelines, and with data analytics,...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Bengaluru, Karnataka, India; Gurugram, Haryana, India . Minimum qualifications: Bachelor's degree in Computer Science, or equivalent practical experience. 6 years of experience with software development in one or more programming languages (e.g., Python, C++, Java). Experience in one or more areas of Artificial Intelligence/Machine Learning, such as: Deep Learning, Natural Language Processing (NLP), Computer Vision, Recommendation Systems, Reinforcement Learning, Large Language Models (LLMs), or related fields. Preferred qualifications: 2 years of experience in buildin...

C1X AdTech Pvt Ltd is a fast-growing product and engineering-driven AdTech company building next-generation advertising and marketing technology platforms. Our mission is to empower enterprise clients with the smartest marketing solutions, enabling seamless integration with personalization engines and delivering cross-channel marketing capabilities. We are dedicated to enhancing customer engagement and experiences while focusing on increasing Lifetime Value (LTV) through consistent messaging across all channels.Our engineering team spans front end (UI), back end (Java/Node.js APIs), Big Data, and DevOps , working together to deliver scalable, high-performance products for the digital adverti...

Bright Vision Technologies has an immediate opportunity for Sr. Hadoop Developer at Chennai with primary skills in HDFS, MapReduce, Hive, Spark , and related technologies. : As a Sr. Hadoop Developer at Bright Vision Technologies, you will have the opportunity to work on challenging projects, collaborate with a talented team, and contribute to the development of innovative solutions. If you are interested in exploring this opportunity, please let us know by responding to this email. We would be happy to schedule a call to discuss the details further and answer any questions you may have. Responsibilities Design, develop, and maintain Hadoop-based solutions. Collaborate with data scientists a...

Bright Vision Technologies has an immediate Full-time opportunity for Hadoop Developer. Job Role Hadoop Developer Bright Vision Technologies Your Path to a Successful Career in the U.S. Starts Here! Now Accepting Applications for the H1B 2025 Lottery! At Bright Vision Technologies, we specialize in turning aspirations into reality. Whether you're an IT professional looking for growth or a recent graduate planning your next step, weve got you covered! Why Partner with Us? Proven Success : A trusted partner in successful H1B filings for over a decade. End-to-End Support : From documentation to final approval, we handle it all. Top Clients : Access premium opportunities with Fortune 500 compani...