654 Apache Pig Jobs - Page 6

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

Business Operations is leading the DevOps transformation at Mastercard through our tooling and by being an advocate for change & standards throughout the development, quality, release, and product organizations. We need team members with an appetite for change and pushing the boundaries of what can be done with automation. Experience in working across development, operations, and product teams to prioritize needs and to build relationships is a must. Mastercard looking for a BizOps SRE who would be responsible for supporting, deploying, configuring and maintaining Hadoop applications, jobs and BI reports. Essential Duties and Responsibilities include the following: Keeping a track of all the...

Education/Experience: Bachelor's degree in computer science or equivalent training required. Big Data Engineer: 4-6 Years Experience in developing Big Data processing applications on Azure Databricks. Profound experience with developing Big Data applications using Spark and Scala/Python. Good experience in working with Databricks components, Infrastructure as Code tools like Terraform. Good experience in Airflow and Kubernetes. Develop highly scalable and extensible Big Data platform which enables collection, storage, modelling, and analysis of massive data sets from numerous data sources. Should have very good knowledge on SQL Programming and ETL Data Warehousing concepts. Good understandin...

You should have: Experience with cloud database platforms, e.g. Azure SQL Database, Snowflake etc, or on-prem database platforms like MS SQL server, and have good SQL skills Experience working with Azure Data Factory (ADF). Experience with data modelling. Experience of working with a variety of stakeholders including product owners, delivery managers and architects. Experience with performance tuning and relational database design particularly in the development of business intelligence solutions. Experience with data migration strategies from on premise to cloud. Experience with Data Warehouse concepts. Experience of communicating and documenting technical design proposals. Experience with ...

Roles and Responsibilities Client Impact Lead client engagements across a range of industries and problem statements Develop analytics strategies and programs for large, regional, and global clients by leveraging data and technology solutions to unlock client value Team Collaboration & Culture Lead team to creative insights and sound business recommendations, and deliver impactful client presentations while growing team members roles and skills Provide analytical and day-to-day project delivery team leadership, and create a collaborative and inclusive environment for all levels Collaborate with internal Mastercard stakeholders including Product and Business Development to scope projects, cre...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...

Role Description As a Technical Lead - Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big d...

UiPath Robotic Automation Process India Pvt Ltd is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological a...

Design, develop, and maintain scalable big data pipelines and architectures. Work with large datasets from various sources and transform them for analysis. Implement and optimize ETL processes using big data tools. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. Monitor and troubleshoot data pipelines for performance and reliability issues. Manage and maintain big data platforms (e.g., Hadoop, Spark, Kafka). Ensure data quality, security, and compliance with company policies. Continuously evaluate and adopt new big data technologies and best practices.

As a Techie, Do you face these challenges while pursuing opportunities? Navigating numerous job platforms. Enduring lengthy interview processes. Tedious negotiation phases. Ambiguity about project quality. Getting entangled in unsatisfactory work cultures. Wavering job security. What are we looking for ? Actively seeking experienced senior developers in #Spark and #Kafka who are open to working in the PST timezone. Ideal candidates should possess a minimum of 6 years of hands-on experience with Spark, Kafka, #java, Postgres, and a track record of successfully delivering 3-4 Spark projects.

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Hyderabad, Telangana, India; Bengaluru, Karnataka, India; Gurugram, Haryana, India; Pune, Maharashtra, India Minimum qualifications: Bachelor's degree in Computer Science, or a related technical field, or equivalent practical experience, Experience in building data and AI solutions and working with technical customers, Experience in designing cloud enterprise solutions and supporting customer projects to completion, Ability to communicate in English fluently to support client relationship management in this region, Preferred qualifications: Experience working with Larg...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Hyderabad, Telangana, India; Bengaluru, Karnataka, India; Gurugram, Haryana, India; Pune, Maharashtra, India Minimum qualifications: Bachelor's degree in Computer Science, or a related technical field, or equivalent practical experience, Experience in building data and AI solutions and working with technical customers, Experience in designing cloud enterprise solutions and supporting customer projects to completion, Ability to communicate in English fluently to support client relationship management in this region, Preferred qualifications: Experience working with Larg...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Hyderabad, Telangana, India; Bengaluru, Karnataka, India; Gurugram, Haryana, India; Pune, Maharashtra, India Minimum qualifications: Bachelor's degree in Computer Science, or a related technical field, or equivalent practical experience, Experience in building data and AI solutions and working with technical customers, Experience in designing cloud enterprise solutions and supporting customer projects to completion, Ability to communicate in English fluently to support client relationship management in this region, Preferred qualifications: Experience working with Larg...

Position Summary This Requisition is for the Employee Referrals Campaign This is a Leadership role for a person who will be responsible for leadingand managing a team of Managers and senior managers working on multiple project streams for a client. They would be applying domain knowledge for better business decision-making, especially in the areas ofAnalytics/Technology/Product Engineering/Product Management. Job Responsibilities Leadership – Lead & guide the team independently or with little support to implement & deliver complex project assignments. Logical Thinking – Able to think analytically, use a systematic and logical approach to analyze data, problems, and situations. Must be able t...

Roles and Responsibility Design and implement data pipelines using Google Cloud Platform services. Develop and maintain large-scale data architectures and systems. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Troubleshoot and resolve complex technical issues related to data engineering. Job Requirements Strong understanding of Google Cloud Platform services and technologies. Experience with data modeling, design, and architecture. Excellent problem-solving skills and attention to det...

About The Role Project Role : Engineering Services Practitioner Project Role Description : Assist with end-to-end engineering services to develop technical engineering solutions to solve problems and achieve business objectives. Solve engineering problems and achieve business objectives using scientific, socio-economic, technical knowledge and practical experience. Work across structural and stress design, qualification, configuration and technical management. Must have skills : 5G Wireless Networks & Technologies Good to have skills : AWS Core Infrastructure, Red Hat Cloud Architecture and DesignMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time edu...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Primary Skills: Core Java, Spring Boot, Java2/EE, Microsservices Hadoop Ecosystem (HBase, Hive, MapReduce, HDFS, Pig, Sqoop etc) Spark Good to have Python Preferred technical and professional experience None

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Key Responsibilities: Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Dataproc, BigQuery, Pub/Sub, and Cloud Storage. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver efficient solutions. Implement ETL/ELT workflows, data ingestion, transformation, and validation processes. Optimize performance and cost-efficiency of data processing jobs and cloud resources. Troubleshoot and resolve data pipeline issues and production incidents. Ensure data quality, governance, and compliance standards are met. Automate data w...

Overview We're looking for a motivated Senior Data Engineer to manage the transformation of data pipelines from Hadoop to BigQuery. You should have strong experience in Google Cloud Platform (GCP), BigQuery, and Dataproc, as well as proficiency in Linux/Unix environments. Experience with Spark, Scala or Python and shell scripting Responsibilities Mandatory Skills: Experience in pipeline migration from Hadoop to BigQuery. Proficiency with GCP, BigQuery, and Dataproc. Strong skills in Linux/Unix environments. Knowledge of Spark, Scala or Python. Advanced Experience with SQL (Any Query Language), shell scripting Strong Analytical skills Finetech & data migration exp. is an added advantage Requi...

Analyze large volumes of data to identify trend and anomalies Identify, evaluate, and integrate new data sources and capabilities into decision-making Create tableau dashboards prepare performance insights, trends using the testing and monitoring data Ensure compliance to Policies, Standard Operating Procedures, and American Express Compliance standards with respect to documentation, testing, and certification of GCS business monitoring and testing Collaborate and consult with Colleagues, Internal Partners and key control teams both within the lines of business and across the organization, to promote a well-controlled environment. Maintain an effective control environment and respond to oper...

We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment. Roles and Responsibility Design, develop, and implement big data solutions using Hive and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems with high performance and reliability. Troubleshoot and resolve complex technical issues related to big data systems. Participate in code reviews and contribute to the improvement of the o...

Role Description: As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team...

Role Description: As a Technical Lead - Cloud Data Platform (GCP) at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security tea...