654 Apache Pig Jobs - Page 3

We are looking for a skilled Senior Big Data Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in big data development and analysis. Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies. Job Requirements Strong understanding of big data concepts, including Hadoop, ...

We are looking for a skilled Team Lead with 6-8 years of experience to join our team in the Big Data domain. The ideal candidate will have a strong background in leading teams and driving business growth through data-driven insights. Roles and Responsibility Develop and implement big data strategies to drive business growth and improvement. Lead cross-functional teams to design, develop, and deploy big data solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Design and implement data governance frameworks to ensure data quality and integrity. Develop and maintain technical documentation for big data systems and processes. Provide training...

We are looking for a skilled Tech Lead - Big Data with 7-11 years of experience to join our team in India. Roles and Responsibility Design and implement big data solutions using various technologies. Lead the development team in building scalable and efficient big data systems. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure high-quality code and adhere to industry standards. Mentor junior team members and provide technical guidance. Job Requirements Strong experience in big data technologies such as Hadoop, Spark, and NoSQL databases. Proven track record of le...

We are looking for a skilled Big Data Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing large-scale data systems. Roles and Responsibility Design and develop scalable big data architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for big data systems and processes. Ensure compliance with industry standards and best practices for big data management. Provide technical leadership and guidance to junior team members on big data technologies. Participate in ...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Your role and responsibilities As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in impl...

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

We are looking for a skilled professional with 5-9 years of experience to join our team as an Hadoop-Spark specialist. The ideal candidate will have a strong background in big data processing and analytics. Roles and Responsibility Design, develop, and implement scalable big data solutions using Hadoop and Spark. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and optimize performance issues in big data systems. Ensure data quality and integrity through data validation and testing procedures. Stay updated with industry trends and emerging technologies in ...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Job Title: - GCP Data Engineer with Big Query ( AIA Kolkata ) Location: - AIA Kochi Minimum 6 to 9 years of experience Mandatory Skills: GCP Services – Big Query, Cloud SQL, Data flow Around 7+ years of experience in development in Data warehousing projects in GCP platforms, Good understanding of dimensional modelling Expertise in MySQL & SQL/PL GCP & BigQuery knowledge is must, GCP certification is added advantage Good experience in Cloud Composer, DAGs , airflow REST API development experience Good in analytical and problem solving, efficient communication Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the de...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

We are looking to fill Project Lead position for product migration assignment. Project Lead position for product migration assignment will be remote and require no travel. The Project Lead will act as a primary contact to external customers (Physicians and Hospitals) while working closely with cross-functional teams to manage product migration tasks. The role will be responsible for planning, coordinating and managing Revenue Cycle solutions product migration activities. Primary responsibilities of a Project Lead include: Manage the product implementation of existing clients adding new business or modifying current business Responsible for client outreach to kick off the product implementati...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

where youll be supported and inspired by a collaborative community of colleagues around the world, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role Experience working with Fact and Dimension tables, SCD. Proven analytical skills and Problem-solving attitude. Any other GCP services or databases like Datastore, Bigtable, Spanner, Cloud Run, Cloud Functions etc. Should have worked on handling big data. experience in Agile methodologies ETL, ELT skills, Da...

where youll be supported and inspired by a collaborative community of colleagues around the world, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role As a senior software engineer with Capgemini, you will have 3 + years of experience in Scala with strong project track record. Hands-on expertise in Scala and Spark, strong SQL skills on DB2, and proficiency in handling diverse file formats including JSON, Parquet, AVRO, ORC, and XML. Proven experience in H...

About The Role Project Role Application Lead Project Role Description Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills Apache Kafka, Apache Administration Good to have skills NA Minimum 7.5 year(s) of experience is required Educational Qualification 15 years full time education Summary :We are looking for a skilled Kafka Administrator to join our team . In this role, you will be responsible for setting up, configuring, and managing Kafka clusters, ensuring high availability and performance of our data streaming platform. You will work closely with development and operations teams to design and implement Kafka solutions that...

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

Overview GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL

? Mentor and guide engineering teams in all aspects of the SDLC. ? Lead technical design sessions and translate ideas into robust technical architecture. ? Develop and maintain scalable, high-performance data pipelines and streaming systems. ? Use Python, SQL, Scala, NodeJS, and work with relational databases, NoSQL stores, and Kafka. ? Refactor and optimize legacy codebases for improved performance and scalability. ? Collaborate with product and engineering teams to deliver innovative solutions in an agile environment. ? Support technical support teams with ad-hoc data queries and operational troubleshooting. ? Ensure data pipelines and APIs meet enterprise-grade performance and usability s...

? Design, develop, and maintain scalable data pipelines and streaming systems. ? Work with Python, SQL, Scala, NodeJS, and various data stores (relational, NoSQL, Kafka). ? Analyze healthcare and marketing datasets using SQL. ? Refactor and optimize existing codebases for performance improvements. ? Collaborate closely within an agile team to deliver creative technical solutions. ? Support ad-hoc data requests and assist technical support teams as needed. ? Ensure high performance of data ingestion, transformation, and API consumption layers. ? Follow best practices for coding, testing, CI/CD, and cloud deployments

Project Role : AI / ML Engineer Project Role Description : Develops applications and systems that utilize AI to improve performance and efficiency, including but not limited to deep learning, neural networks, chatbots, natural language processing. Must have skills : Google Cloud Machine Learning Services Good to have skills : GCP Dataflow, Google Dataproc, Google Pub/SubMinimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an AI / ML Engineer, you will engage in the development of applications and systems that leverage artificial intelligence to enhance performance and efficiency. Your typical day will involve collaborating with cros...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Job Role Very good Understanding of current work and the tools and technologies being used. Comprehensive knowledge and clarity on Bigquery, ETL, GCS, Airflow/Composer, SQL, Python. Experience working with Fact and Dimension tables, SCD. Minimum 3 years" experience in GCP Data Engineering. Java/ Pytho...

The candidate will work on modernizing high-volume, large-scale, multi-tiered transaction processing production system to cloud. Working in Agile software development lifecycle methodology, he will analyze the requirements, provide solution and mentor junior developers. Will design and develop near real-time applications using various Java based cloud technologies. She / He will work as technical lead, providing solution for modernization effort. He / She will also analyze new requirements and provide estimates for new development, mentor team member and in charge for the technical delivery of the project / module. Very good verbal and written communication 10+ Years of experience in develop...