755 Apache Pig Jobs - Page 6

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Talend Big Data Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in implementing the same Learn new te...

Role Purpose The purpose of this role is to design, develop and troubleshoot solutions/ designs/ models/ simulations on various softwares as per clients/ project requirements Do 1. Design and Develop solutions as per clients specifications Work on different softwares like CAD, CAE to develop appropriate models as per the project plan/ customer requirements Test the protype and designs produced on the softwares and check all the boundary conditions (impact analysis, stress analysis etc) Produce specifications and determine operational feasibility by integrating software components into a fully functional software system Create a prototype as per the engineering drawings & outline CAD model is...

Job Description : Trend-Sniping: Clock a viral moment in under 30 minutes and clap back with the perfect Boom Games-flavored take (apolitical, but savage). Engagement Warfare: Spark 100+ reply threads under influencer posts, without catching bans. Troll Alchemy: Flip haters into hype-trains with wit, charm, and zero toxicity. Compliance Jiu-Jitsu: Work with mods to only delete whats legally necessary, not whats fun. Vibe Curation: Youre not just a commenter, youre a personality. If people dont wanna reply to you, we dont want you. Come up with original content ideas from constantly perusing the interweb

Job Summary: We are looking for a skilled GCP Data Engineer to design, build, and optimize data pipelines and solutions on Google Cloud Platform. The ideal candidate will have hands-on experience with BigQuery, Composer, Dataproc, Python, PySpark, Airflow, and SQL , and will play a key role in ensuring data reliability, scalability, and efficiency across our data ecosystem. Collaborate with data analysts, scientists, and other stakeholders to deliver reliable data solutions. Monitor and troubleshoot data pipelines and ensure data accuracy and consistency. Optimize cloud resources for cost efficiency and performance . Maintain clear technical documentation for all data processes and workflows...

Your role and responsibilities As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in impl...

Your Role Excellent Communication Skills. Experience working with Fact and Dimension tables, SCD. Proven analytical skills and Problem-solving attitude. Any other GCP services or databases like Datastore, Bigtable, Spanner, Cloud Run, Cloud Functions etc. Should have worked on handling big data. experience in Agile methodologies ETL, ELT skills, Data movement skills, Data processing skills. Certification on Professional Google Cloud Data engineer will be an added advantage. Ability to effectively function in a cross-teams environment Your Profile Require 5+ years experience and relevant is minimum 3 years' experience in GCP Data Engineering. Strong experience in GCP Services, data engineerin...

Cloud Platforms ( AWS, MS Azure, GC etc.)Containerization and Orchestration ( Docker, Kubernetes etc..)APIs - Change APIs to APIs developmentData Pipeline construction using languages like Python, PySpark, and SQLData Streaming (Kafka and Azure Event Hub etc..)Data Parsing ( Akka and MinIO etc..)Database Management ( SQL and NoSQL, including Clickhouse, PostgreSQL etc..)Agile Methodology ( Git, Jenkins, or Azure DevOps etc..)JS like Connectors/ framework for frontend/backendCollaboration and Communication

Your role and responsibilities As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in impl...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Spark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeholders to drive...

Notice Period : Immediate to 15 Days. Job Description : - 6+ years of overall Data Analytics and BI experience - Experience in Spark, Hive, Scala. - Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs - Python scripting with focus on data transformation and manipulation libraries such as Pandas and numpy - Strong knowledge and hands-on experience of SQL (should be able to write advance level SQL queries) - Good hands-on experience on data visualization tools such as Power BI, Tableau, Looker - Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow - Good Communication skills.

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Alteryx Good to have skills : Hadoop Administration Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. Your typical day will involve collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into functional specifications. You will en...

Job Description : Trend-Sniping: Clock a viral moment in under 30 minutes and clap back with the perfect Boom Games-flavored take (apolitical, but savage). Engagement Warfare: Spark 100+ reply threads under influencer posts, without catching bans. Troll Alchemy: Flip haters into hype-trains with wit, charm, and zero toxicity. Compliance Jiu-Jitsu: Work with mods to only delete whats legally necessary, not whats fun. Vibe Curation: Youre not just a commenter, youre a personality. If people dont wanna reply to you, we dont want you. Come up with original content ideas from constantly perusing the interweb

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

Immediate Openings onPyspark Experience : 5+ Skill:-Pyspark Location :- Bangalore Notice Period :- Immediate. Pyspark Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline

Python, big data (Hive, spark or snowflake, Kafka), SQL/ SQLServer. Experience in Python for data processing.

We are looking for a skilled Hadoop Developer with 3 to 6 years of experience to join our team in Chennai. The ideal candidate will have expertise in Scala, SQL, Unix, and Hive & Spark. Roles and Responsibility Design, develop, and implement scalable data processing solutions using Hadoop technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Scala and Spark. Troubleshoot and resolve complex technical issues related to Hadoop applications. Participate in code reviews and contribute to improving overall code quality. Stay up-to-date with the latest trends and technologies in Hadoop developmen...

We are looking for a skilled Big Data Developer with 6-9 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment. Roles and Responsibility Design, develop, and implement big data solutions using Hive and other relevant technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data processing systems with high performance and reliability. Troubleshoot and resolve complex technical issues related to big data systems. Participate in code reviews and contribute to the improvement of the o...

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

We are looking for a skilled Tech Lead - Data Engineer with 7-11 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. Roles and Responsibility Design, develop, and implement data engineering solutions using various technologies. Lead a team of data engineers to ensure timely project delivery. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data systems and architectures. Ensure data quality, integrity, and security. Stay updated with industry trends and emerging technologies. Job Requirements Strong knowledge of data engineering principles and practices. Experience w...

Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...

We are looking for a skilled Team Lead - Data Engineer with 6-8 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in data engineering and excellent leadership skills. Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Lead a team of data engineers to deliver high-quality results. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical documentation for data systems and processes. Troubleshoot and resolve complex technical issues related to data engineering. Mentor and guide ...

We are looking for a skilled PySpark Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing scalable data processing architectures using PySpark. Roles and Responsibility Design and develop scalable data processing architectures using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain large-scale data pipelines using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data processing workflows for performance, scalability, and reliability. Mentor junior...

We are looking for a skilled Senior Pyspark Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark. Roles and Responsibility Design, develop, and deploy large-scale data processing pipelines using Pyspark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain complex data transformations and data quality checks. Optimize pipeline performance and troubleshoot issues. Ensure compliance with industry standards and best practices. Participate in code reviews and contribute to improving overall code quality. Job Requiremen...