67 Pig Jobs - Page 2

This is an opportunity for you to shape the direction of your career and lead multiple teams to success at one of the world's top financial institutions. As a Manager of Software Engineering at JPMorgan Chase in the Employee Platforms team, you will be responsible for overseeing multiple teams and managing daily implementation activities. Your duties will include identifying and escalating issues, ensuring compliance with standards, meeting business requirements, and adhering to tactical best practices. You will be tasked with managing data integration and analysis of disparate systems, building extensible data acquisition and integration solutions, implementing processes to extract, transfo...

As a Data Engineer Trainer/Big Data Trainer, you will be responsible for imparting knowledge and training on various technical aspects related to data engineering and big data. Your key responsibilities will include expertise in Data Mining and ETL Operations/Tools. It is crucial to have a deep understanding and knowledge of HDFS, Hadoop System, Map Reduce, RDD, Spark DataFrame, PySpark along with related concepts. You should also have experience in using Business Intelligence Tools such as Tableau, Power BI, and Big Data Frameworks like Hadoop and Spark. Proficiency in Pig, Hive, Sqoop, and Kafka is essential for this role. Knowledge of AWS and/or Azure, especially with Big Data Stack, will...

Our Data Engineers work with Data Scientists, Project Leads, Managers on implementation, upgrade, and migration projects. Key Responsibilities Analyzing raw data Developing and maintaining datasets Improving data quality and efficiency Create solution and design documentation Work on projects independently as well as being part of a large team Develop internal training, process and best practices Crosstrain Junior Data Engineers or other team members with your area of expertise Further develop skills both on the job and through formal learning channels Assist in pre-sales activities by providing accurate work estimate Interacts closely with Project Management to deliver projects that are don...

Exp working with technologies like Hadoop, Hive, Pig, Oozie, Map Reduce, Spark, Sqoop, Kafka, Flume, etc. Extensive experience in software development, scripting and project management Exp using system monitoring tools (e.g. Grafana, Ganglia)

Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open source tools and data processing frameworks. • Hands-on on technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python, Hadoop Platform, Hive, airflow • Experience in GCP Cloud Composer, Big Query, DataProc • Offer system support as part of a support rotation with other team members. • Operationalize open-source data-analytic tools for enterprise use. • Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification. • Understand and follow the company development lifecycle to d...

As a Senior Software Engineer specializing in Big Data technologies, you will leverage your proven experience to drive impactful software solutions. Your hands-on expertise with a wide array of tools such as Hadoop, Hive, Pig, Oozie, MapReduce, Spark, Sqoop, Kafka, and Flume will be instrumental in developing cutting-edge software applications. Your role will involve extensive software development, scripting, and project management, ensuring the successful execution of projects. You will demonstrate proficiency in utilizing system monitoring tools like Grafana and Ganglia, along with automated testing frameworks to streamline the development process. Your knowledge of programming languages s...

The Applications Development Intermediate Programmer Analyst position at our organization involves working at an intermediate level to assist in the development and implementation of new or updated application systems and programs in collaboration with the Technology team. Your main responsibility will be to contribute to application systems analysis and programming activities. You will be expected to utilize your knowledge of applications development procedures and concepts, as well as basic knowledge of other technical areas, to identify and define necessary system enhancements. This includes using script tools, analyzing code, and consulting with users, clients, and other technology group...

We have a job opening for GenAI Team Lead at PibyThree Consulting Services Pvt Ltd in Mumbai. The company is a Global Cloud Consulting & Services provider specializing in Cloud Transformation, Cloud FinOps, IT Automation, Application Modernization, and Data & Analytics. PibyThree aims to make businesses successful by leveraging technology for automation and enhanced productivity. As a Gen AI lead at PibyThree, you will be responsible for building both Traditional AI/ML systems and Generative AI-based systems. The ideal candidate should have a total experience of 5 to 7 years with hands-on experience in building language models, machine learning, and AI models using industry tools, products, ...

As a skilled professional with over 7 years of experience, you will be responsible for reviewing and understanding business requirements to ensure timely completion of development tasks with rigorous testing to minimize defects. Collaborating with a software development team is crucial to implement best practices and enhance the performance of Data applications, meeting client needs effectively. In this role, you will collaborate with various teams within the company and engage with customers to comprehend, translate, define, and design innovative solutions for their business challenges. Your tasks will also involve researching new Big Data technologies to evaluate their maturity and alignme...

As an experienced Data Engineer with 6-12 years of experience, you will be responsible for working with Big Data technologies, programming languages, ETL & Data Engineering, Cloud Platforms, and various tools & frameworks. Your expertise in Scala, Spark, PySpark, Python, SQL, Hadoop, Hive, Pig, MapReduce, and other related skills will be crucial in this role. You must have a strong background in Data Warehouse Design, ETL, Data Analytics, Data Mining, Data Cleansing, and experience in creating data pipelines, optimization, troubleshooting, and data validation. Proficiency in cloud platforms such as GCP and Azure, along with tools like Apache Hadoop, Airflow, Kubernetes, and Containers, will ...

As a Big Data/Hadoop Trainer, your main responsibility will be conducting training sessions on Big Data and Hadoop. You will be tasked with creating assignments and projects that are centered around Hadoop to enhance the learning experience of the participants. To excel in this role, you should have a minimum of 2 years of hands-on experience in Hadoop/Big Data Technology within the corporate sector. Your profile should showcase excellent knowledge of Hadoop, Big Data, HDFS, MapReduce, Pig, Hive, Sqoop, ZooKeeper, Hbase, and Java. Additionally, possessing strong communication and presentation skills is essential in effectively delivering the training content. We are looking for candidates wi...

Looking for immediate joiner - Mumbai (work from office) Roles and Responsibilities: Programming Skills knowledge of statistical programming languages like R, Python, and database query languages like SQL, Hive, Pig is desirable. Familiarity with Scala, Java, or C++ is an added advantage. Data mining or extracting usable data from valuable data sources Carrying out the preprocessing of structured and unstructured data Enhancing data collection procedures to include all relevant information for developing analytic systems Processing, cleansing, and validating the integrity of data to be used for analysis Analyzing large amounts of information to find patterns and solutions Data Wrangling prof...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. As a Senior Data Engineer at EY's GDS Assurance Digital, your mission is to develop, implement, and integrate technology solutions that better serve audit clients and engagement teams. You will have the opportunity to develop a deep audit-related technical knowledge and outstanding database, data analytics, and programming skills. The role in...

You are ready to gain the skills and experience needed to grow within your role and advance your career, and we have the perfect software engineering opportunity for you. As a Software Engineer II at JPMorgan Chase within the Employee Platforms team, you will be part of an agile team dedicated to enhancing, designing, and delivering the software components of the firm's cutting-edge technology products in a secure, stable, and scalable manner. In your role as an emerging member of the software engineering team, you will execute software solutions by designing, developing, and technically troubleshooting various components within a technical product, application, or system, while acquiring th...

The Role Develops and program methods, automated processes, and systems to cleanse, integrate and analyze structured and unstructured, diverse big data sources to generate actionable insights and solutions using machine learning and advanced analytics . Interprets and communicates insights and findings from analyses and experiments to other analysts, data scientists, team members and business partners. The Main Responsibilities Support the development of end-to-end analytics solutions by assisting in the design and implementation of solutions that cover the entire data science lifecycle, including data discovery, cleaning, exploratory data analysis, model building, and deployment. Assist wit...

As a Data Platform Engineer - Tech Lead at Deutsche Bank in Pune, India, you will be part of the DB Technology global team of tech specialists. Your role involves leading a group of engineers working on cutting-edge technologies in Hadoop, Big Data, GCP, Terraform, Big Query, Data Proc, and data management to develop robust data pipelines, ensure data quality, and implement efficient data management solutions. Your leadership will drive innovation, maintain high standards in data infrastructure, and mentor team members to support data-driven initiatives. You will collaborate with data engineers, analysts, cross-functional teams, and stakeholders to ensure the data platform meets the organiza...

The ideal candidate should be highly interested and available immediately. Please submit your resume along with your total experience, current CTC, notice period, and current location details to Nitin.patil@ust.com. You will be responsible for designing, developing, and optimizing data pipelines and ETL workflows. Your work will involve collaborating with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data processing. Additionally, you will implement data analytics and mining techniques to derive valuable business insights. Managing cloud-based big data solutions on GCP and Azure will also be part of your job. Lastly, you will troubleshoot Hadoop log files and utilize multi...

As an experienced data analytics professional with 1 to 2 years of experience, you will be responsible for developing and implementing data analytics methodologies. Your role will require good interpersonal skills along with excellent communication abilities. Your technical skills must include proficiency in Python, machine learning, deep learning, data wrangling, and integration with Big Data tools such as Hadoop, Scoop, Impala, Hive, Pig, and Spark R. You should also have a solid understanding of statistics, data mining, algorithms, time series analysis, forecasting, SQL queries, and Tableau data visualization. Having a good grasp of technologies like Hadoop, HBase, Hive, Pig, Mapreduce, P...

As a Big Data Architect with 4 years of experience, you will be responsible for designing and implementing scalable solutions using technologies such as Spark, Scala, Hadoop MapReduce/HDFS, PIG, HIVE, and AWS cloud computing. Your role will involve hands-on experience with tools like EMR, EC2, Pentaho BI, Impala, ElasticSearch, Apache Kafka, Node.js, Redis, Logstash, statsD, Ganglia, Zeppelin, Hue, and KETTLE. Additionally, you should have sound knowledge in Machine learning, Zookeeper, Bootstrap.js, Apache Flume, FluentD, Collectd, Sqoop, Presto, Tableau, R, GROK, MongoDB, Apache Storm, and HBASE. To excel in this role, you must have a strong background in development with both Core Java an...

As an ETL Testing & Big Data professional, you will be responsible for designing and implementing ETL test strategies based on business requirements. Your role involves reviewing and analyzing ETL source code, as well as developing and executing test plans and test cases for ETL processes. Data validation and reconciliation using SQL queries will be a key aspect of your responsibilities. Monitoring ETL jobs, resolving issues affecting data accuracy, and performing performance testing on ETL processes to focus on optimization are crucial tasks in this role. Ensuring data quality and integrity across various data sources, along with coordinating with development teams to troubleshoot issues an...

The Applications Development Senior Programmer Analyst position is an intermediate level role where you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Your responsibilities will include conducting tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing and implementing new or revised applications systems and programs to meet specific business needs or user areas. You will...

You have experience in ETL testing and are familiar with Agile methodology. With a minimum of 4-6 years of testing experience in test planning & execution, you possess working knowledge in Database testing. It would be advantageous if you have prior experience in the auditing domain. Your strong application analysis, troubleshooting, and behavioral skills along with extensive experience in manual testing will be valuable. While experience in Automation scripting is not mandatory, it would be beneficial. You are adept at leading discussions with Business, Development, and vendor teams for testing activities such as Defect Coordinator and test scenario reviews. Your excellent verbal and writte...

You have over 5 years of experience in building production-grade Neural Network models using Computer Vision or Natural Language Processing techniques. You possess a strong understanding of various machine learning techniques and algorithms, including k-NN, Naive Bayes, SVM, Decision Forests, and Neural Networks. Experience with Deep Learning frameworks like TensorFlow, PyTorch, and MxNet is part of your skillset. Proficiency in common data science toolkits such as R, Sklearn, NumPy, MatLab, and MLib is highly desirable. Additionally, you have solid applied statistics skills encompassing distributions, statistical testing, and regression. Your expertise extends to using query languages like ...

You will be responsible for big data development and support for production deployed applications, analyzing business and functional requirements for completeness, and developing code with minimum supervision. Working collaboratively with team members, you will ensure accurate and timely communication and delivery of assigned tasks to guarantee the end-products" performance upon release to production. Handling software defects or issues within production timelines and SLA is a key aspect of the role. Your responsibilities will include authoring test cases within a defined testing strategy, participating in test strategy development for Configuration and Custom reports, creating test data, as...

You should have strong experience in PySpark, Python, Unix scripting, SparkSQL, and Hive. You must be proficient in writing SQL queries, creating views, and possess excellent oral and written communication skills. Prior experience in the Insurance domain would be beneficial. A good understanding of the Hadoop Ecosystem including HDFS, Map Reduce, Pig, Hive, Oozie, and Yarn is required. Knowledge of AWS services such as Glue, AWS S3, Lambda function, Step Function, and EC2 is essential. Experience in data migration from platforms like Hive/S3 to Data Bricks is a plus. You should be able to prioritize, plan, organize, and manage multiple tasks efficiently while delivering high-quality work. As...