9690 Big Data Jobs - Page 6

ABOUT THE ROLE We are seeking a seasoned Senior Data Engineer to drive the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers. Roles & Responsibilities: Contribute to the design, development, and implementation of automations to monitor our data and cloud platforms for reliability, cost, and maintenance. Take ownership of platform management, managing scope, timelines, and risks. Ensure data quality and integrity through rigo...

Senior Data Engineer What you will do The role is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that ...

We are seeking a Specialist Backend Software Engineer to join the Labs software engineering practice. This role is integral to developing top-tier talent, setting engineering best practices, and evangelizing full-stack development capabilities across the organization. The Specialist Backend Software Engineer will play a key role in turning AI concepts into products, working closely with product managers and AI and software engineers and architects. This is a hands-on, cross-functional role that blends modern software development with AI integration in a rapid innovation and prototyping operating model. Roles & Responsibilities: Design, develop, and maintain microservices using Python to ensu...

Role Description: The Product Master Data Management (PMDM) Data Engineer is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives, and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes. You will play a key role in a regulatory submission content automation initiative which will modernize and digitize t...

What you will do In this vital role you will be part of the Data Platform Engineering team to support and maintain cloud and big data solutions used by functional teams like Manufacturing, Commercial, Research and Development Work closely with the Enterprise Data Lake/Fabric delivery and platform teams to ensure that the applications are aligned with the overall architectural and development guidelines Research and evaluate technical solutions including Databricks, AWS Services, Kubernetes/EKS, NoSQL databases, Data Science packages, platforms and tools with a focus on enterprise deployment capabilities like security, scalability, reliability, maintainability, cost management etc. Management...

Role Description: The role is responsible for designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and , visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design ...

About Position: We are seeking a skilled and passionate Java/Scala Developer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining high-performance, scalable applications using Java and Scala. You will collaborate closely with cross-functional teams to deliver innovative solutions that meet business requirements while adhering to best practices in software development. Role: Java Scala Lead Location: All Persistent Locations Experience: 8 to 12 years Job Type: Full Time Employment What You'll Do: Identifying and resolving immediate and potential issues with applications. Drafting detailed reports on the work performed and projects complete...

Role Description: The Commercial Data Management Manager will be responsible for managing the execution of the Data Platforms Operations in partnership with the Technology team, driving continuous innovation, operational excellence, and cost efficiencies. The manager will oversee execution of features aligned with one or more of our Data Platform product teams and work with the global team and functional partners to implement additional capabilities to the platform aligned with business objectives. Also, the manager will partner with the Senior Manager, Data Platforms to initially focus on the transition efforts from the vendor teams, building a highly talented and data-focused team in our I...

Role Description: As part of the cybersecurity organization, In this vital role you will be responsible for designing, building, and maintaining data infrastructure to support data-driven decision-making. This role involves working with large datasets, developing reports, executing data governance initiatives, and ensuring data is accessible, reliable, and efficiently managed. The role sits at the intersection of data infrastructure and business insight delivery, requiring the Data Engineer to design and build robust data pipelines while also translating data into meaningful visualizations for stakeholders across the organization. The ideal candidate has strong technical skills, experience w...

Role Description: Amgen is seeking a Specialist Software Engineer to contribute to designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing data pipelines, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills and experience with MuleSoft, Databricks, Airflow and AWS. Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing using Databricks and Airflow Design, build and ...

Role: Associate Architect - Data Experience Level: 6 to 10 Years Work location: Mumbai, Bangalore or Trivandrum (Hybrid) Notice period: Preferred up to 45 days Role & Responsibilities: 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business requirements, translate them into functional and non-functional areas, and define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc. Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions fo...

What you will do In this vital role you will be part of the Data Platform Engineering team to support and maintain cloud and big data solutions used by functional teams like Manufacturing, Commercial, Research and Development Work closely with the Enterprise Data Lake delivery and platform teams to ensure that the applications are aligned with the overall architectural and development guidelines Research and evaluate technical solutions including Databricks, AWS Services, Kubernetes/EKS, NoSQL databases, Data Science packages, platforms and tools with a focus on enterprise deployment capabilities like security, scalability, reliability, maintainability, cost management etc. Management of Ent...

ABOUT THE ROLE Role Description: We are seeking a highly skilled Machine Learning Engineer with a strong MLOps background to join our team. You will play a pivotal role in building and scaling our machine learning models from development to production. Your expertise in both machine learning and operations will be essential in creating efficient and reliable ML pipelines. Roles & Responsibilities: Collaborate with data scientists to develop, train, and evaluate machine learning models. Build and maintain MLOps pipelines, including data ingestion, feature engineering, model training, deployment, and monitoring. Leverage cloud platforms (AWS, GCP, Azure) for ML model development, training, and...

Specialist IS Bus System Analyst Tech Product Owner What you will do We are seeking a Specialist Business Analyst to join our team to harness the power of data leveraging digital technologies to serve the need of Manufacturing and Clinical Supply Chain. As part of this role, you both engage with the business users and partners to elicit requirements and perform data analysis and metrics definition activities as part of a product team of data scientists, business analysts, and software engineers. Roles & responsibilities Collaborate with System Architects and Product Managers to manage business analysis activities, ensuring alignment with engineering and product goals Capture the voice of the...

What you will do In this vital role you will be responsible for developing and maintaining the overall IT architecture of the organization. This role involves defining the architecture vision, creating roadmaps, and ensuring that IT strategies align with business goals in the Hire to Retire capability and more specifically to Human Resources Service Delivery module in ServiceNow. You will be working closely with partners to understand requirements, develop architectural blueprints, and ensure that solutions are scalable, secure, and aligned with enterprise standards. Architects will be involved in defining the enterprise architecture strategy, guiding technology decisions, and ensuring that ...

Description: Design Develop & Testing of complex ETL components using Ab-Initio Proficient in Metaprogramming and worked on generic ETL patterns Effective integration with upstream and downstream processes and systems Ability to provide Technical help to team members and participate and contribute to relevant technical standards Along with Ab-Initio ability to learn quickly other technology like AWS Python Spark etc. Excellent at Data warehousing Concepts with experience in designing robust scalable ETL Solutions. Good Communication and Interpersonal skills. Well versed in building SQL Queries and Shell Scripting in Unix Big data knowledge including Hive Impala (Good To have) Named Job Posti...

Description: strong data analyst (with knowledge on SQL and AWS data engineering knowledge). good analytical and strong SQL writing skills Year of experience :7-8yrs Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :No Global Role Family :60242 (P) Data Management Local Role Name :60326 AI and Analytics Specialist Local Skills :6170 SQL Languages Required::English Role Rarity :To Be Defined

Description: Primary/Mandatory Experience: - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity: Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud...

Description: Key job responsibilities include, but are not limited to Become involved with day-to-day operations in Production Control. Understand the workflows and be able to troubleshoot issues and define new workflows in PCS and Control-M Design Airflow infrastructure according to the industry best practices. Work with System Administrators, Platform Engineers, Network, Firewall and Monitoring teams on the implementation of the infrastructure. Document the system's specifics, define, and implement administrative controls and policies of Airflow. Work with the development teams to identify the groups of jobs to migrate to airflow. Assist the development teams with the migrations:define DAG...

1. GCP Data Engineer Lead :1. GCP Data Engineer :Experience: 10-15 years of experience in data engineering, with a focus on cloud-based solutions. Extensive experience with Google Cloud Platform (GCP) and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer. Proven track record of designing and building scalable data pipelines and architectures. Experience with ETL tools and processes. Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Pub/Sub, Cloud Functions, and Cloud Composer. Implement ETL (Extract, Transform, Load) processes to ingest data from various sources into GCP data warehouses like BigQuer...

Educational Requirements Bachelor of Engineering Service Line Strategic Technology Group Responsibilities Power Programmer is an important initiative within Global Delivery to develop a team of Full Stack Developers who will be working on complex engineering projects, platforms and marketplaces for our clients using emerging technologies., They will be ahead of the technology curve and will be constantly enabled and trained to be Polyglots., They are Go-Getters with a drive to solve end customer challenges and will spend most of their time in designing and coding, End to End contribution to technology oriented development projects., Providing solutions with minimum system requirements and in...

Description: Experiencein coding in Ruby Experience in Angular REST API experience required Exposure to CI/CD tools like Jenkins, Maven, Git, etc. Development and implementation of integrated solutions with external applications through APIs and other connection methods with secure data exchange. Experience with federal security, privacy, and Section 508 compliance. Experience with Scrum/Agile methodologies. Proficiency in various SQL or NoSQL databases. Familiarity with XHTML, CSS, XML, JQuery, and JavaScript. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :B Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remot...

Educational Requirements Bachelor of Engineering Service Line Strategic Technology Group Responsibilities Power Programmer is an important initiative within Global Delivery to develop a team of Full Stack Developers who will be working on complex engineering projects, platforms and marketplaces for our clients using emerging technologies., They will be ahead of the technology curve and will be constantly enabled and trained to be Polyglots., They are Go-Getters with a drive to solve end customer challenges and will spend most of their time in designing and coding, End to End contribution to technology oriented development projects., Providing solutions with minimum system requirements and in...

Data Engineer (Hadoop, Spark/Scala, HBase, Kafka) Responsibilities: Gather and understand data requirements, build complex data pipelines, and work to achieve high quality data ingestion goals. Drive the development of Hadoop based data warehouses, data ingestion, and data profiling activities. Analyzing, re architecting, and re platforming on premise datalake if needed Implementation and maintenance of standard data/technology deployment workflow to ensure that all deliverables/enhancements are delivered in a disciplined and robust manner. Highly self motivated and able to work independently as well as in a team environment. Required Skills: Proficiency with Spark Scala, Python language (ma...

Data Engineer-29064 Position:FTE, remote, IndiaAvailability-Immediate-1 weekMax rate:28-30 LPAOverlap:4 hours with PST(Pacific Standard Time)Candidate proficiency level:Senior(8+)Requirements:Bachelor's degree or higher in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong focus on designing and building data pipelines and infrastructure.Proficient in SQL and Python, with the ability to translate complexity into efficient code.Experience with data workflow development and management tools (dbt, Airflow).Solid understanding of distributed computing principles and experience with cloud-based data platforms such as AWS, GCP, or Azure.Stro...