9690 Big Data Jobs - Page 19

Experience At least 5 years of experience in AWS based projects Technical skills Proficiency in Python and PySpark for data engineering tasks Big Data Strong knowledge of Big Data technologies and data warehousing concepts AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions SQL Strong SQL skills for data manipulation and querying CI CD Experience with CI CD tools like Terraform and Git Actions Soft skills Good communication skills and ability to work in a multicultural team

About Mitsogo | Hexnode Mitsogo is a global organization that highly values the contributions of each employee. Our ability to attract top talent is a testament to our commitment to fostering a sense of belonging for everyone. We recognize the rapid evolution of technology and society that impacts our industry, and we prioritize equipping our employees with diverse opportunities and empowering them with a wide range of skills. Hexnode, the Enterprise software division of Mitsogo Inc., was founded with a mission to simplify the way people work. Operating in over 100 countries, Hexnode UEM empowers organizations in diverse sectors. Fueling the transformation to a seamless ecosystem of connecte...

ABOUT THE ROLE Role Description: Amgen is seeking a Sr Associate Software Engineer to contribute to designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing data pipelines, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills and experience with MuleSoft, Databricks, Airflow and AWS. Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing using Databricks and Airflow D...

Roles & Responsibilities: Serves as a technical leader across multiple teams Coaches mid-level and senior software development engineers Drive architectural decisions across multiple projects Maintain technical excellence and scalability in products Design, develop, and implement IS solutions to enable end to end digitization of lab experimentation, simulations and electronic recipe management across Operations. Actively engage with business users to analyze business needs, identify technology solutions capture, and document design guided by best practices in Agile development. Collaborate with IS Architects and System Owners to implement an integrated solution across PLM, ERP, MES, and Ente...

Role & responsibilities Design, develop, and maintain data pipelines and ETL processes using Databricks , BigQuery , and SQL . Collaborate with business and technical teams to understand data requirements and deliver high-quality solutions. Optimize data workflows for performance, scalability, and reliability. Develop and manage data models , ensuring data accuracy, integrity, and consistency. Support analytics and reporting teams by providing clean, well-structured data sets. Troubleshoot and resolve data issues across multiple environments. Interact directly with clients to gather requirements, present deliverables, and manage expectations. Ensure compliance with data governance and securi...

Sr. Spark Big Data Developer Experience : 5 7 years Location : Pune, India (Work from Office) Notice Period : 0 30 Days Must Have: Proficiency in at least one of the following programming languages: Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end data storage/processing pipeline Strong Experience in Spark development with batch and streaming Intermediate level expertise in HDFS and Hive Experience with Pyspark and Data Engineering ETL implementation and migration to spark Experience of working with Hadoop cluster Python, PySpark, Data Bricks developer with knowledge of cloud Experience with Kafka and Spark streaming (Dstream and...

Job Title: Lead / Senior AI/ML Developer Experience Required: 6 to 8 Years Location: Hybrid Number of projects on ML: minimum 2 Role Overview: We are seeking a Lead or Senior AI/ML Developer to design, develop, and implement machine learning solutions that solve complex business challenges. The ideal candidate will have a strong grasp of algorithms, model development, data preprocessing, and deployment techniques, along with the ability to translate business requirements into scalable AI-driven applications. Key Responsibilities: Understand and analyze business and technical requirements to identify AI/ML opportunities. Design, develop, and optimize machine learning and deep learning models....

Job Title: Machine Learning Engineer Location : Pune or Gurgaon Hybrid Experience Required : 6-9 Years Job Summary: We are looking for a Machine Learning Engineer with 3 plus years of experience to join our AIML team You will be responsible for building deploying and optimizing machine learning models that solve real world problems across domains such as NLP computer vision recommendation systems and predictive analytics Key Responsibilities: Design and develop machine learning models using Python and relevant ML libraries Preprocess and analyse large datasets to extract meaningful insights Implement and optimize algorithms for performance and scalability Collaborate with data scientists sof...

Guide and shape the future of technology at a globally recognized firm, driven by pride in ownership. As a Senior Manager of Site Reliability Engineering at JPMorgan Chase within the Fice technology team which is aligned to Corporate Technology Division, you are the non-functional requirement owner and champion for the applications in your remit. You are a key influencer in your team s strategic planning, driving continual improvement in customer experience, resiliency, security, scalability, monitoring, instrumentation, and automation of the software in your area. You act in a blameless, data-driven manner and navigate difficult situations with composure and tact. Job responsibilities Demon...

About the Role: Seeking a highly skilled Java Full Stack Developer with an experience of 5 years to join our dynamic team. Requirements: Proficiency in Core Java, preferably with sound knowledge of libraries and frameworks (Spring, Hibernate, Spring Boot). Core expertise in front-end development using React, Angular, etc. , along with familiarity with backend architecture, databases, microservices and UI design patterns. Sound experience in designing and building scalable backend systems and reliable APIs. Working knowledge of performing software upgrades, including JDK and Tomcat. Should be experienced in databases such as SQL and Big Data technologies. Understanding of cloud platforms incl...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Palantir Foundry Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role :Lead Data Engineer Project Role Description :Design, build and enhance applications to meet business process and requirements in Palantir foundry.Work experience :Minimum 6 years Must have Skills :Palantir Foundry , PySpark, TypeScript (for customizing Workshop Forms & UI)Good to Have Skills :Experience in Pyspark, python and SQLKnowledge on Big Data tools & Tech...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also engage in s...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL p...

Role Purpose The purpose of the role is to design, and architect VLSI and Hardware based products and enable delivery teams to provide exceptional client engagement and satisfaction. Title: Data Science Architect. Location Gurgaon / Noida Machine Learning, Data Science, Model Customization [4+ Years] Exp with performing above on cloud services e.g AWS SageMaker and other tools AI/ Gen AI skills: [1 or 2 years] MCP, RAG pipelines, A2A, Agentic / AI Agents Framework Auto Gen, Lang graph, Lang chain, codeless workflow builders etc Role & Responsibilities Build working POC and prototypes rapidly. Build / integrate AI driven solutions to solve the identified opportunities, challenges. Lead cross ...

Overall experience 5+ years with minimum 4+ years experience in GCP Bigquery,Data proc Proficient in GCP Bigquery,Data proc Proven experience as a Senior Data Engineer or similar role. Strong problem-solving techniques with an ability to troubleshoot complex software issues. Excellent communication skills, both written and verbal. Self-motivated and able to work independently with minimal supervision.

Ficial Reconciliation Platform Team owns a portfolio of products and tools that are used for reconciling account balances and Manual Journal Entries (MJE) in the General Ledger (GL). We currently have 3 Products (MACE, Workbench/TREx, OTTO) in Production, with some more in Ideation phase. MACE processes 11 million transactions daily, totaling $1.2 trillion in value, handling 100 GB files and up to 100 million transactions in under 30 minutes, while automating the matching between general ledger and subledger data to swiftly identify discrepancies. 3+ years of non-internship professional software development experience 2+ years of non-internship design or architecture (design patterns, reliab...

Collaborate with Platform Engineers to understand the architecture and implementation of Mastercard s cloud data platforms. Translate complex technical information into clear, concise, and user-friendly documentation, including: o Runbooks o Business and technical documentation o User manuals o API documentation o System architecture guides o Process workflows Ensure all documentation aligns with regulatory and organizational standards. Structure content logically and visually using diagrams, flowcharts, and other visual aids. Develop and maintain internal knowledge bases, FAQs, and training materials. Continuously improve documentation based on feedback and evolving platform capabilities. R...

Design, develop, test, and deploy custom Salesforce solutions using Apex, Lightning Web Components (LWC), Flows, and Visualforce Build and maintain integrations between Salesforce and external systems (ERP, CLM , Marketing, Provisioning, etc.) using REST and SOAP APIs. Develop and optimize automations, triggers, and batch processes to support end-to-end business workflows. Ensure data quality, performance, and scalability across Salesforce environments. Participate in code reviews, release management, and deployment processes using CI/CD tools (Copado, Gearset, Flosum, or Gitlab). Collaborate with global teams to support new features, troubleshoot issues, and deliver enhancements. Stay updat...

Interact with stakeholders to understand business needs and deliver efficient reporting solutions Write SQL code and stored procedures to identify exceptions and develop Tableau control reports Ensure reporting elements are organized, automated, and documented for consistency and performance Proactively identify growth opportunities and communicate recommendations to leadership Collaborate with cross-functional teams to synthesize data into actionable insights Provide regular updates to key stakeholders and senior leaders Required qualifications, capabilities, and skills Bachelor s or Master s degree in a quantitative discipline with four years of experience in data transformation and visual...

Job Purpose Responsible for all Risk related data reporting to Senior Management Team and MD. ™s office. This position is also responsible for running a robust Daily Pre-approved Offer generation process, campaign control and governance process that would enable excellence in campaign execution and display of Pre-approved offers in the 3in1 App which is a key strategy of the Company. Responsible for creating and implementing Auth BRE process which will be common across all offers generated by campaign governance process or generated online based on customer. ™s inputs to reduce difference in two processes of offer generation. Enabling all the Risk team with daily/weekly/monthly data with aut...

Job Purpose This position is open with Bajaj Finance ltd. We are looking for highly motivated, energetic Cloud solution Architect who will be responsible for: To manage cloud architecture & lead team of cloud engineers Bridging the gaps between complex business problems and solutions in the cloud Play a strategic role in maintaining all cloud systems including the front-end platforms, servers, storage, and management networks Enterprise cloud architecture lead with hands on implementation, architecture and design experience with a strong background in cloud IaaS/PaaS, Public/Private Cloud. Infrastructure experience on Hybrid cloud, disaster recovery, SSO, Security, MFA, monitoring and manage...

Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies in big data. Job Requirements Strong understanding of big data concepts, including data modeling, warehousing, and analytics. Experience with big data technologies such as Hadoop, Spark, and NoSQL databases. Proficiency in programming languages such as Java,...

A Team Leader for Software/Data Engineering is responsible for both leading a team and the technical oversight of software and data projects. Key duties include mentoring junior engineers, managing project workflows, and making technical decisions. This role requires a strong background in software development and data engineering, with responsibilities encompassing architectural design, data pipeline development, and stakeholder communication. Key Responsibilities Technical leadership: Lead the design, development, and implementation of software and data pipelines; act as a subject matter expert and make key technical decisions. Team management: Manage the team's workload, facilitate meetin...

Key Responsibilities: Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark. Implement data models and schemas for efficient querying. Develop and optimize code in Scala and Java for data processing tasks. Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability. Collaborate with cross-functional teams to ensure seamless data integration and flow across systems. Stay up-to-date with industry trends and best practices in data engineering and big data technologies. Required Skills: 1-3 years of experience in data engineering space. Proficiency in Kafka, Airflow, Spark, Scala, SQL, and Java. Experience in designing and managing d...

In this role, you will: Hadoop Admin is responsible for building different solutions on Big Data Platform CDP and ODP Environment Builds and Engineering Solutions through pipeline creation Proficient in Shell scripting, YAML, Python and Ansible Automations Use Agile /DevOps methodology to deliver quality software. Proficient in VAST Administration Guide team members in arriving at and delivering the right solutions. Monitor and improve the performance of Hadoop platforms. CDP / ODP Migration / Upgrade experience Agile proficient and experience in other agile methodologies. Ideally certified. Strong communication & networking skills Ability to work autonomously and take accountability to exec...