9690 Big Data Jobs - Page 13

Key Qualifications 3+ years of experience working in a software product development organization building modern and scalable big data applications Expertise with functional programming in Scala Experience in developing REST-based microservices, preferably with Play as an MVC framework In-depth knowledge of developing applications using Elastic search, Kafka messaging Experience with NoSQL and SQL databases, with familiarity with the Cassandra database Experience in building low-latency high high-transactional services

About the job As a Regional Master Data Management Analyst, you shape our data usage and ensure the adherence to global standard and polices. With our goal to simplify and automate you will drive standardization and consistent data usage across the region. This role will focus on analyzing regional data, implementing automation solutions, preparation of mass loads and ensuring data is accurate and in alignment with global data governance. Main responsibilities: Analyze regional data using Python, Big Data technologies, and advanced root cause analysis methodologies Automate data and processes to improve operational efficiency Develop PowerApps solutions to streamline business processes and e...

5+ years of experience working in a software product development organization building modern and scalable big data applications Expertise with functional programming, preferably Scala Fluency in Hadoop technologies and big data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive Experience implementing RESTful web services in Java, Scala, Python, or similar languages. Experience with NoSQL and SQL databases Experience in information retrieval and machine learning

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, GCP). - Build and manage data warehouse solutions, schema evolution, and data versioning. - Implement and manage workflow orchestration u...

We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, GCP). - Build and manage data warehouse solutions, schema evolution, and data versioning. - Implement and manage workflow orchestration u...

We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, GCP). - Build and manage data warehouse solutions, schema evolution, and data versioning. - Implement and manage workflow orchestration u...

Role Overview: Tanla is seeking a highly skilled Data Engineer with 5-10 years of experience to join our dynamic Data Engineering team in Hyderabad. The ideal candidate will design, build, and optimize large-scale data pipelines and data warehouses that power real-time analytics and business intelligence across Tanlas CPaaS ecosystem. You’ll work on diverse datasets, including Call Detail Records (CDR), and collaborate closely with cross-functional teams to ensure data reliability, scalability, and performance. Key Responsibilities: Design and implement ETL/ELT pipelines for large-scale data processing and analytics. Develop and optimize analytical SQL queries for performance and scalability...

As a Hadoop Big Data Trainer at Wing Educations, you will play a crucial role in leading engaging training sessions on Hadoop and Big Data concepts for students and professionals. Your responsibilities will include: - Preparing training materials to ensure comprehensive coverage of Hadoop and Big Data tools such as HDFS, MapReduce, Hive, HBase, and Pig - Customizing content to cater to different learning needs and levels of expertise - Conducting hands-on demos and exercises to facilitate practical understanding of the concepts - Staying updated with the latest industry trends in Hadoop and Big Data technologies - Assessing trainees" progress and providing constructive feedback to help them ...

As a GoLang Engineer at our company, your role will involve working on various aspects of software development with a focus on Go Lang, Microservice architecture, Kafka, Big Data, Low code No code, AWS, and version control systems (Git). Your expertise in these areas will be crucial in developing highly available, scalable, and distributed backend services. Key Responsibilities: - Utilize Go Lang for Microservice development at a pro level. - Demonstrate intermediate expertise in Time Series with PostgresDB. - Display intermediate/basic expertise in Kafka. - Understand and implement Collector Pattern and OTA Paradigm. - Work on Big Data Applications and Low code No Code apps. - Build and opt...

As an Assistant Professor/Associate Professor/Professor at Amrita Vishwa Vidyapeetham, Chennai campus in the Department of Computer Science Engineering, your role will involve expertise in the following areas: - Artificial Intelligence / Machine Learning / Deep Learning - Big Data / Cloud Computing / Data Science - Software Engineering (Agile Methodologies) / DevOps - Theory of Computation / Compiler Design - Cyber-Physical Systems / Cryptography / Network Security - Ethical Hacking / Cyber Security - Signal and Image Processing Your skills should include: - Competitive programming expertise in Python, C/C++, and JAVA - Strong scientific paper-writing skills - Significant research experience...

We are looking for a dynamic professional who brings a unique blend of software development expertise and business analysis acumen. The ideal candidate will have hands-on experience in coding and system design, coupled with a strong understanding of business processes and stakeholder management. Key Responsibilities: Collaborate with stakeholders to gather and analyze business requirements. Translate business needs into technical specifications and solutions. Participate in system design, development, and testing phases. Work closely with development teams to ensure business requirements are met. Create and maintain documentation including BRDs, FRDs, and user stories. Conduct gap analysis a...

At TEKsystems , were partnering with a global leader in data-driven digital transformation, and we're on the lookout for skilled Senior Data Engineers to build robust, scalable, and cloud-native data platforms. If you're passionate about designing high-performance data pipelines, working with cutting-edge cloud technologies, and driving insights across enterprise and analytics ecosystems – we want to hear from you! What we’re looking for: 8-10 years of Data Engineer experience Senior Data Engineer 8–10 years’ experience in design, architecture, or development in Analytics and Data Warehousing Must have 3+ years of experience in development projects using AWS/Cloud Services like S3, Glue, Ath...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune,Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), ...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune,Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), ...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune,Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark)...

Role Description: The role is responsible for designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design an...

The Principal Data Scientist/AI Engineer is a senior technical expert who leads complex, high-impact AI initiatives across the organization. This role is responsible for driving architectural decisions, establishing reusable frameworks, and influencing the AI strategy at an enterprise level. The Principal AI Engineer operates as a cross-functional advisor, mentoring engineering teams, evaluating emerging technologies, and setting the long-term direction for AI systems at scale. Key Responsibilities: Serve as the technical authority on all AI/ML and GenAI solutions across business lines Define and enforce AI security, ethical AI principles, and model governance guidelines in line with global ...

Overview: At Mastercard, were building the future of intelligent infrastructurewhere data science meets automation, and AI drives operational excellence. We are looking for a Senior Data Scientist to join our Engineering team and lead the transformation of massive operations datasets into predictive insights and autonomous systems. This role is ideal for someone passionate about building scalable machine learning solutions, developing Large Language Models (LLMs), and pioneering agentic AI systems that optimize engineering workflows and decision-making. Role : As a Senior Data Scientist, you will: Analyze large-scale operations data to build predictive models for system performance, anomaly ...

About The Role Work Location: Delhi, Mumbai| Years of experience:10 + years | Entity: India Business | Level :Senior Manager Accenture Industry X Industry X combines Accentures powerful digital capabilities with deep engineering, manufacturing, andinfrastructure & capital projects expertise. Working across multiple industries, we offer the broadest suite of services for digitizing R&D, engineering, construction, factory floors, and plant operations; speeding up the transformation of hardware into software-enabled products; reinventinginfrastructure & capital projects processes and resulting infrastructure; driving operational safety, sustainability and productivity at scale. Using data and t...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Expertise in Data warehousing/ information Management/ Data Integra...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage in strategic pl...