6547 Big Data Jobs - Page 20

Roles and Responsibilities Client Impact Manage deliverable development and workstreams on projects across a range of industries and problem statements Contribute to and/or develop analytics strategies and programs for large, regional, and global clients by leveraging data and technology solutions to unlock client value Manage working relationship with client managers, and act as trusted and reliable partner Create predictive models using segmentation and regression techniques to drive profits Review analytics end-products to ensure accuracy, quality and timeliness. Proactively seek new knowledge and structures project work to facilitate the capture of Intellectual Capital with minimal overs...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and appli...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and appli...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and appli...

Location : Remote Experience : 8 - 10+ Years We are seeking a highly experienced and skilled Data Architect to join our dynamic team. In this pivotal role, you will work directly with our enterprise customers, leveraging your expertise in the Adobe Experience Platform (AEP) to design and implement robust data solutions. The ideal candidate will possess a profound understanding of data modeling, SQL, ETL processes, and customer data architecture, with a proven track record of delivering impactful results in large-scale environments. About the Role : As a Data Architect specializing in AEP, you will be instrumental in transforming complex customer data into actionable insights. You will serve ...

Location : Remote Experience : 8 - 10+ Years We are seeking a highly experienced and skilled Data Architect to join our dynamic team. In this pivotal role, you will work directly with our enterprise customers, leveraging your expertise in the Adobe Experience Platform (AEP) to design and implement robust data solutions. The ideal candidate will possess a profound understanding of data modeling, SQL, ETL processes, and customer data architecture, with a proven track record of delivering impactful results in large-scale environments. About the Role : As a Data Architect specializing in AEP, you will be instrumental in transforming complex customer data into actionable insights. You will serve ...

We are seeking a big data engineer with Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models. Responsibilities: * Design and implement efficient data handling system based on Java and Spark. * Perform and oversee tasks such as programming, writing scripts, calling APIs, and writing complex SQL queries. * Implement...

Position Responsibilities: Contribute to the design, build, and upkeep of data architectures in standard databases and data warehouses Translate stakeholder requirements into data models for acquisition and implementation Write Python code for ETL/ELT tasks, data validation, and automation Build and operate simple, repeatable data pipelines across multi- and hybrid-cloud environments Develop and support basic data access APIs to enable reliable data consumption Prepare curated datasets and features to support data scientists analysis and modeling Create collection frameworks for structured and unstructured data; address low-complexity data issues Implement data quality checks, monitoring, an...

Extensive experience with Redis, MongoDB, ElasticSearch, SQL, and NoSQL. Deep understanding of test-driven development and unit testing practices. Exceptional problem-solving abilities and keen attention to detail. Capable of working both independently and collaboratively within a team. Strong communication skills with the ability to effectively collaborate with stakeholders. Mandatory Competencies Beh - Communication Big Data - Big Data - Mongo DB Programming Language - Java - Java Caching (Redis/Memcache/Hazlecast) Database - No SQL - Elastic, Solr, Lucene etc Database - Database Programming - SQL

Education/Experience: Bachelor's degree in computer science or equivalent training required. Big Data Engineer: 4-6 Years Experience in developing Big Data processing applications on Azure Databricks. Profound experience with developing Big Data applications using Spark and Scala/Python. Good experience in working with Databricks components, Infrastructure as Code tools like Terraform. Good experience in Airflow and Kubernetes. Develop highly scalable and extensible Big Data platform which enables collection, storage, modelling, and analysis of massive data sets from numerous data sources. Should have very good knowledge on SQL Programming and ETL Data Warehousing concepts. Good understandin...

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners). Location - Bengaluru,Mumbai,Pune,Chennai,Kolkata,Hyderabad.

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

About the Role: We are looking for an experienced Java Developer to design, build, and maintain scalable data solutions. You will work on modern Java (21+) technologies, contribute to distributed cloud-native systems, and collaborate with cross-functional teams. Key Responsibilities: Develop and maintain scalable, efficient Java-based applications. Collaborate with product and data teams to translate requirements into solutions. Implement best practices: code reviews, unit testing, CI/CD. Troubleshoot performance issues and ensure system reliability. Participate in Agile ceremonies (sprints, stand-ups, retros). Mentor junior developers and support knowledge sharing. Required Skills: 6+ years...

About the Role: We are looking for an experienced Java Developer to design, build, and maintain scalable data solutions. You will work on modern Java (21+) technologies, contribute to distributed cloud-native systems, and collaborate with cross-functional teams. Key Responsibilities: Develop and maintain scalable, efficient Java-based applications. Collaborate with product and data teams to translate requirements into solutions. Implement best practices: code reviews, unit testing, CI/CD. Troubleshoot performance issues and ensure system reliability. Participate in Agile ceremonies (sprints, stand-ups, retros). Mentor junior developers and support knowledge sharing. Required Skills: 6+ years...

Bachelors or Master’s degree in Computer Science, Engineering, or a related field with Data Engineering Experience. 5+ years of professional experience in software development, with at least 2 years in a lead or senior engineering role. Strong proficiency in Python programming and experience building data processing applications. Hands-on expertise with Apache Spark and Hadoop for big data processing. Solid experience with workflow orchestration tools like Apache Airflow. Experience designing and managing data ingestion and integration pipelines with Apache NiFi. Understanding on Data Quality automation, CI/CD, Jenkins, Oracle, Power BI, Splunk Deep understanding of data quality concepts, da...

locationsIN - Bangalore posted onPosted 28 Days Ago job requisition idR145361 Maersk, the worlds largest integrated logistics company, is transforming how goods move across continents - and at the heart of that shift is data infrastructure . We are building MIDAS , a modern, federated, metadata-driven data platform engineered for composability, governance, and AI-readiness. We are hiring a Senior Engineering Manager to lead platform engineering efforts for MIDAS - designing and scaling a multi-tenant, real-time, contract-first data platform that spans hundreds of internal systems and supports critical customer and operational use cases. This is not just a leadership role. Its a once-in-a-dec...

Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETL Interested candidates can share their resume with the following details to navaneetha@suzva.com Current CTC Expected CTC Location

Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications. Resource should have experience in Astronomer DAGS, Python , Pyspark , GCP , BigQuery . Collaborate with cross-functional teams including designers, product owners, managers, and stakeholders. Execute the unit testing to produce defect-free software. Ensuring test coverage and creating test methods. Creating documentation on modules/enhancements developed. Experience on Airflow , Python coding, BigQuery concepts. Functional knowledge of billing automations. Ensure high quality code stan...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud envi...

Location : Remote We are seeking a highly experienced and skilled Data Architect to join our dynamic team. In this pivotal role, you will work directly with our enterprise customers, leveraging your expertise in the Adobe Experience Platform (AEP) to design and implement robust data solutions. The ideal candidate will possess a profound understanding of data modeling, SQL, ETL processes, and customer data architecture, with a proven track record of delivering impactful results in large-scale environments. About the Role : As a Data Architect specializing in AEP, you will be instrumental in transforming complex customer data into actionable insights. You will serve as a technical expert, guid...

Role : Data Architect Location : Remote Experience : 8 - 10+ Years Employment Type : Full-Time, Permanent We are seeking a highly experienced and skilled Data Architect to join our dynamic team. In this pivotal role, you will work directly with our enterprise customers, leveraging your expertise in the Adobe Experience Platform (AEP) to design and implement robust data solutions. The ideal candidate will possess a profound understanding of data modeling, SQL, ETL processes, and customer data architecture, with a proven track record of delivering impactful results in large-scale environments. About the Role : As a Data Architect specializing in AEP, you will be instrumental in transforming co...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud envi...

Role : Data Architect Location : Remote Experience : 8 - 10+ Years Employment Type : Full-Time, Permanent We are seeking a highly experienced and skilled Data Architect to join our dynamic team. In this pivotal role, you will work directly with our enterprise customers, leveraging your expertise in the Adobe Experience Platform (AEP) to design and implement robust data solutions. The ideal candidate will possess a profound understanding of data modeling, SQL, ETL processes, and customer data architecture, with a proven track record of delivering impactful results in large-scale environments. About the Role : As a Data Architect specializing in AEP, you will be instrumental in transforming co...

Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, GCP). - Build and manage data warehouse s...

PURPOSE OF THE JOB: The purpose of the job is to develop through iterative process data Integration and analytics solutions. Develop data products answering to Projects/Customer needs, from the data ingestion to ML productization. You will Build data analytics solutions, developing Data applications (Data ingestion, Cleaning, data processing, etc.) to provide state-of-the-art advanced analytic and quantitative tools and modelling techniques to derive business insights, solve complex business problems and improve decisions. Reporting to the Data Architect, the role will develop, support and advice on the day-to-day Data platform, Data processing and Data analytics requirements of Business are...