6525 Data Engineering Jobs - Page 14

Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar framew...

Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar framew...

Role & responsibilities Role Purpose The Data Engineer will be responsible for developing and maintaining ADA (Analytical Data Architecture) solutions that support the Personal Bank Reporting teams. This role requires a strong technical foundation in data engineering, with a focus on building scalable, efficient data pipelines and enabling high-quality reporting and analytics. The successful candidate will: Apply critical thinking to solve complex data challenges, identify root causes, and propose innovative solutions that improve data quality and reporting outcomes. Design, build, and optimise ETL processes and ADA data pipelines using SQL , Python , and the Databricks platform , ensuring r...

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS.Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL.Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency.Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Key Skills & Responsibilities Hands-on experience with AWS services: S3, Lambda, Glue, API Gateway, and SQS. Strong data engineering expertise on AWS, with proficiency in Python, PySpark, and SQL. Experience in batch job scheduling and managing data dependencies across pipelines. Familiarity with data processing tools such as Apache Spark and Airflow. Ability to automate repetitive tasks and build reusable frameworks for improved efficiency. Provide RunOps DevOps support, and manage the ongoing operation and monitoring of data services. Ensure high performance, scalability, and reliability of data workflows in cloud environments. Skills: aws,s3,glue,apache spark,lambda,airflow,sql,s3, lambda...

Key Skills & Responsibilities Hands-on experience with AWS services: S3, Lambda, Glue, API Gateway, and SQS. Strong data engineering expertise on AWS, with proficiency in Python, PySpark, and SQL. Experience in batch job scheduling and managing data dependencies across pipelines. Familiarity with data processing tools such as Apache Spark and Airflow. Ability to automate repetitive tasks and build reusable frameworks for improved efficiency. Provide RunOps DevOps support, and manage the ongoing operation and monitoring of data services. Ensure high performance, scalability, and reliability of data workflows in cloud environments. Skills: aws,s3,glue,apache spark,lambda,airflow,sql,s3, lambda...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and appli...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and appli...

Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and appli...

We are looking for Senior Data Engineer to join our team remotely. Responsibilities: * Design, develop & maintain data pipelines using Python & Snowflake Data Warehouse and Power BI. Mandatory skills: - Snowflake Data Warehouse - Power BI - Python

YOUR IMPACT: We are seeking a seasoned Data Engineer with 6-8 years of experience to lead the design and implementation of robust data pipelines, AI/ML-driven systems, and enterprise-ready data science solutions. The ideal candidate will have deep expertise in Generative AI , Machine Learning , and Python , along with a proven track record of delivering scalable data projects in complex environments. WHAT THE ROLE OFFERS: Architect and deploy enterprise-grade data pipelines that integrate Generative AI and Machine Learning models to solve business problems. Conduct research on the latest innovations in AI/ML and quickly build proof-of-concepts (PoCs) to validate new ideas. Apply advanced Dat...

Key Responsibilities: Lead the design, development, and deployment of Power BI reports and dashboards aligned with business requirements. Collaborate with business stakeholders to understand reporting needs and translate them into technical solutions. Manage and mentor a team of BI developers, ensuring best practices in data modeling, visualization, and performance optimization. Develop data models, DAX calculations, and Power Query transformations to support complex business analytics. Optimize Power BI reports and datasets for performance, scalability, and usability. Implement data governance, security, and access controls within Power BI environments. Integrate Power BI with other data so...

Required Skills & Experience Data Engineering & ETL 7+ years in data architecture, pipelines, or ETL frameworks (Airflow, dbt, Spark, Kafka, etc.). Proven experience building pipelines that integrate multiple external APIs. Strong skills in data validation, mapping, and schema design. Search Engines & Marketplace Tech Hands-on experience with Typesense, Elasticsearch, or Solr. Background in marketplace or price aggregation systems (e.g., e-commerce, travel, fintech, or cloud pricing). AI & NLP Experience with NLP / semantic search (e.g., vector embeddings, Pinecone, Weaviate, FAISS, OpenAI/LLM APIs). Knowledge of relevance ranking, recommendation systems, and personalization. Programming & C...

We are seeking a big data engineer with Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models. Responsibilities: * Design and implement efficient data handling system based on Java and Spark. * Perform and oversee tasks such as programming, writing scripts, calling APIs, and writing complex SQL queries. * Implement...

Design, implement and optimize end-to-end data pipelines for ingesting, processing and transforming large volumes of structured and unstructured data. Develop data pipelines to extract and transform data in near real time using cloud native technologies. Implement data validation and quality checks to ensure accuracy and consistency. Monitor system performance, troubleshoot issues and implement optimizations to enhance reliability and efficiency. Collaborate with business users, analysts and other stakeholders to understand data requirements and deliver tailored solutions. Document technical designs, workflows and best practices to facilitate knowledge sharing and maintain system documentati...

This role offers the opportunity to leverage your cloud-native deployment skills and experience with modern AI platforms to build scalable ML pipelines, LLM-based applications, and intelligent agent frameworks. You will play a key role in accelerating the delivery of innovative solutions for telecom, enterprise, and next-generation autonomous networks. If you thrive in a challenging and rewarding environment, we encourage you to apply. You have: Bachelor's/Master's degree in computer science, Data Engineering, AI/ML, or related field. 10+ years in AI/ML engineering, with 5+ years focused on MLOps. Proficient in Python, PyTorch, TensorFlow, Scikit-learn, and SQL. Experience with MLOps pipelin...

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills Data analytics,ETL,SQL,Python,Google Big Query,AWS Redshift,Data architecture

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills SQL,Python,AWS Redshift,Google BigQuery,machine learning models,ETL,data architectures,Data engineering.

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills ETL pipelines,data warehouses,SQL,Python,cloud data platforms,AWS Redshift,Google BigQuery,machine learning models,Data Engineering.

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills ETL pipelines,data warehouses,SQL,Python,cloud data platforms,AWS Redshift,Google BigQuery,machine learning models,Data Engineering

Our client is a global commerce leader where you can influence how the world buys, sells, and gives. Youll be part of a work culture thats been genuinely committed to diversity and inclusion since its founding over twenty five years ago. Here, you can be yourself, do your best work along with a team of professionals, and have a meaningful impact on people across the globe. We seek people with drive, ideas, and a passion for helping small businesses succeed to help About the team: We are the AI Platform Team! We are looking for a highly motivated, self-reliant, experienced SRE and customer support engineer who is passionate about driving major transformation within the AI organization. This r...

Position Responsibilities: Contribute to the design, build, and upkeep of data architectures in standard databases and data warehouses Translate stakeholder requirements into data models for acquisition and implementation Write Python code for ETL/ELT tasks, data validation, and automation Build and operate simple, repeatable data pipelines across multi- and hybrid-cloud environments Develop and support basic data access APIs to enable reliable data consumption Prepare curated datasets and features to support data scientists analysis and modeling Create collection frameworks for structured and unstructured data; address low-complexity data issues Implement data quality checks, monitoring, an...

Position Responsibilities : The successful candidate will perform the following duties: Locate source data from the applicable files and systems. Perform analysis from either pre-set-up packages or from original source data. Perform production roles as assigned. Follows desktop procedures, publications standards and government/customer specifications for authoring. When required, programs document multiple SGML outputs by applying applicability rules within the structure of the text. Determines proper effectiveness and applicability for each authoring job. Verify information and check for discrepancies. Make changes as required. Marks up illustrations and submits using established procedures...

Tech Stack - AWS Big Data Stack Expertise in ETL, SQL, Python and AWS tools like Redshift,S3, Glue, Data pipeline, Lambda is a must. Good to have knowledge on Glue Workflows, Step Functions, Quick sight, Athena, Terraform and Dockers. Responsibilities -Assists in the analysis, design and development of a roadmap, design pattern, and implementation based upon a current vs. future state from a architecture viewpoint. Participates in the data related technical and business discussions relative to future serverless architecture. Responsible for working with our Enterprise customers and migrate data into Cloud. Set up scalable ETL process to move data into Cloud warehouse. Deep understanding in D...