673 Data Engineer Jobs - Page 27

Key Responsibilities: Design & Develop Data Pipelines : Build and optimize scalable, reliable, and automated ETL/ELT pipelines using AWS services (e.g., AWS Glue, AWS Lambda, Redshift, S3) and Databricks . Cloud Data Architecture : Design, implement, and support in maintaining data infrastructure in AWS , ensuring high availability, security, and scalability. Work with lake houses, data lakes, data warehouses, and distributed computing. DBT Core Implementation : Lead the implementation of DBT Core to automate data transformations, develop reusable models, and maintain efficient ELT processes. Data Modelling : Build efficient data models to support required analytics/reporting. Optimize Data ...

Skills : Data Engineer, Python, GCP, SQL Exp : 5-10 yrs Location :Pune

Sr Data Engineer SR DE-II Highly skilledDataEngineerwith minimum 6+ years of relevant experience in SQL, PySpark, ETL,DataLakes and Azure Tech Stack. Responsibilities 4+ years of experience in buildingdataPipelines with Python/PySpark. 5+ years of experience in Azure ETL stack ( eg. Blog Storage,DataLake,DataFactory, Synapse). 4+ years of experience with SQL. Proficient understanding of code versioning tools such as Git and PM tool like Jira. Should have Experience in Leading the Team Qualifications Excellent verbal and written communication skills. UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization. A good internet connection is a must. Azure certif...

Prepares and pipelines data for training and inference.

MEC Sr. S/W Developer ( Data Engineers) Location Bangalore Must-Have - - SQL and Python Good to Have - - ETL and DWH - RESTFul API Experience: 5 + Years Domain: eCommerce / Financial Reconciliation Brief JD: We are seeking a Data Engineers own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive), and SLA based execution of SQL based financial report generation. You will be responsible for triaging reconciliation issues, performing deep root cause analysis (RCA) using data from MySQL, HBase, and HDFS, and...

Role & responsibilities As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member and Data Modeling lead as demanded by each project to define, design, and deliver actionable insights. On a typical day, you might Engage the clients & understand the business requirements to translate those into data models. Create and maintain a Logical Data Model (LDM) and Physical Data Model (PDM) by applying best practices to provide business insights. Contribute to Data Modeling accelerators Create and maintain the Source to Target Data...

Job Title: Data Engineer Mandatory Skills: Data Engineer, Python, AWS, SQL, Glue, Lambda, S3, SNS, ML, SQS Job Summary: We are seeking a highly skilled Data Engineer (SDET) to join our team, responsible for ensuring the quality and reliability of complex data workflows, data migrations, and analytics solutions across both cloud and on-premises environments. The ideal candidate will have extensive experience in SQL, Python, AWS, and ETL testing, along with a strong background in data quality assurance, data science platforms, DevOps pipelines, and automation frameworks. This role involves close collaboration with business analysts, developers, and data architects to support end-to-end testing...

Job Title: Senior Principal Data Engineer Location: Gurgaon, Bangalore Work Schedule: 12:00 PM 8:30 PM IST Job Type: Full-Time Position Overview: We are seeking a Senior Principal Data Engineer with expertise in cloud-native AI/ML architecture and Generative AI . This role will be pivotal in designing innovative solutions, guiding development teams, and ensuring alignment with architectural best practices while leveraging cutting-edge technologies and AWS cloud services. Key Responsibilities: Architect Generative AI solutions using AWS services: Bedrock , SageMaker , Kendra , S3 , PGVector. Lead end-to-end solution design for AI/ML initiatives and complex data systems. Collaborate with cross...

Position Purpose The data engineer is responsible for Designing, Architecting and implementing robust, scalable and maintainable data pipelines. The data engineer will work directly with upstream stockholders (applications owners, data providers) and downstream stakeholders (Data consumers, Data analysts, Data Scientists) to define the data pipeline requirements, implement solutions that serve downstream stakeholders needs through APIs, materialized views. On day to day, the data engineer works in conjunction with the Data Analyst, for the aggregation and preparation of data. The data engineer interacts with security, continuity and IT architecture to validate the IT assets the person design...

We are hiring for- Role: Azure Data Engineer Key Responsibilities: Design, develop, and optimize scalable data pipelines using Databricks (PySpark, Scala, SQL). Implement ETL/ELT workflows for large-scale data integration across cloud and on-premise environments. Leverage Microsoft Fabric (Data Factory, OneLake, Lakehouse, DirectLake, etc.) to build unified data solutions. Collaborate with data architects, analysts, and stakeholders to deliver business-critical data models and pipelines. Monitor and troubleshoot performance issues in data pipelines. Ensure data governance, quality, and security across all data assets. Work with Delta Lake, Unity Catalog, and other modern data lakehouse compo...

Job Description : As a Data Engineer for our Large Language Model Project, you will play a crucial role in designing, implementing, and maintaining the data infrastructure. Your expertise will be instrumental in ensuring the efficient flow of data, enabling seamless integration with various components, and optimizing data processing pipelines. 5+ years of relevant experience in data engineering roles. Key Responsibilities : Data Pipeline Development - Design, develop, and maintain scalable and efficient data pipelines to support the training and deployment of large language models. Implement ETL processes to extract, transform, and load diverse datasets into suitable formats for model traini...

Skill: Data Engineer Experience: 6+ Years Location: Bangalore & Pune Shift Timings: 4:00 PM to 1:00 AM IST Mode: Hybrid Notice Period: Immediate - 15 Days Must-Have Skills: Minimum of 6 years of Data Engineering Experience Must be an expert in SQL, Data lake, Azure, ETL Must be an expert in data modeling Incorta experience is a plus Excellent oral and written communication skills Self-starter with analytical, organizational, and problem-solving skills Must be highly flexible and adaptable to change Power BI Strong programming skills in languages such as SQL, Python Experience with data modelling, data warehousing, and dimensional modelling concept Familiarity with data governance, data secur...

Job Description: Primary Skills Data engineer + AI/ML +LLM + Azure devops +Blob Minimum experience: • Minimum of 4 years of experience in data management, analysis, and AI data preparation. Must have hands-on: • Build scalable data pipelines and feature stores for AI/ML use cases • Develop CI/CD pipelines for training, deployment, and monitoring of data and ML models • Manage real-time inference pipelines for GenAI / LLM-based applications • Automate retraining, versioning, and drift monitoring processes • Collaborate with data scientists and AI engineers to productionize models • Ensure data quality, lineage, and model governance across all systems • Maintain infrastructure-as-code using Az...

Data Engineer-Data Warehouse DWH Concepts, Data Modelling, Tera Data Architecture, SQL Teradata

5+ years of experience in building and maintaining big data platforms using Spark/Scala. Strong knowledge of distributed computing principles and big data technologies such as Hadoop, Spark, Streaming etc. Experience with ETL processes and data modelling. Problem-solving and troubleshooting skills. Working knowledge on Oozie/Airflow. Experience in writing unit test cases, shell scripting. Ability to work independently and as part of a team in a fast-paced environment. Use of version control (Git) and related software lifecycle tooling. Experience in Spark Streaming/Kafka streaming. Experience with software development methodologies including Scrum & Agile. Approaches for optimization, at a s...

Role & responsibilities Key Responsibilities: Coding proficiency in SQL, Python/PySpark AWS Glue , redshift , lambda Data Engineering (Designing ETL Workflows, Understanding on DB Concepts/Architecture, Handling Big Data Volumes) Performance (Measurement, Indexes, Partitioning and Tuning) Data modeling and design Preferred candidate profile Job Description: Job Title: Data Engineer Experience: 5+ Years Location: Hyderabad Job Type: Full-Time

Job Summary We are looking for a Techno-Functional Data Engineer who is passionate about solving realworld problems through data-driven systems. While prior e-commerce experience is a plus, it is not mandatory we welcome engineers, tinkerers, and builders who are eager to challenge themselves, build scalable systems, and work closely with product and business teams. In this role, you will be at the intersection of data engineering, automation, and product strategy, contributing to a modern SaaS platform that supports diverse and dynamic customer needs. Key Responsibilities Data Engineering & Automation - Build and maintain data pipelines and automated workflows for data ingestion, transforma...

Data Engineer , We looking for 6+ years , looking for people who can attend for F2F Hyderabad / Chennai we have 3 combination roles DATA Engineer AWS, Python, Pyspark DATA Engineer Big Data, Python, Pyspark DATA Engineer Snowflake, Python, Pyspark

Profile: As a Principal Data Engineer, to lead the architecture, design, and implementation of scalable and efficient data pipelines, data models, and data infrastructure solutions on GCP. To collaborate with cross-functional teams, including Data Scientists, Analysts, and Product Engineers, to build data architectures that support data-driven decision-making across the organization. Also, to play a crucial role in the data engineering team's efforts to manage and optimize data infrastructure, ensuring performance, reliability, and scalability on GCP Key Responsibilities : Architect Data Solutions: Lead the design and implementation of complex data architectures and pipelines on Google Cloud...

Designation : Senior Data Engineer Experience: 5+ Years Location: Navi Mumbai (JUINAGAR) - WFO Immediate Joiners preferred. Interview : Face - 2 - Face (Only 1 Day Process) Job Description We are looking for an experienced and results-driven Senior Data Engineer to join our Data Engineering team . In this role, you will design, develop, and maintain robust data pipelines and infrastructure that enable efficient data flow across our systems. As a senior contributor, you will also help define best practices, mentor junior team members, and contribute to the long-term vision of our data platform. You will work closely with cross-functional teams to deliver reliable, scalable, and high-performan...

Good proficiency in end to end coding which includes deployment experience. Experience processing large data. Min. 3 years exp in Retail domain Preferred skills include proficiency in SQL, Spark, Excel, Azure, AWS, GCP, Power BI, and Flask. Preferred experience in areas such as time series analysis, market mix modelling, attribution modelling, churn modelling, market basket analysis, etc.Possess a strong understanding of mathematics with logical thinking abilities. Excellent communication skills are a must. Qualifications BTech/Masters in Statistics/Mathematics/Economics/Econometrics from Tier 1-2 institutions Or BE/B-Tech, MCA or MBA Relevant Experience :8+ years of hands on experience in d...

Role and Responsibilities: Model complex data sets in Graph technology (Neo4j) Work collaboratively with team to plan and solve complex problems like fraud investigations across different products and transactions. Expertise in graph modeling based on business rules. Work with business teams to develop analytical visualization especially identifying fraud rings through linked party analysis using Neo 4J. Build and set up Cyper queries that can be repetitively utilized by the business operations teams. Develop customizations based on evolving fraud trends as defined by business team. Work as part of the product with a team of Business Analysts in building capabilities defined by the business ...

Job Overviews Designation: Software Engineer Location: Ahmedabad Work Mode: Work from Office Vacancy: 1 Experience: 4.0 To 7.0 ManekTech is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessibl...