14025 Data Engineering Jobs - Page 7

Data Engineer to build and manage data pipelines that support batch and streaming data solutions The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc Responsibilities Strong experience in develop, test, and maintain data pipelines (batch & stream) using Cloudera, Spark, Kafka and Azure services like ADF, Cosmos DB, Databricks, NoSQL DB/ Mongo DB etc Strong programming skills in spark, python or scala & SQL Optimize data pipelines to improve speed, performance, and reliability, ensuring that data is available for data consumers as required Create ETL pipelines for...

We are seeking a highly skilled Python Developer with strong expertise in AWS Athena to join our data engineering team with 5years to 7 years experience The successful candidate will be responsible for building and maintaining data pipelines, optimizing queries on large-scale datasets, and integrating AWS Athena with Python-based applications This role is ideal for developers who thrive in cloud-native, data-intensive environments

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake Implement data transformation workflows using DBT (Data Build Tool) Write efficient, reusable, and reliable code in Python Optimize and tune data solutions for performance and scalability Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions Ensure data quality and integrity through rigorous testing and validation Stay updated with the latest industry trends and technologies in data engineering Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field Proven experience as a Data Engineer or similar role Strong pro...

The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data platforms to support analytics, reporting, forecasting, and advanced data science use cases. The role requires strong technical expertise in modern data engineering tools, cloud platforms, and data processing frameworks. The engineer will work closely with data scientists, analysts, and business teams to ensure reliable, high-quality data availability

Role : Senior Data Engineer Location : Hyderabad Employment Type : Full-Time Job Description: The Senior Data Engineer will build and maintain the core data infrastructure for an enterprise AI platform. This role focuses on designing scalable data pipelines, developing knowledge graphs, and preparing structured and unstructured data for AI and LLM-based applications. Roles & Responsibilities : Data Pipeline Development : - Design and build scalable data ingestion pipelines from enterprise systems (ERP, documentation tools, version control, and project management tools) - Develop connectors for structured, semi-structured, and unstructured data - Implement incremental data loads, change data ...

Role Overview We are looking for AI Evaluation Data Engineering Specialists to design, curate, and operationalize datasets and evaluation frameworks for AI product performance assessment. This role involves working with large language models (LLMs), human raters, and automation tools to measure model accuracy, correctness, and usability. Key Responsibilities Build and maintain evaluation datasets for AI models across programming languages (Python, Golang, JavaScript, Java). Develop and apply data labeling and scoring guidelines based on Googles evaluation framework. Implement LLM-judge calibration workflows to align automated and human evaluations. Perform error analysis, drift detection, an...

Position : Data Product Manager Location : Pune/Nagpur Type of Employment : Full time Purpose of the Position : Purpose of this role is to liaison with the business stakeholders, gather business requirements, capture them and create business requirements document. We are seeking a highly skilled Data Product Manager cum Business Analyst to envision Data Products & implement. This role will focus on gathering and translating data engineering and analytics requirements into actionable deliverables, ensuring alignment with business objectives. The ideal candidate will have strong experience in retail domain, data platforms, and analytics tools such as Incorta and Databricks. Key Result Areas an...

"HCL Tech is hiring for Data Engineer- Snowflake and DBT for PAN India" Profile: Data Engineer - DBT & Snowflake Experience: 5-10 years Location: PAN(Noida, Bangalore, Hyderabad, Pune and Chennai) Introduction to the Organization: HCL Tech is a leading global technology company, recognized for its innovative solutions and commitment to driving digital transformation for clients worldwide. As a multinational industry leader, HCLTech delivers a broad portfolio of services and products, including IT consulting, digital and engineering services, and next-generation technology solutions. With a workforce spanning over 50 countries, HCLTech is celebrated for its customer-centric values, strong cul...

Job description Perform ETL testing including data validation transformation checks and sourcetotarget mapping verification Write and execute complex SQL queries for data quality and integrity checks Develop and maintain automation test scripts using Playwright Collaborate with development and data engineering teams to identify issues and ensure highquality releases Document test results and support defect resolution Strong ETL testing background including data pipeline validation and data warehouse concepts Advanced proficiency in SQL Handson experience with Playwright for automation Strong analytical and problemsolving skills Experience with AIML application testing Exposure to cloudbased ...

Job description Data Pipeline Development Design develop and maintain efficient reliable and reusable ETLELT pipelines using DBT Snowflake and related technologies Data Modeling Build and optimize data models star snowflake schemas to support analytical and reporting use cases ensuring data quality accuracy and performance Data Integration Integrate data from multiple sources APIs databases SaaS platforms cloud storage into Snowflake using modern data ingestion tools and frameworks Performance Optimization Tune SQL queries manage compute resources and optimize Snowflake performance for scalability and cost efficiency Data Governance Quality Implement data validation testing and monitoring pr...

Job description As an Aera Developer you will design develop and implement Aera Skills cognitive applications that enable realtime decisionmaking You will work on data engineering analytics models and automation workflows using Aeras proprietary tools and standard technologies like SQL Python and Java Key Responsibilities Build data crawlers to extract data from customer sources using Aeras ETL platform Develop data processing scripts and optimize SQL queries for large datasets Design and implement data warehouse models facts dimensions measures Create workflows and processes using Java Python and SQL interfaces Build and customize Aera Skills using modules like Data Workbench Decision Workb...

Job description 8+ years of experience in designing, developing, Data engineering Solutions. This role requires strong technical skills, including experience with AWS frameworks, programming languages like Python, PySpark, understanding of event driven solution development

We are looking for a highly skilled and experienced Data Engineering Tech Lead to join our team at ERNST YOUNG LLP. The ideal candidate will have a strong background in data engineering and technical leadership, with 6-10 years of experience. Roles and Responsibility Design and implement scalable data pipelines and architectures. Lead the development of data engineering solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data systems and applications. Ensure high-quality data processing and analysis. Mentor junior engineers and provide technical guidance. Job Requirem...

Job description Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or...

Qualification About the Role We are seeking a highly motivated and experienced Generative AI Lead to spearhead our efforts in leveraging generative AI technologies to solve complex business problems, enhance productivity, and build innovative products and solutions. You will lead the design, development, and deployment of cutting edge GenAI models and systems that deliver tangible business value. Key Responsibilities Strategy and Leadership Define and drive the companys generative AI roadmap in alignment with business goals Collaborate with senior leadership to identify high impact GenAI use cases across departments Evangelize GenAI within the organization, fostering a culture of innovation ...

We are seeking a skilled and proactive Data Integration Engineer with handson experience in modern data platforms and integration tools The ideal candidate will be responsible for designing developing and maintaining robust data pipelines and integrations across various systems using tools like SnapLogic Fivetran Snowflake and DBT Key Responsibilities Design and implement scalable data pipelines using SnapLogic Fivetran and DBT Develop and optimize data models and queries in Snowflake using SQL and Python Integrate data from various sources using REST SOAP APIs with appropriate authentication methodsCollaborate with cross functional teams to understand data requirements and deliver high qual...

Data Engineer (Contract | 6 Months) We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake, Azure Data Factory (ADF), dbt, and other tools. This role requires strong hands-on experience with data integration platforms, documentation, and pipeline optimizationespecially in cloud environments such as Azure and AWS. #KeyResponsibilities Build and maintain ETL pipelines using Fivetran, dbt, and Azure Data Factory Monitor and support production ETL jobs Develop and maintain data lineage documentation for all systems Design data mapping and d...

We are seeking a Sr. Data Engineer to join our Data Engineering team within our Enterprise Data Insights organization to build data solutions, design and implement ETL/ELT processes and manage our data platform to enable our cross functional stakeholders. As a part of our Corporate Engineering division, our vision is to spearhead technology and data-led solutions and experiences to drive growth & innovation at scale. The ideal candidate will have a strong Data Engineering background, advanced Python knowledge and experience with cloud services and SQL/NoSQL databases. You will work closely with our cross functional stakeholders in Product, Finance and GTM along with Business and Enterprise T...

Employment Type: Contract Job Summary We are seeking an experienced Power BI Administrator to manage, configure, and optimize Power BI services in a large-scale enterprise environment. The candidate will focus on data connection setups, user management, governance, and security compliance, ensuring a seamless BI experience for end users. Key Responsibilities Configure and maintain secure connections to on-premises and cloud data sources via Power BI gateways. Manage user onboarding/offboarding, roles, and access permissions within the Power BI environment. Administer tenant settings, workspace access, and security policies. Troubleshoot and resolve user access and connectivity issues in a ti...

Hiring: Data Engineers (30 Openings | Immediate Joiners Only) Locations: Bangalore, Pune, Gurgaon, Hyderabad Experience: 6-12 years (please do not apply if less then 6 years) Cloud Expertise: Azure, GCP, AWSMode: Full-time (Onsite) Joining: Immediate Key RequirementsStrong experience in Data Engineering across large-scale systems Hands-on expertise in Azure, GCP, and AWS cloud platforms For Azure & AWS roles, Scala is mandatory Strong understanding of data pipelines, ETL, and big data technologies Interview ProcessOnline AssessmentTechnical Interview (Face-to-Face) Non-Technical Discussion (Virtual) Data Engineering across large-scale systems.

5 to 7 years of experience in data engineering Architect and maintain scalable, secure, and reliable data platforms and pipelines Design and implement data lake/data warehouse solutions such as Redshift, BigQuery, Snowflake, or Delta Lake Build real-time and batch data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT Ensure data governance, lineage, quality, and observability

Designation / Position : Data Engineer SAP BW/4HANA Work Experience Required : 5-10 years Job Location(s) : Remote Industry Type : IT / Software / SAP Services Functional Area : Data Engineering / SAP BW/4HANA / Automation Qualification : Bachelors or Masters Degree in Computer Science, Information Technology, or related field Responsibilities : - Design, develop, and maintain high-performance data solutions within the SAP BW/4HANA environment, ensuring data quality and integrity. - Utilize ABAP and AMDP to develop efficient data extraction, transformation, and loading (ETL) processes within SAP BW/4HANA. - Optimize existing data models, data flows, and query performance in SAP BW/4HANA. - I...

Role & responsibilities Strong experience with DataEngineering SQL Datawarehouse – ETL /orchestration- Classical Data Lakehouse Hands on snowflake or starschema Good to have - Python / Pyspark.

Primarily focused on data transformation skills and experience (writing SQL to transform raw data objects into usable datasets for reporting) and data visualization, specifically with Power BI Strong experience in SQL is a must. Performance tuning is also a good skill to target Python is optional but very helpful as many of our tools run on Python. Ret would be extremely beneficial Snowflake is not mandatory, and in fact we would prefer people with a combination of Snowflake and non-Snowflake experience as our task is centered around moving non-Snowflake work to Snowflake. Someone with a deep understanding of the challenges involved in those migrations would be very useful A candidate who ca...

We are seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and solutions in a cloud environment. This individual contributor role requires strong expertise in AWS services (IAM, EMR Serverless, Glue, Athena), advanced PySpark skills, and a solid understanding of data warehousing techniques. The ideal candidate will have experience in modern ETL frameworks and cloud-native data engineering practices. Familiarity with visualization tools like Power BI is a plus but not mandatory. You will work on building robust, secure, and high-performance data platforms that enable analytics and business intelligence across the organization. Key Responsibilities Interpretin...