6525 Data Engineering Jobs

Role & responsibilities Job Summary: We are seeking a skilled and motivated Data Engineer with hands-on experience in Azure Databricks , PySpark , and cloud-based data solutions. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions that support business decision-making and digital transformation initiatives. Key Responsibilities: Design and develop robust, scalable data pipelines using PySpark on Azure Databricks . Implement ETL/ELT processes to ingest, transform, and load data from various sources into data lakes or data warehouses. Collaborate with data scientists, analysts, and business stakeholders to understand ...

Role & responsibilities Preferred candidate profile Job Title: Data Engineer Azure Databricks & PySpark Location: Bangalore/ Kolkata Department: Data & Analytics Employment Type: Full-Time-ITC Infotech Hybrid 3+ Years immediate joiners up to 30 LPA Job Summary: We are seeking a skilled and motivated Data Engineer with hands-on experience in Azure Databricks , PySpark , and cloud-based data solutions. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions that support business decision-making and digital transformation initiatives. Key Responsibilities: Design and develop robust, scalable data pipelines using PySpark on...

Role Summary We are seeking a highly skilled Data Architect to design and optimize cloud-native data architectures on platforms like Databricks and Snowflake . In this role, you will lead the development of scalable data pipelines, drive governance and security frameworks, and enable advanced analytics and AI/ML solutions for global enterprise clients. This is a leadership opportunity for professionals passionate about shaping modern data ecosystems and mentoring data engineering teams. Key Responsibilities Design and implement Lakehouse architectures using Databricks, Delta Lake, and Apache Spark. Build and optimize data pipelines, ETL/ELT processes, and integration strategies across platfo...

Job Title: GenAI ArchitectYears of Experience: 10-15 YearsJD-Mandatory Skills:Proven experience in providing AI Solution and design specifically within AI/ML projects Strong understanding of AI/ML concepts, tools, and technologies Excellent leadership and team management skills Exceptional communication and interpersonal skills Ability to manage multiple projects simultaneously in a fast paced environment Proficiency in project management tools and methodologies (eg, Agile, Scrum, Waterfall) Preferred Skills:Experience with cloud platforms (e g, AWS, Azure, Google Cloud) for AI/ML deployment Familiarity with data engineering and data science practices Knowledge of regulatory and compliance s...

Job Role : As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL,and collaborating with data teams for informed decision-making. Why Choose Ideas2IT: Ideas2IT has all the good attributes of a product startup and a services company. Since we launch our products, you will have ample opportunities to learn and contribute. However, single-product companies stagnate in the technologies they use. In our multiple product initiatives and customer-facing projects, you will have the opportunity to work on various technologies. AGI is going to change the world. Big companies like Microsoft are ...

Experience in designing, building, and managing data solutions on Azure. Design, develop, and optimize big data pipelines and architectures on Azure. Implement ETL/ELT processes using Azure Data Factory, Databricks, and Spark. Required Candidate profile 5yrs of exp in data engineering and big data technologies. Hands-on experience with Azure services (Azure Data Factory, Azure Synapse, Azure SQL, ADLS, etc.). Databricks Certification (Mandatory).

Review emails looking for open issues and priority requests Resolve any job failures Pick up next or continue current JIRA task in the analysis and delivery of data for use by other teams Work with other team members to assist and develop. Develop Data models / ERD Diagrams for review and execution Document any solutions in code and updates to Data Dictionary Review work product with manager, Business Analysts Required skills: Ability to code using SQL, Python Use of SQL IDE Mngt. Studio or Visual Studio Previous experience with Data Warehouse design and modeling Experience with GIT Methodical problem solving skills Good communication skills through verbal and written communication. Teams, E...

Review emails looking for open issues and priority requests Resolve any job failures Pick up next or continue current JIRA task in the analysis and delivery of data for use by other teams Work with other team members to assist and develop. Develop Data models / ERD Diagrams for review and execution Document any solutions in code and updates to Data Dictionary Review work product with manager, Business Analysts Required skills: Ability to code using SQL, Python Use of SQL IDE Mngt. Studio or Visual Studio Previous experience with Data Warehouse design and modeling Experience with GIT Methodical problem solving skills Good communication skills through verbal and written communication. Teams, E...

As an Engineering Manager on the FinTech Data Engineering team, you will: Lead a high-performing engineering team in designing, implementing, and scaling data solutions that drive analytics, reporting, and business insights. Provide technical leadership in architecting, building, testing, releasing, and monitoring data pipelines, models, and workflows Work closely with product managers, data scientists, ML engineers, and other stakeholders to define the vision and roadmap for core services analytics and data products. Identify strategically important problems, inefficiencies, or opportunities for meaningful improvement, and drive alignment across teams to deliver high-impact solutions. Promo...

Job DescriptionKey Responsibilities:- Design, develop, and maintain scalable, efficient, and reliable systems to support GenAI and machine learning-based applications and use cases- Lead the development of data pipelines, architectures, and tools to support data-intensive projects, ensuring high performance, security, and compliance- Collaborate with other stakeholders to integrate AI and ML models into production-ready systems- Work closely with non-backend expert counterparts, such as data scientists and ML engineers, to ensure seamless integration of AI and ML models into backend systems- Ensure high-quality code, following best practices, and adhering to industry standards and company gu...

Establish and maintain best practices for ML Ops. Including version control, CI/CD pipelines and the Vertex Al Model Registry and End Points. Implement MLOps tools to streamline model development, training, tuning, deployment, monitoring and explain. Deploy and Manage ML models on GCPs Vertex Al platform ensuring efficient and scalable execution. Identify and address performance bottleneck in ML models and pipelines. Troubleshoot and resolve ML issues ensuring optimal model performance and costs. Work Closely with data scientists to prepare and preprocess data for model training and evaluation. Assist in feature engineering and selection to ensure model performance. Develop techniques to vis...

DATA COLLECTION & ANALYSIS: Gathers, processes, prepares, and analyzes moderately complex datasets to extract significant insights, develop and maintain automated reporting systems to streamline data analysis. REPORTING & VISUALIZATION: Implements detailed reports and dashboards using various tools, designs and completes data visualizations to communicate moderately complex data clearly. STATISTICAL ANALYSIS: Supports statistical analysis execution to identify trends, patterns, and anomalies in data using statistical software and programming languages for data manipulation and analysis. PROCESS IMPROVEMENT: Implements found opportunities to improve data collection and reporting processes and...

Develop and maintain efficient ETL (Extract, Transform, Load) pipelines that ingest, process and transform large datasets from diverse sources. Build and manage data storage solutions using relational and non-relational databases, ensuring high availability, performance and scalability. Work with APIs, third-party data sources and internal databases to create unified datasets that provide actionable insights for business stakeholders. Partner with business intelligence analysts, data scientists and software engineers to design and implement data-driven solutions that meet business requirements. Design optimized data schemas and structures that support analytical workloads and improve query p...

Design and develop solutions using Bigdata tools and technologies like Bigquery, Hive, Spark etc. Extensive hands-on experience in object-oriented programming using Python, PySpark APIs etc. Experience in building data pipelines for huge volume of data. Experience in designing, implementing, and managing various ETL job execution flows. Experience in implementing and maintaining Data Ingestion process. Hands on experience in writing basic to advance level of optimized queries using HQL, SQL & Spark. Hands on experience in designing, implementing, and maintaining Data Transformation jobs using most efficient tools/technologies. Ensure the performance, quality, and responsiveness of solutions....

Design and develop solutions using Bigdata tools and technologies like Bigquery, Hive, Spark etc. Extensive hands-on experience in object-oriented programming using Python, PySpark APIs etc. Experience in building data pipelines for huge volume of data. Experience in designing, implementing, and managing various ETL job execution flows. Experience in implementing and maintaining Data Ingestion process. Hands on experience in writing basic to advance level of optimized queries using HQL, SQL & Spark. Hands on experience in designing, implementing, and maintaining Data Transformation jobs using most efficient tools/technologies. Ensure the performance, quality, and responsiveness of solutions....

We are looking for a seasoned Senior Data Engineer with a passion for building scalable, reliable, and cutting-edge data solutions on cloud platforms. The ideal candidate will bring deep expertise in Google Cloud Platform (GCP), BigQuery, and modern data engineering practices, including experience with ingestion and transformation tools, as well as proficiency in medallion architecture to drive data quality and governance.Experience with Databricks on AWS is highly valued and considered a distinct advantage.As a key member of our data engineering team, you will architect and implement end-to-end data pipelines that power actionable business intelligence, advanced analytics, and machine learn...

Role Summary We are seeking a Senior Data Scientist (Generative AI & LLMs) to design, build, and scale AI-powered solutions for retail media and ad-tech. This role blends technical leadership, applied research, and business impact , requiring hands-on expertise in machine learning, deep learning, natural language processing, and large language models. You will drive innovation in Generative AI , lead applied research, and collaborate with product and engineering teams to deliver customer-facing AI solutions. Key Responsibilities Translate complex business problems into advanced statistical and ML frameworks. Develop scalable ML and DL solutions with a strong emphasis on LLMs and Generative A...

We are looking for a Principal Data Engineer, Data Products to join KONE IT Enterprise Data & Analytics team in Pune, India. The team is driving forward Data Foundation, new way of working with data using latest cloud technology. Data Foundation is key enabler in our digital transformation creating ability to develop new scalable analytics, AI and digital use cases by leveraging data across the whole organization. In our approach, data products play a vital role in business value generation. Driving optimized data engineering practices is crucial to ensure reusability and maintainability of the data products. Principal Data Engineer leads the design, development, and industrialization of dat...

Job Title: Data Engineer Location: Gurugram/Noida Job Type: Full-time Experience Level: 2-5 years Job Summary: As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and data infrastructure. Your expertise in Python and experience with big dataset and key performance indicators (KPIs) will be crucial in delivering high-quality data solutions. Key Responsibilities: Design and implement scalable data pipelines to collect, process, and store data. Collaborate with analysts and business stakeholders to understand data needs and translate them into technical requirements. Develop ETL processes to integrate various data sources, ensuring data qua...

Job Description Perform comprehensive ETL operations using ADF to extract, transform, and load data from various data sources, including SaaS applications through APIs, with a focus on multi-region setups and cross-region API calls Architect and manage linked services to enable secure, scalable, and maintainable multi-region data replication and transformation workflows within ADF Optimize ADF pipeline performance by identifying and resolving bottlenecks, implementing data quality checks, and using best practices for efficiency and reliability Design database solutions with a focus on security, scalability, and maintainability, ensuring data protection and compliance with organizational stan...

Job Description Job Title:*Lead Data Engineer Data Company:*Happiest Minds Experience:*8 to 11 years Job Description:** Happiest Minds is seeking a talented and experienced Lead Data Engineer to join our dynamic team The successful candidate will be responsible for designing and implementing robust data pipelines and engineering solutions that empower our analytics and business intelligence initiatives As a key member of our data engineering team, you will work closely with data scientists, analysts, and other stakeholders to turn raw data into actionable insights, Key Responsibilities:** Design, develop, and maintain scalable data pipelines using Azure services and Azure Databricks, Collabo...

Job Description Job Title: Software/Data Engineer AWS Role Overview We are seeking a skilled Data Engineer to develop and maintain a high-performance streaming data platform for a leading healthcare CRM product You will work across technologies like Python, SQL, NodeJS, Kafka, and cloud-native services, contributing to scalable, efficient, and robust data solutions, Key Responsibilities Design, develop, and maintain scalable data pipelines and streaming systems, Work with Python, SQL, Scala, NodeJS, and various data stores (relational, NoSQL, Kafka), Analyze healthcare and marketing datasets using SQL, Refactor and optimize existing codebases for performance improvements, Collaborate closely...

Job Description Job Title:*Lead Data Engineer Data Company:*Happiest Minds Location:*Bangalore Job Type:*Full-time Job Description:** Happiest Minds is seeking a highly skilled and experienced Lead Data Engineer to join our innovative team As a Lead Data Engineer, you will play a vital role in designing, developing, and managing data infrastructure and solutions that drive our data strategy You will lead a team of data engineers, ensuring the delivery of high-quality data pipelines and architecture to support our analytics and business initiatives, Key Responsibilities:** Design and build scalable data pipelines and ETL processes to ingest, process, and store large volumes of structured and ...

**Job Title:*Data Architect Azure Data Engineering **Company:*Happiest Minds **Location:*Bangalore **Job Type:*Full-Time **Minimum Years of Experience:*10 **Maximum Years of Experience:*15 --- **About Happiest Minds:** At Happiest Minds, we are committed to providing innovative digital transformation solutions that empower businesses and enhance user experiences We value creativity, collaboration, and a commitment to quality, and we are seeking like-minded individuals who are passionate about leveraging technology to drive positive change, --- **Job Description:** We are looking for an experienced **Data Architect*with a deep understanding of data management and analytics to join our dynamic...

Data Analysis, Database Design Data Warehouse Design Architecture Roadmap Data Engineering SQL Server Snowflake, Azure Data Factory Should be good in communication and interaction with stakeholders and should have experience in handling large data engineering and Analytics projects Should be able to understand customer requirement and do solutioning and present the solution to both technical and non-technical audience Should be able to work with stakeholders and define the architecture roadmap for the project Should be able to manage and lead a team and should be able to contribute individually as well towards design PoCs,coordination etc, Secondary skill MySQL SSIS and Pentaho and Power BI