10148 Data Engineering Jobs - Page 10

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL pro...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL pro...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : DevOps Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a DevOps Engineer, you will be responsible for solutioning end to end dev-ops architecture and suggesting tool for AWS, build automations, ETL pipelines, code quality & security. A typical day involves utilizing your expertise in continuous in...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Walk-In Drive Alert Positions Available: - Associate Data Architect - Senior Data Engineer - QA Engineer Mark your calendar for the walk-in drive at ECI Bangalore office on November 12th, Wednesday Venue: ECI, Venkatadri IT City, 4th Floor, Konappana Agrahara, Electronic City, Phase-1, Bangalore 560100 Date & Time: November 12th (Wednesday) between 11 AM IST – 6 PM IST Learn more about the roles and requirements: Associate Data Architect: 8+ years of experience in developing ETL-based data solutions on Azure platform, experience with multiple platforms a plus. Should have worked on a project with experience in (Data Extraction, Data Transformation and Data Loading) in Microsoft Azure. Should...

Position Overview: We are seeking a skilled Data Engineer with 36 years of experience to join our dynamic Data Engineering team . The ideal candidate will design, build, and optimize large-scale data pipelines and warehouses that enable real-time analytics and business intelligence across Tanla’s CPaaS ecosystem. You’ll work on diverse datasets, including Call Detail Records ( CDR )/ Telecom , and collaborate closely with cross-functional teams to ensure data reliability, scalability, and performance. Key Responsibilities: • Design and implement ETL/ELT pipelines for large-scale data processing and analytics. • Develop and optimize analytical SQL queries for performance and scalability. • Ex...

Job Description We are looking for an experienced Azure Data Fabric Engineer to join our data engineering team. The ideal candidate will have strong hands-on experience in Microsoft Fabric , Azure Data Factory , and end-to-end data engineering across the Azure ecosystem. The role involves designing and implementing scalable data pipelines, building data lakehouse solutions, and ensuring data quality, performance, and governance across the platform. Key Responsibilities Design, develop, and implement end-to-end data engineering solutions using Microsoft Fabric (Data Engineering, Data Factory, Data Warehouse, Real-Time Analytics, Power BI). Build and maintain data pipelines following medallion...

Analysis and Insight Generation : Engage in advanced data analysis to uncover trends and correlations. Utilize statistical methods and tools to drive insightful recommendations for business strategies and process improvements. Reporting and Dashboard Development: Develop automated reports and interactive dashboards using BI tools like Tableau, QuickSight, PowerBI. Focus on creating user-friendly and efficient data visualizations to support business decisions. Stakeholder Collaboration and Communication: Work closely with stakeholders across various departments including program, product, legal, and tech teams. Communicate complex data insights effectively and implement optimal communication ...

Provide end-to-end application support for data platforms and AI applications, ensuring high availability and reliability. Manage and optimize AWS infrastructure for data and analytics workloads, including cost and performance tuning. Implement and maintain ML Ops pipelines, supporting model deployment, monitoring, and lifecycle management. Troubleshoot and resolve platform and application issues, collaborating with engineering and data science teams. Drive automation and continuous improvement initiatives aligned with Danaher Business System (DBS) principles. The essential requirements of the job include: Bachelors in Computer Science, Data Engineering, or related field with 6+ years in dat...

Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production data platform Define and implement the processes needed to achieve operational excellence in all areas, including agile development, and data solutions Oversee the design, development and maintenance of data infrastructure, including data warehouses, data lakes, data integration components supporting optimal extraction, transformation, and loading of data Leading the communication with vendors, clients, the leadership team, and other stakeholders to facilitate effective project management and provide ongoing support Collaborate with business owners for roadmap plan...

Position Summary This is the Requisition for Employee Referrals Campaign and JD is Generic. We are looking for Associates with 5+ years of experience in delivering solutions around Data Engineering, Big data analytics and data lakes, MDM, BI, and data visualization. Experienced to Integrate and standardize structured and unstructured data to enable faster insights using cloud technology. Enabling data-driven insights across the enterprise. Job Responsibilities He/she should be able to design implement and deliver complex Data Warehousing/Data Lake, Cloud Data Management, and Data Integration project assignments. Technical Design and Development- Expertise in any of the following skills. Any ...

Lead and scale a global Data Engineering & Operations team, fostering a culture of accountability, innovation, and continuous improvement. Drive operational excellence by establishing best practices for data pipeline monitoring, automation, and incident management using AI/ML-enabled observability tools. Oversee data infrastructure and workflows , ensuring performance, scalability, security, and compliance across cloud platforms (AWS, GCP, Azure). Define and track KPIs for data availability, quality, reliability, and incident resolution; present key metrics and insights to senior leadership regularly. Enable automation-first culture by reducing repetitive incidents and streamlining issue res...

As a Data Engineer, youll be building and scaling mission-critical data products that power worldwide operations business decisions. In this role, youll drive technical excellence while building data infrastructure and products. Youll be working on scalable solutions that process petabytes of data daily, serving diverse user personas from front-line operators to corporate leadership. We expect you to bring strong technical acumen to solve difficult problems at scale, while maintaining high operational standards and driving innovation in both traditional analytics and AI/ML domains. Design and implement scalable, secure data pipelines and infrastructure using AWS technologies and big data too...

1.Relevant accredited certifications for Azure, AWS, Cloud Engineering, and/or Databricks Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure 1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 ...

Design, develop, and maintain scalable data pipelines and systems. Collaborate with data scientists and software engineers to integrate data solutions. Optimize and improve existing data systems for performance and reliability. Implement data security and privacy measures to protect sensitive information. Monitor and troubleshoot data pipeline issues to ensure data integrity. Required Qualifications Bachelors degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or in a similar role. Strong knowledge of SQL and database management systems. Experience with data pipeline and workflow management tools. Proficiency in programming languages such as Pyth...

- Design, develop, and deploy LLM-based applications for clinical and operational workflows (summarization, chat, reasoning, data extraction). - Implement and optimize RAG (Retrieval-Augmented Generation) pipelines with vector databases (FAISS, Pinecone, or Vertex AI Matching Engine). - Work hands-on with LLM APIs (OpenAI, Claude, Gemini, Mistral, Llama) for fine-tuning, evaluation, and productionization. - Build and maintain AI microservices / APIs using FastAPI or Flask, integrated with FoldUnity platform. - Implement Agentic AI workflows (multi-step reasoning, tool use, and task orchestration) using frameworks such as LangGraph, CrewAI, or Semantic Kernel. - Collaborate with the Data Engi...

Collaborative Solution Development- Engage with a diverse range of stakeholders, including analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions. State-of-the-Art Pipelines and Architecture- Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability. Design scalable architectures. Champion Data Best Practices- Proactively establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability across Adyen through mentoring, train...

The Position Data Architecture and Technology (Advanced Skills): Build and maintain a unified view of the affiliate s data architecture leveraging strong data engineering expertise to map data tables, understand underlying schemas, and oversee data flow across systems, from source to warehouse, ensuring clarity, reliability, and alignment with business needs while maintaining and upgrading ETL processes. Collaborate with cross-functional teams partner with data governance, data engineering, analytics teams to ensure data pipelines, definitions, and reports align with data definitions to maintain consistency. Comply with data governance practices, flag gaps or redundancies in sources or proce...

Design and implement data architecture and pipelines using PySpark, Python, and AWS services (Glue, EMR, S3, Redshift, Athena). Modernize legacy systems by converting Java-based migration or ETL scripts into Spark-based solutions. Build and manage data lakes and data warehouses optimized for analytics and AI/ML workflows. Collaborate with data scientists and analysts to enable model training, deployment, and continuous data delivery. Define and document HLD (High-Level Design) and LLD (Low-Level Design) for scalable data systems. Implement standards for data quality, governance, performance optimization, and security. Lead troubleshooting, performance tuning, and architecture reviews for dat...

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

As a SA/VLM associate, you will be responsible for creating high-quality written content for videos/images and/or labeling of objects on audio, image, and/or video-file. Your primary focus will be on producing clear, concise, and informative content that meets the needs of the target audience. Performs simple annotation-related tasks in a narrow ML data process area (e.g. audio, image, and/or video-file). Uses internal tools and software provided by team. May participate in data collection activities when scripts and instructions are provided. Adheres to compliance and confidentiality requirements. Apply strong language skills, grammar knowledge, and linguistic rules to ensure the generated ...

About The Role : Job TitleBusiness Functional Analyst Corporate TitleAssociate LocationPune, India Role Description Business Functional Analysis is responsible for business solution design in complex project environments (e.g. transformational programmes). Work includes Identifying the full range of business requirements and translating requirements into specific functional specifications for solution development and implementation Analysing business requirements and the associated impacts of the changes Designing and assisting businesses in developing optimal target state business processes Creating and executing against roadmaps that focus on solution development and implementation Answeri...