6525 Data Engineering Jobs - Page 21

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills Data analytics,ETL,SQL,Python,Google Big Query,AWS Redshift,Data architecture*

About The Role Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Cloud Data Architecture Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Technology Architect, you will engage in a dynamic environment where you will review and integrate all application requirements, ensuring that functional, security, integration, performance, quality, and operations needs are met. Your typical ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Java Enterprise Edition Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : Java, Python (Programming Language) Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Amazon Web Services (AWS) Good to have skills : Python (Programming Language), Data Engineering, PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are ali...

ACL Digital is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the qu...

HSBC electronic data processing india pvt ltd is looking for SENIOR SOFTWARE ENGINEER/ DATA ENGINEER to join our dynamic team and embark on a rewarding career journey Develop high-quality software design and architecture Identify, prioritize and execute tasks in the software development life cycle Develop tools and applications by producing clean, efficient code Automate tasks through appropriate tools and scripting Review and debug code Perform validation and verification testing Collaborate with internal teams and vendors to fix and improve products Document development phases and monitor systems Ensure software is up-to-date with latest technologies Serve as a technical lead contributing ...

Diverse Lynx is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the q...

Diverse Lynx is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the q...

Job Duties: Wyndham Group of Hotels is advancing its modern data platform on Databricks (AWS) and is seeking a senior offshore data engineering lead to build high-performance, production-grade data pipelines. This role is not migration-focused initially but will evolve into one. The current mandate is to ingest semi-structured JSON data dropped via SFTP to S3, transform and validate it using Databricks, and deliver curated datasets into Amazon Redshift. This is a player-coach role, ideal for a technically hands-on leader capable of delivering pipelines while mentoring junior engineers and ensuring best practices across the offshore team. Initial Scope and Responsibilities:Develop high-perfor...

Key Skills & Competencies Advanced SQL development (joins, CTEs, window functions, optimization) Experience with ETL/ELT processes and tools Data modeling (dimensional and normalized Familiarity with version control (e.g., Git) and CI/CD practices Understanding of DWH architectures and data integration patterns Ability to work with large datasets and performance-tune queries Platform-agnostic mindset with readiness to adapt to Azure or AWS

Key Responsibilities: Develop and implement traditional machine learning algorithms. Deploy at least one model in a production environment. Write and maintain Python code for data science and machine learning projects.Preferred Qualifications: Knowledge of Deep Learning (DL) techniques. Experience working with Generative AI (GenAI) and Large Language Models (LLM). Exposure to Langchain.

Job Duties: Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems. Document ETL processes and migration steps. Minimum Skills Required: Strong hands-on experience with SAP BODS. Proficiency in PySpark and Python scripting. Experience with AWS PostgreSQL (schema design, performance tuning, migration). Strong SQL and data modelling skills. Experience with Unix/Linux and shell scripting. Knowledg...

About the Role: We are seeking a highly skilled and experienced Senior Adobe Experience Platform (AEP) Developer to join our growing team. In this role, you will play a critical part in Support & maintenance, design, development, and implementation of innovative customer data solutions within the AEP ecosystem. You will be responsible for building and maintaining robust data pipelines, integrating data from various sources, and developing custom solutions to meet the unique needs of our business. Key Responsibilities: AEP Platform Expertise: Deep understanding of the AEP suite, Experience Data Model (XDM), Data Science Workspace, and other relevant modules. Proficient in AEP APIs, Web SDKs, ...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

Understand and execute data migration blueprints (migration concepts, transformation rules, mappings, selection criteria) Understand and contribute to the documentation of the data mapping specifications, conversion rules, technical design specifications as required Build the conversion processes and associated programs that will migrate the data per the design and conversion rules that have been signed-off by the client Execution of all data migration technical steps (extract, transform & load) as well as Defect Management and Issue Resolution Perform data load activities for each mock load, cutover simulation and production deployment identified in L1 plan into environments identified Prov...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the client’s needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our client’s business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bache...

IBM is seeking talented and movtivated Software Developers to work on products across the Software Portfolio. In this role, you will collaborate closely with a worldwide team of experienced and energetic professionals to create new and expected capabilities in our industry-leading Sustainability Software portfolio. You will work across the entire software delivery cycle including requirements gathering, use case definition, design, implementation, test, test automation documentation, and delivery, including cloud infrastructure such as DevOps, SRE, Security, and customer support work as part of your scope. You'll frequently work with Product Owners, Architects, Release Managers, Designers, S...

Advanced Programming Skills in Python,Scala,GoStrong expertise in developing and maintaining microservices in Go (or other similar languages), with the ability to lead and mentor others in this area. Extensive exposure in developing Big Data Applications ,Data Engineering ,ETL and Data Analytics . Cloud ExpertiseIn-depth knowledge of IBM Cloud or similar cloud platforms, with a proven track record of deploying and managing cloud-native applications. Leadership and CollaborationAbility to lead cross-functional teams, work closely with product owners, and drive platform enhancements while mentoring junior team members. Security and ComplianceStrong understanding of security best practices and ...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Build and maintain Power BI dashboards and data models for cross-functional business reporting. Develop and optimize data queries from the Enterprise Data Warehouse (EDW) and other systems. Normalize, transform, and integrate data to support both managed reporting and self-serve BI . Design reusable, governed datasets and provide training to help stakeholders adopt self-serve analytics confidently. Develop and maintain ETL workflows using Alteryx , Informatica , and MS Azure Data Factory . Apply advanced analytics and basic data science techniques for forecasting, costing, and workforce planning. Review work from junior analysts, provide coaching, and support enterprise data education initia...

We are currently seeking a AI Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Title: Data Science & AIML, GenAI Lead/Engineer Key Responsibilities: Develop and implement traditional machine learning algorithms. Deploy at least one model in a production environment. Write and maintain Python code for data science and machine learning projects. Preferred Qualifications: Knowledge of Deep Learning (DL) techniques. Experience working with Generative AI (GenAI) and Large Language Models (LLM). Exposure to Langchain. #GenAI

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Mandatory Key SkillsETL pipelines,data warehouses,SQL,Python,AWS Redshift,Google BigQuery,ETL*

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Mandatory Key SkillsPython,AWS Redshift,Google BigQuery,ETL pipelines,data warehousing,data architectures,SQL*

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key SkillsData analytics,ETL,SQL,Python,Google Big Query,AWS Redshift,Data architecture*