2103 Data Engineer Jobs - Page 27

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Troubleshoot, test, and optimize BPM applications for performance. Document process designs, configurations, and technical specificat...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform * Responsibilities: * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform * Experience in developi...

Looking for immediate job opening for # Azure Data Engineer_Pan India Skills:Azure Data Engineer, Azure Data Bricks Exp: 6 +years Location: Pan India(Hybrid) 6+ years of experience in Data engineering projects using COSMOS DB- Azure Databricks (Min 3-5 projects) Strong expertise in building data engineering solutions using Azure Databricks, Cosmos DB Strong T-SQL programming skills or with any other flavor of SQL Experience working with high volume data, large objects, complex data transformations Experience working in DevOps environments integrated with GIT for version control and CI/CD pipeline. Good understanding of data modelling for data warehouse and data marts Strong verbal and writte...

Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using Snowflake as the primary database engine. Collaborate with cross-functional teams to gather requirements and design solutions that meet business needs. Develop complex SQL queries to optimize query performance and troubleshoot issues in the pipeline. Ensure high availability, scalability, security, and compliance of the data warehousing environment. Job Requirements : 5-10 years of experience in a similar role as a Data Engineer or related field. Strong expertise in working with Snowflake as a primary database engine. Proficiency in writing efficient SQL queries for complex datasets. Expe...

Role & responsibilities Mandatory Skills Databricks Engineer, Power Bi Developer, SQL, Dax Queries, SQL Server, Data Warehousing Skill to Evaluate Databricks Engineer, Power Bi Developer, SQL, Dax Queries, SQL Server, Data Warehousing Experience 5 to 6 Years Location Bengaluru Job Description Job Title: Data Engineer with Databricks and Power BI (DAX) Experience Company: Sony India Software Centre Job Description: As a Senior Data Engineer at Sony India Software Centre, you will be responsible for designing, developing, and maintaining robust data pipelines and data architectures to support advanced analytics and reporting initiatives. You will work closely with data scientists, analysts, an...

What you will be doing: Service Management: Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS, Zookeeper, and more. Job Scheduling and Workflow Management : Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing. Security and Access Control: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and m...

As a Data Engineer at SAP, you play a crucial role in delivering cutting-edge support to strategic customers, contributing to IT and business operations improvement, safeguarding critical projects, and driving innovation. Your responsibilities include: - Implementing data engineering solutions to meet business requirements - Developing and maintaining data pipelines for efficient data processing - Collaborating with cross-functional teams to ensure data quality and integrity - Troubleshooting and resolving data-related issues in a timely manner In order to excel in this role, you are required to have the following skills: - Strong proficiency in data engineering tools and technologies - Expe...

Role Overview: As a Data Engineer specializing in Agentic AI, your main responsibility will be to implement AI integration, develop data pipelines, collaborate with stakeholders, and automate deployment processes. Key Responsibilities: - Implement LLM-based workflows, RAG pipelines, and agentic orchestration using frameworks like LangChain, LangGraph, CrewAI, or similar - Design, develop, and maintain efficient and scalable data pipelines using Python and Azure tech stack - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs - Containerize and deploy solutions using Docker, Kubernetes, and cloud-na...

You will be part of a company that helps the world run better, where you can bring out your best and contribute to shaping the future. SAP is a global leader in business software, touching over 20 industries and 80% of global commerce. You will have the opportunity to work with top talent in the Center of Expertise (CoE) within Premium Hub, delivering cutting-edge support to strategic customers, focusing on proactive, long-term partnerships based on trust and innovation. **Role Overview:** As a Data Engineer at SAP, you will be responsible for: - Implementing data models and workflows - Developing data pipelines for processing and analyzing large datasets - Collaborating with cross-functiona...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

We are looking for a skilled .NET React Developer with 4 to 6 years of experience. The position is based in Gurgaon. Roles and Responsibility Design, develop, and maintain high-quality software applications using .

We are looking for a skilled Big Data Developer with 6-8 years of experience to join our team in Hyderabad/Pune. The ideal candidate will have strong knowledge of Unix/BigData Scripting and a solid understanding of BigData (CDP/Hive) Environment. Roles and Responsibility Design, develop, and implement big data solutions using Hadoop/CDP, Hive. Collaborate with the Lead Hadoop Data Engineer and Product Owner to achieve project goals. Support existing applications and design/build new Data Pipelines. Participate in service management and issue resolution activities. Ensure efficient use of Hive, Unix Scripting, and Control-M to reduce lead time to delivery. Provide solutions and tools to enhan...

We are looking for skilled professionals with 6 to 13 years of experience in SAP ATTP with Pharma, based in Pan India. The ideal candidate will have a strong background in SAP ATTP and Pharma. Roles and Responsibility Implement and support SAP ATTP projects. Collaborate with cross-functional teams to deliver high-quality solutions. Provide technical expertise and guidance on SAP ATTP implementations. Develop and maintain documentation of SAP ATTP configurations. Troubleshoot and resolve issues related to SAP ATTP. Ensure compliance with industry standards and best practices. Job Requirements Minimum 6 years of experience in SAP ATTP with Pharma. Strong knowledge of SAP ATTP and Pharma. Exper...

Looking to onboard a skilled professional with 4-10 years of experience in Service Level Management to join our team in Mumbai, Bangalore, and Pune. The ideal candidate will have a strong background in IT service management processes. Roles and Responsibility Maintain the SLM framework and provide templates for SLM documents. Identify service requirements and document them for initial evaluation. Check if Service Acceptance Criteria are fulfilled and sign off on agreements. Monitor achieved service levels and compare them with agreed targets. Report on service level performance and suggest improvements. Collaborate with teams to lead an environment driven by customer service and teamwork. Jo...

We are looking for a skilled professional with 6 to 12 years of experience to join our team as an Azure Data Factory /Azure DataLake/ Azure Databricks with Terraform expert. The ideal candidate will have a strong background in designing, implementing, and supporting enterprise-grade technical solutions. Roles and Responsibility Drive end-to-end integration delivery through analysis, design, build, and deployment. Manage requirement gathering and analysis necessary for integration build. Develop new and enhanced integrations following appropriate HRIT and HR delivery lifecycle. Develop and maintain integration patterns and blueprints in accordance with HRIT and HR standards. Document integrat...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skills.

5 to 8 years of relevant experience in data engineering using Kingsway Soft and SSIS package, D365 CRM, and Power Platform

Responsibilities: We are looking for a highly skilled Databricks & Azure Senior Data Engineer with at least 6 to 10 years of experience to join our vibrant Data & Analytics team. The ideal candidate should have strong background in Azure data services, including Databricks, Synapse Analytics, Microsoft Fabric, PySpark and SQL. He/She will be responsible for designing, building, and maintaining scalable data solutions that meet business requirements and align with industry best practices. What is expected out of you? 6+ years of experience as a Databricks & Data Engineer, building Azure-based data solutions using Data Factory, Synapse, Databricks. Expertise in Python, SQL (SparkSQL, TSQL, PLS...

Proficient in building large-scale systems end to end using Java/Python/Golang or other high-performance languages, developer tools, CI/CD, DevOps, monitoring tools and engineering cloud migration solutions Hands on experience working with API Architecture and Solution Design - REST/GraphQL/gRPC and API Development using Spring boot and Spring framework, RDBMS & No-SQL (e.g., PostgreSQL, Elastic Search) 10+ years of experience in technologies including Docker, Kubernetes, DevOPs, Observability, Site Reliability Engineering (EgTools like ArgoCD, jFrog, Git, Git Workflows) Work with API developers across the teams to build new API features at large scale Expertise in AWS Cloud - AWS CLI, Lambd...

* Provide expertise in analysis, requirements gathering, design, coordination, customization, testing and support of reports, in client’s environment * Develop and maintain a strong working relationship with business and technical members of the team * Relentless focus on quality and continuous improvement * Perform root cause analysis of reports issues * Development / evolutionary maintenance of the environment, performance, capability and availability. * Assisting in defining technical requirements and developing solutions * Effective content and source-code management, troubleshooting and debugging. Required education Bachelor's Degree Preferred education Master's Degree Required technica...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpora...