6525 Data Engineering Jobs - Page 36

Data Analysis, Database Design Data Warehouse Design Architecture Roadmap Data Engineering SQL Server Snowflake, Azure Data Factory Should be good in communication and interaction with stakeholders and should have experience in handling large data engineering and Analytics projects Should be able to understand customer requirement and do solutioning and present the solution to both technical and non-technical audience Should be able to work with stakeholders and define the architecture roadmap for the project Should be able to manage and lead a team and should be able to contribute individually as well towards design PoCs,coordination etc Secondary skill MySQL SSIS and Pentaho and Power BI

General Summary: Data Platform, Engineering and Operations lead will play a pivotal role in shaping the future of our data capabilities as part of strategic and critical Enterprise Data Transformation (EDT) program. We're seeking a visionary, hands-on leader to drive the build out of a modern enterprise-wide lake house, ensuring reliability, scalability, security, and compliance. and enabling cutting edge analytics solutions. This role will be leading a talented team of platform and data engineers, fostering a culture of excellence while balancing speed of delivery with innovation and operational excellence. This role will also collaborate with cross functional teams (Solution engineers, SME...

Role & responsibilities Landslide Hazard Identification and Mapping Conduct landslide hazard mapping using geospatial, geological, and hydrometeorological data. Analyze remote sensing and field survey data to identify high-risk zones. Develop GIS-based susceptibility and hazard maps for use by decision-makers. Assess the exposure of populations, infrastructure, and ecosystems to landslide hazards. Analyze socio-economic vulnerabilities and integrate them with hazard data. Create composite risk maps to support risk-informed decision-making. Risk Modelling and Early Warning System Development Develop landslide risk models combining hazard, exposure, and vulnerability data. Use probabilistic an...

" Educational Requirements Bachelor of Engineering , BCA , BSc , MCA , MTech , MSc Service Line Data & Analytics Unit Responsibilities 5-8 yrs exp in Azure (Hands on experience in Azure Data bricks and Azure Data Factory) Good knowledge in SQL, PySpark. Should have knowledge in Medallion architecture pattern Knowledge on Integration Runtime Knowledge on different ways of scheduling jobs via ADF (Event/Schedule etc) Should have knowledge of AAS, Cubes. To create, manage and optimize the Cube processing. Good Communication Skills. Experience in leading a team Additional Responsibilities: Good knowledge on software configuration management systems Strong business acumen, strategy and cross-indu...

Responsibilities: * Design, develop & maintain data pipelines using ETL, SQL, Python & AWS. * Optimize data warehousing solutions for performance & scalability.

In this role, you will: Lead moderately complex initiatives and deliverables within technical domain environments Contribute to large scale planning of strategies Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements Collaborate and consult with peers, colleagues, and mid-level managers to...

Software Real-Time Data Engineer III - Streaming data Position Responsibilities Summary: Configure and validate infrastructure related to our internal SAAS Real-Time Data Streaming Platform in Azure. Develop and validate the Streaming Pipeline and data models. Enrich data with Azure Stream Analytics. Use Machine Learning techniques like classification and regression. Develop systems to support applying AI/ML techniques . Provide support to our development teams and work with our Data Organization Work with our Application Architects. Documentation: writes knowledge articles and other documentation General Responsibilities: Serving as a regional point of contact in our Data Streaming team tog...

Greetings from Cognizant!!! We have an exciting opportunity for the skill Java + Spark Architect with Cognizant, if you are an aspirant for matching the below criteria apply with us immediately!! Skill: Java + Spark Architect Experience: 13 to 16 years Location: Hyderabad Interview mode : In-person ( Face to Face ) Interview Date : 13-Sep-25 ( Saturday) If you're interested kindly fill the below details and share your updated resume arunadevi.e@cognizant.com and will reach you shortly also refer your friends for this opportunity.

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Data Management: Proficiency in data architectures such as data warehouses, data lakes, and data hubs, along with supporting processes like data integration, governance, and metadata management DevOps Practices Required Candidate profile Data Pipeline Construction: Designing, building, and managing data pipelines for data transformation, data models, schemas, metadata, and workload management Data Analysis Tools

Data Management: Proficiency in data architectures such as data warehouses, data lakes, and data hubs, along with supporting processes like data integration, governance, and metadata management DevOps Practices Required Candidate profile Data Pipeline Construction: Designing, building, 5 years of experience in Python, Apache Spark, DBT(1-2 Years), AWS (EMR, LAMBDA, EKS, EC2, RDS, S3, VPC) and Snowflake.

Strong in pureplay SQL and Python (approx. 6-7 yoe) Familiarity with data pipelines (nifi/airflow etc.), data lineage, reviewing data logs, data architecture etc. Exposure to tag mgmt, web data, GCP big query is a plus Required Candidate profile Data Pipeline Construction: Designing, building, 5 years of experience in Python, Apache Spark, DBT(1-2 Years), AWS (EMR, LAMBDA, EKS, EC2, RDS, S3, VPC) and Snowflake.

About The Opportunity : Join a pioneering consulting firm in the Data Analytics and Cloud Solutions sector, where transformative data architectures empower global enterprises. We specialize in leveraging cutting-edge Snowflake technologies and innovative cloud solutions to drive real-time insights and business intelligence. This remote role, based in India, offers the opportunity to work on high-impact projects while collaborating with a diverse team of experts. Role & Responsibilities : - Design, implement, and optimize scalable data warehousing solutions using Snowflake Cortex. - Develop robust ETL pipelines that ensure data quality, reliability, and efficient integration across platforms....

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (5+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 5+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 5+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...

We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities : - Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond). - Model and structure data for performance, scalability, and usability. - Work with cloud i...

We are seeking a highly skilled and motivated Senior MarkIT EDM Data Engineer to join our team. The ideal candidate will be a self-starter who can work independently and collaborate effectively with both internal and external stakeholders. This role requires a deep understanding of data engineering principles, strong technical skills, and the ability to drive projects to successful completion. Key Responsibilities : - Design, develop, and maintain data solutions using MarkIT EDM. - Collaborate with internal teams and external stakeholders to gather requirements and deliver data solutions. - Ensure data quality, integrity, and security across all data processes. - Optimize data workflows and ...

Position : Data Engineer (ETL Informatica Powercenter) Work Location : Pune , Hyderabad Interview Mode : 1st round Virtual (Assessment Test) | 2nd round (Technical round) | 3rd Round F2F at Apexon office Job Summary: We are seeking a highly skilled Lead/Senior Data Engineer to provide L2 and L3 production support for enterprise-scale data platforms.The ideal candidate should have strong experience in Informatica PowerCenter, Informatica PowerExchange, Yellowbrick (or any RDBMS), Unix Shell Scripting, and Tivoli Workload Scheduler.You will be responsible for ensuring seamless, reliable, and efficient data processing operations. Key Responsibilities: Provide L2/L3 production support for comple...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Develop full-stack forecasting and simulation tools using React, Node.js, and Python on AWS Modernize Excel/VBA tools into scalable cloud-native web applications Deploy solutions efficiently with AWS services, CI/CD, and infrastructure-as-code tools Food allowance Annual bonus Health insurance Provident fund

Work Timings - Rotational Shifts (IST) Work Location - Remote Notice Period - only 30days Job Description Summary The Data engineer is responsible for managing and operating upon Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI . The engineer will work closely with the customer and team to manage and operate cloud data platform. Job Description Leads operational coverage: Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects. Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving...

Location: Remote Position: Full-time / 4-5 Hours PST overlap Department: Engineering Position Overview Website- www.turing.com We are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data engineering, and is excited about blending these disciplines to create innovative solutions. You will be responsible for one or more software and data products, participating in architectural decisions, design, development, and evaluation of new technical solutions. This role also involves leading a small team of develo...