858 Data Ingestion Jobs - Page 14

This role is accountable for running day to day operations of Data Platform in Azure / AWS Databricks NCS. Data Engineer is accountable for ongoing Development, Enhancement support and maintenance data availability and data quality, performance enhancement and stability of the system. Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks Ensure data pipelines run smoothly and efficiently Adherence to security, regulatory and audit control guidelines Drive optimization, continuous improvement and efficiency Roles and Responsibilities 1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipel...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Job Role Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for me...

About The Opportunity : A fast-scaling technology company operating in the Enterprise AI / Generative AI sector, building production-grade LLM-driven products and intelligent automation for global clients. We deliver secure, low-latency generative systems that power conversational AI, summarization, code generation, and retrieval-augmented applications across cloud-native environments. We are hiring a Senior Generative AI Engineer (7+ years) to own architecture, model development, and production deployment of advanced generative systems. This is a fully remote role for candidates based in India. Role & Responsibilities : - Lead end-to-end design and delivery of Generative AI/LLM solutionsdat...

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

About AutoZone: AutoZone is the nation's leading retailer and a leading distributor of automotive replacement parts and accessories with more than 6,000 stores in US, Puerto Rico, Mexico, and Brazil. Each store carries an extensive line for cars, sport utility vehicles, vans and light trucks, including new and remanufactured hard parts, maintenance items and accessories. We also sell automotive diagnostic and repair software through ALLDATA, diagnostic and repair information through ALLDATAdiy.com, automotive accessories through AutoAnything.com and auto and light truck parts and accessories through AutoZone.com. Since opening its first store in Forrest City, Ark. on July 4, 1979, the compan...

As a seasoned professional with extensive experience in machine learning operations (MLOps), you will be responsible for leading a talented team and developing a comprehensive technical strategy. Your expertise in Python programming and ML frameworks such as TensorFlow or PyTorch will be crucial in implementing MLOps best practices, including model versioning, monitoring, automated deployment, and infrastructure automation. Your in-depth knowledge of Google Cloud Platform services, including Data Fusion, Dataproc, and Dataflow, will play a key role in data processing and pipeline orchestration. Experience with PostgreSQL databases and data integration tools like Qlik Replicate will further e...

You are a highly skilled Snowflake Developer with extensive experience in designing, implementing, and managing Snowflake-based data solutions. Your role will involve developing data architectures and ensuring the effective use of Snowflake to drive business insights and innovation. Your key responsibilities will include designing and implementing scalable, efficient, and secure Snowflake solutions to meet business requirements. You will also develop data architecture frameworks, standards, and principles, including modeling, metadata, security, and reference data. In addition, you will implement Snowflake-based data warehouses, data lakes, and data integration solutions, and manage data ing...

Position: Snowflake Data Engineer Work Location: Hyderabad(WFO) Experience : 3+ About the opportunity : We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using industry-standard tools. Primary Roles & Responsibilities • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake. • Develop and optimize complex SQL queries for data extraction, transformation, and reporting. • Write robust Python scripts fo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Develop full-stack forecasting and simulation tools using React, Node.js, and Python on AWS Modernize Excel/VBA tools into scalable cloud-native web applications Deploy solutions efficiently with AWS services, CI/CD, and infrastructure-as-code tools Food allowance Annual bonus Health insurance Provident fund

About AutoZone: AutoZone is the nation's leading retailer and a leading distributor of automotive replacement parts and accessories with more than 6,000 stores in US, Puerto Rico, Mexico, and Brazil. Each store carries an extensive line for cars, sport utility vehicles, vans and light trucks, including new and remanufactured hard parts, maintenance items and accessories. We also sell automotive diagnostic and repair software through ALLDATA, diagnostic and repair information through ALLDATAdiy.com, automotive accessories through AutoAnything.com and auto and light truck parts and accessories through AutoZone.com. Since opening its first store in Forrest City, Ark. on July 4, 1979, the compan...

NTT DATA is seeking a Salesforce Data Cloud Developer to join their team in Bangalore, Karnataka, India. As a Salesforce Data Cloud Developer, you will be responsible for designing, building, and supporting Salesforce applications for CRM-based product development. You will work within an agile (SAFe) team, participating in SAFe ceremonies and contributing daily to high-quality implementation. Your role will involve end-to-end Data Cloud design and delivery, including data ingestion, modeling, identity resolution, Calculated Insights, segmentation, activations, and governance. You will collaborate with a multidisciplinary team in a high-demand yet highly collaborative environment. Additional...

As the USPB Data Lending Domain lead within Citis Analytics & Information Management (AIM) group, you will be responsible for overseeing team expansion within tight timelines, developing standardized and measurable delivery frameworks, and ensuring the achievement of business priorities for the year. Your leadership will play a crucial role in bringing agility, consistency, speed of deployment, innovation, and governance processes through a centralized and extensive analytics-driven framework. This highly visible and challenging role directly impacts the banks Consent Order milestones and commitments. In this role, you will have the opportunity to manage the implementation of best-in-class d...

As an entry level Package Consultant at IBM, you will help to assist clients in the selection, implementation, and production support of application packaged solutions, such as SAP, Oracle, Salesforce, Microsoft Dynamics, Workday, or SharePoint solution suite, to meet client needs. Leveraging a growth mindset, you're ready and willing to deliver business value, wherever needed. In your role, you may be responsible for: Assisting clients in selection, implementation, and support of package Make strategic recommendations and leverage business knowledge to drive solutions for clients and their management Run or support workshops, meetings, and stakeholder interviews Develop process maps to unde...

Your role: We are looking for experienced professionals in Data Tokenization and Data Protection with expertise in AWS and Knowledge of Protegrity for Pan India locations, with 9 to 12 years of experience. T his role is ideal for individuals who are passionate about securing critical infrastructure and industrial environments. Candidates should be capable of leading technical discussions, engaging with stakeholders, and delivering secure, scalable data security solutions. Data Tokenization & SecurityDesign and manage tokenization strategies using Protegrity and AWS to protect sensitive data, ensuring compliance with industry standards. AWS ExpertiseProficient in Amazon Redshift, Athena, Glue...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...

About The Role Project Role : Security Architect Project Role Description : Define the cloud security framework and architecture, ensuring it meets the business requirements and performance goals. Document the implementation of the cloud security controls and transition to cloud security-managed operations. Must have skills : Security Information and Event Management (SIEM) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Security Architect, you will define the cloud security framework and architecture, ensuring it meets the business requirements and performance goals. Your typical day will involve col...

We are hiring for Big 4-Bangalore Immediate joiners/serving notice (Preferred)/45 days/60 days JD: Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 7 years work experience). At least 4+ years of consulting or client service delivery experience on Azure At least 4+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Azure Synapse Extensive experience providing practical direction with using Azure Native services. Extensive hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADL...

About The Role Project Role : Security Architect Project Role Description : Define the cloud security framework and architecture, ensuring it meets the business requirements and performance goals. Document the implementation of the cloud security controls and transition to cloud security-managed operations. Must have skills : Security Information and Event Management (SIEM) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Security Architect, you will define the cloud security framework and architecture, ensuring it meets the business requirements and performance goals. Your typical day will involve col...

About the Role: Grade Level (for internal use): 08 S&P Global Mobility The Role: Data Engineer The Team We are the Research and Modeling team, driving innovation by building robust models and tools to support the Vehicle & Powertrain Forecast team. Our work includes all aspects of development of, and ongoing support for, our business line data flows, analyst modelling solutions and forecasts, new apps, new client-facing products, and many other work areas besides. We value ownership, adaptability, and a passion for learning, while fostering an environment where diverse perspectives and mentorship fuel continuous growth. The Impact We areseekinga motivated and talented Data Engineer to be a k...

Urgent Need for Databricks Engineer with 5-10 Yrs of experience for Chennai & Pune Location, need candidates who can join us in short notice . 1. Overview We are building a scalable data ingestion and streaming platform that ingests change data capture (CDC) events from diverse source systems (databases and applications), processes them in real time and lands curated data into our analytics lake. The platform uses Confluent connectors (Debezium/Oracle CDC) to emit Parquet files into cloud storage and leverages Databricks Auto Loader to incrementally ingest, deduplicate and write this data into Delta Lake Bronze table. To ensure broad applicability, the following job description emphasizes ge...

Job Requirements Perform statistical analysis, identify trends, patterns, and anomalies within datasets using Python libraries such as NumPy, SciPy, and Scikit-learn. Develop and implement predictive models or machine learning algorithms to address specific business problems.Looking for a lead engineer for a data anawith good knowledge in Python Programming ,Experience in working with core data analytics libraries in Python (Pandas, Numpy). He / she should have Experience Web Frameworks & APIs (Flask, FastApi) and containerization , Docker. Experienced and having knowledge in building ETL pipelines, data engineering workflows and Data Visualization (spark, plotly, Dash, SQL) Experience in wo...

Educational Requirements Bachelor of Engineering,Bachelor Of Technology,Bachelor Of Science,Bachelor Of Comp. Applications,Master Of Engineering,Master Of Technology,Master Of Science,Master Of Comp. Applications Service Line Engineering Services Responsibilities Must have skills -: Expert level knowledge - JavaScript, NodeJS, etc. Good Exposure to C, C++, etc. Expert level knowledge on frequently used data storage or SQL or NoSQL databases. Expert level knowledge in Software development, networking & system design. Knowledge of Linux Operating System internals. Experience in Linux embedded systems. Experience in architecture of complex performant Linux system software. Capability to transla...

Qualification: Degree in Computer Science (or similar), alternatively well-founded professional experience in the desired field Experience Range: 3 to 5 Years Roles & Responsibilities: As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You are responsible for the implementation of the IT governance guidelines. Collaborate with the Spokes Data Scientists, Data Analysts, and Business Analysts, when relevant. Tasks Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation Experience working with and creating cloud data solutions Assemble large, complex data sets that meet functi...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality, and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with: - Hands-on experience in PySpark and strong knowledge of Dataframes, RDD, and SparkSQL. - Hands-on experience in developing, testing, and maintaining applications on AWS Cloud. - Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambd...