875 Data Ingestion Jobs - Page 35

Graph data Engineer required for a complex Supplier Chain Project. Key required Skills Graph data modelling (Experience with graph data models (LPG, RDF) and graph language (Cypher), exposure to various graph data modelling techniques) Experience with neo4j Aura, Optimizing complex queries. Experience with GCP stacks like BigQuery, GCS, Dataproc. Experience in PySpark, SparkSQL is desirable. Experience in exposing Graph data to visualisation tools such as Neo Dash, Tableau and PowerBI The Expertise You Have: Bachelors or Masters Degree in a technology related field (e.g. Engineering, Computer Science, etc.). Demonstrable experience in implementing data solutions in Graph DB space. Hands-on e...

Salary: 10 to 20 LPA Exp: 3 to 7 years Location : Gurgaon Notice: Immediate to 30 days..!! Key Responsibilities & Skillsets: Common Skillsets : 3+ years of experience in Data Engineering, ETL, Data Warehousing Experience in managing Python codes and collaborating with customer on model evolution Good knowledge of data warehousing Exp in Data modelling Good communication skill for client interaction Data Management Skillsets: Ability to understand data models and identify ETL optimization opportunities. Exposure to ETL tools is preferred Should have strong grasp of advanced SQL functionalities (joins, nested query, and procedures). Strong ability to translate functional specifications / requi...

We are seeking an experienced and highly skilled Senior Data Engineer to drive data-driven decision-making and innovation. In this role, you will leverage your expertise in advanced analytics, machine learning, and big data technologies to solve complex business challenges. You will be responsible for designing predictive models, building scalable data pipelines, and uncovering actionable insights from structured and unstructured datasets. Collaborating with cross-functional teams, your work will empower strategic decision-making and foster a data-driven culture across the organization. Role & responsibilities 1 Position Overview: We are seeking an experienced and highly skilled Senior Data ...

We are looking for a skilled and experienced Microsoft Fabric Data Engineer Lead with strong experience in designing, implementing, and managing data engineering solutions using Microsoft Fabrica unified platform for data integration, analytics, and governance Role Overview Architect scalable data solutions using Fabric components like Lake houses, Pipelines, and Dataflows Lead data ingestion and transformation using tools such as Azure Data Factory, PySpark, SQL, and Kusto Query Language (KQL) Ensure data quality and governance across Bronze (raw), Silver (cleansed), and Gold (curated) layers Collaborate with cross-functional teams including analytics engineers, architects, and business sta...

Strong problem-solving skills with a focus on product development. Domain expertise in Big Data, Data Platforms, and Distributed Systems. Proficiency in Java, Scala, or Python (hands-on experience with Apache Spark is essential). Experience with data ingestion frameworks such as Apache Storm, Flink, or Spark Streaming. Experience with streaming technologies like Kafka, Kinesis, Oplogs, Binlogs, or Debezium. Strong database skills with experience in HDFS, Delta Lake, Iceberg, or Lakehouse architectures.

About The Role : Job Title - IT Architect Specialist, AVP Location - Pune, India Role Description This role is for a Senior business functional analyst for Group Architecture. This role will be instrumental in establishing and maintaining bank wide data policies, principles, standards and tool governance. The Senior Business Functional Analyst acts as a link between the business divisions and the data solution providers to align the target data architecture against the enterprise data architecture principles, apply agreed best practices and patterns. Group Architecture partners with each division of the bank to ensure that Architecture is defined, delivered, and managed in alignment with the...

Mandatory Skills: AWS, Python, SQL, spark, Airflow, Snowflake Responsibilities: Create and manage cloud resources in AWS Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform Develop automated data quality check to make sure right data enters the platf...

About the Role We are seeking a highly skilled Snowflake Developer to join our team in Bangalore. The ideal candidate will have extensive experience in designing, implementing, and managing Snowflake-based data solutions. This role involves developing data architectures and ensuring the effective use of Snowflake to drive business insights and innovation. Key Responsibilities: Design and implement scalable, efficient, and secure Snowflake solutions to meet business requirements. Develop data architecture frameworks, standards, and principles, including modeling, metadata, security, and reference data. Implement Snowflake-based data warehouses, data lakes, and data integration solutions. Mana...

Role Description Sr. Spark/Python/Pentaho Developer. Need to workon Data Integration project. Mostly batch oriented using Python/Pyspark/Pentaho. Your key responsibilities Hands on Spark/Python/Pentaho programming experience Participating in agile development projects for batch data ingestion. Fast learner into order to understand the current data landscape and existing Python/Spark/Pentaho program to make enhancement. Stakeholder communication Contribute to all stages of software development lifecycle Analyze user requirements to define business objectives Define application objectives and functionality Develop and test software Identify and resolve any technical issues arising Create detai...

Educational Requirements Master Of Comp. Applications,Master Of Engineering,Master Of Science,Master Of Technology,Bachelor Of Comp. Applications,Bachelor Of Science,Bachelor of Engineering,Bachelor Of Technology Service Line Engineering Services Responsibilities Must have skills -: Expert level knowledge - JavaScript, NodeJS, etc. Good Exposure to C, C++, etc. Expert level knowledge on frequently used data storage or SQL or NoSQL databases. Expert level knowledge in Software development, networking & system design. Knowledge of Linux Operating System internals. Experience in Linux embedded systems. Experience in architecture of complex performant Linux system software. Capability to transla...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...

What youll achieve As a Senior Software Principal Engineer, you will be part of the Storage team to innovate and deliver Storage and data management support. You will collaborate and work closely with our Global engineering talents and will have significant opportunities to innovate and modernize the next-gen storage platform. You will: Design and develop various storage features for next-gen AI storage platform Participate in design collaboration, code reviews, exercising development tools and processes Take part in the full software development life cycle including development, testing, continuous delivery, and support Be an active member of an agile team Take the first step towards your d...

Job Title: Spark/Python/Pentaho Developer Role Description Spark/Python/Pentaho Developer. Need to workon Data Integration project. Mostly batch oriented using Python/Pyspark/Pentaho. Your key responsibilities Hands on Spark/Python/Pentaho programming experience Participating in agile development projects for batch data ingestion. Fast learner into order to understand the current data landscape and existing Python/Spark/Pentaho program to make enhancement. Stakeholder communication Contribute to all stages of software development lifecycle Analyze user requirements to define business objectives Define application objectives and functionality Develop and test software Identify and resolve any...

8+years of experience in data engineering, with a minimum of 2+ years in a leadership or lead capacity. Proven experience building and operating large-scale data platforms in a production environment. Track record of successfully delivering complex data projects from ideation to deployment. Educational Background : Bachelor's or Masters degree in Computer Science, Engineering, or a related technical field. Communications Excellent analytical, problem-solving, and critical thinking skills with meticulous attention to detail. Strong communication (written and verbal) and interpersonal skills, with the ability to collaborate effectively with cross-functional teams. Ability to work independently...

Role Description Spark/Python/Pentaho Developer. Need to workon Data Integration project. Mostly batch oriented using Python/Pyspark/Pentaho. Your key responsibilities Hands on Spark/Python/Pentaho programming experience Participating in agile development projects for batch data ingestion. Fast learner into order to understand the current data landscape and existing Python/Spark/Pentaho program to make enhancement. Stakeholder communication Contribute to all stages of software development lifecycle Analyze user requirements to define business objectives Define application objectives and functionality Develop and test software Identify and resolve any technical issues arising Create detailed ...

Job Summary: Leads projects for design, development and maintenance of a data and analytics platform. Effectively and efficiently process, store and make data available to analysts and other consumers. Works with key business stakeholders, IT experts and subject-matter experts to plan, design and deliver optimal analytics and data science solutions. Works on one or many product teams at a time. Key Responsibilities: Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues. ...

Cloud Observability Administrator JOB_DESCRIPTION.SHARE.HTML CAROUSEL_PARAGRAPH JOB_DESCRIPTION.SHARE.HTML Pune, India India Enterprise IT - 22685 about our diversity, equity, and inclusion efforts and the networks ZS supports to assist our ZSers in cultivating community spaces, obtaining the resources they need to thrive, and sharing the messages they are passionate about. Cloud Observability Administrator ZS is looking for a Cloud Observability Administrator to join our team in Pune. As a Cloud Observability Administrator, you will be working on configuration of various Observability tools and create solutions to address business problems across multiple client engagements. You will levera...

What you’ll do Work with business stakeholders to understand their business needs. Create data pipelines that extract, transform, and load (ETL) from various sources into a usable format in a Data warehouse. Clean, filter, and validate data to ensure it meets quality and format standards. Develop data model objects (tables, views) to transform the data into unified format for downstream consumption. Expert in monitoring, controlling, configuring, and maintaining processes in cloud data platform. Optimize data pipelines and data storage for performance and efficiency. Participate in code reviews and provide meaningful feedback to other team members. Provide technical support and troubleshoot ...

What you’ll do Collaborate with ZS internal teams and client teams to shape and implement high quality technology solutions that address critical business problems Develop a deep understanding of the business problems and effectively translate them into technical designs Lead modules and workstreams within projects while participating in hands on implementation Work with technical architects to validate the technical design and implementation approach Apply appropriate development methodologies and best practices to ensure exceptional client and project team experience Support the project lead in project delivery, including project planning, people management, staffing, and risk mitigation M...

Description: Job Description: We are looking for an experienced Python Data Engineer with a strong background in Python, Pandas, AWS, and SQL to join our data engineering team. The ideal candidate should be passionate about building robust data pipelines, optimizing data workflows, and working on scalable cloud-based data solutions. Requirements: Required Skills: 5.5 to 8 years of hands-on experience in Python programming with strong expertise in Pandas for data manipulation. Solid understanding and experience with AWS cloud services (such as S3, Lambda, Glue, Redshift, Athena, etc.). Proficient in SQL with experience in querying and optimizing large datasets. Good understanding of data ware...

Front-End Development: Design and implement responsive, user-friendly interfaces using Modern frameworks (e.g.,React, Angular). Collaborate with designers to translate Figma/wireframes into functional code. Back-End Development:Develop robust, secure, and scalable back-end services using technologies like Node.js, Python. Create and maintain RESTful APIs for seamless data exchange between client and server. Database Management:Design & implement SQL and NoSQL (e.g. MongoDB, DynamoDB) databases. Optimize queries for performance and scalability. Cloud and Deployment:Manage cloud platforms (e.g., AWS, Azure). Use containerization tools like Docker and orchestration tools like Kubernetes for dep...