10148 Data Engineering Jobs - Page 20

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to design, build and deploy highly secure and performant data engineering solutions You will analyze the requirements and specifications to understand the client requirements in a detailed manner and translate them into production grade data applications that meet the client requirements. You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey If you think you fit righ...

Educational Requirements Bachelor of Engineering Service Line Quality Responsibilities Assess the complete ML development process.- Data Engineering- Evaluate the maturity level of ML systems. - Software Development- Provide recommendations for improvement - DevOps- Implement and maintain CI/CD pipelines for ML models. - Monitor and manage model performance in production. Technical and Professional Requirements: 3+ years in MLOps or related roles - Data Science- Hands-on experience with ML model deployment and monitoring - System Administration- Proven track record of implementing CI/CD pipelines - Automation Tools- Experience with version control systems (Git). Preferred Skills: Technology-...

Were looking for an experienced professional passionate about building data-driven learning experiences. Required Skills: Azure Data Factory, Databricks, Synapse, SQL, Python, Data Modelling, ETL/ELT Processes, and Data Warehousing Concepts. Health insurance Provident fund Annual bonus

About QX: The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights, businesses will continue to face challenges to better understand their customers and even lose them; Secondly, without insights businesses won't be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization. Job Summary: We are seeking a...

As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that th...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed Required Candidate profile Minimum requirement of 5 years of relevant work experience. Typically reflects 7 years or more of relevant experience. Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.

Data Engineer to build and manage data pipelines that support batch and streaming data solutions. The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc. Responsibilities: Strong experience in develop, test, and maintain data pipelines (batch & stream) using Cloudera, Spark, Kafka and Azure services like ADF, Cosmos DB, Databricks, NoSQL DB/ Mongo DB etc. Strong programming skills in spark, python or scala & SQL. Optimize data pipelines to improve speed, performance, and reliability, ensuring that data is available for data consumers as required. Create ETL pipelin...

Primary Responsibilities: Responsible for large and more complex components, while influencing overall Data architecture and patterns Implements component design in line with pre-defined team architectural patterns Creates design documents, for larger component work to gain alignment Delivers designs aligning to appropriate componentized architectures and integration patterns Can work autonomously Influences the team designs and solutions. Mentors software engineers through code reviews, and hands-on design sessions Code reviews are appropriately broken down in to reviewable chunks Contributes meaningfully to code reviews of teams work, providing collaborative guidance in areas of strength C...

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

GCP Data Engineer Primary Skill : Big Querry, Data flow, Data Composer, SQL, Python, Pyspark Proven experience as a Data Engineer with a focus on GCP services. Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub. Hands-on experience with Terraform for provisioning and managing GCP infrastructure. Proficiency in Pyspark, SQL and Python for data manipulation and analysis. Solid understanding of data warehousing concepts and ETL processes. Experience with real-time data processing and streaming analytics. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills.

Experienced Azure Data Engineer Tech Lead ( Tech Lead ) with 7 to 10 years of expertise Design, develop, and maintain robust data pipelines using Azure Databricks, Azure Data Factory,Pyspark / Python, Azure Data Lake Gen2, and Azure SQL Database. Integrate and manage data from various source systems, ensuring data quality and consistency. Mandatory Skills :Azure Databrick + Pyspark + Azure Data Facory + SQL +CICD + Strong Coding skills.

GCP Data Engineer Primary Skill : Big Querry, Data flow, Data Composer, SQL, Python, Pyspark Proven experience as a Data Engineer with a focus on GCP services. Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub. Hands-on experience with Terraform for provisioning and managing GCP infrastructure. Proficiency in Pyspark, SQL and Python for data manipulation and analysis. Solid understanding of data warehousing concepts and ETL processes. Experience with real-time data processing and streaming analytics. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills.

Description: JOB DESCRIPTION Applied Innovation Exchange AI Solutions Architect Capgeminis Applied Innovation Exchange (AIE) is a global platform for innovation bringing together a framework for action a network of exchanges and a rich and diverse ecosystem of experts startups alliance partners and Capgeminis own capabilities to deliver the pinnacle innovation engagement experience. We are seeking an experienced Solutions Architect/Innovation Solution Architect with a strong background in data and AI Gen AI and Immersive experience technologies to join our dynamic team. As a Solutions Architect you will be responsible for driving customers' data and AI solutions Horizon 1 and Horizon 2 techn...

6 + years of overall IT experience in Telecom OSS especially in Assurance domain Solution, design, and Implementation - Strong Knowledge of Telecom OSS domain, with excellent experience Service Now for Assuance - Knowledge and experience on Big Data,Data lake solution, KAFKA , Hadoop/Hive. - Experience on Python (pyspark) is essential. - Implementation experience in continuous integration and delivery philosophies and practices specifically on Docker, Git, JenKins - Self driven and highly motivated candidate for a client facing role in a challenging environment

Role & responsibilities Design and build a scalable data platform that can ingest, store, manage and stream massive amounts of data while simplifying its analysis and processing to enable rapid development of high-quality data products and services. •Implement and test robust low latency data pipelines for preparing/curating data that will support various data as a service product. •You will work with various cross functional teams to explore data and figure out all the data wrangling needed to clean, curate the data and build the end-to-end data pipeline per requirements. •You will design necessary privacy and security preventive and detective controls into the CICD pipelines of each data p...

RoleAdvanced Data Engineer , LocationHyderabad Hire TypeFulltime Tech Stack: Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real time data processing experience/frameworks, Cloud experience (Azure preferred) About The Role Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure] Experienced in migrating data from on-prem to cloud-based solution architectures [Azure] Extensive experience with Python, Spark and SQL Experience in developing ETL processes. Proficient with Azure Data Lake, ...

Description Experience in following technologiesHadoop Spark Hive Pig SQL query experience in data application development at scale in the Hadoop ecosystem. Bigdata Spark kafka Java/python/scala Hadoop hive design and architecture problem solving skills Roles and responsibilities Drive the technical design of large scale data platforms utilizing modern and open source technologies. Set standards for data engineering functions; design templates for the data management program which are scalable repeatable and simple Serve as a consultant on all aspects of data engineering analytics and data projects Be able to consult on complex data engineering efforts and lead project teams through the solu...

Description Basic Skills: Strong expertise in cloud platforms engineering on GCP or Proficient in Google Cloud Platform (GCP) services. Primary proficiency in Python and experience with a secondary language such as Golang Proven ability to manage codebases and configurations effectively. Key Skills for the role Proficiency in Terraform or similar IaC tools. Experience in implementing and maintaining CICD pipelines. Understanding of containerization (Docker Kubernetes). Experience with monitoring and optimizing cloud resources. Strong problem-solving skills and the ability to work collaboratively with teams. Familiarity with data engineering and ETL processes. Design experience with Service o...

Description Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and processing. Utilize Python and PySpark to develop and optimize data workflows. Leverage AWS services such as S3 Redshift Glue Kinesis and Lambda for data storage processing and analytics. Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Ensure data quality i...

Description The position involves working within our CX Program Implementation team with a focus on building the surveys and reporting. Your day would include working with the business analyst to understand CX requirements shared by the stakeholders and work with the implementation team to develop solutions. The role requires a creative thinker who can solve problems through innovative technology solutions while supporting the development of customer experience programs. Responsibilities ? Configure the Medallia surveys and reporting setup as per the requirements shared by the Business Analyst. ? Build Auto Importers for the new survey programs. ? Conduct file inflow reviews to understand th...

To continue modernizing our fax infrastructure, we must transition the Production B workflow environment supporting 294 groups and thousands of end-user accounts-each with unique workflows. This transition involves migrating business processes from one platform to another, requiring close collaboration with business users to ensure their workflows are adapted without adding extra steps or time. The ideal candidate will not only support this transition but also identify opportunities to streamline operations using AI. This includes replacing manual steps and reducing the need for users to review fax images before proceeding. Their insights will be critical in shaping the next phase of our fax...

Description Responsibilities Accountable for the end-to-end build and engineering of the production ML / AI application taking a prototype model from the data scientists and developing a production-ready application using appropriate tools and technologies to deploy using AWS cloud. Accountable for the successful development resilience and reliability of the analytical model scoring application pipelines. Follow the established patterns to make the ML / AI models ready for deploy to pre-prod and prod environments with MLOps engineers. Study and transform data science prototypes understanding the requirements and designing the application. Understand the container environments for where these...

Job Title: Principal Engineer - Cloud Architect Location: Bengaluru Position Description: Coming up with technical solution leveraging the cloud infrastructure Design solutions that are scalable, cloud architecture compliant Technically lead the team to ensure on time delivery with good quality Inculcate effective coding practices and improve performance of team through coaching and guidance Collaborate with product management to understand the user needs and contribute to the design of application Collaborate with department architecture team to propose and review architectural solutions/designs created by self What you will do: Design and implement cloud-based applications and services rel...