14139 Data Engineering Jobs - Page 14

About The Role Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert req...

About The Role Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert req...

About The Role Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert req...

Data Pipeline Development Design develop and maintain efficient reliable and reusable ETLELT pipelines using DBT Snowflake and related technologies Data ModelingBuild and optimize data models star snowflake schemas to support analytical and reporting use cases ensuring data quality accuracy and performance Data Integration Integrate data from multiple sources APIs databases SaaS platforms cloud storage into Snowflake using modern data ingestion tools and frameworks Performance Optimization Tune SQL queries manage compute resources and optimize Snowflake performance for scalability and cost efficiency Data Governance QualityImplement data validation testing and monitoring processes to ensure ...

About The Role Role Purpose The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions. Do 1. Managing the technical scope of the project in line with the requirements at all stages a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends b. Develop record management process and policies c. Build and maintain relationships at all levels within the client base and understand their requirements. d. Providing sales data, proposals, data insights and account reviews to the c...

About The Role Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client que...

About The Role Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert req...

About The Role Role Purpose The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions. Do 1. Managing the technical scope of the project in line with the requirements at all stages a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends b. Develop record management process and policies c. Build and maintain relationships at all levels within the client base and understand their requirements. d. Providing sales data, proposals, data insights and account reviews to the c...

About The Role Role Purpose The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions. Do 1. Managing the technical scope of the project in line with the requirements at all stages a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends b. Develop record management process and policies c. Build and maintain relationships at all levels within the client base and understand their requirements. d. Providing sales data, proposals, data insights and account reviews to the c...

About The Role Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert req...

About The Role Role Purpose The purpose of this role is to develop minimum viable product (MVP) and comprehensive AI solutions that meet and exceed client?¢??s expectations and add value to business. Do Manage the product/ solution development using the desired AI techniques Lead development and implementation of custom solutions through thoughtful use of modern AI technology Review and evaluate the use cases and decide whether a product can be developed to add business value Create the overall product development strategy and integrating with the larger interfaces Create AI models and framework and implement them to cater to a business problem Draft the desired user Interface and create AI ...

About The Role We are seeking an experienced Site Reliability Engineer (SRE) with strong expertise in GCP Cloud Engineering and DevOps practices. The role involves designing, building, and maintaining reliable, scalable, and secure cloud infrastructure, with additional exposure to GCP data products. Location - Bangalore / Experience - 6 - 10 Years Core Expertise o GCP Cloud, Terraform (IaC), Jenkins, GitHub, Harness o CI/CD pipeline design and automation o Kubernetes (GKE/OpenShift) o Python scripting for automation ?¢ Good to Have o Familiarity with IDE platforms (e.g., Backstage IDP) o Understanding of GCP Data ProductsCloud SQL, GCS, Pub/Sub, Dataflow, BigQuery, Vertex AI Experience ?¢ 5+...

About The Role Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFP?¢??s received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology...

We are looking for a skilled Data Engineering Manager with 8 to 13 years of experience to lead our team in designing, developing, and optimizing scalable data pipelines and infrastructure. This position is based in Hyderabad. Roles and Responsibility Lead a team of data engineers to design, develop, and optimize scalable data pipelines and infrastructure. Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines for efficient data processing and integration. Build and maintain scalable, fault-tolerant data architectures ensuring efficient data storage, retrieval, and processing across cloud and on-premises environments. Oversee the design, implementation, and performanc...

Position Description: Over 5+ years of experience in provisioning, operations, and management of AWS environments Demonstrated competency with the following AWS services: ECS, EC2, ECR, S3, RDS, VPC, IAM, QuickSight, CloudFront, CloudFormation, CloudWatch, SQS, ElastiCache, Lambda, Glue ETL , Dynamodb , Neptune , route53 , Application Load balancers , ECS , SQS Experience with Automating Testing and deployment pipelines using devops tools such as Jenkins Strong Data Engineering background with the ability to implement Spark based or AWS Lambda based or glue based ETL jobs Knowledge of operating system administration Experience in creation of highly automated infrastructures Comprehensive kno...

Snowflake Developer ADF Developer ADF & Snowflake (2- 4 Years Experience) Key Technologies Azure Data Factory (ADF), Snowflake, SQL, Azure Services Job Summary We are seeking a motivated and detail-oriented Data Engineer with 2- 4 years of experience in Azure Data Factory and Snowflake SQL to join our growing data engineering team. You will be responsible for building, maintaining, and optimizing data pipelines and integrating data from various sources to Snowflake. The ideal candidate has hands-on experience in developing ETL/ELT processes using ADF and writing efficient Snowflake SQL queries. Key Responsibilities : Design, develop, and maintain scalable data pipelines using Azure Data Fact...

KEY Responsibilities: Participate in requirements gathering, database design, testing and production deployments. Analyse system/application requirements and design innovative solutions. Translating business requirements to technical specifications?data streams, data integrations, data transformations, databases, data warehouses & data validation rules. Design and develop SQL Server database objects (i.e., tables, views, stored procedures, indexes, triggers, constraints, etc.) Understand design and develop apache spark notebooks in Azure databricks . Analyze and design data flow, data lineage mapping and data models. Optimize, scale and reduce the cost of analytics data platforms for multipl...

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or similar role. S...

We are looking for a highly skilled and experienced Senior Lead Software Engineer to join our team As an Lead Software Engineer you will be responsible for designing and overseeing the construction of buildings and structures Your main goal will be to ensure that all projects are completed on time within budget and meet the client s specifications This is a full-time position and you will be required to work from the clients office The ideal candidate will have at least 6 years of work experience in the field of architecture and a strong understanding of building codes and regulations You should also have excellent communication and project management skills as you will be working closely wi...

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or similar role. S...

3+ years of experience in a data engineering or related role, managing complex data workflows and large-scale datasets. Expertise in SQL, with the ability to write, optimize, Required Candidate profile Proficiency in Python, including libraries like Pandas, PySpark, and others used for data manipulation and processing. Experience with big data tools such as Apache Spark,

Required qualifications to be successful in this role: Responsibilities:Administer and maintain Databricks workspaces, clusters, jobs, and user access Monitor performance and usage metrics to optimize cost and efficiency Implement and manage CI/CD pipelines for notebooks and jobs Ensure platform security, compliance, and governance (including Unity Catalog and access controls) Collaborate with data engineering and DevOps teams to streamline workflows Troubleshoot and resolve platform issues, ensuring high availability Stay updated with Databricks releases and recommend upgrades or improvements Required Skills 5+ years of experience in cloud data platforms, with at least 4+ years hands-on in ...

We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience in the Big Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more. Key Responsibilities Design, develop, and maintain scalable data pipelines and big data solutions Implement data transformations using Spark, Snowflake (Snowpark), Pig, and Sqoop Process large data volumes from diverse sources using Hadoop ecosystem tools Build end-to-end data workflows for batch and streaming pipelines Optimize data storage and retrieval processes in HBase, ...

About The Role We are seeking a skilled and detail-oriented Data Engineer to join our team You will be responsible for designing, developing, and maintaining scalable ETL pipelines, optimizing data infrastructure, and ensuring data integrity through governance best practices This role involves working closely with quantitative teams and developers to build robust data solutions while leveraging cutting-edge big data technologies and cloud platforms Key Responsibilities Design, develop, and maintain scalable ETL pipelines for multi-scale datasets Architect and optimize high-performance data pipelines for seamless data flow and transformation Implement data quality checks and governance proces...

About us: Working at Tech Holding isnt just a job, its an opportunity to be a part of something bigger We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients Our founders and team members have industry experience and have held senior positions in a wide variety of companies- from emerging startups to large Fortune 50 firms- and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability We are looking for talented Data Engineer to join our team As a Data Engineer, you will be responsible for de...