14025 Data Engineering Jobs - Page 10

Position Description: Over 5+ years of experience in provisioning, operations, and management of AWS environments Demonstrated competency with the following AWS services: ECS, EC2, ECR, S3, RDS, VPC, IAM, QuickSight, CloudFront, CloudFormation, CloudWatch, SQS, ElastiCache, Lambda, Glue ETL , Dynamodb , Neptune , route53 , Application Load balancers , ECS , SQS Experience with Automating Testing and deployment pipelines using devops tools such as Jenkins Strong Data Engineering background with the ability to implement Spark based or AWS Lambda based or glue based ETL jobs Knowledge of operating system administration Experience in creation of highly automated infrastructures Comprehensive kno...

Snowflake Developer ADF Developer ADF & Snowflake (2- 4 Years Experience) Key Technologies Azure Data Factory (ADF), Snowflake, SQL, Azure Services Job Summary We are seeking a motivated and detail-oriented Data Engineer with 2- 4 years of experience in Azure Data Factory and Snowflake SQL to join our growing data engineering team. You will be responsible for building, maintaining, and optimizing data pipelines and integrating data from various sources to Snowflake. The ideal candidate has hands-on experience in developing ETL/ELT processes using ADF and writing efficient Snowflake SQL queries. Key Responsibilities : Design, develop, and maintain scalable data pipelines using Azure Data Fact...

KEY Responsibilities: Participate in requirements gathering, database design, testing and production deployments. Analyse system/application requirements and design innovative solutions. Translating business requirements to technical specifications?data streams, data integrations, data transformations, databases, data warehouses & data validation rules. Design and develop SQL Server database objects (i.e., tables, views, stored procedures, indexes, triggers, constraints, etc.) Understand design and develop apache spark notebooks in Azure databricks . Analyze and design data flow, data lineage mapping and data models. Optimize, scale and reduce the cost of analytics data platforms for multipl...

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or similar role. S...

We are looking for a highly skilled and experienced Senior Lead Software Engineer to join our team As an Lead Software Engineer you will be responsible for designing and overseeing the construction of buildings and structures Your main goal will be to ensure that all projects are completed on time within budget and meet the client s specifications This is a full-time position and you will be required to work from the clients office The ideal candidate will have at least 6 years of work experience in the field of architecture and a strong understanding of building codes and regulations You should also have excellent communication and project management skills as you will be working closely wi...

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or similar role. S...

3+ years of experience in a data engineering or related role, managing complex data workflows and large-scale datasets. Expertise in SQL, with the ability to write, optimize, Required Candidate profile Proficiency in Python, including libraries like Pandas, PySpark, and others used for data manipulation and processing. Experience with big data tools such as Apache Spark,

Required qualifications to be successful in this role: Responsibilities:Administer and maintain Databricks workspaces, clusters, jobs, and user access Monitor performance and usage metrics to optimize cost and efficiency Implement and manage CI/CD pipelines for notebooks and jobs Ensure platform security, compliance, and governance (including Unity Catalog and access controls) Collaborate with data engineering and DevOps teams to streamline workflows Troubleshoot and resolve platform issues, ensuring high availability Stay updated with Databricks releases and recommend upgrades or improvements Required Skills 5+ years of experience in cloud data platforms, with at least 4+ years hands-on in ...

We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience in the Big Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more. Key Responsibilities Design, develop, and maintain scalable data pipelines and big data solutions Implement data transformations using Spark, Snowflake (Snowpark), Pig, and Sqoop Process large data volumes from diverse sources using Hadoop ecosystem tools Build end-to-end data workflows for batch and streaming pipelines Optimize data storage and retrieval processes in HBase, ...

About The Role We are seeking a skilled and detail-oriented Data Engineer to join our team You will be responsible for designing, developing, and maintaining scalable ETL pipelines, optimizing data infrastructure, and ensuring data integrity through governance best practices This role involves working closely with quantitative teams and developers to build robust data solutions while leveraging cutting-edge big data technologies and cloud platforms Key Responsibilities Design, develop, and maintain scalable ETL pipelines for multi-scale datasets Architect and optimize high-performance data pipelines for seamless data flow and transformation Implement data quality checks and governance proces...

About us: Working at Tech Holding isnt just a job, its an opportunity to be a part of something bigger We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients Our founders and team members have industry experience and have held senior positions in a wide variety of companies- from emerging startups to large Fortune 50 firms- and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability We are looking for talented Data Engineer to join our team As a Data Engineer, you will be responsible for de...

3-5 years of experience in Data Engineering or similar roles Strong foundation in cloud-native data infrastructure and scalable architecture design Build and maintain reliable, scalable ETL/ELT pipelines using modern cloud-based tools Design and optimize Data Lakes and Data Warehouses for real-time and batch processing

Role : Data Engineer Experience : 10 to 20 Yrs Key Responsibilities: Serve as the point of contact and subject matter expert for all Databricks-related activities, including architecture, development, and operational best practices. Should work closely with Sales team, propose data roadmap to prospects intending to migrate to cloud, create proof of concepts to showcase our expertise. Design, develop, and manage ETL/ELT pipelines in Databricks using Python (PySpark), integrating various data sources to support business operations. Leverage Unity Catalog to ensure data lineage, security, and governance are properly managed across the Databricks environment. Implement and maintain CI/CD pipelin...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Analytics Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:?¢Architecture, design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies?¢Mentoring of more junior team members and supporting their personal development ?¢Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & ...

About The Role Project Role : Program/Project Management Lead Project Role Description : Manage overall delivery of a program or project to achieve business outcomes. Define project scope and monitor execution of deliverables. Communicate across multiple stakeholders to manage expectations, issues and outcomes. Must have skills : Program Project Management Good to have skills : Microsoft SQL Server, Product Development Management, Microsoft Azure Data Services Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Program/Project Management Lead, you will manage the overall delivery of a program or project to achieve business outco...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather requirements, developing application features, and ensuring that the solutions align w...

About the Role - We are seeking a highly skilled and experienced Senior Data Architect to join our growing data engineering team. - As a Senior Data Architect, you will play a critical role in designing, developing, and implementing robust and scalable data solutions to support our business needs. - You will be responsible for defining data architectures, ensuring data quality and integrity, and driving data-driven decision making across the organization. Key Responsibilities - Design and implement data architectures for various data initiatives, including data warehouses, data lakes, and data marts. - Define data models, data schemas, and data flows for complex data integration projects. - ...

Job Responsibilities : MDM Data Vault Design and Development : - Efficiently design and develop DBT-based data models and entities by understanding project requirements. - Implement Data Vault 2.0 architecture principles, including the creation of Hubs, Links, and Satellites for master data management (MDM). Data Warehousing : - Design, develop, and maintain robust data structures to facilitate efficient data processing, storage, and retrieval within an enterprise data warehouse (Snowflake). - Collaborate with data architects to ensure data warehousing solutions align with business needs and scalability requirements. SQL Development : - Create, debug, and optimize stored procedures, function...

Job Responsibilities : Data Governance Expertise : - Develop and maintain comprehensive data governance strategies to ensure data quality, security, and compliance. - Establish and implement policies, standards, and guidelines related to data governance, data stewardship, and data quality management. - Lead initiatives to enhance data governance capabilities including data catalog, data dictionary, business lineage, technical lineage, and stewardship workflows. Data Catalog Management : - Configure, maintain, and optimize data catalog tools such as Alation, Collibra, Informatica, or similar platforms. - Ensure accurate metadata management and data lineage tracking across various systems. - C...

We are seeking a skilled Data Engineer with strong experience in SQL, PySpark, and cloud technologies to join our dynamic team. The ideal candidate will have a solid background in designing and implementing data engineering pipelines, with a focus on performance, scalability, and reliability. You will work closely with other data engineers, data scientists, and stakeholders to develop, maintain, and optimize data infrastructure. Key Responsibilities : SQL Development : - Write medium-complexity SQL queries to extract, transform, and load data efficiently. - Optimize SQL queries for performance and scalability. - Collaborate with team members to understand data requirements and translate them...

Skills: data scientist, py torch, SQL, python, scala, aws, ML,. Position:Data Scientist. Location:Chennai/ Mumbai/ Pune. Experience:5-10 years. Job Type:Permanent. Qualifications. D. 3+ years of experience in data science with a focus on recommendation systems. Strong knowledge of machine learning algorithms, including supervised and unsupervised methods. Proficiency in programming languages such as Python, R, or Scala and SQL. Experience with any of the popular libraries like scikit-learn, XGBoost, TensorFlow, or PyTorch is highly desirable. Experience working in cloud environments (GCP/AWS). Familiarity with data modeling and data engineering techniques. Familiarity with ML Ops concepts an...

Location: Bangalore Experience: 3 - 6 Years CTC: 10 - 24 LPA Notice Period: Immediate to 15 Days Role Overview We are seeking a Data Engineer (Core) Implementation Specialist to design, build, and implement robust data solutions that support business and analytics needs. In this role, you will work closely with stakeholders to translate business requirements into scalable data pipelines and reliable data models. You will play a hands-on role across the data implementation lifecycleright from ingestion and transformation to deployment and post-go-live supportensuring high data quality, performance, and reliability across platforms. Key Responsibilities Design, build, and implement data pipeli...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

We are currently considering only candidates based in Bangalore who can attend in-person interviews. We're open to considering candidates with 6 to 12 years of experience, provided you are a hands-on coder with strong technical skills. The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support the next evolutionary stage of the Investment Process. They build robust data pipelines, optimize data storage, and access patterns, and ensure data quality while collaborating across engineering teams to deliver high-value data products Key Responsibilities • Implement and maintain data pipelin...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...