661 Data Engineer Jobs - Page 13

Hiring, Data Engineer 4+ years of hands-on experience Experience in building and optimizing Big Data data pipelines, architectures, and data sets. Experience with big data tools: Hadoop, Spark Optimization, Spark-Streaming, Hive, Kafka, Hbase, Airflow, etc. Hands-on in SQL

Role & responsibilities Azure Data Engineer involved in all stages of the development life cycle, through requirements analysis, coding, unit testing, system testing, UAT and warranty-support. Analyzing data sets and designing and coding stable and scalable data pipelined also integrating into existing data pipelines. Ensure timely delivery of systems that meet functional requirements by performing comprehensive unit testing. Implement processes and tools to ensure data quality and reliability. Review, refactor, and debug code to identify and resolve defects, improve performance, and address technical debt. Provide technical support and troubleshooting assistance for developed systems, ensur...

ob Description Fabric Data Engineer Experience: 5–7 years We are seeking a skilled and motivated Fabric Data Engineer to join our data engineering team. The ideal candidate will have strong proficiency in SQL and PySpark for data wrangling, transformation, and modeling, along with solid experience working in Microsoft Azure environments . Familiarity with Power BI for data visualization and analytics is highly desirable. You will play a key role in building robust data pipelines and scalable solutions that support business intelligence and advanced analytics initiatives . Mandatory Skills: Microsoft Fabric SQL PySpark Nice to Have: Power BI

LOOKING FOR IMMEDIATE/ EARLY JOINERS ONLY. Role: Lead Data engineer Location: Bengaluru Mode: 5 days work from office (Alternate Saturday work from home) Budget: 20 LPA- 30 LPA Max. A Data Engineer with PySpark experience develops, maintains, and optimizes scalable data pipelines and infrastructure, focusing on data extraction, transformation, and loading (ETL/ELT) processes using PySpark, Python, and SQL. ETL/ELT Process Optimization Data System Design Data Quality & Integrity Collaboration Performance Optimization Essential Skills & Qualifications: Programming Languages : Proficiency in Python and advanced SQL PySpark : Strong hands-on experience with PySpark, DataFrames, RDDs, and SparkSQ...

Role & responsibilities Bachelors or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical field. 7+ years of experience in data engineering, solution architecture, or enterprise data management roles. 5+ years of experience leading delivery of complex data integration or analytics solutions in a cloud environment (GCP, AWS, or Azure). 5+ years of hands-on experience in data modeling, database design, and architecture (dimensional, normalized, and canonical modeling). Expertise in cloud-native data architecture, particularly with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, Cloud Composer). Deep understanding of ETL/ELT frameworks, ba...

Data_and_MLOps_Engineer - Contract - onsite Experience within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres, with expertise in leveraging these tools for data processing, storage, and analytics tasks. Proficiency in data preprocessing and cleaning large datasets efficiently using Azure Tools, Python, and other data manipulation tools. Strong background in Data Science/MLOps, with hands-on experience in DevOps, CI/CD, Azure Cloud computing, and model monitoring. Expertise in healthcare data standards, such as HIPAA and FHIR, with a deep understanding of sensitive data handling and data masking techniques to protect PII and PHI. In-depth knowledge of search...

Bachelors or masters degree in Computer Science, IT, or related field. 5+ years of data engineering experience, including 1+ years on Azure Data Platform. Strong proficiency in Azure Data Factory, Azure Fabric, and Notebooks (PySpark/Python/SQL). Expertise in Delta Lake, Parquet, and modern data lakehouse architectures. Experience with Azure Synapse Analytics, Databricks (if applicable), and data visualization tools such as Power BI. Skilled in SQL, Python, and PySpark for large-scale data transformations. Experience implementing CI/CD for data pipelines and notebooks using Azure DevOps or Git. Knowledge of data governance, security best practices, and compliance frameworks. If youre ready t...

Key Skills: Google Cloud Platform, Data Engineer, Data Engineering Roles and Responsibilities: Design and implement scalable data pipelines and ETL/ELT workflows using GCP-native tools. Develop and optimize relational and non-relational databases for performance and reliability. Build and manage data lakes and warehouses using BigQuery, Cloud Storage, and Dataproc. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. Ensure data governance, security, and compliance with industry standards. Lead architectural discussions and mentor junior engineers. Hands-on experience with GCP services: BigQuery, Dataflow, Dataproc, Cloud Storage, Clou...

Key Skills: Azure, Data Engineer Roles and Responsibilities: Design and implement scalable data pipelines and ETL/ELT processes using Azure Data Factory Develop and optimize relational and non-relational databases for performance, scalability, and reliability Build and manage data lakes and data warehouses using Azure Synapse Analytics , Data Lake Storage , and SQL-based solutions Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions Ensure data governance, security, and compliance with industry standards Lead architectural discussions and mentor junior engineers Utilize strong proficiency in SQL and database design including Azure SQL ,...

Key Skills: AWS, Data Engineer Roles and Responsibilities: Architect and develop data pipelines using AWS services. Design and optimize relational and non-relational databases. Implement ETL/ELT processes using AWS Glue, Lambda, and other tools. Manage data lakes and warehouses (e.g., S3, Redshift, Athena). Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions. Ensure data quality, security, and compliance with governance standards. Mentor junior engineers and contribute to architectural decisions. Hands-on experience with AWS services: AWS Glue, Redshift, S3, Lambda, EMR, Athena, Lake Formation. Proficiency in Python, PySpark for data processing. Ex...

Key Skills: PostgreSQL, PostgreSQL database, Data Engineer, Data Engineering Roles and Responsibilities: Design, install, configure, and maintain PostgreSQL database systems. Perform database tuning, optimization, and capacity planning. Implement backup and recovery strategies, including disaster recovery planning. Monitor database performance and proactively address issues. Ensure database security, compliance, and access control. Collaborate with development and infrastructure teams to support application requirements. Automate routine tasks and improve operational efficiency. Lead database migration and upgrade projects. Skills Required: Strong expertise in PostgreSQL database administrat...

Americana Restaurants International PLC is a pioneering force in the MENA region and Kazakhstan's Out-of-Home Dining industry, and ranks among the world's leading operators of Quick Service Restaurants (QSR) and casual dining establishments. With an extensive portfolio of iconic global brands and a dominant regional presence, we have consistently driven growth and innovation for over 60 years. Our expansive network of 2,600+ restaurants spans 12 countries throughout the Middle East, North Africa, and Kazakhstan from Kazakhstan in the east to Morocco in the west powered by a team of over 40,000+ talented individuals committed to delivering exceptional food, superior service, and memorable exp...

As a senior Data Engineer at Papigen, you will play a crucial role in leading the data and dashboard setup for a centralized sovereign and country risk DataMart. Your responsibilities will include designing and implementing modern cloud-based data solutions, collaborating with global teams, and ensuring the delivery of high-impact analytical and reporting capabilities. You will lead the data analysis, data repository design, and data architecture for the centralized data platform. Collaborating closely with business teams, you will gather requirements, document data flows, and identify value-driven data solutions. Your expertise in designing ETL workflows and building scalable, high-performa...

Skills ADF, Azure Data Lake , Databrick, PySpark, SQL, Python. Need Immediate Joiners Contact Tanisha -9899025091 tanisha.batra@wsneconsulting.com Vrinda-9625997927 Vrinda.sahni@wsneconsulting.com Ishita -92891 17976 ishita.sarkar@wsneconsulting.com

Candidate Specification: Notice Period - Immediate joiner, 5 days 3+ years experience in Data Engineering Candidate with coding experience in Python Experience in Data brick and Pyspark. Candidate with good communication and coding knowledge. Contact Person - Deepikad Email id- deepikad@gojobs.biz

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Key Responsibilities Design, build, and manage scalable, reliable, and secure ETL/ELT data pipelines using tools such as Apache Spark, Apache Flink , Airflow, and Databricks. Develop and maintain data architecture, ensuring efficient data modeling, warehousing, and data flow across systems. Collaborate with data scientists, analysts, and business teams to understand data requirements and implement robust solutions. Work with cloud platforms (AWS, Azure, or GCP) to build and optimize data lake and data warehouse environments (e.g., Redshift, Snowflake, BigQuery ). Implement CI/CD pipelines for data infrastructure using tools such as Jenkins, Git, Terraform, and related DevOps tools. Apply dat...

Dear Candidates, Were Hiring :ETL Developer/Data Engineer Experience: 5.1 to 7 years Location- Mumbai (Hybrid) Notice Period: Immediate to 20 Days Interview Process: 2- 3 Rounds ( 2nd Round will be Face to Face-Mandatory ) Job description Develop and optimize ETL processes using Python, Oracle SQL, and any other ETL tools S hould have SSIS excellent working knowledge of SQL / PL-SQL Oracle and MS SQL DB Good to have conceptual knowledge on Machinelearning / ArtificialIntelligence . Knowledge and understanding of Agile development practices Behavioral: Structured, organized and a good communicator Willing to share knowledge and skills with other developers within the team Delivery-focused wit...

a . 2 + years experience in bigdata technologies like pyspark , hadoop , trino , druid b. Strong experience on query optimisation in trino /pyspark c. Strong hands on in Airflow / scheduler d. Expertise in python Role & responsibilities Preferred candidate profile Data Engineer Responsibilities: About the Role: H ands-on Data Engineers to build and maintain scalable data solutions and services . The role includes : a. Maintain , develop data engineering pipelines to ensure seamless data flow for BI applications b. Create data models to ensure seamless query system c. Develop or onboard opensource tools to make the data platform up to date d. Optimize queries and scripts over large-scale data...

Role & Responsibilities Excellent problem-solving skills with the ability to analyze business problems systematically and deliver effective right-sized solutions in a timely manner. Proven analysis and design/development skills on AWS platforms. Develop, Test, and Implement the changes following the Software Development Life Cycle methodologies and quality concepts. Technical Skills Strong knowledge on AWS Glue/Python/PySpark. Understanding of AWS data/automation services Step functions, Lambda, SNS, SQS. Hands-on experience in ETL projects. Good knowledge of data warehousing concepts. Good analytical and problem-solving skills. Experience in GIT code versioning tools. Strong knowledge of re...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evangelize modern d...

Job Description: 5+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python . Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git . Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazons Compute services like Amazon Lambda, Amazon EC2 and Amazon Storage service like S3 and few other services like SNS. Good to have knowledge of data warehousing concepts dimensions, facts, schemas-snowflake, star etc. Have worked with columnar storag...

Must-Have Skills: Strong experience with Google BigQuery data modeling, query optimization, performance tuning. Proficient in building and managing data pipelines and ETL/ELT workflows. Solid SQL skills and experience working with large datasets. Experience with Looker creating/modifying dashboards and LookML understanding. Experience with version control (e.g., Git) and CI/CD for data solutions. Ability to work in Agile environments and with remote teams. Good-to-Have Skills: Exposure to GCP services beyond BigQuery (e.g., Dataflow, Cloud Functions).

Role & responsibilities Develop and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Delta Lake). Design and optimize data models in AWS Redshift for performance and scalability. Manage Redshift clusters and EC2-based deployments, ensuring reliability and cost efficiency. Integrate data from diverse sources (structured/unstructured) into centralized data platforms. Implement data quality checks, monitoring, and logging across pipelines. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Required Skills & Experience: 36 years of experience in data engineering. Strong expertise in Databricks (Spark, Delta Lake, notebooks, job o...

Primary Responsibilities: Collaborate with cross-functional teams to understand business requirements and provide database solutions that support company objectives Work with software design and development teams in designing database architectures and data modelling, building database schemas, tables, procedures, and views Work with the system administrators for hardware and software installations and configurations Administer, monitor, and maintain Postgres SQL databases, ensuring their integrity, security, and high performance Design, implement, and maintain the database architecture, including high-availability and disaster recovery solutions Manage database environments within the cloud...