658 Data Engineer Jobs - Page 5

Description: 10+ years of relevant IT experience in the BI/DW domain with minimum 3 years of hands-on experience on Azure modern data platform that includes Data Factory Databricks Synapse (Azure SQL DW) and Azure Data Lake Meaningful experience of data analysis and transformation using Python/R/Scala on Azure Databricks or Apache Spark Well versed NoSQL data store concepts Good knowledge in Distributed Processing using Databricks (preferred) or Apache Spark Ability to debug using tools like Ganglia UI expertise in Optimizing Spark Jobs The ability to work across structured semi-structured and unstructured data extracting information and identifying linkages across disparate data sets Expert...

Skills Required: Strong proficiency in Pyspark , Scala , and Python Experience with AWS Glue Experience Required: Minimum 5 years of relevant experience Location: Available across all UST locations Notice Period: Immediate joiners

Hello, We are building a Data Architect team and are looking for passionate professionals to join us. Please find the details below: Role - Data Architect Location - Bengaluru Experience - 10+ years Duration - Permanent Notice Period - Immediate to 15 Days Role & responsibilities Technical skills: 3+ years experience with Snowflake Leveraged native Cortex and ML capabilities to build RAG solutions, chatbots, genAI infused pipelines etc. 3+ years of experience with Python 3+ years of Azure experience Advanced SQL skills 2+ years of Power BI (nice to have) GenAI/LLM/AI/ML This is a staff aug role and the individual should be able to assist with new projects as well as ad-hoc analytical request...

About Position: We are seeking a skilled Python Developer to join our dynamic software development team. Role: Data Engineer Location: All Persistent Locations Experience: 3 to 6 years Job Type: Full Time Employment What You'll Do: We are seeking a skilled Python Developer to join our dynamic software development team. In this role, you will be responsible for designing and implementing server-side logic, developing software components, integrating user-facing elements with server-side logic, and ensuring high performance and responsiveness to requests from the front-end. You will also be involved in improving the functionality of existing systems, debugging and troubleshooting, and collabor...

Job Title: ======= Microsoft ETL Developer - Microsoft SSIS / Informatica x5 positions Onsite Location: ============= Dubai, UAE Doha , Qatar Riyadh, Saudi Onsite Monthly Salary: ============== 10k AED - 15k AED Project duration: ============= 2 Years Initially, Extendable Desired Experience Level Needed: =========================== 4 - 8 Years Experience Needed: =============== Over all: 5 or more Years of total IT experience Solid 4+ Years experience or more - as ETL Developer with Microsoft SSIS / Informatica as ETL Developer Engineer Job Responsibilities: ================ - Design and develop ETL data flows - Design Microsoft ETL packages - Able to code T-SQL - Able to create Orchestrati...

As an experienced and highly skilled GCP Data Engineer, your role will involve designing, developing, and maintaining robust data pipelines and cloud-based solutions on Google Cloud Platform. You will collaborate closely with data analysts, architects, and stakeholders to build scalable and efficient data systems. Key Responsibilities: - Design, build, and maintain scalable ETL/ELT pipelines using GCP tools such as Cloud Dataflow, BigQuery, Cloud Composer, and Cloud Storage. - Develop and optimize data models for analytics and reporting using BigQuery. - Implement data quality, data governance, and metadata management best practices. - Collaborate with data scientists, analysts, and other en...

Job Summary About the Role We are looking to hire a dynamic and detail-oriented Azure Data Engineer with up to 4 years of experience to join our growing Data & Analytics team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures using modern Azure services. Key Responsibilities • Design and develop scalable and secure data pipelines using Azure Data Factory (ADF), ADLS, Azure Databricks.• Build and optimize data models and data flows in Azure Synapse Analytics. • Write optimized SQL and Python scripts to handle large-scale data transformation and validation. • Implement best practices for data integration, data quality, ...

Location - Borivali Work Pattern - 5 Days Work From Office 1st And 3rd Saturday Working We are seeking a driven and result-oriented Technical Recruiter to join our recruitment team. The ideal candidate will have strong experience in sourcing, screening, and placing candidates for technical roles across IT and engineering domains. You will work closely with hiring managers and clients to fulfill position requirements while ensuring a smooth recruitment process for candidates. Key responsibility - Develop and execute sourcing strategies to attract top technical talent through job boards, social media, networking, and referrals. Screen and evaluate candidates for technical skills, cultural fit,...

Data Reporting & Dashboarding team responsible for designing, developing, and maintaining interactive dashboards and data reports to support business decision-making. The team will focus on data lookup, validation, visualization, and performance reporting across multiple business domains. We are seeking professionals at different levels (A3B1) with strong skills in Power BI or Tableau , solid understanding of data analysis and reporting logic , and hands-on experience working with large datasets. Key Responsibilities: Develop and maintain interactive dashboards and reports using Power BI or Tableau . Perform data validation, quality checks, and consistency analysis to ensure accurate reporti...

You will be responsible for the end-to-end development and management of data integration modules using Informatica Cloud services. As an Informatica IICS data engineer, you will provide technical leadership and mentorship to junior team members. Your role will involve working on various projects involving IICS and ensuring all duties are performed in compliance with company policies, U.S. state and federal laws, and regulations. - Provide technical leadership and mentorship to junior team members - Work on end-to-end projects involving IICS - Ensure compliance with company policies and relevant laws and regulations - Develop and test complex mapping tasks and task flows - Collaborate with c...

Exp: Above 5 yrs Location: Bangalore(Electronic city) Mandatory to be check: ETL, Azure, Power App, Power Query, BI(power app and data engineer is mandatory)developer profile. - 2+ years in a systems analyst or technical analyst role. - Strong understanding of business processes, data workflows, and integrated systems. - Hands-on experience running, maintaining, troubleshooting, and fixing data pipelines. - Hands-on experience conducting and documenting testing. - Familiarity with Microsoft Power Platform (Power Apps, Power Automate). - Foundational understanding of SQL, data structures, and relational data. - Excellent communication and collaboration skills.

Role & responsibilities:- Job Summary:- We are seeking a highly skilled and motivated Data Engineer to join our Data, Reporting & Analytics team. The ideal candidate will have a strong background in data engineering, database design, SQL, excellent problem-solving skills, and a passion for working with large datasets to drive business insights and improve decision-making processes. The candidate should have extensive knowledge of data pipeline components in Azure or AWS, and have exposure to data warehousing. Skills & Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering. Proven Experience as a Data Engineering of b...

Role & responsibilities Job Details : Position : AWS Data Engineer Experience : 7+ Years Location : PAN INDIA (currently Remote) Notice Period: Immediate to 15 Days (Only serving or served Notice Period) Must have your own Laptop Job Description: Data Engineer with a minimum of 7+ years of experience of data engineering experience. The role will require deep knowledge of data engineering techniques to create data pipelines and build data assets. At least 4+ years of Strong hands on programming experience with Pyspark / Python / Boto3 including Python Frameworks, libraries according to python best practices. Strong experience in code optimization using spark SQL and Pyspark. Understanding of ...

Microsoft Purview and azure Azure services Data governance, lineage tracking, regulatory mapping SQLdata analysis, reporting,validation Fintech, Asset Management, equities trading, fixed income instruments. Purview, Azure, Sql

Job Description:Key Responsibilities Work within Agile development teams, contributing to sprints and ceremonies. Apply data engineering best practices to ensure scalable, maintainable codebases. Develop solutions using Python and SQL. Understand and manipulate business data. Collaborate with cross-functional teams to deliver data solutions that meet business needs. Communicate effectively to gather requirements and present solutions. Follow best practices for data processing and coding standards. Skills Proficient in Python for data manipulation and automation. Must have Hands-on experience with orchestration and automation tools such as Snowflake Tasks and Streams. Strong experience with S...

Role & responsibilities Azure Cosmos DB (Mongo API): hands-on experience with schema design, query optimization, and partitioning strategies. Azure Blob Storage: efficient data storage, retrieval, and integration with pipelines. Azure Data Factory (ADF) or equivalent orchestration tools (e.g., Apache Airflow ) for ETL/ELT workflows. Azure AI Search: data indexing, hybrid search queries, and semantic query tuning. Python: data manipulation, ETL scripting, and integration with Azure SDKs. SQL & NoSQL data modeling: relational and document-based schema design. Query tuning & performance optimization: profiling queries, caching, and cost optimization in Azure. ETL/ELT pipeline design & automatio...

Work closely with clients to understand business needs, design data solutions, and deliver insights through end-to-end data management. Lead project execution, handle communication, documentation, and guide team members throughout. Required Candidate profile Must have hands-on experience with Python, ETL tools (Fivetran, StitchData), databases, and cloud platforms (AWS, GCP, Azure, Snowflake, Databricks). Familiarity with REST/SOAP APIs is essential.

Hi, We are hiring Senior Data engineer for our Client located at Chennai location. Hybrid mode. Job Overview: We are seeking an experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for Design and implement the data engineering framework. Responsibilities Strong Skill in Big Query, GCP Cloud Data Fusion (for ETL/ELT) and PowerBI. Need to have strong skill in Data Pipelines Able to work with Power BI and Power BI Reporting Design and implement the data engineering framework and data pipelines using Databricks and Azure Data Factory. Document the high-level design components of the Databricks data pipeline framework. Evaluate and document the curren...

Job description: Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements. www.irissoftware.com Title- Data Engineer Location- Pan india Notice: 15 Days OR Immediate joiners only Mode- remote Shift: 1:00 PM- 10:00 PM IST Key Responsibilities: Design, develop, and optimize complex data pipelines and transformation processes using Snowflake, dbt, and AWS services. Implement and manage dat...

We are hiring for- Role: Data Engineer Experience: 2-4 Years Location: Bangalore Mandatory Skills: Data Engineer, Python or Scalar, Pyspark, AWS, Performance tuning

We do have an opening for the role of AWS Data Engineer with in the MNC in IT Sector. Required Skills & Qualifications 5+ years of experience in data engineering with strong AWS expertise. Hands-on with AWS services such as Glue, EMR, Athena, Redshift, Lambda, S3, RDS, EC2, and VPC. Familiarity with CI/CD pipelines and DevOps practices for data deployments. Exposure to container orchestration (ECS, EKS, Kubernetes) and monitoring tools (CloudWatch, Prometheus, Grafana). Strong scripting skills in Python, Shell, or PowerShell. Experience: 5- 7 years Location: Bengaluru Electronic City Notice Period: 0- 30 Days Work Mode: Hybrid (4 days work from office out of 5 working days)

Greetings from Getronics! This is Narmadha from the Talent Acquisition Team. Please find below the company profile and Job Description. If interested, please share your updated resume, recent professional photograph and Aadhaar proof at the earliest to narmadha.baskar@getronics.com Company : Getronics (Permanent role) Client : Automobile Industry Experience Required : 4+ Years in IT and minimum 3+ years in GCP Data Engineering Location : Chennai Work Mode : Hybrid Responsibilities As a Data Engineer (Elasticsearch Specialist) , - You will design, build, and optimize data pipelines that feed into Elasticsearch clusters, enabling high-performance search and analytics. - You will be responsible...

Python + SQL experts in the Digital Marketing domain within the Data & Analytics space typically play a critical role in driving data-informed marketing strategies. Heres a breakdown of their role and responsibilities : Role Overview: These professionals analyse digital marketing data using Python and SQL to extract insights, optimize campaigns, and support decision-making. They serve as the bridge between raw marketing data and actionable business intelligence. Key Responsibilities: Data Extraction & Transformation: Use SQL to query large marketing databases (e.g., from Google Analytics, ad platforms, CRMs). Clean, transform, and prepare datasets using Python (Pandas, NumPy). Marketing Anal...

Work Timings - Rotational Shifts (IST) Work Location - Remote Notice Period - only 30days Job Description Summary The Data engineer is responsible for managing and operating upon Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI . The engineer will work closely with the customer and team to manage and operate cloud data platform. Job Description Leads operational coverage: • Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.• Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiv...

Databricks: PySpark/Scala/Spark SQL, Delta Lake, MLflow integration, notebook orchestration, Delta Live tables Snowflake: SnowSQL, Snowpipe, performance tuning, security/role management, data sharing. Required Candidate profile Microsoft Fabric: Dataflows, pipelines, OneLake, integration with Power BI Advanced SQL skilLS Python, Scala, Java Git, CI/CD for data solutions, Infrastructure as Code (Terraform, Bicep)