661 Data Engineer Jobs - Page 15

NTT DATA is looking for a Databricks Developer to join their team in Bangalore, Karnataka, India. As a Databricks Developer, your responsibilities will include pushing data domains into a massive repository and building a large data lake by highly leveraging Databricks. To be considered for this role, you should have at least 3 years of experience in a Data Engineer or Software Engineer role. An undergraduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field is required, while a graduate degree is preferred. You should also have experience with data pipeline and workflow management tools, advanced working SQL knowledge, and familiarity wi...

POSITION OVERVIEW: We are seeking an experienced and highly skilled Data Engineer with deep expertise in Microsoft Fabric , MS-SQL, data warehouse architecture design , and SAP data integration. The ideal candidate will be responsible for designing, building, and optimizing data pipelines and architectures to support our enterprise data strategy. The candidate will work closely with cross-functional teams to ingest, transform, and make data (from SAP and other systems) available in our Microsoft Azure environment, enabling robust analytics and business intelligence. KEY ROLES & RESPONSIBILITIES : Spearhead the design, development, deployment, testing, and management of strategic data archite...

INTERESTED CANDIDATES SHARE CV TO VAIJAYANTHI.M@PARAMINFO.COM Exp: 5-10 Years Notice: Max 30 Days Location: Pan India (Remote - Work From Home) Domain: Core Banking is Must Must Required Skills: Cloudera Data Platform (CDP) hands-on experience Strong programming in: Python, PySpark Workflow orchestration: Apache Airflow ETL Development: Batch and streaming pipelines DevOps Practices: CI/CD, version control, automation Data Governance & Quality: Security, validation, alerting Nice-to-Have / Preferred: AI/ML & Generative AI exposure Use case implementation/support Experience with ML workflows, model pipelines Familiarity with cloud-native data tools (Azure/AWS) Collaboration in cross-functiona...

Job title: Senior Software Engineer Experience: 5- 8 years Primary skills: Python, Spark or Pyspark, DWH ETL. Database: SparkSQL or PostgreSQL Secondary skills: Databricks ( Delta Lake, Delta tables, Unity Catalog) Work Model: Hybrid (Weekly Twice) Cab Facility: Yes Work Timings: 10am to 7pm Interview Process: 3 rounds (3rd round F2F Mandatory) Work Location: Karle Town Tech Park Nagawara, Hebbal Bengaluru 560045 About Business Unit: The Architecture Team plays a pivotal role in the end-to-end design, governance, and strategic direction of product development within Epsilon People Cloud (EPC). As a centre of technical excellence, the team ensures that every product feature is engineered to m...

• Experience in cloud-based systems (GCP, BigQuery) • Strong SQL programming skills. • Expertise in database programming and performance tuning techniques • Possess knowledge of data warehouse architectures, ETL, reporting/analytic tools,

You are invited to join our team as a Mid-Level Data Engineer Technical Consultant with 4+ years of experience. As a part of our diverse and inclusive organization, you will be based in Bangalore, KA, working full-time in a permanent position during the general shift from Monday to Friday. In this role, you will be expected to possess strong written and oral communication skills, particularly in email correspondence. Your experience in working with Application Development teams will be invaluable, along with your ability to analyze and solve problems effectively. Proficiency in Microsoft tools such as Outlook, Excel, and Word is essential for this position. As a Data Engineer Technical Consu...

As a Techno functional professional with over 5 years of experience in Data warehousing and BI, you should have a strong grasp of fundamental concepts in this domain. Your role will involve designing BI solutions from scratch and implementing Agile Scrum practices like story slicing, grooming, daily scrum, iteration planning, retrospective, test-driven, and model storming. Additionally, you must possess expertise in Data Governance and Management along with a track record of proposing and implementing BI solutions successfully. Your technical skills should include proficiency in SQL for data analysis and querying, as well as experience with Postgres DB. It is mandatory to have a functional b...

Position Name: Data Engineer Location: Coimbatore (Hybrid 3 days per week) Work Shift Timing: 1.30 pm to 10.30 pm (IST) Mandatory Skills: SCALA, Spark, Python, Data bricks Good to have: Java & Hadoop The Role: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from various sources and storage systems. Leading the implementation of algorithms and prototypes to transform raw data into useful information. Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations. Creating innovative data validation ...

Role & responsibilities Key Responsibilities: At least 5 years of experience in data engineering with a strong background on Azure Databricks and Scala/Python. Databricks with knowledge in Pyspark Database: Oracle or any other database Programming: Python with awareness of Streamlit

Greetings from BCforward INDIA TECHNOLOGIES PRIVATE LIMITED. Contract To Hire(C2H) Role Location: Bengaluru,IN; Gurgaon,IN; Chennai,IN Payroll: BCforward Work Mode: Hybrid JD GCP; PySpark; ETL - Big Data / Data Warehousing; SQL; Python Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Bigdata experience Please share your Updated Resume, PAN card soft copy, Passport size Photo & UAN History. Interested applicants can share updated resume to g.sreekanth@bcforward.com Note: Looking for Immediate to 30-Days joiners at most. All the be...

Greetings from TSIT Digital !! This is with regard to an excellent opportunity with us and if you have that unique and unlimited passion for building world-class enterprise software products that turn into actionable intelligence, then we have the right opportunity for you and your career. This is an opportunity for Permanent Employment with TSIT Digital. What are we looking for: Data Engineer Experience: 4+ Year's Relevant Experience 2-5 Years Location:Bangalore Notice period: Immediately to 15 days Job Description: Work location-Manyata Tech Park, Bengaluru, Karnataka, India Work mode- Hybrid Model Client- Lowes Mandatory Skills: Data Engineer Scala/Python, SQL,Scripting Knowledge on BigQu...

As a GCP Data Engineer with Tableau expertise, you will be responsible for designing, implementing, and maintaining data pipelines on Google Cloud Platform (GCP) to support various data analytics initiatives. Your role will involve working closely with stakeholders to understand their data requirements, developing scalable solutions to extract, transform, and load data from different sources into GCP, and ensuring the integrity and quality of the data. In this role, you will leverage your expertise in GCP services such as BigQuery, Dataflow, Pub/Sub, and Data Studio to build and optimize data pipelines for efficient data processing and analysis. You will also be required to create visualizat...

As a Data Analyst with expertise in Market Research and Web Scraping, you will be responsible for analyzing large datasets to uncover trends and insights related to market dynamics and competitor performance. Your role will involve conducting thorough market research to track competitor activities, identify emerging trends, and understand customer preferences. Additionally, you will design and implement data scraping solutions to extract competitor data from various online sources while ensuring compliance with legal standards and website terms of service. Your key responsibilities will include developing dashboards, reports, and visualizations to communicate key insights effectively to stak...

As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines that enable data analytics and machine learning solutions on the Azure platform. You will work closely with data scientists, analysts, and other stakeholders to understand their data requirements and develop efficient data processing solutions. Your primary focus will be on building and optimizing data pipelines using Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure HDInsight. You will also be responsible for integrating data from various sources, ensuring data quality and consistency, and implementing data security and compliance ...

GLOINNT is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Design, develop, and maintain data infrastructure, databases, and data pipelinesDevelop and implement ETL processes to extract, transform, and load data from various sourcesEnsure data accuracy, quality, and accessibility, and resolve data-related issuesCollaborate with data analysts, data scientists, and other stakeholders to understand data needs and requirementsDevelop and maintain data models and data dictionariesDesign and implement data warehousing solutions to enable efficient and effective data analysis and reportingImplement and manage data security and access controls to protect d...

Job Description: Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or ...

Senior Data Engineer Experience: 5+yrs Location: Noida 5 days Work from Office Shift:1pm to 10pm Job Summary We are seeking a highly skilled Senior Data Engineer / BI Developer with deep expertise in SQL Server database development and performance tuning, along with experience in ETL pipelines (SSIS), cloud-based data engineering (Azure Databricks), and data visualization (Power BI/Sigma). This role is critical in designing, optimizing, and maintaining enterprise grade data solutions that power analytics and business intelligence across the organization. Key Responsibilities Design, develop, and optimize SQL Server databases in Azure Cloud, including schema design, indexing strategies, and s...

Responsibilities: * Develop data pipelines using PySpark and SQL. * Collaborate with cross-functional teams on ML projects. * Optimize database performance through data modeling and visualization.

Hi, Greetings!!! Role : Data Engineer Experience : 4+ years Location: Pune (Hybrid 3 days in office per week) Work Model : Hybrid Mail Skills: Data Engineer with Java, ETL, Apache, SQL Key Responsibilities: Design, implement, and optimize ETL/ELT pipelines using DBT for data modeling and transformation. Develop backend components and data processing logic using Java. Build and maintain DAGs in Apache Airflow for orchestration and automation of data workflows. Ensure the reliability, scalability, and efficiency of data pipelines for ingestion, transformation, and storage. Work with cross-functional teams to understand data needs and deliver high-quality solutions. Troubleshoot and resolve dat...

Our client is Global IT Service & Consulting Organization Data Software Engineer Location- Pune Notice period: Immediate to 60 days F2F interview on 27th July ,Sunday in Pune location Exp:5 -12 years Skill: Python, Spark, Azure Databricks/GCP/AWS Data Software Engineer - Spark, Python, (AWS, Kafka or Azure Databricks or GCP) Job Description: 5-12 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm...

distributed data technologies,Hadoop, MapReduce, Spark, Kafka, Flink etc.for building efficient, large-scale ‘big data’ pipelines,Java, Scala, Python or equivalent,stream-processing applications using Apache Flink, Kafka. AWS,Azure,Google Cloud

You are sought for the position of Data Engineer / PowerBI Developer at Solvios Technology with 3 to 5 years of experience. Your role will involve designing, constructing, and optimizing data pipelines to ensure the seamless flow of data across various systems. Your responsibilities will include: - Creating and implementing ETL Operations using Azure Data Factory or similar tools - Utilizing different REST APIs for data collection - Developing interactive dashboards and reports using Power BI - Crafting efficient SQL queries for data extraction and manipulation from relational databases - Establishing and managing data models, DAX calculations, and Power BI datasets - Conducting data analysi...

Person should have 6+ years in Azure Cloud. Should have experience in Data Engineer, Architecture. Experience in working on Azure Services like Azure Data Factory, Azure Function, Azure SQL, Azure Data Bricks, Azure Data Lake, Synapse Analytics etc.

Immediate Joiners Only-0-15 days Only Considered 3+Years Mandatory Work Mode-Hybrid Work Loation: Hyderabad, Bengaluru,Chennai,Pune Mandatory Skills: Azure, ADF, Spark, Astronomer Data Engineering topics Kafka based ingestion API based ingestion Astronomer, Apache Airflow, dagster, etc. (orchestration tools) Familiarity with Apache Iceberg, Delta & Hudi table designs when to use, why to use & how to use Spark architecture Optimization techniques Performance issues and mitigation techniques Data Quality topics Data engineering without quality provides no value Great Expectations (https://docs.greatexpectations.io/docs/core/introduction/try_gx/) Pydeequ (https://pydeequ.readthedocs.io/en/lates...

We are seeking a highly skilled Senior Data Engineer 2 with extensive experience in analysing existing data/databases, designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databases, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark. Responsibilities Adhere to coding and Numerator technology standards Build suitable automation test suites within Azure DevOps Maintain and update automation test suites as required Carry out manual testing, load testing, exploratory testing as required Perform Techni...