Home
Jobs

10314 Etl Jobs - Page 19

Filter Interviews
Min: 0 years
Max: 25 years
Min: ₹0
Max: ₹10000000
Setup a job Alert
Filter
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

6.0 - 11.0 years

12 - 17 Lacs

Gurugram

Work from Office

Naukri logo

Job Responsibilities Skillet Needed from the resource Data Architecture and Management : Understanding of Azure SQL technology, including SQL databases, operational data stores, and data transformation processes. Azure Data Factory : Expertise in using Azure Data Factory for ETL processes, including creating and managing pipelines. Python Programming : Proficiency in writing Python scripts, particularly using the pandas library, for data cleaning and transformation tasks. Azure Functions : Experience with Azure Functions for handling and processing Excel files, making them suitable for database import. API Integration : Skills in integrating various data sources, including APIs, into the data warehouse. BPO Exp Mandatory

Posted 2 days ago

Apply

3.0 - 6.0 years

0 Lacs

Hyderabad, Telangana, India

On-site

Linkedin logo

Job Title : Epic Reporting and BI Analyst Location : Hyderabad Experience : 3 to 6 Years Job Type : Full-Time Department : IT/Healthcare Technology Job Summary We are looking for a detail-oriented and experienced Epic Reporting and BI Analyst to provide essential support within our healthcare IT environment. The ideal candidate will have hands-on experience with Epic Systems, particularly Epic Caboodle and Epic Cogito, and be able to support clinical teams by resolving issues, optimizing workflows, and ensuring the smooth operation of Epic applications. Key Responsibilities Develop and manage Epic reports and build reports for Epic Caboodle, Epic Cogito, and other Epic modules. Serve as the primary point of contact for clinicians and end-users facing technical challenges with Epic systems. Identify, document, and escalate complex issues to senior support teams as needed. Collaborate with IT, data analysts, and clinical stakeholders to maintain the integrity, availability, and performance of Epic applications. Assist in the deployment of system upgrades, enhancements, and configuration changes to enhance the user experience. Support data extraction, reporting, and analytics using Epic Cogito and Caboodle, ensuring timely and accurate delivery of healthcare data. Stay up to date with Epic best practices and offer training and guidance to end-users when necessary. Monitor system performance, proactively identifying and resolving potential issues that could disrupt clinical workflows. Adhere to ITIL service management practices, including incident, problem, and change management. Document troubleshooting procedures and create knowledge base articles to improve service desk efficiency. Required Qualifications Bachelor's degree in healthcare informatics, Information Systems, Computer Science, or a related field, or equivalent work experience. Minimum of 5 years of experience working with Epic Systems in a support or analyst capacity. Strong proficiency in Epic Caboodle and Epic Cogito, with experience in data modelling, ETL processes, and reporting. Familiarity with Epics clinical modules and their impact on patient care workflows. Experience with SQL queries, reporting tools (Analytics & BI), and business intelligence platforms is a plus. Proven ability to diagnose, troubleshoot, and resolve technical issues related to Epic systems. Excellent communication skills and the ability to work effectively with clinicians, IT teams, and business stakeholders. Epic certifications in relevant modules (Caboodle, Cogito, or others) are highly preferred. Experience in Data Modelling and Data Warehouse & experience with SQL Server Integration Services and SQL Server Reporting Services. Preferred Qualifications Experience working in a healthcare IT setting or supporting clinical service desks. Knowledge of IT ticketing systems such as ServiceNow or Jira. Understanding of healthcare compliance regulations (HIPAA, HITECH, etc.). Ability to thrive in a fast-paced environment and demonstrate strong problem-solving abilities. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

0 years

0 Lacs

Hyderabad, Telangana, India

On-site

Linkedin logo

Responsibilities Technical Configuration and Build : Lead the configuration and build of Workday SCM modules (Procurement, Inventory Management, Supplier Management, and Logistics) to meet client-specific business processes. This includes configuring security, business processes, reporting, and data loads. System Integration : Work closely with the integration team to design and implement integrations between Workday SCM and other systems (internal and third-party), using Workdays integration tools such as EIB, Workday Studio, and Workday Web Services (WWS). Customization and Development : Develop and customize solutions within Workday SCM, including the creation of calculated fields, reports, dashboards, and custom business processes. Troubleshooting and Technical Support : Provide ongoing technical support for Workday SCM modules, identifying and resolving complex system issues, bugs, and performance bottlenecks. Data Migration & Load : Lead the extraction, transformation, and loading (ETL) of data into Workday SCM, ensuring data integrity and consistency across all modules and integrations. Testing & Quality Assurance : Oversee the testing process, including unit testing, integration testing, and regression testing for SCM-related configurations and integrations. Ensure that the system meets performance and functionality expectations. Technical Documentation : Maintain detailed technical documentation on system configurations, customizations, integrations, and data migration processes for future reference and auditing purposes. Collaboration with Technical Teams : Partner with Workday HCM, IT, and other cross-functional teams to ensure seamless integration of Workday SCM with other enterprise systems (e.g., Finance, HR) and support multi-system projects. Process Optimization : Identify opportunities for process improvement and automation within the Workday SCM system, working closely with the business and functional teams to deliver optimized solutions. Qualifications Workday SCM Technical Expertise : Strong technical experience with the configuration, customization, and integration of Workday Supply Chain Management modules. Expertise in Procurement, Inventory, and Supplier Management modules is highly desirable. Workday Integration Tools : Proficiency in Workday integration tools such as EIB (Enterprise Interface Builder), Workday Studio, and Web Services (WWS). Ability to design and implement complex integrations with third-party systems. Data Management : Strong experience in data migration, data transformation, and data loading techniques in Workday using EIB, iLoad, or similar tools. Familiarity with the Workday Data Model is a plus. Technical Problem Solving : Ability to troubleshoot, identify root causes, and resolve complex technical issues within Workday SCM. Strong analytical and problem-solving skills are essential. Technical Reporting : Experience in creating and configuring custom reports and dashboards in Workday, including the use of Workday's reporting tools such as Workday Report Writer and Workday Prism Analytics. Programming/Development Skills : Experience with Workdays advanced calculated fields, custom business process configuration, and scripting (e.g., Workday BIRT reports, WSDL, REST APIs) is highly preferred. Project Management Skills : Experience with agile project management methodologies and the ability to handle multiple concurrent tasks, deadlines, and priorities. Communication Skills : Strong written and verbal communication skills to convey technical information to both technical and non-technical stakeholders. Preferred Skills Workday Certifications : Workday certifications in SCM or related modules (Procurement, Inventory, etc.) are highly desirable. Cloud/ERP Experience : Hands-on experience with other cloud-based ERP systems or supply chain management systems, and understanding of cloud integrations. Experience with Advanced Workday Functionality : Familiarity with advanced Workday functionalities such as Workday Cloud Platform, Workday Studio, and Workday Reporting. Licensure and Certification : Workday Integration (Added Advantage) (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

10.0 years

0 Lacs

Trivandrum, Kerala, India

On-site

Linkedin logo

Our Company Techvantage.ai is a next-generation technology and product engineering company at the forefront of innovation in Generative AI, Agentic AI, and autonomous intelligent systems. We design intelligent platforms that solve complex business problems and deliver measurable impact through cutting-edge AI Overview : We are seeking an experienced Solution Architect with a strong foundation in software architecture and a working knowledge of AI-based products or platforms. In this role, you will be responsible for designing robust, scalable, and secure architectures that support AI-driven applications and enterprise systems. You will work closely with cross-functional teamsincluding data scientists, product managers, and engineering leadsto bridge the gap between business needs, technical feasibility, and AI we are looking from an ideal candidate ? Architect end-to-end solutions for enterprise and product-driven platforms, including components such as data pipelines, APIs, AI model integration, cloud infrastructure, and user interfaces. Guide teams in selecting the right technologies, tools, and design patterns to build scalable systems. Collaborate with AI/ML teams to understand model requirements and ensure smooth deployment and integration into production. Define system architecture diagrams, data flow, service orchestration, and infrastructure provisioning using modern tools. Work closely with stakeholders to translate business needs into technical solutions, with a focus on scalability, performance, and security. Provide leadership on best practices for software development, DevOps, and cloud-native architecture. Conduct architecture reviews and ensure alignment with security, compliance, and performance Skills : What skills do you need ? Requirements 10+ years of experience in software architecture or solution design roles. Proven experience designing systems using microservices, RESTful APIs, event-driven architecture, and cloud-native technologies. Hands-on experience with at least one major cloud provider: AWS, GCP, or Azure. Familiarity with AI/ML platforms or components, such as integrating AI models, MLOps pipelines, or inference services. Understanding of data architectures, including data lakes, streaming, and ETL pipelines. Strong experience with containerization (Docker, Kubernetes) and DevOps principles. Ability to lead technical discussions, make design trade-offs, and communicate with both technical and non-technical Qualifications : Exposure to AI model lifecycle management, prompt engineering, or real-time inference workflows. Experience with infrastructure-as-code (Terraform, Pulumi). Knowledge of GraphQL, gRPC, or serverless architectures. Previous experience working in AI-driven product companies or digital transformation We Offer : High-impact role in designing intelligent systems that shape the future of AI adoption. Work with forward-thinking engineers, researchers, and innovators. Strong focus on career growth, learning, and technical leadership. Compensation is not a constraint for the right candidate. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

3.0 - 8.0 years

0 Lacs

Kochi, Kerala, India

On-site

Linkedin logo

Role : Data & Visualisation Engineer Location : Kochi, Onsite Experience : 3-8 years Availability : Immediate Joiners Job Description We are seeking a Data & Visualization Engineer with 3 to 8 years of experience to design, develop, and maintain scalable data pipelines while creating intuitive and interactive visualizations. This role requires a strong foundation in data engineering, ETL processes, and data visualization tools to support seamless data-driven decision-making. Key Responsibilities Data Engineering : Design, develop, and optimize scalable data pipelines for structured and unstructured data. Implement and manage ETL/ELT processes to ensure data quality and consistency. Work with databases, data warehouses, and data lakes (MySQL, NoSQL, Redshift, Snowflake, BigQuery, etc.). Ensure compliance with data security, governance, and best practices. Optimize data workflows using Azure cloud platforms. Data Visualization & Analytics Develop interactive dashboards and reports using BI tools (Tableau, Power BI, Looker, D3.js). Transform complex datasets into clear, visually compelling insights. Collaborate with stakeholders to understand business needs and create impactful visualizations. Integrate visual analytics into web applications using JavaScript frameworks. Ensure accuracy, usability, and optimal performance of visualizations. Stay up to date with best practices in data storytelling and UX. Required Skills & Qualifications Bachelors or Masters degree in Computer Science, Data Engineering, or a related field. Proficiency in Python, SQL, Scala, or Java. Strong knowledge of MySQL and other database technologies. Hands-on experience with cloud data services. Expertise in BI tools (Tableau, Power BI, Looker) and front-end frameworks (React, D3.js). Strong analytical, problem-solving, and communication skills. Experience working with large datasets and optimizing query performance. Familiarity with version control (Git) and CI/CD pipelines. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

0 years

0 Lacs

Indore, Madhya Pradesh, India

On-site

Linkedin logo

Key Responsibilities Develop and execute test cases for ETL processes and data migration across large datasets. Perform data validation and validation of source-to-target data mappings using advanced SQL. Collaborate with developers, Business Analysts (BAs), and Quality Assurance (QA) teams to ensure data quality and integrity. Report and track defects, ensuring timely resolution to maintain data accuracy and quality. Automate and optimize data workflows and ETL pipelines. Monitor the performance of data pipelines and troubleshoot any data issues as needed. Maintain detailed documentation for data processes, workflows, and system architecture. Ensure the data quality, integrity, and security across Skills & Qualifications : Experience in ETL/Data Warehouse testing or a similar role. Strong proficiency in SQL with a solid understanding of database concepts. Hands-on experience with ETL tools like Informatica, Talend, SSIS, or similar. Experience with data warehousing platforms (e.g., Snowflake) and performance tuning. Experience in defect tracking and issue management using tools like JIRA. Familiarity with version control systems (e.g., Git) and CI/CD practices. Good communication, collaboration, and documentation skills. Solid understanding of data warehousing principles and ETL process design. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

3.0 years

0 Lacs

Delhi, India

On-site

Linkedin logo

Location : Work from Office (Okhla Phase III, Okhla Industrial Estate, New Delhi - 110020) About Us 1buy.ai is an innovative procurement and pricing intelligence platform specialized in the electronics industry, leveraging cutting-edge technology to streamline and optimize component sourcing. We are seeking a Data Engineer to join our dynamic tech team. You'll play a critical role in managing, transforming, and delivering data-driven insights to empower our platform and decision-making. Key Responsibilities Develop and optimize complex SQL queries for data extraction and analytics. Build and maintain robust ETL/ELT pipelines for data ingestion and transformation. Collaborate closely with stakeholders to support data visualization initiatives. Ensure data accuracy, integrity, and availability across various databases (MongoDB, PostgreSQL, Clickhouse). Monitor, maintain, and enhance data solutions leveraging Grafana dashboards. Continuously improve data processes and efficiency, aligning with business and industry needs. Required Skills 3+ years of experience and proficiency in writing and optimizing complex SQL queries. Strong expertise in ETL/ELT processes and data pipeline frameworks. Familiarity With Data Visualization tools and frameworks (Grafana). Databases : MongoDB (NoSQL), PostgreSQL. Electronics industry and component types. Optional Skills AWS cloud services for deploying data solutions Python scripting and automation. Data warehousing databases (Clickhouse). Workflow orchestration tools (Apache Airflow). What We Offer A collaborative and innovative environment. Opportunities for professional growth within a high-growth startup. Exposure to industry-leading data technologies and best practices. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

7.5 years

0 Lacs

Pune, Maharashtra, India

On-site

Linkedin logo

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 7.5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand their data needs and provide effective solutions, ensuring that the data infrastructure is robust and scalable to meet the demands of the organization. Roles & Responsibilities: - Expected to be an SME. - Collaborate and manage the team to perform. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Provide solutions to problems for their immediate team and across multiple teams. - Mentor junior team members to enhance their skills and knowledge in data engineering. - Continuously evaluate and improve data processes to enhance efficiency and effectiveness. Professional & Technical Skills: - Must To Have Skills: Proficiency in PySpark. - Strong understanding of data pipeline architecture and design. - Experience with ETL processes and data integration techniques. - Familiarity with data quality frameworks and best practices. - Knowledge of cloud platforms and services related to data storage and processing. Additional Information: - The candidate should have minimum 7.5 years of experience in PySpark. - This position is based in Pune. - A 15 years full time education is required. 15 years full time education Show more Show less

Posted 2 days ago

Apply

10.0 years

0 Lacs

Pune, Maharashtra, India

On-site

Linkedin logo

Key Responsibilities Develop, optimize, and maintain MSSQL databases to support business operations. Design, build, and maintain cloud database solutions to ensure efficient data storage and retrieval. Perform data migration between on-premise and cloud databases, ensuring data integrity and security. Develop and optimize complex SQL queries, stored procedures, functions, and triggers for data analysis and reporting. Implement reporting automation solutions using BI tools, SQL, and scripting techniques to enhance data-driven decision-making. Work on data warehousing solutions to store and analyze structured and unstructured business data efficiently. Ensure data quality, governance, and security by implementing best practices. Collaborate with business stakeholders to understand data requirements and provide actionable insights. Work independently under strict deadlines and manage multiple tasks Skills & Qualifications : 10+ years of experience in SQL development, database management, and data analysis. Expertise in MSSQL Server development, including query optimization and performance tuning. Hands-on experience with cloud databases (AWS RDS, Azure SQL, Google Cloud SQL, etc.). Strong knowledge of data migration strategies and tools. Experience in designing and implementing automated reporting solutions using SQL and BI tools (Power BI, Tableau, etc.). Solid understanding of ETL processes and data warehousing concepts. Ability to analyze large datasets and provide meaningful insights. Strong problem-solving skills, with attention to detail. Excellent communication skills and ability to work independently under tight Functional and Behavioral Characteristics : Positive and professional attitude. Self-motivated with a proactive approach to tasks. Team player with a willingness to collaborate and support colleagues. Strong commitment to accuracy and attention to detail. What We Have To Offer Competitive salary and benefits package. Work in a fast-growing financial services company with a dynamic work environment. Opportunity to work on cutting-edge database and reporting automation solutions. Career growth opportunities and professional development support. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

0.0 - 2.0 years

0 Lacs

Pune, Maharashtra, India

On-site

Linkedin logo

The Applications Development Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements Identify and analyze issues, make recommendations, and implement solutions Utilize knowledge of business processes, system processes, and industry standards to solve complex issues Analyze information and make evaluative judgements to recommend solutions and improvements Conduct testing and debugging, utilize script tools, and write basic code for design specifications Assess applicability of similar experiences and evaluate options under circumstances not covered by procedures Develop working knowledge of Citi’s information systems, procedures, standards, client server application development, network operations, database administration, systems administration, data center operations, and PC-based applications Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency. Additional Job Description We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Responsibilities Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities Implementing data wrangling, scarping, cleaning using both Java or Python Strong experience on data structure. Extensively work on API integration. Monitoring performance and advising any necessary infrastructure changes Defining data retention policies Skills And Qualifications Proficient understanding of distributed computing principles Proficient in Java or Pyhton and some part of machine learning Proficiency with Hadoop v2, MapReduce, HDFS,Pyspark,Spark Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala Experience with Spark Experience with integration of data from multiple data sources Experience with NoSQL databases, such as HBase, Cassandra, MongoDB Knowledge of various ETL techniques and frameworks, such as Flume Experience with various messaging systems, such as Kafka or RabbitMQ Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O Good understanding of Lambda Architecture, along with its advantages and drawbacks Experience with Cloudera/MapR/Hortonworks Qualifications: 0-2 years of relevant experience Experience in programming/debugging used in business applications Working knowledge of industry practice and standards Comprehensive knowledge of specific business area for application development Working knowledge of program languages Consistently demonstrates clear and concise written and verbal communication Education: Bachelor’s degree/University degree or equivalent experience This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required. ------------------------------------------------------ Job Family Group: Technology ------------------------------------------------------ Job Family: Applications Development ------------------------------------------------------ Time Type: Full time ------------------------------------------------------ Most Relevant Skills Please see the requirements listed above. ------------------------------------------------------ Other Relevant Skills For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------ Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster. Show more Show less

Posted 2 days ago

Apply

8.0 - 12.0 years

0 Lacs

Pune, Maharashtra, India

On-site

Linkedin logo

Major Duties Monitor the production environment. Identify and implement opportunities to improve production stability. Ensure incidents are prioritized and worked on in proper order and review backlog items. Investigating, diagnosing, and solving application issues. Problem resolution in an analytical and logical manner, to troubleshoot root cause and resolve production incidents. Follow-up on cross-team incidents to drive to resolution. Developing and delivering product changes, enhancements in a collaborative, agile team environment. Build solutions to fix production issues and participate in ongoing software maintenance activities. Understand, define, estimate, develop, test, deploy and support change requests. Monitor and attend to all alerts and escalate production issues as needed to relevant teams and management. Operates independently; has in-depth knowledge of business unit / function. Communicate with stakeholders and business on escalated items. As subject area expert, provides comprehensive, in-depth consulting to team and partners at a high technical level. Develops periodic goals, organizes the work, sets short-term priorities, monitors all activities, and ensures timely and accurate completion of the work. Periodically engage with business partners to review progress and priorities and develop and maintain rapport through professional interactions with clear, concise communications. Ensure cross-functional duties, including bug fixes & scheduling changes etc. are scheduled and completed by the relevant teams. Work with the team to resolve problems, improve production reliability, stability, and availability. Follow the ITIL processes of Incident, Problem & Change Management. Ability to solve complex technical Have : 8 -12 years of professional experience in software maintenance / support / development with Programming / Strong Technical background. 80% Technical and 20% Manager skills. Proficient in working with ITIL / ITSM (Service Now) & Data Analysis. Expert on Unix commands and Scripting. Working knowledge of SQL (Preferably Oracle, MSSQL). Experience in supporting ETL/EDM/MDM Platform using tools like SSIS, Informatica, Markit EDM, IBM Infosphere DataStage ETL experience is mandate if EDM experience is not present. Understanding of batch scheduling system usage and implementation concepts. Trigger solutions using external schedulers (Control-M), services (Process Launchers & Event Watchers) and UI. Well versed with Change Management process and tools. Experience in incident management, understanding of ticket workflows and use of escalation. Good understanding of MQ/Kafka (both consumer/producer solutions). Good understanding of Rest/SOAP to Have : Proficient in Java and able to go into code to investigate and fix issues. Understanding of DevOps, CICD & Agile techniques preferred. Basic understanding of front-end technologies, such as React JS, JavaScript, HTML5, and CSS3. Banking and Financial Services Knowledge is preferred. More importantly, the candidate should have a strong technical background. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

0 years

0 Lacs

Gurugram, Haryana, India

On-site

Linkedin logo

Position Overview We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python and DataOps tools and technologies. Knowledge of SAP HANA & Snowflake is a plus. This role is critical for designing, developing, and maintaining our clients data pipeline architecture, ensuring the efficient and reliable flow of data across the organization. Key Responsibilities Design, Develop, and Maintain Data Pipelines : Develop robust and scalable data pipelines using AWS Glue, Apache Airflow, and other relevant technologies. Integrate various data sources, including SAP HANA, Kafka, and SQL databases, to ensure seamless data flow and processing. Optimize data pipelines for performance and reliability. Data Management And Transformation Design and implement data transformation processes to clean, enrich, and structure data for analytical purposes. Utilize SQL and Python for data extraction, transformation, and loading (ETL) tasks. Ensure data quality and integrity through rigorous testing and validation processes. Collaboration And Communication Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs. Collaborate with cross-functional teams to implement DataOps practices and improve data life cycle management. Monitoring And Optimization Monitor data pipeline performance and implement improvements to enhance efficiency and reduce latency. Troubleshoot and resolve data-related issues, ensuring minimal disruption to data workflows. Implement and manage monitoring and alerting systems to proactively identify and address potential issues. Documentation And Best Practices Maintain comprehensive documentation of data pipelines, transformations, and processes. Adhere to best practices in data engineering, including code versioning, testing, and deployment procedures. Stay up-to-date with the latest industry trends and technologies in data engineering and DataOps. Required Skills And Qualifications Technical Expertise : Extensive experience with AWS Glue for data integration and transformation. Proficient in Apache Airflow for workflow orchestration. Strong knowledge of Kafka for real-time data streaming and processing. Advanced SQL skills for querying and managing relational databases. Proficiency in Python for scripting and automation tasks. Experience with SAP HANA for data storage and management. Familiarity with DataOps tools and methodologies for continuous integration and delivery in data engineering. Preferred Skills Knowledge of Snowflake for cloud-based data warehousing solutions. Experience with other AWS data services such as Redshift, S3, and Athena. Familiarity with big data technologies such as Hadoop, Spark, and Hive. Soft Skills Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Detail-oriented with a commitment to data quality and accuracy. Ability to work independently and manage multiple projects simultaneously. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

4.0 years

0 Lacs

Noida, Uttar Pradesh, India

On-site

Linkedin logo

Summary We are looking for a skilled and experienced Spring Boot Developer with 4+ years of hands-on experience to join our development team. The ideal candidate should have a strong background in Java development, with a focus on building robust and scalable applications using Spring Boot framework. As a Spring Boot Developer, you will be responsible for designing, developing, and implementing software solutions while collaborating with cross-functional teams to deliver high-quality products. As a Lead Spring Boot Developer, you will lead a team, design software solutions, and collaborate with cross-functional teams to drive innovation. Key Responsibilities Design, develop, and implement high-quality, scalable, and efficient Java applications using Spring Boot framework. Collaborate with developers, product, and project owners to understand requirements and translate them into technical solutions. Understanding of security best practices and compliance requirements Work closely with stakeholders to understand requirements and translate them into technical solutions. Exposure to healthcare standards like HL7, FHIR, and EDI X12 is highly desirable. Experience in HIPAA-compliant application development. Industry Exposure : Healthcare, Insurance, Fintech. Designing High-Level (HLD) and Low-Level (LLD) architectures, defining database schemas is a must. Lead code reviews, unit testing, and system integration testing. Good to have exposure to Data pipelines and ETL workloads. Requirements Bachelor's degree in computer science, Engineering, or a related field. 5+ years of hands-on experience in Java development. 2+ years of experience specifically with Spring Boot framework. Proficiency in Java, Spring Boot, Spring Framework (Core, MVC, Security, etc.). Experience with RESTful APIs and microservices architecture. Strong understanding of object-oriented programming principles. Familiarity with front-end technologies such as JavaScript, HTML, and CSS is a plus. Experience with relational databases and SQL. Knowledge of Agile development methodologies. Excellent problem-solving and analytical skills. Ability to lead and mentor a team, fostering collaboration and growth. Ability to work both independently and collaboratively in a team environment. Strong communication and interpersonal skills. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

10.0 years

0 Lacs

Gurugram, Haryana, India

On-site

Linkedin logo

Job Description Design, build, and maintain scalable and efficient data pipelines to move data between cloud-native databases (e.g., Snowflake) and SaaS providers using AWS Glue and Python Implement and manage ETL/ELT processes to ensure seamless data integration and transformation Ensure information security and compliance with data governance standards Maintain and enhance data environments, including data lakes, warehouses, and distributed processing systems Utilize version control systems (e.g., GitHub) to manage code and collaborate effectively with the team Primary Skills Enhancements, new development, defect resolution, and production support of ETL development using AWS native services Integration of data sets using AWS services such as Glue and Lambda functions. Utilization of AWS SNS to send emails and alerts Authoring ETL processes using Python and PySpark ETL process monitoring using CloudWatch events Connecting with different data sources like S3 and validating data using Athena. Experience in CI/CD using GitHub Actions Proficiency in Agile methodology Extensive working experience with Advanced SQL and a complex understanding of SQL. Secondary Skills Experience working with Snowflake and understanding of Snowflake architecture, including concepts like internal and external tables, stages, and masking policies. Competencies / Experience Deep technical skills in AWS Glue (Crawler, Data Catalog): 10+ years. Hands-on experience with Python and PySpark: 5+ years. PL/SQL experience: 5+ years CloudFormation and Terraform: 5+ years CI/CD GitHub actions: 5+ year Experience with BI systems (PowerBI, Tableau): 5+ year Good understanding of AWS services like S3, SNS, Secret Manager, Athena, and Lambda: 5+ years Additionally, familiarity with any of the following is highly desirable: Jira, Gi (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

3.0 - 4.0 years

0 Lacs

Gurugram, Haryana, India

On-site

Linkedin logo

Data Engineer (3-4 Years Experience) - Real-time & Batch Processing | AWS, Kafka, Click House, Python Location : NOIDA. Experience : 3-4 years. Job Type : Full-Time. About The Role We are looking for a skilled Data Engineer with 3-4 years of experience to design, build, and maintain real-time and batch data pipelines for handling large-scale datasets. You will work with AWS, Kafka, Cloudflare Workers, Python, Click House, Redis, and other modern technologies to enable seamless data ingestion, transformation, merging, and storage. Bonus: If you have Web Data Analytics or Programmatic Advertising knowledge, it will be a big plus!. Responsibilities Real-Time Data Processing & Transformation : Build low-latency, high-throughput real-time pipelines using Kafka, Redis, Firehose, Lambda, and Cloudflare Workers. Perform real-time data transformations like filtering, aggregation, enrichment, and deduplication using Kafka Streams, Redis Streams, or AWS Lambda. Merge data from multiple real-time sources into a single structured dataset for analytics. Batch Data Processing & Transformation Develop batch ETL/ELT pipelines for processing large-scale structured and unstructured data. Perform data transformations, joins, and merging across different sources in Click House, AWS Glue, or Python. Optimize data ingestion, transformation, and storage workflows for efficiency and reliability. Data Pipeline Development & Optimization Design, develop, and maintain scalable, fault-tolerant data pipelines for real-time & batch processing. Optimize data workflows to reduce latency, cost, and compute load. Data Integration & Merging Combine real-time and batch data streams for unified analytics. Integrate data from various sources (APIs, databases, event streams, cloud storage). Cloud Infrastructure & Storage Work with AWS services (S3, EC2, ECS, Lambda, Firehose, RDS, Redshift, ClickHouse) for scalable data processing. Implement data lake and warehouse solutions using S3, Redshift, and ClickHouse. Data Visualization & Reporting Work with Power BI, Tableau, or Grafana to create real-time dashboards and analytical reports. Web Data Analytics & Programmatic Advertising (Big Plus!) : Experience working with web tracking data, user behavior analytics, and digital marketing datasets. Knowledge of programmatic advertising, ad impressions, clickstream data, and real-time bidding (RTB) analytics. Monitoring & Performance Optimization Implement monitoring & logging of data pipelines using AWS CloudWatch, Prometheus, and Grafana. Tune Kafka, Click House, and Redis for high performance. Collaboration & Best Practices Work closely with data analysts, software engineers, and DevOps teams to enhance data accessibility. Follow best practices for data governance, security, and compliance. Must-Have Skills Programming : Strong experience in Python and JavaScript. Real-time Data Processing & Merging : Expertise in Kafka, Redis, Cloudflare Workers, Firehose, Lambda. Batch Processing & Transformation : Experience with Click House, Python, AWS Glue, SQL-based transformations. Data Storage & Integration : Experience with MySQL, Click House, Redshift, and S3-based storage. Cloud Technologies : Hands-on with AWS (S3, EC2, ECS, RDS, Firehose, Click House, Lambda, Redshift). Visualization & Reporting : Knowledge of Power BI, Tableau, or Grafana. CI/CD & Infrastructure as Code (IaC) : Familiarity with Terraform, CloudFormation, Git, Docker, and Kubernetes. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

5.0 years

0 Lacs

Chennai, Tamil Nadu, India

On-site

Linkedin logo

Spendflo is a fast-growing Series A startup helping companies streamline how they procure, manage, and optimize their software and services. Backed by top-tier investors, were building the most intelligent, automated platform for procurement operations. We are now looking for a Senior Data Engineer to design, build, and scale our data infrastructure. Youll be the backbone of all data movement at Spendflo from ingestion to transformation to Youll Do : Design, implement, and own the end-to-end data architecture at Spendflo. Build and maintain robust, scalable ETL/ELT pipelines across multiple sources and systems. Develop and optimize data models for analytics, reporting, and product needs. Own the reporting layer and work with PMs, analysts, and leadership to deliver actionable data. Ensure data quality, consistency, and lineage through validation and monitoring. Collaborate with engineering, product, and data science teams to build seamless data flows. Optimize data storage and query performance for scale and speed. Own documentation for pipelines, models, and data flows. Stay current with the latest data tools and bring in the right technologies. Mentor junior data engineers and help establish data best Qualifications : 5+ years of experience as a data engineer, preferably in a product/startup environment . Strong expertise in building ETL/ELT pipelines using modern frameworks (e.g., Dagster, dbt, Airflow). Deep knowledge of data modeling (star/snowflake schemas, denormalization, dimensional modeling). Hands-on with SQL (advanced queries, performance tuning, window functions, etc.). Experience with cloud data warehouses like Redshift, BigQuery, Snowflake, or similar. Comfortable working with cloud platforms (AWS/GCP/Azure) and tools like S3, Lambda, etc. Exposure to BI tools like Looker, Power BI, Tableau, or equivalent. Strong debugging and performance tuning skills. Excellent communication and documentation Qualifications : Built or managed large-scale, cloud-native data pipelines. Experience with real-time or stream processing (Kafka, Kinesis, etc.). Understanding of data governance, privacy, and security best practices. Exposure to machine learning pipelines or collaboration with data science teams. Startup experience able to handle ambiguity, fast pace, and end-to-end ownership. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

7.0 - 12.0 years

25 - 27 Lacs

Kolkata, Bengaluru

Hybrid

Naukri logo

Required Experience: • Design, develop, and maintain ETL/ELT workflows using Informatica IICS. • Collaborate with business and technical teams to understand requirements and translate them into robust data integration solutions. • Optimize data pipelines for performance and scalability. • Integrate IICS solutions with cloud-based data stores like Google BigQuery and cloud storage solutions. • Develop data mappings, task flows, parameter files, and reusable objects. • Manage deployments, migrations, and version control for IICS assets. • Perform unit testing, debugging, and troubleshooting of ETL jobs. • Document data flow and architecture as part of the SDLC. • Work in an Agile environment and participate in sprint planning, reviews, and retrospectives. • Provide mentorship and code reviews for junior developers, ensuring adherence to best practices and coding standards. Skills & Qualifications: • Bachelors or Master’s degree in Computer Science, Information Systems, or related field. • 7+ years of experience in ETL development with at least 2–3 years in Informatica IICS. • Strong experience in data integration, transformation, and orchestration using IICS. • Good working knowledge of cloud data platforms, preferably Google Cloud Platform (GCP). • Hands-on experience with Google BigQuery (GBQ) including writing SQL queries, data ingestion, and optimization. • Strong SQL skills and experience with RDBMS (e.g., Oracle, SQL Server, PostgreSQL). • Experience in integrating data from various sources including on-prem, SaaS applications, and cloud data lakes. • Familiarity with data governance, data quality, and data cataloging tools. • Understanding of REST APIs and experience with API integration in IICS. • Excellent problem-solving skills and attention to detail. • Strong communication skills and the ability to work effectively in a team.

Posted 2 days ago

Apply

0 years

0 Lacs

Delhi, India

On-site

Linkedin logo

Key Responsibilities Design, build, and maintain scalable, reliable, and efficient data pipelines to support data analytics and business intelligence needs. Optimize and automate data workflows, enhancing the efficiency of data processing and reducing latency. Implement and maintain data storage solutions, ensuring that data is organized, secure, and readily accessible. Provide expertise in ETL processes, data wrangling, and data transformation techniques. Collaborate with technology teams to ensure that data engineering solutions align with overall business goals. Stay current with industry best practices and emerging technologies in data engineering, implementing improvements as : Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field. Experience with Agile methodologies and software development project : Proven experience in data engineering, with expertise in building and managing data pipelines, ETL processes, and data warehousing. Proficiency in SQL, Python, and other programming languages commonly used in data engineering. Experience with cloud platforms such as AWS, Azure, or Google Cloud, and familiarity with cloud-based data storage and processing tools (e.g., S3, Redshift, BigQuery, etc.). Good to have familiarity with big data technologies (e.g., Hadoop, Spark) and real-time data processing. Strong understanding of database management systems and data modeling techniques. Experience with BI tools like Tableau, Power BI along with ETL tools like Alteryx, or similar, and ability to work closely with analytics teams. High attention to detail and commitment to data quality and accuracy. Ability to work independently and as part of a team, with strong collaboration skills. Highly adaptive and comfortable working within a complex, fast-paced environment. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

0 years

0 Lacs

Delhi, India

On-site

Linkedin logo

What Youll Do Architect and scale modern data infrastructure: ingestion, transformation, warehousing, and access Define and drive enterprise data strategygovernance, quality, security, and lifecycle management Design scalable data platforms that support both operational insights and ML/AI applications Translate complex business requirements into robust, modular data systems Lead cross-functional teams of engineers, analysts, and developers on large-scale data initiatives Evaluate and implement best-in-class tools for orchestration, warehousing, and metadata management Establish technical standards and best practices for data engineering at scale Spearhead integration efforts to unify data across legacy and modern platforms What You Bring Experience in data engineering, architecture, or backend systems Strong grasp of system design, distributed data platforms, and scalable infrastructure Deep hands-on experience with cloud platforms (AWS, Azure, or GCP) and tools like Redshift, BigQuery, Snowflake, S3, Lambda Expertise in data modeling (OLTP/OLAP), ETL pipelines, and data warehousing Experience with big data ecosystems: Kafka, Spark, Hive, Presto Solid understanding of data governance, security, and compliance frameworks Proven track record of technical leadership and mentoring Strong collaboration and communication skills to align tech with business Bachelors or Masters in Computer Science, Data Engineering, or a related field Nice To Have (Your Edge) Experience with real-time data streaming and event-driven architectures Exposure to MLOps and model deployment pipelines Familiarity with data DevOps and Infra as Code (Terraform, CloudFormation, CI/CD pipelines) (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

68.0 years

0 Lacs

Greater Kolkata Area

On-site

Linkedin logo

Role Overview We are looking for a highly skilled and motivated Senior Data Scientist to join our team. In this role, you will design, develop, and implement advanced data models and algorithms that drive strategic decision-making across the organization. You will work closely with product, engineering, and business teams to uncover insights and deliver data-driven solutions that enhance the performance and scalability of our products and services. Key Responsibilities Develop, deploy, and maintain machine learning models and advanced analytics pipelines. Analyze complex datasets to identify trends, patterns, and actionable insights. Collaborate with cross-functional teams (Engineering, Product, Marketing) to define and execute data science strategies. Build and improve predictive models using supervised and unsupervised learning techniques. Translate business problems into data science projects with measurable impact. Design and conduct experiments, A/B tests, and statistical analyses to validate hypotheses and guide product development. Create dashboards and visualizations to communicate findings to technical and non-technical stakeholders. Stay up-to-date with industry trends, best practices, and emerging technologies in data science and machine learning. Ensure data quality and governance standards are maintained across all projects. Required Skills And Qualifications 68 years of hands-on experience in Data Science, Machine Learning, and Statistical Modeling. Proficiency in programming languages such as Python, R, and SQL. Strong foundation in data analysis, data wrangling, and feature engineering. Expertise in building and deploying models using tools such as scikit-learn, TensorFlow, PyTorch, or similar frameworks. Experience with big data platforms (e.g., Spark, Hadoop) and cloud services (AWS, GCP, Azure) is a plus. Deep understanding of statistical techniques including hypothesis testing, regression, and Bayesian methods. Excellent communication skills with the ability to explain complex technical concepts to non-technical audiences. Proven track record of working on cross-functional projects and delivering data-driven solutions that impact business outcomes. Master's or Ph.D. in Data Science, Computer Science, Statistics, Mathematics, or a related field. Experience with NLP, computer vision, or deep learning techniques. Knowledge of data engineering principles and ETL processes. Familiarity with version control (Git), agile methodologies, and CI/CD pipelines. Contributions to open-source data science projects or publications in relevant fields. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

9.0 years

0 Lacs

Greater Kolkata Area

On-site

Linkedin logo

Job Description Having 9+ years of working experience in Data Engineering and Data Analytic projects in implementing Data Warehouse, Data Lake and Lakehouse and associated ETL/ELT patterns. Worked as a Data Modeller in one or two implementations in creating and implementing Data models and Data Base designs using Dimensional, ER models. Good knowledge and experience in modelling complex scenario's like many to many relationships, SCD types, Late arriving fact and dimensions etc. Hands on experience in any one of the Data modelling tools like Erwin, ER/Studio, Enterprise Architect or SQLDBM etc. Experience in working closely with Business stakeholders/Business Analyst to understand the functional requirements and translating it into Data Models and database designs. Experience in creating conceptual models and logical models and translating it into physical models to address the both functional and non functional requirements. Strong knowledge in SQL, able to write complex queries and profile the data to understand the relationships and DQ issues. Very strong understanding of database modelling and design principles like normalization, denormalization, isolation levels. Experience in Performance optimizations through database designs (Physical Modelling). Good communication skills (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

7.0 years

0 Lacs

Greater Kolkata Area

Remote

Linkedin logo

Omni's team is passionate about Commerce and Digital Transformation. We've been successfully delivering Commerce solutions for clients across North America, Europe, Asia, and Australia. The team has experience executing and delivering projects in B2B and B2C solutions. Job Description This is a remote position. We are seeking a Senior Data Engineer to architect and build robust, scalable, and efficient data systems that power AI and Analytics solutions. You will design end-to-end data pipelines, optimize data storage, and ensure seamless data availability for machine learning and business analytics use cases. This role demands deep engineering excellence balancing performance, reliability, security, and cost to support real-world AI applications. Key Responsibilities Architect, design, and implement high-throughput ETL/ELT pipelines for batch and real-time data processing. Build cloud-native data platforms : data lakes, data warehouses, feature stores. Work with structured, semi-structured, and unstructured data at petabyte scale. Optimize data pipelines for latency, throughput, cost-efficiency, and fault tolerance. Implement data governance, lineage, quality checks, and metadata management. Collaborate closely with Data Scientists and ML Engineers to prepare data pipelines for model training and inference. Implement streaming data architectures using Kafka, Spark Streaming, or AWS Kinesis. Automate infrastructure deployment using Terraform, CloudFormation, or Kubernetes operators. Requirements 7+ years in Data Engineering, Big Data, or Cloud Data Platform roles. Strong proficiency in Python and SQL. Deep expertise in distributed data systems (Spark, Hive, Presto, Dask). Cloud-native engineering experience (AWS, GCP, Azure) : BigQuery, Redshift, EMR, Databricks, etc. Experience designing event-driven architectures and streaming systems (Kafka, Pub/Sub, Flink). Strong background in data modeling (star schema, OLAP cubes, graph databases). Proven experience with data security, encryption, compliance standards (e.g., GDPR, HIPAA). Preferred Skills Experience in MLOps enablement : creating feature stores, versioned datasets. Familiarity with real-time analytics platforms (Clickhouse, Apache Pinot). Exposure to data observability tools like Monte Carlo, Databand, or similar. Passionate about building high-scale, resilient, and secure data systems. Excited to support AI/ML innovation with state-of-the-art data infrastructure. Obsessed with automation, scalability, and best engineering practices. (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

5.0 years

0 Lacs

Greater Kolkata Area

Remote

Linkedin logo

Data Engineer - Google Cloud Location : Remote, India About Us Aviato Consulting is looking for a highly skilled and motivated Data Engineer to join our expanding team. This role is ideal for someone with a deep understanding of cloud-based data solutions, with a focus on Google Cloud (GCP) and associated technologies. GCP certification is mandatory for this position to ensure the highest level of expertise and professionalism. You will work directly with clients, translating their business requirements into scalable data solutions, while providing technical expertise and guidance. Key Responsibilities Client Engagement : Work closely with clients to understand business needs, gather technical requirements, and design solutions leveraging GCP services. Data Pipeline Design & Development : Build and manage scalable data pipelines using tools such as Apache Beam, Cloud Dataflow, and Cloud Composer. Data Warehousing & Lake Solutions : Architect, implement, and optimize BigQuery-based data lakes and warehouses. Real-Time Data Processing : Implement and manage streaming data pipelines using Kafka, Pub/Sub, and similar technologies. Data Analysis & Visualization : Create insightful data dashboards and visualizations using tools like Looker, Data Studio, or Tableau. Technical Leadership & Mentorship : Provide guidance and mentorship to team members and clients, helping them leverage the full potential of Google Cloud. Required Qualifications Experience : 5+ years as a Data Engineer working with cloud-based platforms. Proven experience in Python with libraries like Pandas and NumPy. Strong understanding and experience with FastAPI for building APIs. Expertise in building data pipelines using Apache Beam, Cloud Dataflow, or similar tools. Solid knowledge of Kafka for real-time data streaming. Proficiency with BigQuery, Google Pub/Sub, and other Google Cloud services. Familiarity with Apache Hadoop for distributed data processing. Technical Skills Strong understanding of data architecture and processing techniques. Experience with big data environments and tools like Apache Hadoop. Solid understanding of ETL pipelines, data ingestion, transformation, and storage. Knowledge of data modeling, data warehousing, and big data management principles. Certifications Google Cloud certification (Professional Data Engineer, Cloud Architect) is mandatory for this role. Soft Skills Excellent English communication skills. Client-facing experience and the ability to manage client relationships effectively. Strong problem-solving skills with a results-oriented approach. Preferred Qualifications Visualization Tools : Experience with tools like Looker, Power BI, or Tableau. Benefits Competitive salary and benefits package. Opportunities to work with cutting-edge cloud technologies with large customers. Collaborative work environment that encourages learning and professional growth. A chance to work on high-impact projects for leading clients in diverse industries. If you're passionate about data engineering, cloud technologies, and solving complex data problems for clients, wed love to hear from you! (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

14.0 years

0 Lacs

Greater Kolkata Area

On-site

Linkedin logo

Position Overview We are seeking a dynamic and experienced Program Manager to lead and oversee the Data Governance Program for a large banking organization. The Program Manager will be responsible for the successful execution of data governance initiatives, ensuring compliance with regulatory requirements, promoting data quality, and fostering a culture of data stewardship across the enterprise. This role requires a strategic thinker with exceptional leadership, communication, and organizational skills to align cross-functional teams and drive the adoption of governance frameworks. Key Responsibilities Program Leadership : Develop and execute a comprehensive Data Governance strategy aligned with the organization's objectives and regulatory requirements. Act as a liaison between senior leadership, stakeholders, and cross-functional teams to ensure program alignment and success. Drive organizational change to establish a culture of data governance and stewardship. Great focus on program risk identification and timely reporting and devising action to address it. Cost benefit analysis and justification to investments. Planning And Project Management Project planning, scheduling & tracking Work prioritization and resource planning Risk identification and reporting Team planning and management Status reporting Governance Framework Implementation Establish and manage a robust Data Governance framework, including policies, standards, roles, and responsibilities. Implement data cataloging, metadata management, and data lineage tools to enhance data visibility and accessibility. Oversee the creation of workflows and processes to ensure adherence to governance policies. Stakeholder Engagement Reports to CXO level executives with program status update, risk management and outcomes. Collaborate with business units, IT teams, and compliance officers to identify governance priorities and resolve data-related challenges. Facilitate the Data Governance Council meetings and ensure effective decision-making. Serve as a point of contact for internal and external auditors regarding data governance-related queries. Compliance And Risk Management Ensure adherence to industry regulations and banking-specific compliance requirements. Identify and mitigate risks related to data usage, sharing, and security. Monitoring And Reporting Develop key performance indicators (KPIs) and metrics to measure the effectiveness of the Data Governance Program. Provide regular updates to CXO level executive leadership on program status, risks, and outcomes. Prepare and present audit and compliance reports as required. Team Leadership And Mentorship Lead cross-functional teams, including data stewards, analysts, and governance professionals. Provide training and mentoring to promote awareness and understanding of data governance practices. Technical Expertise Understanding of data engineering principles and practices: Good understanding of data pipelines, data storage solutions, data quality concepts, and data security is crucial. Familiarity with data engineering tools and technologies: This may include knowledge of ETL/ELT tools, Informatica IDMC, MDM, data warehousing solutions, Collabra data quality, cloud platforms (AWS, Azure, GCP), and data governance frameworks Qualifications Bachelor's degree in computer science, Data Management, Business Administration, or a related field; MBA or equivalent experience preferred. 14+ years of experience in program management, with at least 6+ years focused on data governance or data management with MDM in the banking or financial services sector. Strong knowledge of data governance frameworks, principles, and tools (e.g., Collibra, Informatica, Alation). Experience with regulatory compliance requirements for the banking industry, such as GDPR, CCPA, BCBS 239, and AML/KYC regulations. Proven track record of successfully managing large, complex programs with cross-functional teams. Excellent communication and stakeholder management skills, with the ability to influence and align diverse groups. Familiarity with data analytics, data quality management, and enterprise architecture concepts. Certification in program or project management (e.g., PMP, PRINCE2) or data governance (e.g., DGSP, CDMP) is a plus. Key Competencies Strong strategic thinking and problem-solving skills. Ability to work under pressure and manage multiple priorities. Exceptional leadership and interpersonal skills. Proficiency in program management tools and methodologies. Strong analytical and decision-making capabilities (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

8.0 years

0 Lacs

Greater Kolkata Area

On-site

Linkedin logo

JD For Data Modeler Key Requirements : Total 8 + years of Experience with 8 years of hands-on experience in data modelling Expertise in conceptual, logical, and physical data modeling Proficient in tools such as Erwin, SQL DBM, or similar Strong understanding of data governance and database design best practices Excellent communication and collaboration skills Having 8+ years of working experience in Data Engineering and Data Analytic projects in implementing Data Warehouse, Data Lake and Lakehouse and associated ETL/ELT patterns. Worked as a Data Modeller in one or two implementations in creating and implementing Data models and Data Base designs using Dimensional, ER models. Good knowledge and experience in modelling complex scenarios like many to many relationships, SCD types, Late arriving fact and dimensions etc. Hands on experience in any one of the Data modelling tools like Erwin, ER/Studio, Enterprise Architect or SQLDBM etc. Experience in working closely with Business stakeholders/Business Analyst to understand the functional requirements and translating it into Data Models and database designs. Experience in creating conceptual models and logical models and translating it into physical models to address the both functional and non functional requirements. Strong knowledge in SQL, able to write complex queries and profile the data to understand the relationships and DQ issues. Very strong understanding of database modelling and design principles like normalization, denormalization, isolation levels. Experience in Performance optimizations through database designs (Physical Modelling). (ref:hirist.tech) Show more Show less

Posted 2 days ago

Apply

Exploring ETL Jobs in India

The ETL (Extract, Transform, Load) job market in India is thriving with numerous opportunities for job seekers. ETL professionals play a crucial role in managing and analyzing data effectively for organizations across various industries. If you are considering a career in ETL, this article will provide you with valuable insights into the job market in India.

Top Hiring Locations in India

  1. Bangalore
  2. Mumbai
  3. Pune
  4. Hyderabad
  5. Chennai

These cities are known for their thriving tech industries and often have a high demand for ETL professionals.

Average Salary Range

The average salary range for ETL professionals in India varies based on experience levels. Entry-level positions typically start at around ₹3-5 lakhs per annum, while experienced professionals can earn upwards of ₹10-15 lakhs per annum.

Career Path

In the ETL field, a typical career path may include roles such as: - Junior ETL Developer - ETL Developer - Senior ETL Developer - ETL Tech Lead - ETL Architect

As you gain experience and expertise, you can progress to higher-level roles within the ETL domain.

Related Skills

Alongside ETL, professionals in this field are often expected to have skills in: - SQL - Data Warehousing - Data Modeling - ETL Tools (e.g., Informatica, Talend) - Database Management Systems (e.g., Oracle, SQL Server)

Having a strong foundation in these related skills can enhance your capabilities as an ETL professional.

Interview Questions

Here are 25 interview questions that you may encounter in ETL job interviews:

  • What is ETL and why is it important? (basic)
  • Explain the difference between ETL and ELT processes. (medium)
  • How do you handle incremental loads in ETL processes? (medium)
  • What is a surrogate key in the context of ETL? (basic)
  • Can you explain the concept of data profiling in ETL? (medium)
  • How do you handle data quality issues in ETL processes? (medium)
  • What are some common ETL tools you have worked with? (basic)
  • Explain the difference between a full load and an incremental load. (basic)
  • How do you optimize ETL processes for performance? (medium)
  • Can you describe a challenging ETL project you worked on and how you overcame obstacles? (advanced)
  • What is the significance of data cleansing in ETL? (basic)
  • How do you ensure data security and compliance in ETL processes? (medium)
  • Have you worked with real-time data integration in ETL? If so, how did you approach it? (advanced)
  • What are the key components of an ETL architecture? (basic)
  • How do you handle data transformation requirements in ETL processes? (medium)
  • What are some best practices for ETL development? (medium)
  • Can you explain the concept of change data capture in ETL? (medium)
  • How do you troubleshoot ETL job failures? (medium)
  • What role does metadata play in ETL processes? (basic)
  • How do you handle complex transformations in ETL processes? (medium)
  • What is the importance of data lineage in ETL? (basic)
  • Have you worked with parallel processing in ETL? If so, explain your experience. (advanced)
  • How do you ensure data consistency across different ETL jobs? (medium)
  • Can you explain the concept of slowly changing dimensions in ETL? (medium)
  • How do you document ETL processes for knowledge sharing and future reference? (basic)

Closing Remarks

As you explore ETL jobs in India, remember to showcase your skills and expertise confidently during interviews. With the right preparation and a solid understanding of ETL concepts, you can embark on a rewarding career in this dynamic field. Good luck with your job search!

cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies