📍 Senior Data Engineer 📍 Location: Hyderabad or Ahmedabad 📌 Experience: 5 - 8 years 🔹 About the Role We are seeking an experienced Senior Data Engineer to join our team. This role requires expertise in designing, developing, and optimizing high-performance data pipelines while leveraging cloud platforms and distributed data processing frameworks . As a key member of our data engineering team, you will play a pivotal role in data architecture, modeling, governance, and automation , ensuring efficiency, scalability, and security across our data ecosystems. Additionally, you will mentor junior engineers and drive best practices in data engineering. 🔹 Key Responsibilities ✅ Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms . ✅ Optimize distributed data processing for improved efficiency and reliability. ✅ Implement best practices in data modeling, architecture, and governance . ✅ Ensure data integrity, security, and compliance within cloud environments. ✅ Automate data workflows , monitor pipeline performance, and troubleshoot issues proactively. ✅ Provide technical leadership and mentorship to junior engineers, conduct code reviews, and establish best practices. 🔹 Required Skills & Experience ✔️ 5+ years of hands-on experience in Data Engineering with expertise in Python, PySpark,Spark, SQL, and Cloud platforms . ✔️ Strong proficiency in Snowflake, Databricks, or Microsoft Fabric . ✔️ Solid experience in data architecture, modeling, and pipeline optimization . ✔️ Hands-on experience with workflow orchestration tools (e.g., Airflow, DBT ). ✔️ Proven ability to mentor and lead junior engineers while driving best practices in data engineering. Show more Show less

About the Role: We are looking for an experienced IT Recruiter with a strong consulting background to join our Talent Acquisition team. The ideal candidate should have 3 to 5 years of experience in technical recruitment, with a strong focus on Data Engineering technologies . This role requires excellent stakeholder management skills, a deep understanding of the tech hiring landscape, and hands-on experience in sourcing, screening, and closing top-tier Data professionals. Required Skills & Experience: 3 to 5 years of IT recruitment experience, preferably in a consulting environment Proven experience in hiring for Data Engineering and Analytics roles. Strong sourcing skills and familiarity with job boards like Naukri, LinkedIn, etc. Good understanding of data-related skill sets and market availability Ability to manage multiple requirements and stakeholders simultaneously Excellent communication, interpersonal, and negotiation skills Experience working with ATS and recruitment tools. Bachelor's degree or equivalent in HR, Business, or related field. Show more Show less

📍 Senior Data Engineer 📍 Location: Hyderabad or Ahmedabad 📌 Experience: 5 - 8 years 🔹 About the Role We are seeking an experienced Senior Data Engineer to join our team. This role requires expertise in designing, developing, and optimizing high-performance data pipelines while leveraging cloud platforms and distributed data processing frameworks . As a key member of our data engineering team, you will play a pivotal role in data architecture, modeling, governance, and automation , ensuring efficiency, scalability, and security across our data ecosystems. Additionally, you will mentor junior engineers and drive best practices in data engineering. 🔹 Key Responsibilities ✅ Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms . ✅ Optimize distributed data processing for improved efficiency and reliability. ✅ Implement best practices in data modeling, architecture, and governance . ✅ Ensure data integrity, security, and compliance within cloud environments. ✅ Automate data workflows , monitor pipeline performance, and troubleshoot issues proactively. ✅ Provide technical leadership and mentorship to junior engineers, conduct code reviews, and establish best practices. 🔹 Required Skills & Experience ✔️ 5+ years of hands-on experience in Data Engineering with expertise in Python, PySpark,Spark, SQL, and Cloud platforms . ✔️ Strong proficiency in Snowflake, Databricks, or Microsoft Fabric . ✔️ Solid experience in data architecture, modeling, and pipeline optimization . ✔️ Hands-on experience with workflow orchestration tools (e.g., Airflow, DBT ). ✔️ Proven ability to mentor and lead junior engineers while driving best practices in data engineering. Show more Show less

Job description Position: Sr Data Engineer Location: Hyderabad or Ahmedabad Experience: 5+ years Mode of work: Hybrid Skill: Python, PySpark, SQL & Snowflake Preferred Immediate to 30 days joiners. Key Responsibilities: Design, develop, and manage robust data pipelines using Snowflake, Python, and PySpark. Implement and optimise Snowflake features, including SnowSQL, Snowpipe, and Snowpark, to enhance performance and efficiency. Build ELT/ETL processes to support data ingestion and transformation for analytics. Automate data workflows, ensuring scalability and reliability for large datasets. Collaborate with cross-functional teams to deliver high-quality, data-driven solutions. Monitor and troubleshoot Snowflake workloads, ensuring cost-effectiveness and optimal performance. Document data architectures, processes, and best practices for future scalability. Stay updated with the latest industry trends in Snowflake and data engineering technologies. Required Skills & Experience: 4+ years of experience in Data Engineering. 2+ years of hands-on expertise with Apache Spark, Python, PySpark, and SQL. 2+ years working with Snowflake, including: SnowSQL, Snowpipe, Snowpipe Streaming, Snowpark Proficiency in data warehouse architecture, data modeling, and ELT/ETL processes. Experience with cloud platforms such as Azure, AWS, or Databricks. Knowledge of Machine Learning and Generative AI platforms. Strong analytical, communication, and problem-solving skills. Show more Show less

📍 Senior Data Engineer 📍 Location: Hyderabad or Ahmedabad 📌 Experience: 5 - 8 years 🔹 About the Role We are seeking an experienced Senior Data Engineer to join our team. This role requires expertise in designing, developing, and optimizing high-performance data pipelines while leveraging cloud platforms and distributed data processing frameworks . As a key member of our data engineering team, you will play a pivotal role in data architecture, modeling, governance, and automation , ensuring efficiency, scalability, and security across our data ecosystems. Additionally, you will mentor junior engineers and drive best practices in data engineering. 🔹 Key Responsibilities ✅ Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms . ✅ Optimize distributed data processing for improved efficiency and reliability. ✅ Implement best practices in data modeling, architecture, and governance . ✅ Ensure data integrity, security, and compliance within cloud environments. ✅ Automate data workflows , monitor pipeline performance, and troubleshoot issues proactively. ✅ Provide technical leadership and mentorship to junior engineers, conduct code reviews, and establish best practices. 🔹 Required Skills & Experience ✔️ 5+ years of hands-on experience in Data Engineering with expertise in Python, PySpark,Spark, SQL, and Cloud platforms . ✔️ Strong proficiency in Snowflake . ✔️ Solid experience in data architecture, modeling, and pipeline optimization . ✔️ Hands-on experience with workflow orchestration tools (e.g., Airflow, DBT ). ✔️ Proven ability to mentor and lead junior engineers while driving best practices in data engineering. Show more Show less

Role: Senior Data Engineer Location: Hyderabad or Ahmedabad Experience: 5+ Years Skill: Python, PySpark, SQL & Data Bricks / MS Fabric Preferred Immediate to 30 days joiners. About the Role: We are seeking an experienced Senior Data Engineer to join our team. This role requires expertise in designing, developing, and optimizing high-performance data pipelines while leveraging cloud platforms and distributed data processing frameworks. As a key member of our data engineering team, you will play a pivotal role in data architecture, modeling, governance, and automation, ensuring efficiency, scalability, and security across our data ecosystems. Additionally, you will mentor junior engineers and drive best practices in data engineering. Key Responsibilities Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms. Optimize distributed data processing for improved efficiency and reliability. Implement best practices in data modeling, architecture, and governance. Ensure data integrity, security, and compliance within cloud environments. Automate data workflows, monitor pipeline performance, and troubleshoot issues proactively. Provide technical leadership and mentorship to junior engineers, conduct code reviews, and establish best practices. Required Skills & Experience 4+ years of hands-on experience in Data Engineering with expertise in Python, PySpark,Spark, SQL, and Cloud platforms. Strong proficiency in Databricks, or Microsoft Fabric. Solid experience in data architecture, modeling, and pipeline optimization. Hands-on experience with workflow orchestration tools (e.g., Airflow, DBT). Proven ability to mentor and lead junior engineers while driving best practices in data engineering. Show more Show less

Tableau Administrator Job Description Overview The Tableau Administrator will be responsible for managing, maintaining, and optimizing the Tableau Server environment to ensure seamless access and utility for all users. This role is crucial for the effective deployment of Tableau analytics across the organization, fostering data-driven decision-making and insight generation. The ideal candidate will possess technical expertise in Tableau Server and Tableau Desktop, along with strong communication skills to support user engagement and training. Key Responsibilities Tableau Server Management: Install, configure, and administer Tableau Server environments, ensuring consistent availability and performance. Performance Optimization: Monitor server performance, troubleshoot issues, and implement solutions to maximize efficiency and reliability. Security Implementation: Manage user permissions and roles, ensuring data security and compliance with organizational policies. Upgrades and Patching: Apply software updates, patches, and new versions to keep Tableau Server up to date. Support and Training: Provide training and support to Tableau users, enabling them to utilize Tableau effectively for their analytical needs. Integration: Work with IT teams to integrate Tableau with other data sources and systems within the organization. Documentation: Create and maintain detailed documentation of server configurations, processes, and best practices. Collaboration: Collaborate with data analysts, business intelligence teams, and other stakeholders to understand their needs and provide solutions. Innovation: Stay updated with the latest Tableau features and enhancements, recommending and implementing new functionality as appropriate. Development: Create Qualifications Education: Bachelor’s degree in Computer Science, Information Technology, Business Analytics, or a related field. Experience: Minimum of 3 years of experience administering Tableau Server in a professional setting. Technical Skills: Proficiency in Tableau Server architecture, installation, configuration, and performance tuning. Familiarity with scripting languages (Python, PowerShell) and SQL for data manipulation and integration. Analytical Skills: Strong understanding of data visualization principles and best practices. Communication Skills: Excellent verbal and written communication skills, with an ability to explain complex technical concepts to non-technical users. Problem-Solving: Proven ability to troubleshoot and resolve technical issues efficiently. Team Player: Ability to work collaboratively within a team and across departments. Certifications: Tableau Server Certified Professional or similar certification preferred. Work Environment The Tableau Administrator will work in a dynamic and collaborative environment, often interacting with various teams and departments. The role may require flexibility in working hours, as system maintenance and upgrades may need to be performed during off-peak hours to minimize disruption.

Technical Skills Languages: C# Frameworks: .NET 8 Cloud: Azure(App Service, Key Vault, Application Gateway, Application Insights, etc.) Databases: SQL Server Tools: Azure Devop, SonarQube Unit Test : Xunit , nUnit Concepts: Microservices, OOPS, SOLID Principles, RESTful APIs, Security (OWASP Top 10) Requirements At least 7+ years of Experience with the .NET/C# technology stack. Experience creating and consuming REST based APIs using .NET 8. Design, develop, and maintain microservices using .NET8, SQL, REST, and EF Core Able to employ best practices for designing reusable code and scalability. Proficient in object-oriented design (OOD) using SOLID design principles and patterns. Experience in delivering high quality products on time while working in Agile Teams and following Agile methodologies. Unit testing with Xunit or nUnit Nice to haves Develop and maintain Azure services (e.g. App Services, Azure key vault, Azure Pipelines, Application Insights). Understanding of cloud computing technologies, business drivers, and emerging computing trends. Good understanding of CI/CD Experience with SQL Database with stored procedures. Responsibilities Work in Agile teams to deliver high quality products on time with performance and requirements in mind. Build, test and deliver high quality systems Show more Show less

Key Responsibilities Coordinate and manage project-related activities, including scheduling meetings, preparing reports, and maintaining documentation. Support project planning, tracking, and execution to ensure milestones and deliverables are achieved on time. Handle administrative tasks such as resource allocation, budgeting, and compliance tracking. Act as a liaison between stakeholders, ensuring clear communication and alignment. Step into a Project Manager role when required, driving execution and providing leadership for project delivery. Monitor project risks and issues, ensuring timely escalation and resolution. Maintain and optimize project management tools and processes to enhance efficiency. Qualifications Proven experience in project coordination, PMO, or a similar role. Strong organizational and multitasking skills with attention to detail. Familiarity with project management methodologies (e.g., Agile, Waterfall). Proficient in project management tools (e.g., JIRA, MS Project, or similar). Excellent communication and interpersonal skills. Ability to work independently and take ownership of tasks. Prior experience in IT or related industries is preferred. Show more Show less

Job Description We are looking for an experienced Scrum Master to lead Agile practices for our Finance Domain ETL/Talend team at the client location. The ideal candidate will facilitate sprints, remove blockers, and ensure seamless collaboration between business and technical teams. Key Responsibilities Guide the team in Agile principles and Scrum framework. Facilitate sprint planning, stand-ups, reviews, and retrospectives. Collaborate with stakeholders to ensure smooth project execution. Identify and resolve impediments for the team. Track progress and ensure timely delivery of ETL/Talend-based solutions. Required Skills Strong experience as a Scrum Master in Finance Domain projects. Hands-on knowledge of ETL/Talend processes and data pipelines. Excellent stakeholder management and communication skills. Certified Scrum Master (CSM) or equivalent is preferred. Show more Show less

Primary Responsibilities Include Perform user acceptance testing from the investigation team's point of view for every feature / data / system that the technology team migrates to production. Have good analytical skills to perform analysis of transactions Be a person with excellent stakeholder management skills i.e. listen to investigation team's concerns and translate that information to the technology team. Perform discovery of newer ERP systems and become a subject matter on those Qualifications I am thinking someone with an MBA in finance would be good to start with as they have both financial/business experience and technology exposure Preferably worked as an analyst in companies like pwc, Deloitte, EY etc. Should know SQL language to perform UAT (This is a must have) Show more Show less

Key Responsibilities Design, develop, and maintain business intelligence solutions. Collaborate with cross-functional teams to understand data requirements and deliver insightful visualizations. Optimize and manage data storage solutions in cloud environments. Implement and maintain semantic models to support business analytics and reporting. Ensure data quality and integrity through rigorous testing and validation. Utilize SQL, Python, Spark, and cloud technologies to process and analyze large datasets. Create and manage visualizations using Power BI, Tableau, or Qlik. Required Qualifications 2-3 years of PowerBI experience 3-5 years of Azure Cloud experience Strong problem-solving skills and effective communication abilities. Proficiency in SQL, Python, Spark, cloud technologies, semantic modeling, and visualizations. Preferred Qualifications Knowledge of AI and Snowflake experience is a plus. Experience with data engineering principles. Show more Show less

Python Senior Developer Must have 5+ years of experience in Python programming. Extensive experience in handling complex projects. Good leadership skills and ability to lead projects independently. Good communication and teamwork skills. Good analytical skills and proficiency in Web based development technologies. Expertise in Agile development methodology. Strong problem-solving skills. Strong knowledge in Design patterns, Security, Performance tuning and App monitoring. Experience in API Design, security patterns, Microservices architecture. Must have experience in building scalable, low latency based web application using Flask, FastAPI or similar. Experience in building python-based SDKs. Experience in python based ORM (Object Relational Mapper) frameworks. Knowledge in distributed in-memory systems such as Redis, MemCache, GemFire or similar. Knowledge in SQL database and no-SQL database. Understanding on building Production grade application using WSGI/ASGI frameworks such as Gunicorn, Uvicorn etc. Experience of Jenkins, CICD pipeline, Logging framework, Splunk, ELK stack is good to have. Knowledge and experience with virtualization and cloud platforms (Kubernetes, AWS, OpenShift, Docker Containers) Familiarity with version control system such as Git. Knowledge on developing test suites, application debugging skills. Good To Have Understanding on front-end technologies including JavaScript, HTML5, Angular. Understanding on Event-driven programming using Python. Knowledge of Generative AI technologies, LLMs, Embeddings, building RAG based solutions. Understanding on HDFS, Hive, Impala, PySpark and other components of BigData systems. Show more Show less

As a Sr.Data Quality Engineer manages and coordinates with internal or external parties the collection, compilation, normalization, and standard analysis of data assets across diverse projects and data platforms. Develops, maintains, evaluates, and tests valuates data solutions within an organization. Develops and executes plans, policies, and practices that control, protect, deliver, and enhance the value and integrity of the organization's data and information assets and programs. Typical Functions Manipulates and queries data by building SQL and stored procedures single handedly in Snowflake Writes and executes test cases for data-related release items within Agile processes Writes complex SQL queries and handle large data set quality validation Builds a Data Quality Testing Framework from scratch to monitor the quality of data. Understands the basic concepts of data Warehousing, ETL to validate changes to them Executes common data quality tests to validate data accuracy, data completeness, data freshness, data integrity, data consistency Builds test cases to validate the generated data analytical report and dashboard Creates database tests to enforce data validation and constraints quality standards Applies your knowledge of dimensional modeling and data warehouse concepts, such as star schemas, snowflakes, dimensions, facts to conduct data analysis Performs statistical tests on large datasets to determine data quality and integrity Evaluates system performance and design, as well as its effect on data quality Collaborates with database developers to improve data collection and storage processes Runs data queries to identify coding issues and data exceptions, as well as cleaning data Gathers data from primary or secondary data sources to identify and interpret trends Keeps abreast of developments and trends in data quality analysis Collects, stores, processes, and analyses raw and/or complex data from multiple sources, recommends ways to apply the data, chooses and designs optimal data solutions, and builds data processing systems, using expertise in data warehousing solutions and working with the latest database technologies. Maintains, implements, and monitors the quality of the data and information with the architecture used across the company; reports on results and identifies and recommends system application changes required to improve the quality of data in all applications. Investigates data quality problems, conducts analysis to determine root causes of problems, corrects errors, and develops prototypes, process improvement plans across all programs, and proof of concepts for the selected solutions. Processes unstructured data into a form suitable for analysis, followed by doing the analysis. Integrates innovations and algorithms into the organization's data systems, working closely with engineering team. Implements complex data projects with a focus on collecting, parsing, managing, analysing, and visualising large sets of data to turn information into insights using multiple platforms. Serves as a data subject matter expert, collaborates with business owners or external clients to establish an analysis plan to answer key business questions, and delivers both reporting results and insights. Generates specific and operational reports in support of objectives and initiatives, and presents and communicates complex analytical data and results to appropriate audiences. Requirements Other duties or functions may be assigned. Bachelor's Degree in Engineering, Computer Science, or equivalent experience 6+ Years of Software Quality Assurance experience which includes Data Warehouse Testing Proficiency in SQL ideally within Snowflake SQL with MySQL, SQL Server, and/or PostgreSQL Experience with Sisense or Power BI 5+ years experience developing data driven software Proficiency in programming languages, including Structured Query Language (SQL) Experience writing DBT tests Experience In Agile Methods, Particularly Scrum, Preferred Demonstrated knowledge of critical thinking Professional experience around the data science lifecycle (feature engineering, training, model deployment) Show more Show less

Job Description We are looking for a highly skilled and passionate Generative AI Engineer to join our AI/ML team. In this role, you will work on designing, building, and deploying advanced generative AI models using cutting-edge deep learning techniques. You will collaborate with cross-functional teams to develop impactful AI solutions that integrate seamlessly into business workflows. Responsibilities Collaborate with product, engineering, and research teams to integrate GenAI capabilities into applications and services. Research, evaluate, and implement the latest advancements in generative AI and large language models (LLMs). Maintain and iterate on prompt engineering strategies to optimize model outputs. Participate in prompt tuning, RLHF, and benchmarking experiments for performance and accuracy. Work with vector databases (e.g., FAISS, PGVector, Pinecone) for retrieval-augmented generation (RAG) and semantic search use cases. Design scalable, observable, and resilient generative AI pipelines for real-world applications. Monitor model performance and continuously improve efficiency, accuracy, and user experience. Qualifications Strong experience in deep learning and NLP, especially LLMs and generative models. Proficiency in Python and ML libraries such as Hugging Face Transformers, LangChain, and OpenAI APIs. Experience with prompt engineering, few-shot learning, and fine-tuning LLMs. Familiarity with ML Ops/LLMOps and distributed systems. Experience working with vector databases and RAG pipelines. Solid understanding of system design patterns, scalability, observability, and performance tuning. Strong analytical and problem-solving skills. Passion for exploring and building with emerging AI technologies. Show more Show less

📍 Lead Data Engineer 📍 Location: Hyderabad or Ahmedabad 📌 Experience: 8 years Immediate Joiners Preferred 🔹 About the Role We are seeking an experienced Lead Data Engineer to join our team. This role requires expertise in designing, developing, and optimizing high-performance data pipelines while leveraging cloud platforms and distributed data processing frameworks . As a key member of our data engineering team, you will play a pivotal role in data architecture, modeling, governance, and automation , ensuring efficiency, scalability, and security across our data ecosystems. Additionally, you will mentor junior engineers and drive best practices in data engineering. 🔹 Key Responsibilities ✅ Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms . ✅ Optimize distributed data processing for improved efficiency and reliability. ✅ Implement best practices in data modeling, architecture, and governance . ✅ Ensure data integrity, security, and compliance within cloud environments. ✅ Automate data workflows , monitor pipeline performance, and troubleshoot issues proactively. ✅ Provide technical leadership and mentorship to junior engineers, conduct code reviews, and establish best practices. 🔹 Required Skills & Experience ✔️ 8+ years of hands-on experience in Data Engineering with expertise in Python, PySpark,Spark, SQL, and Cloud platforms . ✔️ Strong proficiency in Snowflake, Databricks, or Microsoft Fabric . ✔️ Solid experience in data architecture, modeling, and pipeline optimization . ✔️ Hands-on experience with workflow orchestration tools (e.g., Airflow, DBT ). ✔️ Proven ability to mentor and lead junior engineers while driving best practices in data engineering. Show more Show less

Bachelor’s degree in Computer Science, Information Technology, or related field 2-4 years of hands-on experience with Laravel and Angular (academic projects/internships also considered) Good understanding of PHP, MySQL, and RESTful APIs Familiarity with Angular concepts like components, services, routing, and reactive forms understanding of HTML, CSS, JavaScript, and TypeScript Knowledge of version control systems like Git Strong problem-solving and communication skills Eagerness to learn and adapt in a fast-paced environment Familiarity with tools like Postman, Composer, npm, or Webpack Build dynamic frontend interfaces and SPAs using Angular Show more Show less

Data Engineer to design, develop, and maintain data pipelines and ETL workflows for processing large-scale structured and unstructured data. The ideal candidate will have expertise in Azure Data Services (Azure Data Factory, Synapse, Databricks, SQL, SSIS, and Data Lake) along with big data processing, real-time analytics, and cloud data integration. Key Responsibilities Data Pipeline Development & ETL/ELT Design and build scalable data pipelines using Azure Data Factory, Synapse Pipelines ,Databricks, SSIS and ADF Connectors like Salesforce. Implement ETL/ELT workflows for structured and unstructured data processing. Optimize data ingestion, transformation, and storage strategies. Cloud Data Architecture & Integration Develop data integration solutions for ingesting data from multiple sources (APIs, databases, streaming data). Work with Azure Data Lake, Azure Blob Storage, and Delta Lake for data storage and processing. Database Management & Optimization Design and maintain cloud data bases (Azure Synapse, BigQuery, Cosmos DB). Optimize SQL queries and indexing strategies for performance. Implement data partitioning, compression, and caching for efficiency. Data Governance, Security & Compliance Ensure data quality, lineage, and governance with tools like Purview. Implement role-based access control (RBAC), encryption, and security policies. Ensure compliance with GDPR, HIPAA, and ISO 27001 regulations. Monitoring & Performance Tuning Use Azure Monitor, Log Analytics, and OpenTelemetry to track performance and troubleshoot data issues. Automate data pipeline testing and validation. Collaboration & Documentation Document data models, pipeline architectures, and data workflows. Technical Skills Cloud Data Services: Azure Data Factory, Azure Synapse, Databricks, SSIS, BigQuery. ETL & Data Pipelines: Apache Spark, Python, SQL. Big Data Processing: Delta Lake, Parquet, Hadoop, Event Hubs. Database Management: SQL Server, Cosmos DB. Security & Compliance: RBAC, Data Masking, Encryption, Purview. Scripting & Automation: Python, PowerShell, Terraform for IaC. Show more Show less

Summary We are seeking a skilled and proactive Data Engineer with a strong background in ETL development and a focus on integrating data quality frameworks. In this role, you will be responsible for designing, developing, and maintaining ETL pipelines while ensuring data quality is embedded throughout the process. You will play a crucial role in building robust and reliable data pipelines that deliver high-quality data to our data warehouse and other systems. Responsibilities Design, develop, and implement ETL processes to extract data from various source systems, transform it according to business requirements, and load it into target systems (e.g., data warehouse, data lake) Implement data validation and error handling within ETL pipelines. Build and maintain scalable, reliable, and efficient data pipelines. Design and implement data quality checks, validations, and transformations within ETL processes. Automate data quality monitoring, alerting, and reporting within ETL pipelines. Develop and implement data quality rules and standards within ETL processes. Integrate data from diverse sources, including databases, APIs, flat files, and cloud-based systems. Utilize ETL tools and technologies (e.g., SnapLogic, Informatica PowerCenter, Talend, AWS Glue, Apache Airflow, Azure Data Factory, etc.). Write SQL queries to extract, transform, load, and validate data. Use scripting languages (e.g., Python) to automate ETL processes, data quality checks, and data transformations. Show more Show less

Job Description We are seeking a highly skilled Senior Kafka and Scala Developer to join our dynamic team. The ideal candidate will have extensive experience in developing and maintaining scalable, high-performance systems using Kafka and Scala. You will be responsible for designing, implementing, and optimizing data pipelines and distributed systems. Key Responsibilities Design, develop, and maintain scalable data pipelines using Kafka and Scala. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions. Optimize and tune Kafka clusters for performance and reliability. Implement best practices for data processing, storage, and retrieval. Troubleshoot and resolve issues related to Kafka and Scala applications. Mentor and guide junior developers in the team. Qualifications Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 6+ years of experience in software development with a strong focus on Kafka and Scala. Proficiency in designing and implementing distributed systems. Strong understanding of data structures, algorithms, and software design principles. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Preferred Skills Experience with cloud platforms such as AWS, Azure, or Google Cloud. Experience with other big data technologies such as Hadoop, Spark, and Cassandra is a plus. Knowledge of containerization technologies like Docker and Kubernetes. Familiarity with CI/CD pipelines and DevOps practices. Understanding of machine learning and data analytics. Show more Show less