Data Engineer

Relevant experience: 4 - 6 years

Role: Sr Engineer, Analytics, Developer

Location: Bangalore or Vadodara

Responsibilities:

• Design, build, and optimize scalable ETL workflows using Informatica, Snap Logic, and AWS Glue.
• Develop and maintain data pipelines for ingestion, transformation, and loading into data warehouses.
• Manage and monitor data warehouse clusters and AWS EMR ensuring high availability, performance, and security.
• Write and optimize complex SQL queries for data extraction, transformation, and reporting.
• Implement data quality checks, validation, and governance processes.
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver solutions.
• Automate workflows and processes using Python for efficiency and scalability.
• Troubleshoot and resolve data-related issues in production environments.
• Ensure compliance with data security standards and best practices.

Required Skills:

• Strong expertise in SQL (query optimization, stored procedures, performance tuning).
• Hands-on experience with Informatica for ETL development.
• Proficiency in Snap Logic for integration and data flow automation.
• Experience with AWS Glue for serverless ETL and AWS EMR for big data processing.
• Experience in data warehouse cluster management (e.g., Snowflake, Redshift, Big Query, or similar).
• Solid programming skills in Python for scripting and automation.
• Knowledge of data modelling, data governance, and data quality frameworks.
• Familiarity with cloud platforms (AWS, Azure, GCP) and related data services.
• Excellent problem-solving and communication skills.

Preferred Qualifications:

• Bachelor’s degree in computer science, Information Technology or equivalent.
• 3-4 years of relevant experience in Tableau dashboard development in data analytics