Senior Data Engineer

Job Role: Senior Data Engineer
Experience: 5+yrs Location: Bengaluru Notice Period: Max 30days Role Overview We are seeking a Senior Data Engineer to design, build, and maintain robust data ingestion frameworks and scalable pipelines You will be instrumental in shaping platform architecture, implementing efficient data models, and delivering cloud-based solutions to handle both real-time and batch processing on a scale, Key Responsibilities Design, develop, and optimize DBT models for scalable, maintainable data transformations, Architect and implement modern ELT pipelines leveraging DBT and orchestration tools such as Apache Airflow or Prefect, Lead query optimization and performance tuning for DBT models on Snowflake, Redshift, or Databricks, Integrate DBT workflows and pipelines with AWS services (S3, Lambda, Step Functions, RDS, Glue) and event-driven architectures, Build robust ingestion processes from diverse sources, including Manufacturing Execution Systems (MES), manufacturing stations, and web applications, Manage and monitor orchestration tools to ensure automated, reliable execution of DBT models, Implement CI/CD best practices for DBT, including version control, automated testing, and streamlined deployment workflows, Troubleshoot and resolve pipeline issues while optimizing for cost and performance, Qualifications 5+ years of hands-on DBT experience, including model design, testing, and optimization, 5+ years of strong SQL experience, with proven skills in query optimization and database performance tuning, 5+ years of programming experience, including custom DBT macros, scripting, APIs, and AWS integrations using boto3, 3+ years of experience with orchestration tools like Apache Airflow or Prefect, Proven experience with cloud data platforms (Snowflake, Redshift, Databricks, or BigQuery), Hands-on knowledge of AWS data services (S3, Lambda, Step Functions, RDS, SQS, CloudWatch), Familiarity with serverless architectures and infrastructure as code (CloudFormation, Terraform), Strong communication skills with the ability to deliver MVPs aligned with sprint timelines, Excellent analytical and problem-solving abilities, with a track record of cross-functional collaboration, Nice to Have Experience in hardware manufacturing data processing, Contributions to open-source data engineering projects, Knowledge of BI tools such as Tableau for data visualization, Understanding of front-end technologies (React, JavaScript, or similar) for building internal visualization tools or collaborating with UI teams,