Bluethink It Consulting

Role & responsibilities Job Description: Job Summary: We are looking for a skilled Data Engineer to join our data team. The ideal candidate will have hands-on experience in building robust data pipelines using Airflow, managing data warehouses in Snowflake and Redshift, and working with cloud platforms such as AWS and Azure (Databricks, Glue). You will work closely with Data Scientists, Analysts, and Engineers to ensure data availability, quality, and reliability across the organization. Key Responsibilities: l Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, AWS Glue, and Databricks. l Integrate data from multiple sources into Snowflake and Redshift data warehouses. l Optimize queries and data models for performance and cost-efficiency. l Implement data quality and monitoring frameworks. l Collaborate with cross-functional teams to define data requirements and deliver data-driven solutions. l Manage data workflows in AWS and Azure environments. l Automate data processing tasks and ensure adherence to best practices and standards . Required Skills: l Proficiency in Apache Airflow for workflow orchestration. l Strong experience with Snowflake and/or Amazon Redshift. l Hands-on experience with AWS Glue, S3, Lambda, and Athena. l Familiarity with Azure Databricks and Spark-based processing. l Proficient in SQL, Python, and data transformation techniques. l Understanding of data warehouse and c. l Experience with CI/CD pipelines for data deployment. Good to Have: l Experience with data governance and security protocols. l Knowledge of streaming platforms (Kafka, Kinesis). l Familiarity with dbt or similar transformation tools. Qualifications: Bachelor's/Master's degree in Computer Science, Engineering