Job
Description
As a Senior Data Engineer (Azure) at our company, you will be responsible for managing large-scale data and delivering exceptional results. Your expertise in Azure data services, ETL pipelines, and database management will be crucial for this role. If you are a proactive problem solver with a strong technical background and a positive attitude, we are looking forward to hearing from you. **Key Responsibilities:** - Develop, monitor, and maintain end-to-end data pipelines on Azure. - Work with Azure services such as Azure Data Factory (ADF), Azure Synapse, Databricks, and Azure Blob Storage for data ingestion, processing, and analytics. - Develop and optimize data ingestion, transformation, and analytical workflows for structured and unstructured data. - Design efficient data models for optimal performance in data processing and storage. - Implement large-scale data ingestion pipelines capable of handling TBs of data. - Develop scalable batch or real-time data solutions using Apache Kafka, Apache Airflow, and Databricks. - Build and maintain ETL/ELT pipelines for data integration and migration. - Collaborate with cross-functional teams to integrate data solutions into production environments. - Ensure data quality, integrity, and compliance with security best practices. **Qualifications Required:** - Bachelor's/Master's degree in Computer Science, Data Engineering, or a related field. - 4+ years of hands-on experience in data engineering, ETL development, and data pipeline implementation. - Proficiency in Python and SQL for data processing and analysis. - Strong expertise in Azure data services (ADF, Synapse, Databricks, Blob Storage, etc.). - Experience with big data processing frameworks like Spark, Kafka, and Airflow. - Working knowledge of data warehouse solutions such as Synapse, Snowflake, Redshift, or BigQuery. - Strong analytical and problem-solving skills. - Ability to work independently, mentor peers, and meet tight deadlines. - Excellent interpersonal and communication skills. - Experience with cloud-based data architecture and security best practices. - Azure certification is a plus. - Experience with data lake architectures. - Knowledge of machine learning model deployment and data processing for AI applications. - Prior experience in automated data pipeline deployment using CI/CD workflows. The company offers a flat-hierarchical, friendly, engineering-oriented, and growth-focused culture. You'll have flexible work timing, leaves for life events, and work-from-home options. Additionally, benefits include free health insurance, an office facility with a fully-equipped game zone, in-office kitchen with affordable lunch service, free snacks, sponsorship for certifications/events, and a library service. As a Senior Data Engineer (Azure) at our company, you will be responsible for managing large-scale data and delivering exceptional results. Your expertise in Azure data services, ETL pipelines, and database management will be crucial for this role. If you are a proactive problem solver with a strong technical background and a positive attitude, we are looking forward to hearing from you. **Key Responsibilities:** - Develop, monitor, and maintain end-to-end data pipelines on Azure. - Work with Azure services such as Azure Data Factory (ADF), Azure Synapse, Databricks, and Azure Blob Storage for data ingestion, processing, and analytics. - Develop and optimize data ingestion, transformation, and analytical workflows for structured and unstructured data. - Design efficient data models for optimal performance in data processing and storage. - Implement large-scale data ingestion pipelines capable of handling TBs of data. - Develop scalable batch or real-time data solutions using Apache Kafka, Apache Airflow, and Databricks. - Build and maintain ETL/ELT pipelines for data integration and migration. - Collaborate with cross-functional teams to integrate data solutions into production environments. - Ensure data quality, integrity, and compliance with security best practices. **Qualifications Required:** - Bachelor's/Master's degree in Computer Science, Data Engineering, or a related field. - 4+ years of hands-on experience in data engineering, ETL development, and data pipeline implementation. - Proficiency in Python and SQL for data processing and analysis. - Strong expertise in Azure data services (ADF, Synapse, Databricks, Blob Storage, etc.). - Experience with big data processing frameworks like Spark, Kafka, and Airflow. - Working knowledge of data warehouse solutions such as Synapse, Snowflake, Redshift, or BigQuery. - Strong analytical and problem-solving skills. - Ability to work independently, mentor peers, and meet tight deadlines. - Excellent interpersonal and communication skills. - Experience with cloud-based data architecture and security best practices. - Azure certification is a plus. - Experience with data lake architectures. - Knowledge of machine learning model deployment and data p
