Sr. Azure Data Engineer

As an Azure Data Engineer at AiEdge Analytics, you will play a crucial role in transforming raw data into valuable insights using your expertise in Data Engineering, Azure Data Warehousing, and ETL processes. Your responsibilities will include: - Developing and implementing Extract Transform Load (ETL) processes - Working with Azure Data Factory (ADF), ADF Workflows, Databricks, PySpark, Python, and SQL - Utilizing Microsoft Data Analytics tools and technologies to enhance data-driven decisions - Solving complex problems with attention to detail - Collaborating effectively with clients and team members - Working both independently and collaboratively in a team environment To excel in this role, you must possess the following qualifications: - Proficiency in Data Engineering with a focus on ETL processes - Experience with Azure Data Warehousing, ADF, Databricks, PySpark, Python, and SQL - Familiarity with Microsoft Data Analytics tools and technologies (preferred) - Strong problem-solving skills and attention to detail - Excellent communication skills for client and team coordination - Ability to work independently and in a team environment Skills that are a must-have for this role include: - Proficiency and experience as a Data Engineer in ADF, Databricks, and Python - Command over Python, SQL, and ETL processes - Experience with Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse - Proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages - Experience in managing different data formats, handling large datasets, and familiarity with Parquet and Delta Lake - Knowledge of Spark for performance optimization - Experience in Azure cloud stack Production environment - Building and optimizing Big Data pipelines, architectures, and datasets - Working knowledge of relational and non-relational databases - Strong analytic skills for structured and unstructured datasets - Experience with Azure DevOps for deploying data pipelines through CI/CD If you are someone who thrives in challenging and dynamic environments, we encourage you to connect with us by sharing your resume at Career@AiEdgeMS.com. Join us at AiEdge Analytics and be part of a passionate team driving innovation in Microsoft Data Analytics and AI-driven solutions.,