Data Engineer

About Company

Its industry-specific solutions are designed to address complex business challenges by combining domain expertise with deep technical capabilities. With a global workforce of over 80,000 professionals and a presence in more than 50 countries.

We are seeking a highly skilled Data Engineer / BI Specialist with expertise in big data processing, cloud-based analytics, and advanced visualization technologies. The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, Azure data services, Python programming, and emerging technologies like IoT and AR/VR/MR. You will be responsible for designing, building, and optimizing large-scale data pipelines and delivering insightful analytics solutions.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, Azure Data Factory, and Databricks.
• Integrate and manage structured and unstructured data from diverse sources, including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.
• Implement IoT data ingestion, processing, and analytics solutions using Azure IoT services.
• Develop and deploy Python scripts for automation, data transformation, and analytics workflows.
• Create dashboards, visualizations, and reports to support data-driven decision-making (e.g., Power BI, immersive AR/VR/MR analytics).
• Collaborate with cross-functional teams to gather requirements, optimize pipelines, and ensure high data quality.
• Ensure solutions follow security, compliance, and data governance best practices.

Mandatory Skills:

• Apache Airflow
• Apache Spark
• Python
• Azure Cosmos DB
• Azure Data Factory
• Azure IoT
• Azure Synapse Analytics
• Azure Data Lake
• Databricks
• AR/VR/MR

Required Experience & Qualifications:

• 5+ years of experience in data engineering, cloud analytics, or BI development.
• Strong SQL skills and experience with data modeling.
• Proficiency in distributed data processing frameworks.
• Experience working in Microsoft Azure cloud environments.
• Strong problem-solving skills and ability to work with large-scale datasets.

Preferred Skills:

• Experience with AI/ML integrations into analytics pipelines.
• Familiarity with real-time data streaming solutions (Kafka, Event Hubs).
• Exposure to immersive analytics using AR/VR/MR.