Junior Azure Data Engineer

Job Description

WE NEED IMMEDIATE JOINERS...!!! Job Title: Data Engineer – Azure | Big Data | ETL | PySpark Location: Nagpur Job Type: Full-Time Experience Level: 2–5 Years Job Summary: We are seeking a talented and experienced Data Engineer to design, build, and maintain our cutting-edge data infrastructure. You will play a key role in developing scalable data pipelines, implementing data lake and warehouse solutions, and processing large volumes of data efficiently on the Azure cloud platform. The ideal candidate possesses a strong background in ETL development, Big Data technologies, Python/PySpark programming, and Azure Data Services. You will collaborate with cross-functional teams to deliver high-quality data products that drive business insights. Key Responsibilities: ● Design, develop, and manage scalable ETL pipelines and data workflows to ingest, process, and transform structured and unstructured data from diverse sources. ● Work with large-scale datasets using Big Data technologies and distributed processing frameworks such as Spark and/or Databricks. ● Implement data ingestion, cleansing, transformation, and enrichment processes using Python, PySpark, and SQL. ● Develop and maintain cloud-native data solutions leveraging Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks. ● Build optimized data models and data warehouse solutions (e.g., dimensional modeling, star/snowflake schemas) to support analytics and BI reporting. ● Ensure the high availability, reliability, performance, and security of data infrastructure and pipelines. ● Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality data products that meet business needs. ● Implement and enforce data governance policies, data quality standards, and data security best practices. ● Contribute to the development of data engineering best practices and promote a data-driven culture. ● Troubleshoot and resolve data-related issues, optimizing data pipelines for performance and efficiency. Required Skills and Experience: ● 4+ years of hands-on experience in Data Engineering, with a strong focus on ETL processes, Big Data technologies, and cloud platforms. ● Extensive experience with the Azure cloud ecosystem, including: ○ Azure Data Factory ○ Azure Synapse Analytics ○ Azure Data Lake Storage ○ Azure Databricks ● Proficiency in Python and PySpark for large-scale data processing and automation. ● Solid experience with Spark (batch and streaming). ● Strong SQL skills, including experience in query optimization, performance tuning, and data modeling. ● In-depth understanding of data warehousing concepts, dimensional modeling, and star/snowflake schemas. ● Experience with version control tools (e.g., Git) and CI/CD pipelines for data solutions using Azure DevOps or equivalent. ● Solid understanding of data privacy, security, and compliance standards. ● Excellent problem-solving, analytical, and communication skills. ● Ability to work independently and as part of a team in a fast-paced environment. Preferred Qualifications: ● Microsoft Azure Certification (DP-203: Data Engineering on Microsoft Azure, or equivalent). ● Experience working with orchestration tools such as Apache Airflow or dbt. ● Familiarity with BI tools such as Power BI. ● Experience working in Agile/Scrum methodologies. ● Knowledge of data streaming technologies (e.g., Kafka, Azure Event Hubs). ● Experience with Infrastructure as Code (IaC) for data infrastructure (e.g., Terraform, ARM templates). What We Offer: ● Competitive salary and performance-based incentives. ● Opportunity to work on cutting-edge, cloud-first data architectures. ● Collaborative, inclusive, and flexible work environment. ● Professional development opportunities and support for continuous learning. ● Comprehensive benefits package. Show more Show less