Posted:1 month ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

WE NEED IMMEDIATE JOINERS...!!! Job Title: Data Engineer – Azure | Big Data | ETL | PySpark Location: Nagpur Job Type: Full-Time Experience Level: 2–5 Years Job Summary: We are seeking a talented and experienced Data Engineer to design, build, and maintain our cutting-edge data infrastructure. You will play a key role in developing scalable data pipelines, implementing data lake and warehouse solutions, and processing large volumes of data efficiently on the Azure cloud platform. The ideal candidate possesses a strong background in ETL development, Big Data technologies, Python/PySpark programming, and Azure Data Services. You will collaborate with cross-functional teams to deliver high-quality data products that drive business insights. Key Responsibilities: ● Design, develop, and manage scalable ETL pipelines and data workflows to ingest, process, and transform structured and unstructured data from diverse sources. ● Work with large-scale datasets using Big Data technologies and distributed processing frameworks such as Spark and/or Databricks. ● Implement data ingestion, cleansing, transformation, and enrichment processes using Python, PySpark, and SQL. ● Develop and maintain cloud-native data solutions leveraging Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks. ● Build optimized data models and data warehouse solutions (e.g., dimensional modeling, star/snowflake schemas) to support analytics and BI reporting. ● Ensure the high availability, reliability, performance, and security of data infrastructure and pipelines. ● Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality data products that meet business needs. ● Implement and enforce data governance policies, data quality standards, and data security best practices. ● Contribute to the development of data engineering best practices and promote a data-driven culture. ● Troubleshoot and resolve data-related issues, optimizing data pipelines for performance and efficiency. Required Skills and Experience: ● 4+ years of hands-on experience in Data Engineering, with a strong focus on ETL processes, Big Data technologies, and cloud platforms. ● Extensive experience with the Azure cloud ecosystem, including: ○ Azure Data Factory ○ Azure Synapse Analytics ○ Azure Data Lake Storage ○ Azure Databricks ● Proficiency in Python and PySpark for large-scale data processing and automation. ● Solid experience with Spark (batch and streaming). ● Strong SQL skills, including experience in query optimization, performance tuning, and data modeling. ● In-depth understanding of data warehousing concepts, dimensional modeling, and star/snowflake schemas. ● Experience with version control tools (e.g., Git) and CI/CD pipelines for data solutions using Azure DevOps or equivalent. ● Solid understanding of data privacy, security, and compliance standards. ● Excellent problem-solving, analytical, and communication skills. ● Ability to work independently and as part of a team in a fast-paced environment. Preferred Qualifications: ● Microsoft Azure Certification (DP-203: Data Engineering on Microsoft Azure, or equivalent). ● Experience working with orchestration tools such as Apache Airflow or dbt. ● Familiarity with BI tools such as Power BI. ● Experience working in Agile/Scrum methodologies. ● Knowledge of data streaming technologies (e.g., Kafka, Azure Event Hubs). ● Experience with Infrastructure as Code (IaC) for data infrastructure (e.g., Terraform, ARM templates). What We Offer: ● Competitive salary and performance-based incentives. ● Opportunity to work on cutting-edge, cloud-first data architectures. ● Collaborative, inclusive, and flexible work environment. ● Professional development opportunities and support for continuous learning. ● Comprehensive benefits package. Show more Show less

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You