Posted:18 hours ago|
Platform:
On-site
Full Time
Experience Range 2-4 Years
Primary (Must have skills)* - To be
2+ years of experience in Azure Databricks with PySpark.
2+ years of experience in ADF (Azure Data Factory).
2+ years of experience in ADLS Gen 2.
2+ years of experience in Azure SQL.
1+ years of experience in Python programming & package builds.
Job Description of Role* (RNR) - To be
Evaluated by Technical Panel (Define it to give more clarity)
Key technical skills :
Hands-on experience in designing and building scalable data pipelines using Databricks with PySpark, supporting batch and near-real-time ingestion, transformation, and processing.Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs.
Experience in building efficient orchestration solutions using Azure data factory. Ability to design modular, reusable workflows using tasks, triggers, and dependencies.Experience in using dynamic expressions, parameterized pipelines, custom activities, and triggers.Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.
Good experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2. Familiar with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization.
Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL Database
Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components.Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries.
Write clear and concise documentation leveraging industry standard practices & guidelines during development adopting code analyzers and unit testing frameworks.
Soft skills/other skills - To be
Evaluated by Hiring Manager (To define how this will be evaluated)
Communication Skills: Communicate effectively with internal and customer stakeholders Communication approach: verbal, emails and instant messages Interpersonal Skills: Strong
interpersonal skills to build and maintain productive relationships with team members Provide constructive feedback during code reviews and be open to receiving feedback on your own code.
Problem-Solving and Analytical Thinking: Capability to troubleshoot and resolve issues efficiently. Analytical mindset. Task/ Work Updates Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps. Provides regular updates, proactive and due diligent to carry out responsibilities.
Expected Outcome We are seeking a highly skilled Data Engineering specialist with above mentioned Primary Skills to join our dynamic team who are at the forefront of enabling enterprises in Healthcare sectors. The ideal candidate should be passionate about working on Data Engineering on Azure Cloud in building product for our customers. Effectively Communicate and Collaborate with internal teams and customer to build code leveraging low level design documents aligning to standard coding principles and guidelines.
Yalantis Technologies
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python NowChennai, Tamil Nadu, India
Salary: Not disclosed
India
Salary: Not disclosed
Chennai, Tamil Nadu, India
5.0 - 8.0 Lacs P.A.
Bengaluru, Karnataka, India
2.5 - 4.5 Lacs P.A.
Pune, Maharashtra, India
2.0 - 5.0 Lacs P.A.
Bengaluru, Karnataka, India
4.5 - 8.5 Lacs P.A.
Hyderabad, Telangana, India
4.5 - 8.5 Lacs P.A.
Bhubaneswar, Odisha, India
Salary: Not disclosed
India
Salary: Not disclosed
Noida, Uttar Pradesh, India
18.0 - 20.0 Lacs P.A.