Data Analyst

8 - 10 years

0 Lacs

Posted:22 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Location Chennai Work from OfficeExperience Level 8 10 yearsTier T2We are seeking a highly skilled and experienced Senior Data Engineer to lead the design and development of scalable secure and high performance data pipelines hosted on a cloud platform The ideal candidate will have deep expertise in Databricks Data Fabric MDM Informatica and Unity Catalog and a strong foundation in data modelling software engineering and DevOps practicesThis role is critical to building a next generation healthcare data platform that will power advanced analytics operational efficiency and business innovationKey Responsibilities1 Data Pipeline Design DevelopmentTranslate business requirements into actionable technical specifications defining application components enhancement needs data models and integration workflowsDesign develop and optimize end to end data pipelines using Databricks and related cloud native toolsCreate and maintain detailed technical design documentation and provide accurate estimations for storage compute resources cost efficiency and operational readinessImplement reusable and scalable ingestion transformation and orchestration patterns for structured and unstructured data sourcesEnsure pipelines meet functional and non functional requirements such as latency throughput fault tolerance and scalability2 Cloud Platform ArchitectureBuild and deploy data solutions on Microsoft Azure Azure Fabric leveraging Data Lake Unity CatalogIntegrate pipelines with Data Fabric and Master Data Management MDM platforms for consistent and governed data deliveryFollow best practices in cloud security encryption access controls and identity management3 Data Modeling Metadata ManagementDesign robust and extensible data models supporting analytics AI ML and operational reportingEnsure metadata is cataloged documented and accessible through Unity Catalog and MDM frameworksCollaborate with data architects and analysts to ensure alignment with business requirements4 DevOps CI CD AutomationAdopt DevOps best practices for data pipelines including automated testing deployment monitoring and rollback strategiesWork closely with platform engineers to manage infrastructure as code containerization and CI CD pipelinesEnsure compliance with enterprise SDLC security and data governance policies5 Collaboration Continuous ImprovementPartner with data analysts and product teams to understand data needs and translate them into technical solutionsContinuously evaluate and integrate new tools frameworks and patterns to improve pipeline performance and maintainabilityKey Skills Technologies

Required

Databricks Delta Lake Spark Unity CatalogAzure Data Platform Data Factory Data Lake Azure Functions Azure FabricUnity Catalog for metadata and data governanceStrong programming skills in Python SQLExperience with data modeling data warehousing and star snowflake schema designProficiency in DevOps tools Git Azure DevOps Jenkins Terraform Docker

Preferred

Experience with healthcare or regulated industry data environmentsFamiliarity with data security standards e g HIPAA GDPR

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Virtusa logo
Virtusa

Information Technology and Services

Southborough

RecommendedJobs for You

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru

Jalandhar, Punjab, India

Chennai, Tamil Nadu, India

Kolkata, West Bengal, India