5 years
0 Lacs
Posted:5 days ago|
Platform:
On-site
Contractual
● Design and build robust data pipelines using Microsoft Fabric components including Pipelines, Notebooks (PySpark), Dataflows, and Lakehouse architecture.
● Ingest and transform data from a variety of sources such as cloud platforms (Azure, AWS), on-prem databases, SaaS platforms (e.g., Salesforce, Workday), and REST/OpenAPI-based APIs.
● Develop and maintain semantic models and define standardized KPIs for reporting and analytics in Power BI or equivalent BI tools.
● Implement and manage Delta Tables across bronze/silver/gold layers using Lakehouse medallion architecture within OneLake or equivalent environments.
● Apply metadata-driven design principles to support pipeline parameterization, reusability, and scalability.
● Monitor, debug, and optimize pipeline performance; implement logging, alerting, and observability mechanisms.
● Establish and enforce data governance policies including schema versioning, data lineage tracking, role-based access control (RBAC), and audit trail mechanisms.
● Perform data quality checks including null detection, duplicate handling, schema drift management, outlier identification, and Slowly Changing Dimensions (SCD) type management.
● 5+ years of hands-on experience in Data Engineering or related fields.
● Solid understanding of data lake/lakehouse architectures, preferably with Microsoft Fabric or equivalent tools (e.g., Databricks, Snowflake, Azure Synapse).
● Strong experience with PySpark, SQL, and working with dataflows and notebooks.
● Exposure to BI tools like Power BI, Tableau, or equivalent for data consumption layers.
● Experience with Delta Lake or similar transactional storage layers.
● Familiarity with data ingestion from SaaS applications, APIs, and enterprise databases.
● Understanding of data governance, lineage, and RBAC principles.
● Strong analytical, problem-solving, and communication skills.
ALIQAN Technologies
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Bengaluru, Karnataka, India
Salary: Not disclosed
Bengaluru, Karnataka, India
Salary: Not disclosed
