Posted:1 week ago|
Platform:
On-site
Full Time
Position Overview
We are looking for an experienced Data Engineer to design and implement a scalable data platform using Databricks. The ideal candidate will have strong expertise in building modern data architectures, integrating diverse data sources (SQL Server, MongoDB, InfluxDB), and enabling analytics and reporting use cases.
Key Responsibilities
● Design, build, and maintain a robust data platform on Databricks.
● Develop efficient ETL/ELT pipelines to ingest data from SQL Server, MongoDB, and InfluxDB into Databricks Delta Lake.
● Implement real-time and batch data ingestion strategies using tools such as Kafka, Azure Event Hubs, or similar.
● Optimize data storage and processing for performance, scalability, and cost-effectiveness.● Build data models to support BI, advanced analytics, and machine learning use cases.● Collaborate with stakeholders (Data Scientists, Analysts, Product Teams) to define data requirements.● Ensure data quality, governance, and security across the platform.
● Monitor, troubleshoot, and enhance data workflows for reliability.Required Skills & Qualifications
● Proven experience in Databricks (Delta Lake, Spark, PySpark, SQL).
● Strong expertise in data integration from multiple sources (SQL Server, MongoDB, InfluxDB).
● Hands-on experience with ETL/ELT pipeline development and orchestration (e.g., Airflow, ADF, or equivalent).
Proficiency in data modeling, data warehousing concepts, and performance tuning.
Job Type: Full-time
Pay: ₹1,400,000.00 - ₹1,800,000.00 per year
Work Location: In person
Hiretick
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Experience: Not specified
15.0 - 18.0 Lacs P.A.
hyderābād
Experience: Not specified
14.0 - 18.0 Lacs P.A.
Experience: Not specified
15.0 - 18.0 Lacs P.A.
hyderābād
Experience: Not specified
14.0 - 18.0 Lacs P.A.
