Posted:9 hours ago|
Platform:
On-site
Full Time
• Design, develop, and optimize scalable data pipelines using Databricks, PySpark, and Delta Lake.
• Work within a data mesh architecture to support decentralized data ownership and domain-oriented data products.
• Integrate and manage event-driven data pipelines using Azure Event Hubs, Apache Kafka, or similar technologies.
• Collaborate with Data Scientists and Analysts to support the ML lifecycle using tools like MLflow and Databricks Workflows.
• Implement secure and governed data access with tools like Unity Catalog.
• Design and maintain dashboards and reports using Power BI or other visualization tools.
• Automate infrastructure deployment and management using Terraform or other Infrastructure-as-Code (IaC) solutions.
• Ensure high data quality, reliability, and performance of all data systems.
• Collaborate cross-functionally with product, engineering, and business teams to gather requirements and deliver solutions.
• 4+ years of hands-on experience in data engineering roles.
• Strong experience with Databricks, PySpark, and Delta Lake.
• Understanding of data mesh principles and domain-driven data ownership.
• Proficiency in working with event streaming platforms like Azure Event Hubs, Apache Kafka, or equivalents.
• Familiarity with MLflow, Databricks Workflows, and Unity Catalog.
• Experience using Power BI, Tableau, or other BI tools to create dashboards and reports.
• Knowledge of Terraform, ARM Templates, or other IaC tools.
• Strong SQL skills and experience working with large datasets and cloud data platforms (Azure preferred).
• Excellent problem-solving and communication skills.
• Experience with Azure Data Factory, Synapse Analytics, or Data Lake Storage.
• Exposure to CI/CD pipelines in data workflows.
• Knowledge of data governance, security, and compliance in cloud environments.
• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
• Work on cutting-edge data solutions and next-gen cloud platforms.
• Collaborate with experienced professionals in a fast-paced environment.
• Opportunities for continuous learning and development.
• Flexible work arrangements and competitive compensation.
BitsAtom Technologies
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Salary: Not disclosed
Salary: Not disclosed
