Posted:4 hours ago|
Platform:
On-site
Full Time
We're Hiring: Data Engineer – Platform & Distributed Systems
Are you a builder at heart who loves working at the intersection of data engineering, cloud infrastructure, and ML platforms?
We’re looking for a Data Engineer to join our team and help scale our JupyterLab-based Notebook platform, enabling data scientists and engineers across cloud and on-premise environments. This role is ideal for someone who’s passionate about developing powerful tools, enabling distributed processing, and ensuring secure, scalable infrastructure for advanced analytics and machine learning.
🔧 What You’ll Work On:
Enhance and maintain our custom Notebook platform (JupyterLab) for data science and ML workflows.
Integrate diverse data sources: BigQuery, Hive, Teradata, Hadoop, Spark, and more.
Enable distributed computing with Spark, PySpark, and Dataproc.
Implement features for code execution, visualization, scheduling (Airflow), and collaboration.
Ensure platform security with SSO, RBAC, and compliance to governance standards.
Support ML workflows, including model training, tracking (MLflow), and deployment pipelines.
Monitor and optimize performance across cloud-native environments (GKE, Kubernetes, OpenShift).
Collaborate with cross-functional teams: data scientists, engineers, and product managers.
Contribute to onboarding documentation, best practices, and user guides.
🧠 What You Bring:
Proficiency in Python for backend and data engineering.
Hands-on experience with JupyterLab/Notebook customization and extensions.
Expertise in distributed data processing: Spark, PySpark, Dataproc.
Solid experience with cloud platforms (preferably GCP), Kubernetes, and Docker.
Strong understanding of integrating structured and unstructured data sources (BigQuery, Hive, Teradata, etc.).
Experience with CI/CD, DevOps, and observability tools.
Solid grasp of security best practices – SSO, RBAC, secret management.
Familiarity with ML lifecycle tools like MLflow, and ML model deployment.
Strong debugging, communication, and stakeholder collaboration skills.
iAgami
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
coimbatore
5.0 - 9.0 Lacs P.A.
pune
0.5 - 3.0 Lacs P.A.
bengaluru
3.0 - 6.0 Lacs P.A.
12.0 - 22.0 Lacs P.A.
pune, gurugram, bengaluru
20.0 - 27.5 Lacs P.A.
bangalore rural, bengaluru
6.0 - 14.0 Lacs P.A.
6.5 - 12.0 Lacs P.A.
bengaluru
8.0 - 12.0 Lacs P.A.
hyderabad, chennai, bengaluru
6.0 - 10.0 Lacs P.A.
chennai, tamil nadu, india
Experience: Not specified
Salary: Not disclosed
