Name: Jobpe
Address: T-Hub, Plot No 1/C, Sy No 83/1, Raidurgam panmaktha, Knowledge City Rd, Hyderabad, Telangana, 500081, IN
Telephone: +91-83339-09630
Price range: Free

Machine Learning Architect IPG Mediabrands India

4.0 - 8.0 years

0 Lacs

pune, maharashtra

On-site

We are seeking an experienced Machine Learning Engineer / Databricks Architect to join our team and contribute to the development of state-of-the-art, scalable ML and big data solutions. The ideal candidate should have over 8 years of experience in designing ML infrastructure and big data systems, with a strong emphasis on Databricks. Possession of Databricks Architect Certification is mandatory for this role. In addition, the candidate should have at least 4 years of practical experience working with Databricks. The successful candidate should be well-versed in orchestration tools such as Airflow, Kubeflow, DAGster, Optuna, etc. They should also have a solid understanding of CI/CD and DevOps tools like Jenkins, Terraform, and CloudFormation. Proficiency in distributed computing technologies including Apache Spark, EMR/DataProc, and Glue is essential for this role. Hands-on experience with containerization and orchestration tools like Docker and Kubernetes will be highly valued. If you are enthusiastic about constructing scalable ML platforms and have a knack for working with modern cloud-native technologies, we are eager to learn more about you! Feel free to reach out by sending a direct message or submitting your resume to [ankita.gupta@mbww.com]. This position is based in Pune and offers a hybrid working arrangement. Thank you for considering this exciting opportunity!,

Posted 1 week ago

Apply

Databricks Solution Architect Tata Consultancy Services

8.0 - 13.0 years

18 - 33 Lacs

Hyderabad, Pune, Bengaluru

Work from Office

Job Title : Databricks Data Architect Responsibilities: 1. Data Architecture Design and Implementation: a. Design and implement cloud-based data architectures leveraging Databricks, AWS, Azure, or GCP. b. Architect end-to-end data pipelines that integrate with Databricks and other cloud services. c. Ensure that the data architecture supports both batch and real-time data processing and analytics. d. Leverage Databricks Delta Lake for data storage, management, and processing. 2. Data Integration: a. Integrate data from various sources, including operational databases, data lakes, and third-party APIs. b. Work with teams to ensure seamless ETL/ELT processes within the Databricks environment c. Collaborate with data engineers to build data ingestion pipelines and automate data workflows. 3. Optimization and Performance Tuning: a. Optimize Databricks Spark workloads for performance, cost, and scalability b. Monitor and tune Databricks clusters to ensure optimal performance for analytics and data science workflows c. Identify and resolve performance bottlenecks in data pipelines, storage, and queries. 4. Collaboration with Data Teams: a. Implement data governance practices to ensure the integrity, security, and compliance of data within Databricks b. Ensure that the architecture adheres to industry standards for data security, privacy, and compliance (e.g., GDPR, CCPA). c. Leverage Databricks' built-in features for role-based access control, data encryption, and auditing 5. Security and Governance: a. Implement data governance practices to ensure the integrity, security, and compliance of data within Databricks b. Ensure that the architecture adheres to industry standards for data security, privacy, and compliance (e.g., GDPR, CCPA) c. Leverage Databricks' built-in features for role-based access control, data encryption, and auditing. 6. Cloud Infrastructure and Automation: a. Design and manage cloud infrastructure for Databricks, ensuring high availability and fault tolerance. b. Automate infrastructure provisioning, deployment, and monitoring processes using tools like Terraform or CloudFormation. c. Continuously evaluate and recommend cloud solutions to improve efficiency and scalability 7. Continuous Improvement and Innovation: a. Stay up to date with the latest Databricks features, best practices, and industry trends. b. Propose innovative solutions to enhance data architecture and workflows based on new technologies and methodologies. c. Mentor junior data engineers and developers on Databricks best practices.

Posted 3 weeks ago

Apply

Databricks architect Teamware Solutions

7.0 - 10.0 years

18 - 30 Lacs

Bengaluru

Hybrid

About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring a Databricks architect Location: Bangalore Work Model: Hybrid Years of Experience: 7-10 years Notice Period: Immediate to 15 Days Open positions: 10 Connect for Faster Comm Netra Sakunthala Job Description: Databricks architect Additional Information: Mandatory Skills Databricks architecture, framework built Nice to have skills Python, Pyspark Interview Mode Virtual Interview Please let me know if you are interested in this position and send me your resumes to netra.s@twsol.com

Posted 1 month ago

Apply

Solution Architect Databricks(US Healthcare domain) Scalable Systems

8.0 - 13.0 years

60 - 65 Lacs

Bengaluru

Remote

Design and implement data pipelines using Apache Spark on Data bricks for batch and real-time data processing Lead the architecture and migration of traditional data platforms to modern cloud-based lake house architectures

Posted 1 month ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.