Data Engineer (Databricks Specialist)

5 - 9 years

0 Lacs

Posted:2 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

About Mindcurv (Part of Accenture Song) Mindcurv, a part of Accenture Song, assists customers in reimagining their digital business, experiences, and technology to thrive in the new digital landscape. By crafting sustainable and accountable solutions for individuals residing in a digital world, Mindcurv addresses the market's imperative to digitalize business processes and enhance customer experiences while capitalizing on cloud technologies through the adoption of DevOps and agile methodologies. Your Role As a Senior Data Engineer at Mindcurv, you will play a key role within our expanding Data and Analytics team. We are looking for a candidate with extensive proficiency in Databricks and cloud data warehousing, who has a proven history of developing scalable data pipelines, optimizing data architectures, and facilitating robust analytics capabilities. In this position, you will collaborate with diverse teams to ensure that the organization harnesses data as a strategic asset. Your responsibilities will include: - Designing, constructing, and managing scalable data pipelines and ETL processes using Databricks and other contemporary tools. - Architecting, implementing, and overseeing cloud-based data warehousing solutions on Databricks, following the Lakehouse Architecture model. - Creating and maintaining optimized data lake architectures to sustain advanced analytics and machine learning applications. - Engaging with stakeholders to elicit requirements, devise solutions, and ensure the delivery of high-quality data. - Enhancing data pipelines for improved performance and cost efficiency. - Enforcing best practices for data governance, access control, security, and compliance in the cloud. - Monitoring and troubleshooting data pipelines to ensure their reliability and accuracy. - Mentoring junior engineers to cultivate a culture of continuous learning and innovation. - Demonstrating excellent communication skills and the ability to collaborate effectively with clients primarily based in Western Europe. Who You Are To excel in this role, you should possess the following qualifications: - Bachelor's or Master's degree in Computer Science or a related field. - At least 5 years of experience in data engineering roles focused on cloud platforms. - Proficiency in Databricks, encompassing Spark-based ETL, Delta Lake, and SQL. - Solid experience with a major cloud platform (preferably AWS). - Hands-on experience with Delta Lake, Unity Catalog, and concepts related to Lakehouse architecture. - Strong programming skills in Python and SQL, with experience in Pyspark considered a plus. - Sound understanding of data modeling principles, including star schema and dimensional modeling. - Familiarity with CI/CD practices, version control systems like Git, and data governance and security standards such as GDPR and CCPA compliance. Nice-to-Have Qualifications Additionally, the following qualifications would be advantageous: - Experience with Airflow or similar workflow orchestration tools. - Exposure to machine learning workflows and MLOps. - Certification in Databricks and AWS. - Familiarity with data visualization tools like Power BI. What Do We Offer You At Mindcurv, we provide various perks such as refreshments, team events, and attractive compensation packages. Apart from these, we offer intellectually stimulating projects involving cutting-edge technologies, an agile and entrepreneurial atmosphere devoid of office politics, work-life balance, transparent culture, and a management team that values feedback. Our High Performers Individuals who excel at Mindcurv are self-starters, team players, and continuous learners who thrive in ambiguous situations. We empower our employees with the necessary resources for success, encourage exploration within their domain, and offer continuous growth opportunities to enrich their careers. Ready for Change If you are prepared for the next phase in your career - a role that allows you to be authentic and bring out the best in yourself, your colleagues, and clients - do not hesitate to apply for this job opportunity now. Join us at Mindcurv and embark on a journey of professional growth and fulfillment. (Note: The Job Description has been summarized and rephrased for clarity and readability.),

Mock Interview

Practice Video Interview with JobPe AI

Start Machine Learning Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You