Azure Data Engineer

Title: Data Engineer

Practice: Data Engineering & AI

Location: Office (Pune / Mohali / Hyderabad)

Job Description

As a Data Engineer, you will be an integral part of our team, working on data pipelines, data warehousing, and data integration for various analytics and AI use cases. You will collaborate closely with Delivery Managers, ML Engineers and other stakeholders to ensure seamless data flow and accessibility. Your expertise will be crucial in enabling data-driven decision-making for our clients. To thrive in this role, you need to be a quick learner, get excited about innovation and be on the constant lookout to master new technologies as they come up in the Data, AI & Cloud reams.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes to support downstream analytics and AI applications.
• Collaborate with ML Engineers to integrate data solutions into machine learning models and workflows.
• Work closely with clients to understand their data requirements and deliver tailored data solutions.
• Ensure data quality, integrity, and security across all projects.
• Optimize and manage data storage solutions in cloud environments (AWS, Azure, GCP).
• Utilize Databricks for data processing and analytics tasks, leveraging its capabilities to enhance data workflows.
• Monitor the performance of data pipelines, identify bottlenecks or failures, and implement improvements to enhance efficiency and reliability.
• Implement best practices for data engineering, including documentation, testing, and version control.
• Troubleshoot and resolve data-related issues in a timely manner.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL, Python, and other relevant programming languages.
• Hands-on experience with Databricks and its ecosystem.
• Familiarity with major cloud environments (AWS, Azure, GCP) and their data services.
• Experience with data warehousing solutions like Snowflake, Redshift, or BigQuery.
• Comfortable working with a variety of SQL, NoSQL and graph databases like PostgreSQL and MongoDB;
• Knowledge of data integration tools.
• Understanding of data modeling, data architecture, and database design.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Highly Desirable Skills

• Experience with real-time data processing frameworks (e.g., Apache Kafka, Spark Streaming).
• Knowledge of data visualization tools (e.g., Tableau, Power BI).
• Familiarity with machine learning concepts and frameworks.
• Experience working in a client-facing role.

Company Description: Bits in Glass - India

• Industry Leader:
• Bits in Glass(BIG) has been in business for more than 20 years. In 2021 Bits in Glass joined hands with Crochet Technologies, forming a larger organization under the Bits In Glass brand to better serve customers across the globe.
• Offices across three locations in India: Pune, Hyderabad & Chandigarh.
• Specialized Pega partner since 2017, delivering Pega solutions with deep industry expertise and experience.
• Proudly ranked among the top 30 Pega partners, Bits In Glass has been one of the very few sponsors of the annual PegaWorld event.
• Elite Appian partner since 2008, delivering Appian solutions with deep industry expertise and experience.
• Operating in the United States, Canada, United Kingdom, and India.
• Dedicated global Pega CoE to support our customers and internal dev teams.
• Employee Benefits:
• Career Growth: Opportunities for career advancement and professional development.
• Challenging Projects: Work on innovative, cutting-edge projects that make a global impact.
• Global Exposure: Collaborate with international teams and clients to broaden your professional network.
• Flexible Work Arrangements: Support for work-life balance through flexible working conditions.
• Comprehensive Benefits: Competitive compensation packages and comprehensive benefits including health insurance, and paid time off.
• Learning Opportunities- Great opportunity to upskill yourself and work on new technologies like AI-enabled Pega solutions, Data engineering, Integration, cloud migration etc.
• Company Culture:
• Collaborative Environment: Emphasizes teamwork, innovation, and knowledge sharing.
• Inclusive Workplace: Values diversity and fosters an inclusive environment where all ideas are respected.
• Continuous Learning: Encourages professional development through ongoing learning opportunities and certifications.
• Core Values:
• Integrity: Commitment to ethical practices and transparency in all business dealings.
• Excellence: Strive for the highest standards in everything we do.
• Client-Centric Approach: Focus on delivering the best solutions tailored to client needs.
• Join Us:
• Be part of a team that transforms businesses and drives innovation.
• Apply today and take the next step in your professional journey with Bits in Glass India
• Connect with us on and visit to find out more.

Job Type: Full-time

Pay: ₹451,274.00 - ₹1,687,705.55 per year

Benefits:

• Health insurance
• Provident Fund

Application Question(s):

• Can you join us within 30 days

Experience:

• Azure: 4 years (Required)
• Databricks: 4 years (Required)
• Python: 3 years (Required)

Location:

• Pune, Maharashtra (Preferred)

Work Location: In person