You are an experienced Senior Data Engineer with a strong background in Databricks, Apache Airflow, SQL, and Python. Your main responsibility will involve designing and optimizing data pipelines, ETL workflows, and cloud-based data solutions. Your expertise in big data processing, cloud-based analytics, and automation will be crucial in developing efficient and scalable data engineering solutions. You will be responsible for tasks such as designing, developing, and optimizing data pipelines using Databricks and Apache Airflow. Implementing PySpark-based transformations and processing in Databricks to handle large-scale data, and maintaining SQL-based data pipelines with a focus on performance tuning and optimization. Additionally, you will create Python scripts for automation, data transformation, and API-based data ingestion. Your role will also involve working with Airflow DAGs to efficiently schedule and orchestrate data workflows, optimizing data lake and data warehouse performance for scalability and reliability, and integrating data pipelines with cloud platforms like AWS, Azure, or GCP along with various data storage solutions. Ensuring adherence to data security, governance, and compliance standards will be a key aspect of your responsibilities. In terms of required skills and qualifications, you should have 8-9 years of experience in Data Engineering or related fields. You must possess strong expertise in Databricks (PySpark, Delta Lake, DBSQL), proficiency in Apache Airflow for scheduling and orchestrating workflows, advanced SQL skills for data extraction, transformation, and performance tuning, as well as strong programming skills in Python (pandas, NumPy, PySpark, APIs). Experience with big data technologies, distributed computing, cloud platforms (AWS / Azure / GCP), data warehousing, data modeling concepts, CI/CD pipelines, version control (Git), data governance, security, and compliance best practices are also essential. Excellent troubleshooting, debugging, and performance optimization skills are expected from you.,
We are looking for a Technical Project Manager / Scrum Master to join our team in Bangalore immediately. As a Technical Project Manager / Scrum Master, you will be responsible for leading Agile teams in utilizing Agile methodology and scrum practices to effectively plan, manage, and deliver solutions. You will coach Agile teams in self-organization, cross-functional skill set, and domain knowledge while facilitating and supporting scrum events such as Sprint Planning, Daily Scrum, Sprint Review, and Sprint Retrospective. Your role will involve working closely with Agile teams, as well as internal and external stakeholders, to influence and drive decision making. You will be tasked with resolving team impediments to enhance the application of scrum within the program and assisting Agile teams in achieving higher levels of scrum maturity. Additionally, you will contribute to the advancement and improvement of Agile practices within the program. Qualifications: - Bachelor's Degree or related field - 5-8 years of experience with a Scaled Agile Framework (SAFe) and successful Agile techniques - Experience managing projects related to Data Management, including ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform), Data Engineering, and Data Lake implementation/optimization - Experience with product or project development and familiarity with Scrum, Kanban, and SAFe methodologies - Understanding of Software Development Life Cycle (SDLC) models and traditional project management principles and practices - Prior experience working on an Agile team and facilitating meetings at multiple levels of an organization - Intermediate working knowledge of Microsoft Office applications, including Outlook, Word, and Excel - Experience with Cloud Service Providers (CSPs) and certifications such as PMP, CAPM, or Agile ScrumMaster certification - Experience managing implementation or migration projects/programs using AWS and/or Oracle Cloud, as well as MS Project Experience - Salesforce, JIRA, Power BI experience preferred If you are a proactive and experienced Technical Project Manager / Scrum Master with a strong background in Agile methodologies and project management practices, we encourage you to apply for this exciting opportunity to contribute to our program's success.,