Azure Databricks Engineer

Wissen Technology is Hiring for Azure Databricks Engineer   

About Wissen Technology:   

At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge technology expertise, and a relentless focus on quality. We don’t just meet expectations we exceed them by ensuring faster time-to-market, reduced rework, and greater alignment with client objectives. We have a proven track record of building mission-critical systems across industries, including financial services, healthcare, retail, manufacturing, and more. Wissen stands apart through its unique delivery models. Our outcome-based projects ensure predictable costs and timelines, while our agile pods provide clients with the flexibility to adapt to their evolving business needs. Wissen leverages its thought leadership and technology prowess to drive superior business outcomes. Our success is powered by top-tier talent.  Our mission is clear: to be the partner of choice for building world-class custom products that deliver exceptional impact the first time, every time. 

Job Summary: Wissen Technology is hiring a Data Engineer to design, develop, and maintain data   pipelines and ETL/ELT processes using PySpark/Databricks. The ideal candidate will   optimize performance for large datasets, collaborate with cross-functional teams, ensure  

data quality and participate in data migration projects.  

Experience: 3- 6 Years  

Location: Pune, Bengaluru, Mumbai 

Mode of Work: Full Time 

Key Responsibilities:  

• Design, develop, and maintain data pipelines and ETL/ELT processes using  PySpark /Databricks.  
  
• Optimize performance for large datasets through techniques such as partitioning, indexing, and Spark optimization.  
  
• Collaborate with cross-functional teams to resolve technical issues and gather   requirements.  
  
• Ensure data quality and integrity through data validation and cleansing processes. 
  
• Analyze existing SQL queries, functions, and stored procedures for performance improvements. 
  
• Develop database routines like procedures, functions, and views. 
  
• Participate in data migration projects and understand technologies like Delta Lake /warehouse.  
  
• Debug and solve complex problems in data pipelines and processes. 
  

Requirements:  

• Bachelor’s degree in computer science, Engineering, or a related field. 
  
• Strong understanding of distributed data processing platforms like Databricks and   BigQuery. 
  
• Proficiency in Python, PySpark, and SQL programming languages. 
  
• Experience with performance optimization for large datasets. 
  
• Strong debugging and problem-solving skills. 
  
• Cloud services, preferably Azure or GCP 
  

Good To Have Sk ills:  

• Experience with Delta Lake and data lake architectures. 
  
• Knowledge of Azure Data Factory or other orchestration tools. 
  
• Exposure to real-time data processing frameworks like Kafka or Spark Streaming. 
  
• Understanding of data governance and security best practices 
  

Wissen Sites: