Azure Databricks Developer

NTT DATA is looking for an Azure Databricks Developer to join their team in Bengaluru, Karnataka, India. As an Azure Databricks Developer, you will be responsible for advanced experience with Databricks, including Databricks SQL, DataFrames, and Spark using PySpark or Scala. You should have a deep understanding of Spark architecture and optimization strategies, such as tuning Spark SQL configurations, managing data partitions, handling data skew, and leveraging broadcast joins. Your role will also involve proficiency in building and optimizing large-scale data pipelines for ETL/ELT processes using Databricks and familiarity with Delta Lake and data lake architectures. Strong programming skills in Python, SQL, or Scala are required, along with experience in version control (e.g., Git), CI/CD pipelines, and automation tools. You should have an understanding of Databricks cluster setup, resource management, and cost optimization, as well as experience with query optimization, performance monitoring, and troubleshooting complex data workflows. Familiarity with Databricks Photon engine and its enablement for accelerating workloads would be a plus. NTT DATA is a trusted global innovator of business and technology services, serving 75% of the Fortune Global 100. As a Global Top Employer, NTT DATA has diverse experts in more than 50 countries and a robust partner ecosystem. Their services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation, and management of applications, infrastructure, and connectivity. NTT DATA is dedicated to helping clients innovate, optimize, and transform for long-term success. Visit us at us.nttdata.com.,