Big Data Developer

As a Senior Spark SQL/SQL Developer, you will be responsible for designing, developing, and optimizing complex database systems to meet business requirements and support critical applications. Your key responsibilities will include: - Designing, developing, and optimizing complex Spark SQL / SQL queries, stored procedures, views, and triggers for high-performance systems. - Leading the design and implementation of scalable database architectures to meet business needs. - Performing advanced query optimization and troubleshooting to ensure database performance, efficiency, and reliability. - Mentoring junior developers and providing guidance on best practices for SQL development, performance tuning, and database design. - Collaborating with cross-functional teams to understand requirements and deliver robust database solutions. - Conducting code reviews to ensure code quality, performance standards, and compliance with database design principles. - Developing and implementing strategies for data security, backup, disaster recovery, and high availability. - Monitoring and maintaining database performance, ensuring minimal downtime and optimal resource utilization. - Contributing to long-term technical strategies for database management and integration with other systems. - Writing and maintaining comprehensive documentation on database systems, queries, and architecture. Required Skills & Qualifications: - 7+ years of hands-on experience in SQL Developer / data engineering or a related field. - Expert-level proficiency in Spark SQL and extensive experience with Bigdata (Hive), MPP (Teradata), relational databases such as SQL Server, MySQL, or Oracle. - Strong experience in database design, optimization, and troubleshooting. - Deep knowledge of query optimization, indexing, and performance tuning techniques. - Strong understanding of database architecture, scalability, and high-availability strategies. - Experience with large-scale, high-transaction databases and data warehousing. - Strong problem-solving skills with the ability to analyze complex data issues and provide effective solutions. - Ability to mentor and guide junior developers and promote best practices in SQL development. - Proficiency in database migration, version control, and integration with applications. - Excellent communication and collaboration skills, with the ability to interact with both technical and non-technical stakeholders. Preferred Qualifications: - Experience with NoSQL databases (e.g., MongoDB, Cassandra) and cloud-based databases (e.g., AWS RDS, Azure SQL Database). - Familiarity with data analytics, ETL processes, and data pipelines. - Experience in automation tools, CI/CD pipelines, and agile methodologies. - Familiarity with programming languages such as Python, Java, or C#.,