Associate Architect - Big Data

As a Lead Software Engineer / Associate Architect, you will be responsible for designing and implementing scalable and robust data engineering solutions. Your role will involve: - Having an in-depth understanding of Big data concepts and distributed systems - Demonstrating proficiency in Python and writing code in PySpark - Possessing a good understanding of SQL concepts and being proficient in writing complex SQL queries - Understanding optimization and performance improvement for Spark-based Workloads - Having experience with working on at least one Cloud platform (good to have) - Demonstrating conceptual knowledge and fitment for Data Structures & Algorithms - Having in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) and being capable of providing design & architecture for typical business problems - Knowledge and experience with NoSQL Databases (Cassandra/HBase/MongoDB/CouchDB/Neo4j), SQL Databases (MySQL/Oracle), Kafka, Redis, Distributed Message Queues, and Distributed Caching - Understanding Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration - Having strong technical development experience with writing performant code leveraging best coding practices - Possessing good communication skills and aptitude Qualifications required for this role include: - 8 to 12 years of experience - Proficiency in Python, PySpark, SQL, and Cloud platforms - Strong knowledge of Data Processing Patterns, NoSQL Databases, SQL Databases, and various tools like Kafka, Redis, and Distributed Caching - Experience with Build tools, Code Versioning tools, and Continuous Integration Please note that the job reference number for this position is 13248. As a Lead Software Engineer / Associate Architect, you will be responsible for designing and implementing scalable and robust data engineering solutions. Your role will involve: - Having an in-depth understanding of Big data concepts and distributed systems - Demonstrating proficiency in Python and writing code in PySpark - Possessing a good understanding of SQL concepts and being proficient in writing complex SQL queries - Understanding optimization and performance improvement for Spark-based Workloads - Having experience with working on at least one Cloud platform (good to have) - Demonstrating conceptual knowledge and fitment for Data Structures & Algorithms - Having in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) and being capable of providing design & architecture for typical business problems - Knowledge and experience with NoSQL Databases (Cassandra/HBase/MongoDB/CouchDB/Neo4j), SQL Databases (MySQL/Oracle), Kafka, Redis, Distributed Message Queues, and Distributed Caching - Understanding Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration - Having strong technical development experience with writing performant code leveraging best coding practices - Possessing good communication skills and aptitude Qualifications required for this role include: - 8 to 12 years of experience - Proficiency in Python, PySpark, SQL, and Cloud platforms - Strong knowledge of Data Processing Patterns, NoSQL Databases, SQL Databases, and various tools like Kafka, Redis, and Distributed Caching - Experience with Build tools, Code Versioning tools, and Continuous Integration Please note that the job reference number for this position is 13248.