Associate Architect - Big Data

As a Lead Software Engineer / Associate Architect, you will be responsible for designing and implementing scalable and robust data engineering solutions. You should have an in-depth understanding of Big data concepts and distributed systems, along with proficiency in Python and writing code in PySpark. It is essential to possess a good understanding of SQL concepts and be proficient in writing complex SQL queries. Additionally, you should have a thorough understanding of optimization and performance improvement for Spark-based Workloads. Experience with at least one Cloud platform would be beneficial. You should also have conceptual knowledge and fitment for Data Structures & Algorithms. Having in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) and being capable of providing design & architecture for typical business problems is required. Knowledge and experience with NoSQL Databases (Cassandra/HBase/MongoDB/CouchDB/Neo4j) and SQL Databases (MySQL/Oracle) are necessary. Experience with Kafka, Redis, Distributed Message Queues, and Distributed Caching is preferred. Proficient understanding of Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration is expected. Strong technical development experience with writing performant code leveraging best coding practices is essential. Good communication skills and aptitude are important for this role. The ideal candidate should have 8 to 12 years of experience in the field. Job Reference Number: 13248,