Associate Architect - Big Data

As a Lead Software Engineer / Associate Architect, your role will involve designing and implementing scalable and robust data engineering solutions. You should have 8 to 12 years of experience and possess the following skills: - In-depth understanding of Big data concepts and distributed systems - Proficiency in Python and writing code in PySpark - Good understanding of SQL concepts and ability to write complex SQL queries - Knowledge of optimization and performance improvement for Spark based workloads - Experience with at least one Cloud platform is preferred - Conceptual knowledge of Data Structures & Algorithms - Familiarity with various Data Processing Patterns (Batch/NRT/RT processing) and capable of providing design & architecture for typical business problems - Knowledge and experience with NoSQL Databases (Cassandra/HBase/MongoDB/CouchDB/Neo4j) and SQL Databases (MySQL/Oracle) - Experience with Kafka, Redis, Distributed Message Queues, and Distributed Caching - Proficient understanding of Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration - Strong technical development experience with writing performant code using best coding practices - Good communication skills Additionally, you should possess a good aptitude for learning and should be able to contribute effectively in a team environment.,