Associate Architect - Big Data

As a Lead Software Engineer / Associate Architect, your role will involve designing and implementing scalable and robust data engineering solutions. You will be responsible for: - Having an in-depth understanding of Big data concepts and distributed systems - Demonstrating proficiency in Python and writing code in PySpark - Possessing a good understanding of SQL concepts and being proficient in writing complex SQL queries - Ensuring optimization and performance improvement for Spark based workloads - Working on at least one Cloud platform (preferred) - Having conceptual knowledge and fitment for Data Structures & Algorithms - Demonstrating in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) and being capable of providing design & architecture for typical business problems - Having knowledge and experience with NoSQL Database (Cassandra/HBase/MongoDB/CouchDB/Neo4j), SQL Database (MySQL/Oracle) - Working with Kafka, Redis, Distributed Message Queues, and Distributed Caching - Demonstrating proficiency in Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration - Leveraging strong technical development experience to write performant code using best coding practices You should possess the following qualifications: - 8 to 12 years of experience - Skills in Bigdata, Pyspark, Python/Java This job opportunity is for a Lead Software Engineer / Associate Architect with a focus on data engineering solutions. As a Lead Software Engineer / Associate Architect, your role will involve designing and implementing scalable and robust data engineering solutions. You will be responsible for: - Having an in-depth understanding of Big data concepts and distributed systems - Demonstrating proficiency in Python and writing code in PySpark - Possessing a good understanding of SQL concepts and being proficient in writing complex SQL queries - Ensuring optimization and performance improvement for Spark based workloads - Working on at least one Cloud platform (preferred) - Having conceptual knowledge and fitment for Data Structures & Algorithms - Demonstrating in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) and being capable of providing design & architecture for typical business problems - Having knowledge and experience with NoSQL Database (Cassandra/HBase/MongoDB/CouchDB/Neo4j), SQL Database (MySQL/Oracle) - Working with Kafka, Redis, Distributed Message Queues, and Distributed Caching - Demonstrating proficiency in Build tools (Maven/Gradle), Code Versioning tools (Git) with Continuous Integration - Leveraging strong technical development experience to write performant code using best coding practices You should possess the following qualifications: - 8 to 12 years of experience - Skills in Bigdata, Pyspark, Python/Java This job opportunity is for a Lead Software Engineer / Associate Architect with a focus on data engineering solutions.