Data Architect- AWS-Big Data

As a Data Architect specializing in AWS Big Data solutions, you will play a crucial role in the design and optimization of complex data architectures. Your primary responsibility will be to leverage AWS services to create efficient and cost-effective Big Data solutions while maintaining a balance between cost and performance. This includes evaluating existing technologies, conducting impact assessments, optimizing designs, and documenting projects. Effective communication of architectural decisions, conducting Proof-of-Concepts, proposing automation solutions, and providing expert advice are integral parts of this role. Key Result Areas and Activities: - **Technology Assessment and Impact Analysis:** Evaluate current technology and data integration frameworks, and perform impact assessments based on project requirements. - **Big Data Use Case Design:** Develop intricate Big Data use cases using AWS services, with a focus on cost-effectiveness, performance, and durability. - **Optimization and Performance:** Recommend optimizations to enhance the balance between cost and performance in existing designs. - **Architectural Communication and Proof-of-Concepts:** Communicate architectural decisions with stakeholders, conduct Proof-of-Concepts, document outcomes, and lead design reviews. - **Process Improvement and Automation:** Implement automation strategies to streamline processes, boost team productivity, and offer expert advice, troubleshooting, and support for client proposals. **Essential Skills:** - Proficiency in AWS services such as S3, EC2, EMR, Athena, AWS Glue, Lambda, as well as AWS VPC, subnets, security groups, and route tables. - Expertise in MPP databases like AWS Redshift, Snowflake, SingleStore, and solid grasp of Data Warehousing concepts. - Strong knowledge of Big Data technologies, particularly Apache Spark, and experience with table formats like Delta Lake or Apache Iceberg. - Excellent programming skills in Scala and Python, proficiency in SQL, and experience with orchestration tools like Apache Airflow. - Skilled in developing ETL workflows with complex transformations like SCD, deduplication, and aggregation. - Familiarity with operating systems including Linux and Windows. **Desirable Skills:** - Previous experience in a large media company would be beneficial. Knowledge of Data Fabric and Data Mesh concepts. - Proficiency in Java, Bash programming languages, and Cloud Databases like AWS Aurora. **Qualifications:** - Bachelor's degree in computer science, engineering, or a related field (Master's degree preferred). - Continuous learning demonstrated through technical certifications or related methods. - 9 years of IT experience with a minimum of 5 years dedicated to cloud-related projects. **Qualities:** - Possess a strong technical background with the ability to conduct in-depth research across various technical domains. - Self-motivated and dedicated to delivering results for a rapidly growing team and organization. - Effective communication skills through written, verbal, and client presentations. - Efficient and well-organized in cross-functional teams and working across different time zones. This position is based in India and requires 9 to 12 years of experience in the field.,