Job
Description
Role Overview: As a Big Data Architect with 10-12 years of experience, your main responsibility will be to design and implement scalable and resilient data architectures for both batch and streaming data processing. You will develop data models and database structures to ensure efficient data storage and retrieval. Ensuring data security, integrity, and compliance with relevant regulations will also be a crucial part of your role. You will integrate data from various sources into the big data infrastructure, monitor and optimize performance, and collaborate with data scientists, engineers, and business stakeholders to translate requirements into technical solutions. Additionally, you will evaluate and recommend new technologies for data management, provide mentorship to junior team members, and identify and resolve complex data challenges. Key Responsibilities: - Design and implement scalable and resilient data architectures for batch and streaming data processing - Develop data models and database structures for efficient data storage and retrieval - Ensure data security, integrity, and compliance with regulations - Integrate data from various sources into the big data infrastructure - Monitor and optimize the performance of the big data infrastructure - Collaborate with data scientists, engineers, and business stakeholders - Evaluate and recommend new technologies for data management - Provide mentorship to junior team members - Identify and resolve complex data challenges - Participate in the pre and post sales process, assisting both sales and professional teams Qualifications Required: - Bachelors/Masters degree in computer science, computer engineering, or relevant field - 10+ years of overall experience, with at least 2 years in Big Data Architecture - Strong understanding of big data technologies such as Hadoop, Spark, NoSQL databases, and cloud-based data services (AWS, Azure, GCP) - Experience with open-source ecosystem programming languages like Python, Java, Scala, and Spark - Proficiency in data modeling and database design using SQL and NoSQL - Familiarity with ETL processes for data extraction, transformation, and loading - Strong analytical and problem-solving skills - Good communication and collaboration skills - Knowledge of data security and governance principles - Understanding of API design and development - Knowledge of data visualization techniques - Strong understanding of authentication and authorization configurations for Hadoop based distributed systems (LDAP, Active Directory, SAML, Kerberos) - Familiarity with DevOps methodology, toolsets, and automation experience (Note: Additional details about the company were not provided in the job description) Role Overview: As a Big Data Architect with 10-12 years of experience, your main responsibility will be to design and implement scalable and resilient data architectures for both batch and streaming data processing. You will develop data models and database structures to ensure efficient data storage and retrieval. Ensuring data security, integrity, and compliance with relevant regulations will also be a crucial part of your role. You will integrate data from various sources into the big data infrastructure, monitor and optimize performance, and collaborate with data scientists, engineers, and business stakeholders to translate requirements into technical solutions. Additionally, you will evaluate and recommend new technologies for data management, provide mentorship to junior team members, and identify and resolve complex data challenges. Key Responsibilities: - Design and implement scalable and resilient data architectures for batch and streaming data processing - Develop data models and database structures for efficient data storage and retrieval - Ensure data security, integrity, and compliance with regulations - Integrate data from various sources into the big data infrastructure - Monitor and optimize the performance of the big data infrastructure - Collaborate with data scientists, engineers, and business stakeholders - Evaluate and recommend new technologies for data management - Provide mentorship to junior team members - Identify and resolve complex data challenges - Participate in the pre and post sales process, assisting both sales and professional teams Qualifications Required: - Bachelors/Masters degree in computer science, computer engineering, or relevant field - 10+ years of overall experience, with at least 2 years in Big Data Architecture - Strong understanding of big data technologies such as Hadoop, Spark, NoSQL databases, and cloud-based data services (AWS, Azure, GCP) - Experience with open-source ecosystem programming languages like Python, Java, Scala, and Spark - Proficiency in data modeling and database design using SQL and NoSQL - Familiarity with ETL processes for data extraction, transformation, and loading - Strong analytical and problem-solving skills - Good communication and collaboration skills
