LEAD DATA ENGINEER Location: Hyderabad Role: Permanent Mode: WFO JOB RESPONSIBILITIES: Tracks the various Machine learning projects and their data needs. Tracks and improves Kanban process of product maintenance Drives complex technical discussions both within company and outside data partners Actively Contributes to the design of machine learning solutions by having a deep understanding of how the data is used and how new sources of data can be introduced Advocates for investments in tools and technologies to streamline data workflows and reduce technical debt Continuously explores and adopts emerging technologies and methodologies in data engineering and machine learning Develops and maintains scalable data pipelines to support machine learning models and analytics Collaborates with data scientists to ensure efficient data processing and model deployment Ensures data quality, integrity, and security across all stages of the data pipeline Implements monitoring and alerting systems to detect anomalies in data processing and model performance Enhances data versioning, data lineage, and reproducibility practices to improve model transparency and auditing . QUALIFICATION 5+ years of experience in data engineering or related fields, with a strong focus on building scalable data pipelines to support machine learning workflows. Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or other relevant fields. Specific experience in Kafka needed . Snowflake and data bricks would be huge plus. Proven expertise in designing, implementing, and maintaining large-scale, high-performance data architectures and ETL processes managing 1TB a day. Strong knowledge of database management systems (SQL and NoSQL), distributed data processing (e.g., Hadoop, Spark), and cloud platforms (AWS, GCP, Azure). Experience working closely with data scientists and machine learning engineers to optimize data flows for model training and real-time inference with latency requirements. Hands-on experience with data wrangling, data preprocessing, and feature engineering to ensure clean, high-quality data for machine learning models. Solid understanding of data governance, security protocols, and compliance requirements (e.g., GDPR, HIPAA) to ensure data privacy and integrity. Preferred Experience in data pipelines and analytics for video-game development Experience in Advertising industry Experience in online businesses where transactions happen without human intervention. Job Types: Full-time, Permanent Pay: ₹503,603.23 - ₹1,851,406.88 per year Schedule: Day shift Monday to Friday Application Question(s): Are you an Immediate Joiner ? Experience: Kafka: 2 years (Required) snow flake: 2 years (Required) Data engineer: 5 years (Required) Data bricks: 2 years (Required) Location: Hyderabad, Telangana (Required) Work Location: In person
Job Title: Cloudera Hadoop Administrator Location: Hyderabad Experience: 4+ years Employment Type: Full Time Job Summary: We are looking for a proactive and technically strong Hadoop Administrator who has hands-on experience working with Red Hat Linux systems, basic automation through Bash scripting, and foundational exposure to Hadoop and Cloudera platforms. The ideal candidate has been involved in real-time system recovery, automation, and training initiatives and is eager to expand their skills in Linux system administration and Big Data platforms. Key Responsibilities: ● Administered and managed Red Hat Enterprise Linux (RHEL 7/8) servers to ensure system stability, performance, and security. ● Automated daily operational tasks using Bash scripting, enhancing system efficiency and reducing manual work. ● Contributed to backup and disaster recovery strategies for critical enterprise systems. ● Played a key role in recovering a business-critical application (RMA) from disaster with minimal downtime. ● Delivered internal training on Linux administration, shell scripting, Logical Volume Management (LVM), and Hadoop basics to junior engineers. ● Participated in Hadoop administration as part of an insourcing project within the organization. ● Gained hands-on experience installing and maintaining Cloudera CDP Private Cloud Base clusters under guidance, supporting cluster performance, security, and reliability. ● Assisted in implementing security practices using Apache Ranger, Kerberos, and Apache Atlas. Technical Skills: ● Operating Systems: Red Hat Enterprise Linux 7/8 ● Scripting: Bash (automation, disk usage monitoring, LVM setup) ● Big Data Tools: Cloudera CDP, Hadoop basics (HDFS, Hive, Spark, Impala) Job Types: Full-time, Permanent Pay: ₹353,353.41 - ₹1,432,304.51 per year Benefits: Health insurance Paid time off Provident Fund Work Location: In person
Job Title: Cloudera Hadoop Administrator Location: Hyderabad Experience: 4+ years Employment Type: Full Time Job Summary: We are looking for a proactive and technically strong Hadoop Administrator who has hands-on experience working with Red Hat Linux systems, basic automation through Bash scripting, and foundational exposure to Hadoop and Cloudera platforms. The ideal candidate has been involved in real-time system recovery, automation, and training initiatives and is eager to expand their skills in Linux system administration and Big Data platforms. Key Responsibilities: ● Administered and managed Red Hat Enterprise Linux (RHEL 7/8) servers to ensure system stability, performance, and security. ● Automated daily operational tasks using Bash scripting, enhancing system efficiency and reducing manual work. ● Contributed to backup and disaster recovery strategies for critical enterprise systems. ● Played a key role in recovering a business-critical application (RMA) from disaster with minimal downtime. ● Delivered internal training on Linux administration, shell scripting, Logical Volume Management (LVM), and Hadoop basics to junior engineers. ● Participated in Hadoop administration as part of an insourcing project within the organization. ● Gained hands-on experience installing and maintaining Cloudera CDP Private Cloud Base clusters under guidance, supporting cluster performance, security, and reliability. ● Assisted in implementing security practices using Apache Ranger, Kerberos, and Apache Atlas. Technical Skills: ● Operating Systems: Red Hat Enterprise Linux 7/8 ● Scripting: Bash (automation, disk usage monitoring, LVM setup) ● Big Data Tools: Cloudera CDP, Hadoop basics (HDFS, Hive, Spark, Impala) Job Types: Full-time, Permanent Pay: ₹353,353.41 - ₹1,432,304.51 per year Benefits: Health insurance Paid time off Provident Fund Work Location: In person
Job Title: Cloudera Hadoop Administrator Location: Hyderabad Experience: 4+ years Employment Type: Full Time Job Summary: We are looking for a proactive and technically strong Hadoop Administrator who has hands-on experience working with Red Hat Linux systems, basic automation through Bash scripting, and foundational exposure to Hadoop and Cloudera platforms. The ideal candidate has been involved in real-time system recovery, automation, and training initiatives and is eager to expand their skills in Linux system administration and Big Data platforms. Key Responsibilities: ● Administered and managed Red Hat Enterprise Linux (RHEL 7/8) servers to ensure system stability, performance, and security. ● Automated daily operational tasks using Bash scripting, enhancing system efficiency and reducing manual work. ● Contributed to backup and disaster recovery strategies for critical enterprise systems. ● Played a key role in recovering a business-critical application (RMA) from disaster with minimal downtime. ● Delivered internal training on Linux administration, shell scripting, Logical Volume Management (LVM), and Hadoop basics to junior engineers. ● Participated in Hadoop administration as part of an insourcing project within the organization. ● Gained hands-on experience installing and maintaining Cloudera CDP Private Cloud Base clusters under guidance, supporting cluster performance, security, and reliability. ● Assisted in implementing security practices using Apache Ranger, Kerberos, and Apache Atlas. Technical Skills: ● Operating Systems: Red Hat Enterprise Linux 7/8 ● Scripting: Bash (automation, disk usage monitoring, LVM setup) ● Big Data Tools: Cloudera CDP, Hadoop basics (HDFS, Hive, Spark, Impala) Job Types: Full-time, Permanent Pay: ₹353,353.41 - ₹1,432,304.51 per year Benefits: Health insurance Paid time off Provident Fund Work Location: In person
Job Title: Cloudera Hadoop Administrator Location: Hyderabad Experience: 4+ years Employment Type: Full Time Job Summary: We are looking for a proactive and technically strong Hadoop Administrator who has hands-on experience working with Red Hat Linux systems, basic automation through Bash scripting, and foundational exposure to Hadoop and Cloudera platforms. The ideal candidate has been involved in real-time system recovery, automation, and training initiatives and is eager to expand their skills in Linux system administration and Big Data platforms. Key Responsibilities: ● Administered and managed Red Hat Enterprise Linux (RHEL 7/8) servers to ensure system stability, performance, and security. ● Automated daily operational tasks using Bash scripting, enhancing system efficiency and reducing manual work. ● Contributed to backup and disaster recovery strategies for critical enterprise systems. ● Played a key role in recovering a business-critical application (RMA) from disaster with minimal downtime. ● Delivered internal training on Linux administration, shell scripting, Logical Volume Management (LVM), and Hadoop basics to junior engineers. ● Participated in Hadoop administration as part of an insourcing project within the organization. ● Gained hands-on experience installing and maintaining Cloudera CDP Private Cloud Base clusters under guidance, supporting cluster performance, security, and reliability. ● Assisted in implementing security practices using Apache Ranger, Kerberos, and Apache Atlas. Technical Skills: ● Operating Systems: Red Hat Enterprise Linux 7/8 ● Scripting: Bash (automation, disk usage monitoring, LVM setup) ● Big Data Tools: Cloudera CDP, Hadoop basics (HDFS, Hive, Spark, Impala) Job Types: Full-time, Permanent Pay: ₹353,353.41 - ₹1,432,304.51 per year Benefits: Health insurance Paid time off Provident Fund Work Location: In person