Big Data Lead

Company Description

BUSINESSNEXT is a leading provider of composable enterprise solutions, specializing in banks and financial services globally. Recognized as a leader by industry analysts, BUSINESSNEXT leverages technology, innovation, and experience to deliver exceptional and human-centered experiences. The company's platforms, including CRMNEXT, CUSTOMERNEXT, DATANEXT, and WORKNEXT, are AI and ML-driven, cloud-agnostic solutions that facilitate digital transformation. With a footprint across five continents and direct offices in 14 countries, BUSINESSNEXT empowers over 1 million users worldwide, managing 1 billion end customers.

Role Description

This is a full-time on-site role for a Big Data Lead located in Noida. The Big Data Lead will be responsible for leading data analytics projects, managing data architecture, performing data modeling, and overseeing data management tasks. The role involves analyzing large datasets to derive insights, ensuring data quality and consistency, and working with cross-functional teams to implement data-driven strategies.

Qualifications

• Big Data Processing: Hands-on experience with Apache Spark, Trino, Minio/S3, Clickhouse and SQL for batch and streaming data pipelines.

• Design and develop scalable data pipelines using Apache Spark (PySpark) and Python.

• Implement batch and real-time data processing solutions on large datasets.

• Work with various SQL and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Cassandra, DynamoDB).

• Data Migration & Warehousing: Expertise in metadata management, ETL processes, and cloud-based data solutions.

• Data Analysis & Exploration: Strong skills in dataset analysis, pattern recognition, and data visualization using Tableau or Power BI.

• Collaborate with data architects, analysts, and other engineers to understand business requirements and translate them into technical solutions.

• Optimize and troubleshoot Spark jobs for performance, scalability, and reliability.

• Exposure to containerization technologies like Docker and orchestration tools like Kubernetes.