Big Data Developer

As a Big Data Developer at Unison Consulting Pte Ltd, you will play a crucial role in designing, developing, and maintaining big data solutions to enhance data-driven decision making and analytics capabilities for our clients. You will leverage cutting-edge technologies and platforms to work with large volumes of structured and unstructured data. Responsibilities: - Design, develop, and maintain big data solutions utilizing technologies like Hadoop, HDFS, Spark, and Hive. - Ingest, process, and analyze substantial amounts of structured and unstructured data from various sources. - Develop and optimize ETL processes to facilitate efficient data extraction, transformation, and loading. - Implement data models, schemas, and data governance frameworks to uphold data quality and integrity. - Conduct data exploration, profiling, and validation to identify patterns, trends, and anomalies. - Collaborate closely with data scientists, analysts, and business stakeholders to grasp data requirements and provide actionable insights. - Create and enhance data storage and retrieval strategies, including data partitioning and indexing. - Construct and manage scalable data pipelines and workflows for streamlined data processing. - Perform performance tuning and optimization of big data applications and queries. - Implement and uphold data security measures to safeguard sensitive information. - Maintain comprehensive technical documentation of big data solutions, processes, and procedures. Requirements: - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - Proven experience as a Big Data Developer with expertise in technologies like Hadoop, Spark, HDFS, and Hive. - Proficiency in programming languages such as Java, Scala, or Python. - Familiarity with ETL tools and processes for data extraction, transformation, and loading. - Strong grasp of big data concepts, architectures, and technologies. - Experience working with SQL and NoSQL databases. - Knowledge of data modeling and schema design. - Exceptional problem-solving and analytical skills. - Effective communication and collaboration skills to engage with cross-functional teams. - Understanding of data security and privacy principles. - Ability to adapt to new technologies and quickly learn in a dynamic environment.,