Sr. Big Data Engineer

As a Big Data Engineer, you will play a crucial role in developing and managing our company's Big Data solutions. Your responsibilities will include: - Meeting with managers to determine the company's Big Data needs. - Developing Big Data solutions on AWS, utilizing tools such as Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, and Hadoop. - Loading disparate data sets and performing pre-processing services using Athena, Glue, and Spark. - Collaborating with software research and development teams. - Building cloud platforms for company application development. - Maintaining production systems. To excel in this role, you are required to meet the following qualifications: - 5+ years of experience as a Big Data Engineer. - Proficiency in Python & PySpark. - In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, and AWS data analytics services. - Extensive experience with Delta Tables, JSON, and Parquet file format. - Experience with AWS data analytics services like Athena, Glue, Redshift, and EMR. - Familiarity with Data warehousing will be beneficial. - Knowledge of NoSQL and RDBMS databases. - Good communication skills. - Ability to solve complex data processing and transformation-related problems.,