PySpark

You are an experienced PySpark ETL Lead responsible for driving data integration efforts in analytics and data warehousing projects. Your role includes developing and managing PySpark scripts, creating ETL workflows, and ensuring efficient data processing and integration across systems. You should be strong in PySpark and Python for ETL and data processing, with experience in ETL pipeline design, data integration, and data warehousing. Proficiency in SQL and working with large datasets is required, along with familiarity with workflow schedulers such as Airflow and Cron. Hands-on experience with Big Data tools like Hive, HDFS, and Spark SQL is essential. It would be beneficial if you have experience with cloud platforms like AWS, Azure, or GCP. Your responsibilities will involve leading ETL development using PySpark, designing and scheduling data workflows, optimizing data processing performance, and collaborating with cross-functional teams. If you have a passion for data integration, a knack for optimizing processes, and enjoy working in a collaborative environment, this role is perfect for you. Join us and be part of our dynamic team driving impactful data initiatives.,