Data Engineer

Job Description

Client name: Zeta Global Full-time Job Location: Bangalore Experience Required: 8+ years Mode of Work: Hybrid, 3 days work from the office and 2 days work from home Job Title: Data Engineer As a Senior Software Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and batch data infrastructure Daily use technologies such as Python, Spark, Airflow, Snowflake, Hive, Fast API, etc. Maintaining data quality and accuracy across production data systems Working with Data Analysts to develop ETL processes for analysis and reporting Working with Product Managers to design and build data products Working with our DevOps team to scale and optimize our data infrastructure Participate in architecture discussions, influence the road map, take ownership and responsibility over new projects Participating in on-call rotation in their respective time zones (be available by phone or email in case something goes wrong) Desired Characteristics: Minimum 8 years of software engineering experience. An undergraduate degree inComputer Science (or a related field) from a university where the primary language of instruction is English is strongly desired. 2+ Years of Experience/Fluency in Python Proficient with relational databases and Advanced SQL Expert in the use of services like Spark and Hive. Experience working with container-based solutions is a plus. Experience in adequate usage of any scheduler such as Apache Airflow, Apache Luigi, Chronos, etc. Experience in adequate usage of cloud services (AWS) at scale Proven long-term experience and enthusiasm for distributed data processing at scale, eagerness to learn new things. Expertise in designing and architecting distributed low-latency and scalable solutions in either cloud or on-premises environments. Exposure to the whole software development lifecycle from inception to production and monitoring. Experience in the Advertising Attribution domain is a plus Experience in agile software development processes Excellent interpersonal and communication skills. Please fill in all the essential details which are given below & attach your updated resume, and send it to ralish.sharma@compunnel.com 1. Total Experience: 2. Relevant Experience in Data Engineering : 3. Experience in Python : 4. Experience in Spark/Airflow/ Snowflake/Hive : 5. Experience in Fast API : 6. Experience in ETL : 7. Experience in SQL : 8. Experience in Apache : 9. Experience in AWS : 10. Current company : 11. Current Designation : 12. Highest Education : 10. Notice Period: 11 Current CTC: 12. Expected CTC: 13. Current Location: 14. Preferred Location: 15. Hometown: 16. Contact No: 17. If you have any offer from some other company, please mention the Offer amount and Offer Location: 18. Reason for looking for change: 19. PANCARD : If the job description is suitable for you, please get in touch with me at the number below: 9910044363 .