Senior Data Engineer-EL3& EL4

Job Description

We are looking for a highly skilled and experienced Senior Data Engineer with strong expertise in Spark, Scala, Databricks, Snowflake, and hands-on experience with Azure and AWS cloud platforms. The ideal candidate should have at least 5 years of relevant experience and will be deployed on a third-party payroll. Key Responsibilities: Develop, maintain, and optimize scalable data pipelines and ETL processes using Apache Spark and Scala Work on Databricks for data transformation, orchestration, and collaborative analytics Manage and design data models and perform complex queries on Snowflake Integrate data from multiple sources across Azure and AWS cloud platforms Implement best practices in data engineering and ensure data quality, performance, and scalability Collaborate with data scientists, analysts, and business stakeholders to understand data requirements Ensure security and compliance within cloud-based data solutions Technical Skills Required: Strong hands-on experience with Apache Spark and Scala Proficiency in Databricks platform (workspace management, notebook development, job orchestration) Solid understanding and experience with Snowflake (warehousing, performance tuning, data sharing) Cloud experience with both Azure (ADF, Data Lake, Synapse, etc.) and AWS (S3, Glue, Redshift, etc.) Good understanding of CI/CD pipelines and version control tools (e.g., Git) Experience working with structured and unstructured data formats Preferred Qualifications: Bachelor s or Master s degree in Computer Science, Information Technology, or related field Relevant cloud certifications (Azure/AWS/Snowflake) are a plus Experience working in an Agile/Scrum environment