GigsRemote

1 Job openings at GigsRemote
Senior Data Engineer - Contractor karnataka 7 - 11 years INR Not disclosed On-site Full Time

You will be collaborating with solution engineers, data scientists, product owners, and other professionals to deliver high-quality, scalable data assets and analytics solutions. Your role will involve hands-on development, solutioning, and optimization of Spark jobs, with a focus on reliability, data quality, and performance. Responsibilities: - Design and implement data pipelines - Ensure reliability, data quality, and optimal performance of data assets in cloud environments - Translate complex business requirements into high-quality data asset and capability delivery - Deliver high-quality code using PySpark/Python, SQL, and TypeScript, focusing on simplicity, reusability, and maintainability - Optimize Spark jobs for efficiency and cost - Support emerging AI and ML capabilities Requirements: - 7+ years in data engineering, transformation, and analysis with proficiency in programming and scripting languages - Hands-on expertise with cloud platforms - Strong Python/PySpark/Scala skills and in-depth knowledge of SQL - Working knowledge of cloud data services - Conceptual knowledge of system design, data structures, scalable storage solutions, security constraints, and cloud infrastructure - Problem-solving mindset and clarity of thought process for data transformation models If you are interested in this opportunity, you can apply directly on our website. If your qualifications align with the requirements for this role, our Talent Advisor will reach out to you to discuss the next steps.,