4 - 15 years
Posted:5 days ago
SAN Engineering Solutions is expanding its Big Data Engineering team and looking for talented professionals with strong expertise in Python, Spark, PySpark, SQL, and Big Data platforms.
🔹 4–7 Years – 10 Positions
🔹 7–10 Years – 10 Positions
🔹 10–15 Years – 10 Positions
✔️ Design and develop scalable PySpark-based data migration pipelines from source systems to Apache Iceberg.
✔️ Perform data extraction, transformation, cleansing, standardization, and loading.
✔️ Develop complex SQL queries and perform query tuning and performance optimization.
✔️ Analyze Spark execution plans and optimize jobs using partitioning, caching, and efficient transformations.
✔️ Perform data profiling, validation, and reconciliation to ensure data quality and integrity.
✔️ Troubleshoot PySpark jobs, production issues, and performance bottlenecks.
✔️ Monitor Azure DevOps (ADO) pipelines and manage code changes using Git, pull requests, and code reviews.
✔️ Conduct RCA, support deployments, SIT, UAT, hypercare, and production support.
✔️ Collaborate with cross-functional teams to ensure successful project delivery.
#WeAreHiring #BigDataEngineer #BigData #DataEngineering #Python #PySpark #ApacheSpark #SQL #ApacheIceberg #Airflow #DataMigration #DataWarehousing #DataModelling #AzureDevOps #ChennaiHiring #BangaloreHiring #ITJobs #TechHiring #HiringNow
Free courses, interview questions and practice for each skill.
Full Time
SAN Engineering Solutions
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python NowBengaluru
Salary: Not disclosed
Salary: Not disclosed
Hyderabad
Salary: Not disclosed
Bengaluru
Salary: Not disclosed
Salary: Not disclosed
AI Job Matching Summary