Posted:2 weeks ago|
Platform:
On-site
Full Time
Key Responsibilities: Design, develop, and optimize large-scale data pipelines using Databricks and Apache Spark. Collaborate with data scientists, analysts, and stakeholders to understand data requirements. Implement data ingestion, transformation, and storage solutions in cloud environments. Develop and maintain ETL/ELT processes to ensure data quality and reliability. Monitor and troubleshoot performance issues in data processing workflows. Ensure data security, compliance, and best practices across all data solutions. Mentor junior team members and contribute to best practices and standards. Stay current with industry trends and incorporate new tools and techniques as appropriate. Qualifications: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. 5+ years of experience in data engineering, with a focus on big data technologies. Extensive experience with Databricks platform and Apache Spark. Strong programming skills in Python, Scala, or SQL. Experience with cloud platforms such as AWS, Azure, or GCP. Knowledge of data warehousing concepts and tools like Delta Lake, Snowflake, or Redshift. Familiarity with CI/CD pipelines and automation tools. Strong problem-solving and communication skills. Show more Show less
Aaludra Technology Solutions
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Chennai, Tamil Nadu, India
Salary: Not disclosed
Chennai, Tamil Nadu, India
Salary: Not disclosed