Software Engineer Senior Advisor

0 years

0 Lacs

Posted:11 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Company:A Large Global Organization

Key Skills:

Roles and Responsibilities:

  • Design and implement end-to-end data pipelines using Python and Airflow, ensuring efficient scheduling, orchestration, and dependency management for complex workflows.
  • Develop high-performance SQL queries for data extraction, transformation, and reporting, focusing on query optimization and scalability across large datasets.
  • Automate and modularize ETL processes leveraging Python scripting and reusable Airflow DAG components, adhering to best practices in software engineering and data governance.
  • Work with AWS cloud services (S3, Glue, Redshift, Aurora RDS, CloudWatch) to enable scalable, secure, and cloud-native data processing and storage solutions.
  • Integrate and transform data from multiple sources such as Alteryx, PostgreSQL, Oracle, and PL/SQL into unified data models to support analytics and reporting needs.
  • Oversee the work of junior data engineers and mentor them.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Collaborate with stakeholders including Product, Business Analysts, Data Science, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Ensure data security and compliance across national boundaries through multiple data centers and AWS regions.

Skills Required:

  • Numpy
  • Pandas
  • Python
  • SQL
  • Data Engineering
  • Good to have - AWS (S3, Glue, Redshift, Aurora RDS, CloudWatch)
  • Good to have - Airflow (DAG creation, orchestration, workflow management)
  • Databricks (AWS environment)
  • ETL Development & Automation
  • Query Optimization & Performance Tuning
  • Data Pipeline Design & Monitoring
  • Data Integration (Alteryx, PostgreSQL, Oracle, PL/SQL)
  • Data Security & Compliance Management
  • Cloud-Native Data Processing Solutions
  • Process Improvement & Automation Skills
  • Analytics Tool Development
  • Stakeholder Collaboration (Product, BA, Data Science, Design teams)
  • Mentoring & Leadership of Junior Engineers

Education:

Mock Interview

Practice Video Interview with JobPe AI

Start NumPy Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You