Job
Description
We are seeking a highly skilled AWS + Python Professional with a strong focus on data engineering. The ideal candidate will possess 6-7 years of experience with AWS data services (S3, Athena, CDK, Redshift) and data modeling, complemented by at least 4 years of hands-on Python development. You will be responsible for designing, developing, and maintaining robust data pipelines, integrating various data sources, and building scalable data APIs on the cloud. Key Responsibilities: AWS Data Engineering: Utilize thorough understanding and hands-on experience with AWS data services such as S3, Athena, and Redshift . Leverage AWS CDK (Cloud Development Kit) for infrastructure as code. Design and develop data pipelines using AWS Glue, Spark, and Python with Airflow . Experience with Informatica Cloud is advantageous for ETL processes. Python Development: Develop and maintain high-quality code primarily in Python . Design and develop Data APIs (Python, Flask/FastAPI) to expose data on the platform, ensuring security and scalability. Data Modeling & Warehousing: Apply Advanced/Intermediate Data Modeling skills (Master/Reference, ODS, Data Warehouse, Data Mart - Dimension and Fact tables) to enable analytics on the platform. Utilize traditional data warehousing and ETL skillset, including strong SQL and PL/SQL skills . Data Integration: Handle inbound and outbound integrations on the cloud platform. Experience loading and querying cloud-hosted databases like Redshift, Snowflake, and BigQuery . Collaboration & Quality Assurance: Partner with Solution Architects (SA) to identify data inputs, related data sources, review sample data, identify gaps, and perform quality checks. DevOps/DataOps (Preferred): Experience with Infrastructure as Code and setting up CI/CD pipelines . Real-time Streaming (Preferred): Experience building real-time streaming data ingestion solutions. System Integration (Preferred): Knowledge of system-to-system integration, messaging/queuing, and managed file transfer. Required Skills & Experience: Total Years of Experience: 6-7 years. Relevant Experience:AWS (6-7 years): S3, Athena, CDK, Redshift. Data Modeling: Strong understanding of Dimension and Fact tables. Python (4 years): Hands-on development. Mandatory Skills: AWS, Python, Flask (implies API development expertise). Cloud Platforms: Thorough understanding of AWS from a data engineering and tools standpoint. Experience in another cloud (Azure, GCP) is beneficial. ETL Tools: Experience in AWS Glue, Spark, and Python with Airflow. Data Modeling: Advanced/Intermediate data modeling skills. Database Skills: Strong SQL and PL/SQL skills. Data Loading/Querying: Experience with Redshift, Snowflake, BigQuery. Additional Information: Vendor Billing Rate: INR 10,500 per day. Background Check: Post onboarding. Notice Period: 15 days, not more than that.
