0 years
0 Lacs
Posted:5 days ago|
Platform:
Remote
Part Time
Company Description ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations from cyber threats. We offer a range of services, including cloud security, web and mobile security testing, and DevSecOps. Our mission is to provide customized, affordable solutions to meet the specific needs of our clients, ensuring every business has access to high-quality cyber security services. Role Description We are looking for a freelance Python Data Engineer with strong hands-on experience in building and maintaining scalable data pipelines on AWS . The ideal candidate will have deep expertise with AWS Glue , Step Functions , Lambda , and S3 , along with CI/CD experience using Jenkins . A strong understanding of testing strategies, particularly regression testing and handling live data dependencies , is essential. Key Responsibilities: Design, develop, and deploy ETL pipelines using Python and AWS services such as Glue, Lambda, Step Functions, and S3. Implement automated data workflows and orchestration logic using Step Functions. Handle live data ingestion, transformation, and storage with high reliability. Manage and optimize CI/CD processes using Jenkins . Conduct thorough regression testing to ensure stability and prevent disruptions in live environments. Troubleshoot data pipeline issues and ensure seamless production support. Collaborate with other data engineers, developers, and DevOps resources to integrate and deploy data solutions. Required Skills: Strong proficiency in Python , especially for ETL/data engineering use cases. Proven experience with: AWS Glue AWS Lambda AWS Step Functions Amazon S3 Hands-on experience with CI/CD pipelines using Jenkins . Solid understanding of regression testing methods and managing live data dependencies . Ability to work independently in a fast-paced remote environment. Show more Show less
ThreatXIntel
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections ThreatXIntel
Experience: Not specified
Salary: Not disclosed
Experience: Not specified
Salary: Not disclosed