Data Engineer

JD -

Experience : 8 to 14 Years

Location : Hyderabad

• Design and implement project-specific data pipelines and processing workflows using AWS services such as Glue, Lambda, S3, Redshift, and EMR.
• Ensure pipelines are scalable, efficient, and aligned with business requirements.
• Understand and manage domain-specific data requirements, including custom transformations and schema design.
• Collaborate with stakeholders to ensure data models reflect real-world business logic.
• Develop and maintain ETL (Extract, Transform, Load) processes tailored to project needs.
• Apply rigorous data quality checks to ensure accuracy, completeness, and consistency.
• Enforce enterprise data governance policies, including data privacy, lineage, and access control.
• Ensure compliance with internal standards and external regulations.
• Design and manage data storage solutions and access patterns optimized for performance and cost.
• Implement best practices for partitioning, indexing, and lifecycle management.
• Monitor the performance of data processing jobs, databases, and pipelines.
• Optimize for fast data retrieval and minimal latency using techniques like caching, parallel processing, and resource tuning.
• Proactively identify and resolve data-related issues across the infrastructure.
• Maintain high reliability and uptime of data systems through robust monitoring and alerting.
• Proficiency in AWS data services and cloud architecture
• Strong SQL and Python skills for data manipulation and automation
• Experience with ETL tools and workflow orchestration (e.g., Airflow, Step Functions)
• Familiarity with data governance frameworks and compliance standards
• Ability to troubleshoot and optimize large-scale data systems

If Interested please share your resume to preethi.m@responseinformatics.com