Job
Description
CANDIDATE SHOULD BE AVAILABLE FOR FACE TO FACE INTERVIEW ON 12TH APRIL AND SHOULD BE READY TO WORK FROM OFFICE 5 DAYS A WEEK A Data Engineer is responsible for designing, building, and maintaining robust data pipelines and architectures that enable the collection, transformation, and storage of large datasets. Ensure data quality and reliability, support data-driven decision-making, and facilitate the integration of various data sources into centralized systems. Develop and manage data pipelines for extracting, loading, and transforming data from multiple sources. Work with open-source and cloud-based databases (e.g., PostgreSQL, Snowflake, BigQuery, Redshift). Automate database operations and ETL tasks using programming languages such as Python and frameworks like Spark. Implement CI/CD practices and version control to streamline deployments. Ensure efficient and reliable orchestration using tools like Apache Airflow, Prefect, or Dragster. Experience working on API integration and real time streaming. Database: Preferred (PostgresQL, MongoDB),or any RDBMS,NOSQL databases Programming languages : Python, Spark, SQL, DBT orchestration : Apache Airflow, Prefect, NIFI Cloud tech : AWS (e.g., S3, Redshift, Glue), Google Cloud Platform (e.g., BigQuery, Cloud Composer) Streaming : Apache Kafka / google cloud pub/sub Devops : Docker / Kubernetes , GIT,
