Data Engineer

skilled and motivated Data Engineer

Expereince :

Location :

Qualification :

Optional but beneficial: Master’s degree in Data Engineering, Data Science, or related fields.

Required Skills :

• Proficiency in SQL & Python for data processing, data manipulation, and scripting.
• Experience with big data technologies such as Spark, Kafka, Cloud tech stack etc.
• Experience with tools and best practices for developing and managing data engineering pipelines, data lakes and warehouses, such as ETL tools, job management and data management tools, especially open-source tools
• Strong understanding of database technologies (SQL, NoSQL) and data modelling  and data base schema design principles.
• Experience with containerization (Docker, Kubernetes) is a plus.

Responsibilities :

• Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems using Python.
•  Design, develop, and maintain robust and scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources.
• Implement data integration solutions to extract, load, and transform data from disparate systems and databases.
• Develop and optimize ETL processes to cleanse, transform, and enrich raw data for analysis and reporting purposes.
• Ensure data quality and integrity throughout the ETL lifecycle through validation and error-handling mechanisms.
• Ensure architecture will support the requirements of the business.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Implement data security and privacy measures.
•  Monitor and optimize performance of the data infrastructure.

To know more about us: https://algo8.ai/

To drop your resume : smita.choudhury@algo8.ai

Intrested candidate requested to fill the form on this link : https://forms.gle/Y2NkF6fwb35MXd6a9