Data Engineer - 4+ Years -Kolkata

Company Description

Programming.com is dedicated to empowering global enterprises with intelligent and next-gen digital solutions, helping them navigate the complexities of the digital-first world. With over 22 years of excellence and a team of 2200+ tech experts, we have successfully executed over 1000 projects across various industries including healthcare, automotive, finance, and retail. Our core competencies include AI & Machine Learning, digital transformation, cloud enablement, and enterprise software development. We have delivery hubs in the USA, India, Singapore, Mexico, and Ukraine.

Role Description

Experience:

Minimum 4-6 years of experience in data Engineering, data modeling, database design,

and data warehousing.

Roles and Responsibilities:

 Design and implement complex, large-scale data solutions using technologies such

as ADF, Databricks, Pyspark, Python, and SQL.

 Strong proficiency in SQL and experience with relational databases (e.g.,

PostgreSQL, MySQL, SQL Server).

 Proficiency in Python.

 Experience with building and optimizing data pipelines using ETL/ELT tools and

frameworks (e.g., Apache Airflow, dbt, Informatica, Talend, custom scripts).

 Hands-on experience with big data technologies (e.g., Apache Spark, Hadoop

ecosystem - HDFS, MapReduce, Hive).

 Experience with cloud platforms (e.g., Azure - ADLS, Databricks, Synapse; GCP -

GCS, BigQuery, Dataflow).

 Understanding of data warehousing concepts and experience with data warehouse

solutions (e.g., Snowflake, Redshift, BigQuery, Synapse Analytics).

 Familiarity with NoSQL databases (e.g., MongoDB, Cassandra) is a plus.

 Experience with version control systems (e.g., Git).

 Strong analytical and problem-solving skills.

 Excellent communication and collaboration skills, with the ability to work effectively in

a team environment.

 Ability to manage multiple tasks and projects simultaneously.

Certification Required:

 Relevant certifications in data engineering, data architecture, or database

technologies are preferred.

Behavioural Skills:

 Strong analytical and problem-solving skills.

 Excellent communication and interpersonal abilities.

 Ability to work effectively in a team environment.

 Attention to detail and a proactive mindset.

 Adaptability and willingness to learn new technologies.

Technical Skills:

 Proficiency in ADF, Databricks, Pyspark, Python, and SQL.

 Experience with data modeling and database design.

 Knowledge of data warehousing and ETL processes.

 Familiarity with cloud platforms such as Azure or AWS.

Non-Negotiable Skills

 Python/PySpark

 SQL

•  Databricks