Technical Lead

Job Title:

Experience:

Location:

Job Type:

Type of Hire

About Us:

Job Summary:

Key Responsibilities:

• Lead the design, development, and maintenance of database architectures, including data modeling, database schema, and data warehousing.
• Collaborate with development teams to ensure database integration with applications and services.
• Provide technical guidance and mentorship to junior team members.
• Working knowledge of large-scale databases, including database performance tuning, backup and recovery, and security.
• Ensure database compliance with organizational policies, industry standards, and regulatory requirements.
• Develop and implement database monitoring and alerting systems.

• Develop and maintain database models, including entity-relationship diagrams and schema definitions
• Implement database security measures to ensure data integrity and confidentiality
• Quickly resolving user-reported issues, troubleshooting problems, and collaborating with stakeholders to implement fixes, minimizing the impact on user experience

• Design and develop ETL pipelines to extract, transform, and load data from various sources
• Develop and maintain ETL scripts using Python/PySpark and other programming languages
• Ensure data quality and integrity throughout the ETL process

• Integrate data from various sources, including APIs, files, and databases
• Develop and execute data migration plans to ensure seamless data transition

• Analyze and optimize database performance, including query optimization and indexing
• Implement caching and other techniques to improve database performance

• Experience in client facing role
• Experience understanding functional requirements, technical feasibility and translating to technical advantage
• Work closely with development teams to ensure database systems meet application requirements
• Communicate database design and implementation plans to stakeholders
• Provide technical guidance and support to junior team members

Technical Requirements:

• Python (required)
• PySpark

• Experience with relational databases (e.g. MySQL, PostgreSQL, Oracle)

• Experience with any open source ETL tools

• Experience with various data formats (e.g. CSV, JSON, Avro, Parquet)

• Experience with Linux/Unix operating systems
• Familiarity with AWS cloud-based platforms

Nice to Have:

• Data warehousing and business intelligence tools (e.g. Tableau, Power BI)
• Containerization and orchestration tools (e.g. Docker, Kubernetes)

Example of Python skills we are looking for:

• Experience with Python ETL frameworks : PySpark
• Python 3.x
• Pandas, NumPy, and other data science libraries

Example of ETL skills we are looking for:

• Experience with any open source ETL tools
• Familiarity with data integration frameworks (e.g. Apache NiFi, AWS Glue)
• Knowledge of data quality and data governance best practices
• Experience with data migration and data warehousing concepts