Responsibilities: Design, build, and optimize data pipelines to ingest, process, transform, and load data from various sources into our data platform Implement and maintain ETL workfl ows using tools like Debezium, Kafka, Airfl ow, and Jenkins to ensure reliable and timely data processing Develop and optimize SQL and NoSQL database schemas, queries, and stored procedures for effi cient data retrieval and processing *** Work with both relational databases (MySQL, PostgreSQL) and NoSQL databases (MongoDB, DocumentDB) to build scalable data solutions Design and implement data warehouse solutions that support analytical needs and machine learning applications Collaborate with data scientists and ML engineers to prepare data for AI/ML models and implement data-driven features Implement data quality checks, monitoring, and alerting to ensure data accuracy and reliability Optimize query performance across various database systems through indexing, partitioning, and query refactoring Develop and maintain documentation for data models, pipelines, and processes Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs Stay current with emerging technologies and best practices in data engineering Requirements: 5+ years of experience in data engineering or related roles with a proven track record of building data pipelines and infrastructure Strong profi ciency in SQL and experience with relational databases like MySQL and PostgreSQL Hands-on experience with NoSQL databases such as MongoDB or AWS DocumentDB Expertise in designing, implementing, and optimizing ETL processes using tools like Kafka, Debezium, Airfl ow, or similar technologies Experience with data warehousing concepts and technologies Solid understanding of data modeling principles and best practices for both operational and analytical systems Proven ability to optimize database performance, including query optimization, indexing strategies, and database tuning Experience with AWS data services such as RDS, Redshift, S3, Glue, Kinesis, and ELK stack Profi ciency in at least one programming language (Python, Node.js, Java) Experience with version control systems (Git) and CI/CD pipelines Job Description: Experience with graph databases (Neo4j, Amazon Neptune) Knowledge of big data technologies such as Hadoop, Spark, Hive, and data lake architectures Experience working with streaming data technologies and real-time data processing Familiarity with data governance and data security best practices Experience with containerization technologies (Docker, Kubernetes) Understanding of fi nancial back-offi ce operations and FinTech domain Experience working in a high-growth startup environment
Python programming expertise: data structures, OOP, recursions, generators, iterators, decorators, familiarity with regular expressions. Working knowledge and experience with deep learning framework Pytorch or Tensorflow. Embedding representations. Strong experience in Python and production system development. Familiarity with SQL database interactions. Familiarity with Elasticsearch document indexing, querying. Familiarity with Docker, Dockerfile. Familiarity with REST API, JSON structure. Python packages like FastAPI. Familiarity with git operations. Familiarity with shell scripting. Familiarity with PyCharm for development, debugging, profiling. Experience with Kubernetes. Experience with LLms & Gen AI. Desired Skills NLP toolkits like NLTK, spaCy, Gensim, scikit-learn. Familiarity with basic natural language concepts, handling. Tokenization, lemmatization, stemming, edit distances, named entity recognition, syntactic parsing, etc. Good knowledge and experience with deep learning framework Pytorch or Tensorflow. More complex operations with Elasticsearch. Creating indices, indexable fields, etc. Good experience with Kubernetes
WERE Hiring Embedded Linux Developer. 1. System Development & Integration Develop and maintain applications, drivers, and middleware for embedded Linux platforms. Integrate Linux kernel, bootloaders (e.g., U-Boot), and device drivers with hardware. Customize and build Linux distributions (e.g., using Yocto, Buildroot). 2. Kernel & Driver Development Develop, configure, and debug Linux kernel modules. Implement and maintain device drivers for peripherals (I2C, SPI, UART, USB, Ethernet, etc.). Optimize kernel performance and ensure hardware-software compatibility. 3. Board Bring-Up Work on new hardware prototypes for board bring-up. Configure bootloaders and root file systems. Debug hardware/software integration issues. 4. System Optimization Optimize memory, CPU usage, and power consumption. Profile and tune embedded applications for performance and efficiency. 5. Testing & Debugging Perform unit tests, integration tests, and system validation. Debug issues using tools like GDB, strace, or oscilloscope/logic analyzers. 6. Collaboration Work with cross-functional teams (hardware, QA, product management). Contribute to design discussions and documentation. 7. Maintenance & Support Provide long-term support for Linux-based products. Apply security patches and maintain software updates. Required Skills Proficiency in C/C++ programming for embedded systems. Strong understanding of Linux kernel architecture . Experience with Yocto, Buildroot, or OpenEmbedded . Familiarity with device driver development . Knowledge of hardware interfaces (GPIO, I2C, SPI, UART, etc.). Debugging tools and methodologies for embedded Linux. Version control systems (Git). Preferred/Optional Skills Experience with Real-Time Linux (PREEMPT-RT). Knowledge of networking protocols (TCP/IP, MQTT, etc.). Scripting in Python, Bash, or Perl. Exposure to security in embedded systems . Experience with containerization on embedded devices (e.g., Docker Notice Period : Immediate To 30 Days.