3 Ratelimiting Jobs

As an entrepreneurial, passionate, and driven Data Engineer at Startup Gala Intelligence backed by Navneet Tech Venture, you will play a crucial role in shaping the technology vision, architecture, and engineering culture of the company right from the beginning. Your contributions will be foundational in developing best practices and establishing the engineering team. **Key Responsibilities:** - **Web Scraping & Crawling:** Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets. - **Scalable Scraping Systems:** Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions. - **Data Parsing & Cleaning:** Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines. - **Anti-bot & Evasion Tactics:** Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions. - **Integration with Pipelines:** Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage. - **Data Quality & Validation:** Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence. - **Documentation & Maintenance:** Keep scrapers updated when websites change, and document scraping logic for reproducibility. **Qualifications Required:** - 2+ years of experience in web scraping, crawling, or data collection. - Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests). - Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet). - Experience in handling large-scale scraping with proxy management and rate-limiting. - Basic knowledge of ETL processes and integration with data pipelines. - Exposure to graph databases (Neo4j) is a plus. As part of Gala Intelligence, you will be working in a tech-driven startup dedicated to solving fraud detection and prevention challenges. The company values transparency, collaboration, and individual ownership, creating an environment where talented individuals can thrive and contribute to impactful solutions. If you are someone who enjoys early-stage challenges, thrives on owning the entire tech stack, and is passionate about building innovative, scalable solutions, we encourage you to apply. Join us in leveraging technology to combat fraud and make a meaningful impact from day one.,

The ideal candidate for this full-time position based in Sector 31, Faridabad should have experience in protecting websites from massive DDoS attacks by configuring tools such as Cloudflare, WAF, rate-limiting, and bot filtering. Additionally, expertise in optimizing servers including Linux, NGINX/Apache, MySQL, PHP-FPM, and writing custom PHP scripts for security and speed is required. Experience with high-traffic WordPress/CMS and automation for attack detection/blocking would be considered a bonus. The working hours are from Monday to Friday, 10 AM to 6:30 PM, with the salary being commensurate with the candidate's experience. Lunch, tea, and snacks will be provided as perks. If you meet the above requirements and are ready to take on this challenging role, apply now.,

As a Python API Developer specializing in Product Development, you will leverage your 4+ years of experience to design, develop, and maintain high-performance, scalable APIs that drive our Generative AI products. Your role will involve close collaboration with data scientists, machine learning engineers, and product teams to seamlessly integrate Generative AI models (e.g., GPT, GANs, DALL-E) into production-ready applications. Your expertise in backend development, Python programming, and API design will be crucial in ensuring the successful deployment and execution of AI-driven features. You should hold a Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field. Your professional experience should demonstrate hands-on involvement in designing and developing APIs, particularly with Generative AI models or machine learning models in a production environment. Proficiency in cloud-based infrastructures (AWS, Google Cloud, Azure) and services for deploying backend systems and AI models is essential. Additionally, you should have a strong background in working with backend frameworks and languages like Python, Django, Flask, or FastAPI. Your core technical skills include expertise in Python for backend development using frameworks such as Flask, Django, or FastAPI. You should possess a strong understanding of building and consuming RESTful APIs or GraphQL APIs, along with experience in designing and implementing API architectures. Familiarity with database management systems (SQL/NoSQL) like PostgreSQL, MySQL, MongoDB, Redis, and knowledge of cloud infrastructure (e.g., AWS, Google Cloud, Azure) are required. Experience with CI/CD pipelines, version control tools like Git, and Agile development methodologies is crucial for automating deployments and ensuring efficient backend operations. Key responsibilities will involve closely collaborating with AI/ML engineers to integrate Generative AI models into backend services, handling data pipelines for real-time or batch processing, and engaging in design discussions to ensure technical feasibility and scalability of features. Implementing caching mechanisms, rate-limiting, and queueing systems to manage AI-related API requests, as well as ensuring backend services can handle high concurrency during resource-intensive generative AI processes, will be essential. Your problem-solving skills, excellent communication abilities for interacting with cross-functional teams, and adaptability to stay updated on the latest technologies and trends in generative AI will be critical for success in this role.,