2 346 packages trouvés en 23ms

isbot4.9mUnlicense5.1.28

🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.

omrilotanIl y a 2 monthscrawlers, bot, spiders, googlebot

@crawlee/utils201.3kApache-2.03.13.10

A set of shared utilities that can be used by crawlers

apifyIl y a about 1 hourcrawlers, apify, crawling, utilities

sitemapper135.8kMIT4.0.2

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

seantomburkeIl y a 2 monthscrawlers, parse, sitemap, xml

This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.

JefferyHusIl y a 3 monthses6-javascript, crawler, bots, spider

Parse robot directives within HTML meta and/or HTTP headers.

stevenvachonIl y a about 3 yearscrawlers, header, html, http

Packages

Lightweight debugging utility for Node.js and the browser

Lodash modular utilities.

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

Higher-order functions and common patterns for asynchronous code

Babel compiler core.