Scraper
Scraper can handle multiple request type and transform them into object in order to create some API.
Installation
composer require rem42/scraper "^3.0"
Requirement
- PHP: >= 8.1
Scraper can handle multiple request type and transform them into object in order to create some API.
composer require rem42/scraper "^3.0"
Updates the requirements on rector/rector to permit the latest version.
5203352
[scoper] keep phpstan.phar to avoid conflict in install (#5009)34a2a49
[scoper] symplify prefix pick (#5011)4f66248
pusha2b2a0e
build on push dev978fdcd
try symplify scoping087972f
UPGRADE: add --set movingb5e3933
UPGRADE: add set movingd8e13e9
[AbstractRector] Add rollbackComments (#5005)8de8cdd
[PHP 8.0] Skip accessed variable before property assign (#5008)f49c146
cleanDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)@dependabot use these labels
will set the current labels as the default for future PRs for this repo and language@dependabot use these reviewers
will set the current reviewers as the default for future PRs for this repo and language@dependabot use these assignees
will set the current assignees as the default for future PRs for this repo and language@dependabot use this milestone
will set the current milestone as the default for future PRs for this repo and language@dependabot badge me
will comment on this PR with code to add a "Dependabot enabled" badge to your readmeAdditionally, you can set the following in your Dependabot dashboard:
Updates the requirements on rector/rector to permit the latest version.
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
Note: This repo was added to Dependabot recently, so you'll receive a maximum of 5 PRs for your first few update runs. Once an update run creates fewer than 5 PRs we'll remove that limit.
You can always request more updates by clicking Bump now
in your Dependabot dashboard.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)@dependabot use these labels
will set the current labels as the default for future PRs for this repo and language@dependabot use these reviewers
will set the current reviewers as the default for future PRs for this repo and language@dependabot use these assignees
will set the current assignees as the default for future PRs for this repo and language@dependabot use this milestone
will set the current milestone as the default for future PRs for this repo and language@dependabot badge me
will comment on this PR with code to add a "Dependabot enabled" badge to your readmeAdditionally, you can set the following in your Dependabot dashboard:
Updates the requirements on rem42/php-cs-fixer-config to permit the latest version.
0eac225
feat: upgrade php version add ci (#1)45f7b18
feat: upgrade to php-cs-fixer from ^2.16 to ^3.2Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)Updates the requirements on phpstan/phpstan to permit the latest version.
Sourced from phpstan/phpstan's releases.
1.2.0
Improvements 🔧
- Support for some features from PHP 8.1
- Support for
new
in initializers - RFC (https://github.com/phpstan/phpstan-src/commit/1a102fec28a2901927ce703a540fb82e47d17143)- Support for first-class callables - RFC
- Support for
array_is_list()
- RFC (#770), thanks@canvural
!- Support
literal-string
with encapsed strings (#768), thanks@craigfrancis
!- Tips for always used properties and constants extensions (https://github.com/phpstan/phpstan-src/commit/2db3c268e26d44125aa728c917ba51ec400b46b3)
- Autowire rules from the
rules
config section by their class name (https://github.com/phpstan/phpstan-src/commit/50cb90ddc6e6f6bdd248b7ea4bb5002193e808d6)Bugfixes 🐛
- Type system: ConstantStringType created from
::class
is always considered a classname (https://github.com/phpstan/phpstan-src/commit/da34d3f1d642d71d5a5130d371bb243c65b0b195), #5979- Do not run PHP bug workaround on PHP 8+ where it's fixed (https://github.com/phpstan/phpstan-src/commit/6573959829e3d07e1fa2a93845c973d47a12fdfd), #5954
- Promoted properties do not have a default value (https://github.com/phpstan/phpstan-src/commit/7c8e81dcf88378039ac57da459b4288b7e620a59), #5906
- CleaningParser - do not remove inline
@var
tags (https://github.com/phpstan/phpstan-src/commit/2652f2dc6c713ba2200df922a62fe651f2e4445e), #5921- AttributesCheck - do not report named arguments in attributes (https://github.com/phpstan/phpstan-src/commit/6366066f3b28a5bdef0c6a3d533c291a8490e1f8), #5898
Function signature fixes 🤖
- functionMap - removed functions that are reserved keywords and separate AST nodes (https://github.com/phpstan/phpstan-src/commit/08f3e2d02329fa39561356c630d8d561631419d9), #6014
cbe085f
PHPStan 1.2.08170c41
Levels start at 0, so there are 10 levels4d6fefa
Updated PHPStan to commit c862bb97482bced730988217685a8ae019436ad6e33400f
Updated PHPStan to commit 5a0d0314ea20b905e952670820554c541db8029c39d0d4e
Update text to note that level 9 is the strictest898dca3
Updated PHPStan to commit b42ceb618accbe20651165b0a049da299013e273b79d8d0
Updated PHPStan to commit 480c516ce2795d7af27142ac7c370e0d1f6bbb38362e194
Updated PHPStan to commit 7ed316d5983eb5a2601a5c3eb7781f8c06a50503bc99be7
Updated PHPStan to commit db456dd6fd79405bbbdac00fddb8ca0acb90ed49a0a82d2
Open 1.2-devDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)Updates the requirements on phpstan/phpstan to permit the latest version.
Sourced from phpstan/phpstan's releases.
1.1.1
Bugfixes 🐛
- Fixed
/** @phpstan-ignore-line */
and/** @phpstan-ignore-next-line */
annotations sometimes not working because of AST (https://github.com/phpstan/phpstan-src/commit/9474696dff040ba6d5a9adadc8c87551074cbf94), #4750, #4759, #3834, #3563, #4250, #4798- Do not report non-existent function after
function_exists()
check (https://github.com/phpstan/phpstan-src/commit/28e8c11a2bdf11eede53a152825fd3bd7733d95d), #3576- Make
function_exists()
similar tois_callable()
(https://github.com/phpstan/phpstan-src/commit/4a988637e67b6ff6854192c57adbbe3c32d62629), #1849
cb31702
PHPStan 1.1.1cc030e9
Updated PHPStan to commit 9b5387833e1d95c4294edaa03141f7ad427c76aaf418552
Updated PHPStan to commit 9474696dff040ba6d5a9adadc8c87551074cbf94ed9478a
Updated PHPStan to commit 4a988637e67b6ff6854192c57adbbe3c32d626297cb62ff
Updated PHPStan to commit 28e8c11a2bdf11eede53a152825fd3bd7733d95d997eb8e
PHPStan 1.1.0bd81179
Updated PHPStan to commit 6bb0fd66ce3344934549c38366906a5d20d6a3dbdc27acb
Updated PHPStan to commit e3a0e0d1b968c4338d2a50d76562c49e495215654ace177
Updated PHPStan to commit 5a907319eda0dcd86b4e130867f820fa3018509591e2a3c
Updated PHPStan to commit 625cb846a14e7a401534c04442e1f08cfd90251bDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)Updates the requirements on phpstan/phpstan to permit the latest version.
Sourced from phpstan/phpstan's releases.
1.0.0
PHPStan 1.0 is here and I'm really excited about it! Read the accompanying article on PHPStan's blog and also check out the merchandise we're selling for limited time (until November 22nd). It includes white and blue PHPStan t-shirts, PHPStan stickers, and also something very special: Rule level badges that you can pin to your clothes to show off that you care about code quality 😊
Major new features 🚀
- Level 9 with checkExplicitMixed (https://github.com/phpstan/phpstan-src/commit/e5bbb52fbc9139502f231999173ba6412e62587d)
- Consistent remembering and forgetting returned values (https://github.com/phpstan/phpstan-src/commit/d4edc59b36927a2d70f2e8665e657f99dd9d6be2)
- Precise try-catch-finally analysis (https://github.com/phpstan/phpstan-src/commit/4588e73dd618e1077bfe1cec7b8e62e251d5eb95)
- Validate overriding methods in stubs (https://github.com/phpstan/phpstan-src/commit/c98d0a4946c373543c379427983e02ccef71f86c)
- Nicer type descriptions usable in PHPDocs (https://github.com/phpstan/phpstan-src/commit/03341cc6bf010faf1e99f1dbddf5cea66d56e3cf, https://github.com/phpstan/phpstan-src/commit/51d7431dbe802827bac61907d7bcb58a168dff81)
New rules
- Level 0
- Check leading and trailing file whitespace and BOM (https://github.com/phpstan/phpstan-src/commit/6905d66cf4256eae48ae997b88fbbc58e0ad2ae8)
- Check overriding constants (https://github.com/phpstan/phpstan-src/commit/89acb0db4400c95b231ae74830e8607d72824cbc)
- Check classes extending
@final
classes (https://github.com/phpstan/phpstan-src/commit/dffd2c2351e5fc5d22b752bf3b8be84bf1708f71), https://github.com/phpstan/phpstan/discussions/5343- Check that function-scoped template type is in a parameter (https://github.com/phpstan/phpstan-src/commit/18bdd34a808763764ea281d4f1b62fc0e7968873)
- Check overriding properties (https://github.com/phpstan/phpstan-src/commit/0f4885aa101e0cc49f906e72990e356bd281ec63), #4281
- Level 1
- Rule for checking null-coalescing
??
operator issues (#36), thanks@leongersen
!- Level 2
- Detect wrong usage of
@var
PHPDoc tag (https://github.com/phpstan/phpstan-src/commit/58860536dcc60bfc86c29ad67711ed1b19046cb0)- Rules for accessing private class elements through
static::
(https://github.com/phpstan/phpstan-src/commit/d8e89538ac84236cb3c40ea85b524e4f7cc30852, https://github.com/phpstan/phpstan-src/commit/bad2607a032787d822a1a8f91d5176455eac8693, https://github.com/phpstan/phpstan-src/commit/270326a1ed22398a98b15880e12a3b8015a83c4a)- Class constants - incompatible PHPDoc types (https://github.com/phpstan/phpstan-src/commit/780a54cd0149d8cb5a62bb1ef6fa2b0871114ee5)
- Cross-check generic interface implementations (https://github.com/phpstan/phpstan-src/commit/284af50d76210a449f210699732171ecacf3307f), #5222
- Level 3
- Check that function with
@throws void
does not have an explicit throw point (https://github.com/phpstan/phpstan-src/commit/8b3382aceac801b9801fccda253033d8e8e5f655)- Check array deconstruction (https://github.com/phpstan/phpstan-src/commit/aae34d935081a8f8d34f5bd9bdf50ebdfdb85a7e), #3267
- Level 4
- Detect unused and write-only/read-only private properties, methods, and constants
- Rule for checking additional issues like always-defined/never-defined properties, array offsets etc. in
isset()
(https://github.com/phpstan/phpstan-src/commit/25b61d974f5ca1cb00d7d2be4dce750553787b87)empty()
rule (https://github.com/phpstan/phpstan-src/commit/601460ccecfd72888d96e9c53d21cc3a8b66c719), #970- While loop - detect always true and always false conditions (https://github.com/phpstan/phpstan-src/commit/217fac309862f82485f8b756f09665192235aa13, https://github.com/phpstan/phpstan-src/commit/fb3f83e8f601b31a6eb5a12d58211dfced629821)
- Do-while loop - detect always true and always false conditions (https://github.com/phpstan/phpstan-src/commit/e81ccd40a4872bde4f6578919b93b4d821021557)
- Report dead catch with exception that is not thrown in the try block (https://github.com/phpstan/phpstan-src/commit/ce9299c0e9ab55fc63d7a2e0814c99cc221cb514)
- Rule for detecting overwriting exit points in finally (https://github.com/phpstan/phpstan-src/commit/3f712be7c4a840fcae3bb8d3ebfa888ead4e964e)
- Level 5
- Check callable parameter types for
array_map()
andarray_filter()
calls (#555), #5609, #5356, #1954, thanks@BackEndTea
!implode()
function rule (#679), thanks@staabm
!- Check
DateTime
instantiation (#380), thanks@b1rdex
!random_int()
dynamic return type extension and parameters rule (#99), thanks@cs278
!- Level 6
... (truncated)
0d13a99
PHPStan 1.0.04453ce4
Updated PHPStan to commit 3738fcd98a98f5a8ef61b40a4c0c5384b7704714b4442f2
Merch test90f09b0
Updated PHPStan to commit 5ddca4279e348a3e9e8ce1b1dbac70459b7ab20cc3f75a5
Updated PHPStan to commit c836a423d34faa818127e34efb89ef4b3a7b66b6f4538fd
Updated PHPStan to commit fc2b308fd14fc989be72922531e64a6231368ae3d6ec0d1
Updated PHPStan to commit afef6dc7f42ac00945dbed3f52f8700de9593656d557793
Updated PHPStan to commit f8885db4593ce7678ef95fd5b732e13f7db15e5e69f6ffc
Updated PHPStan to commit dbbbd41447de82234e28465c3caa3af147f8787e7633c8a
Updated PHPStan to commit 50a7141a6eaa8df169933116164ad12d63f8ebb4Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)Updates the requirements on rem42/php-cs-fixer-config to permit the latest version.
45f7b18
feat: upgrade to php-cs-fixer from ^2.16 to ^3.2Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase
will rebase this PR@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it@dependabot merge
will merge this PR after your CI passes on it@dependabot squash and merge
will squash and merge this PR after your CI passes on it@dependabot cancel merge
will cancel a previously requested merge and block automerging@dependabot reopen
will reopen this PR if it is closed@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)Dependabot Preview will be shut down on August 3rd, 2021. In order to keep getting Dependabot updates, please merge this PR and migrate to GitHub-native Dependabot before then.
Dependabot has been fully integrated into GitHub, so you no longer have to install and manage a separate app. This pull request migrates your configuration from Dependabot.com to a config file, using the new syntax. When merged, we'll swap out dependabot-preview
(me) for a new dependabot
app, and you'll be all set!
With this change, you'll now use the Dependabot page in GitHub, rather than the Dependabot dashboard, to monitor your version updates, and you'll configure Dependabot through the new config file rather than a UI.
If you've got any questions or feedback for us, please let us know by creating an issue in the dependabot/dependabot-core repository.
Learn more about migrating to GitHub-native Dependabot
Please note that regular @dependabot
commands do not work on this pull request.
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| phpstan/phpstan | require-dev | pin | ^1.8
-> 1.8.10
|
| phpunit/phpunit (source) | require-dev | pin | ^9.5
-> 9.5.25
|
| rem42/php-cs-fixer-config | require-dev | pin | ^3.4
-> 3.4.0
|
Add the preset :preserveSemverRanges
to your config if you don't want to pin your dependencies.
📅 Schedule: Branch creation - "before 3am on the first day of the month" (UTC), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.
This PR has been generated by Mend Renovate. View repository job log here.
Welcome to WhiteSource Bolt for GitHub! This is an onboarding PR to help you understand and configure settings before WhiteSource starts scanning your repository for security vulnerabilities.
:vertical_traffic_light: WhiteSource Bolt for GitHub will start scanning your repository only once you merge this Pull Request. To disable WhiteSource Bolt for GitHub, simply close this Pull Request.
This PR contains a '.whitesource' configuration file which can be customized to your needs. If no changes were applied to this file, WhiteSource Bolt for GitHub will use the default configuration.
Before merging this PR, Make sure the Issues tab is enabled. Once you merge this PR, WhiteSource Bolt for GitHub will scan your repository and create a GitHub Issue for every vulnerability detected in your repository.
If you do not want a GitHub Issue to be created for each detected vulnerability, you can edit the '.whitesource' file and set the 'minSeverityLevel' parameter to 'NONE'.
:question: Got questions? Check out WhiteSource Bolt for GitHub docs. If you need any further assistance then you can also request help here.
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| symfony/http-client-contracts (source) | require | major | ^2.0
-> ^3.0
|
📅 Schedule: At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by WhiteSource Renovate. View repository job log here.
This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.
This repository currently has no open or pending branches.
composer.json
php ^8.1
symfony/http-client-contracts ^3.1
symfony/serializer-pack ^1.1
rem42/php-cs-fixer-config ^3.4
phpstan/phpstan ^1.8
phpunit/phpunit ^9.5
.github/workflows/ci.yml
actions/checkout v3
shivammathur/setup-php v2
actions/cache v3
nick-invision/retry v2
Full Changelog: https://github.com/rem42/scraper/compare/v2.2...v3.0
Source code(tar.gz)Full Changelog: https://github.com/rem42/scraper/compare/v2.1...v2.2
Source code(tar.gz)Full Changelog: https://github.com/rem42/scraper/compare/2.0...v2.1
Source code(tar.gz)Full Changelog: https://github.com/rem42/scraper/compare/v1.0.11...2.0
Source code(tar.gz)A small example of crawling another website and extracting the required information from it to save the website wherever we need it Description This s
A browser testing and web scraping library for PHP and Symfony Panther is a convenient standalone library to scrape websites and to run end-to-end tes
Library for Rapid (Web) Crawler and Scraper Development This package provides kind of a framework and a lot of ready to use, so-called steps, that you
PHP Scraper An opinionated & limited way to scrape the web using PHP. The main goal is to get stuff done instead of getting distracted with xPath sele
Goutte, a simple PHP Web Scraper Goutte is a screen scraping and web crawling library for PHP. Goutte provides a nice API to crawl websites and extrac
Note on backwards compatibility break: since v0.5.0, Symfony EventDispatcher v3 is no longer supported and PHP Spider requires v4 or v5. If you are st
crawlerdetect.io About CrawlerDetect CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent and http_from header. Current
QueryList QueryList is a simple, elegant, extensible PHP Web Scraper (crawler/spider) ,based on phpQuery. API Documentation 中文文档 Features Have the sam
Goutte, a simple PHP Web Scraper Goutte is a screen scraping and web crawling library for PHP. Goutte provides a nice API to crawl websites and extrac
Disco the Ripper was created to rip all messages from a Discord specific channel into JSON via CLI and help people to investigate some servers who has awkward channels before they get deleted.
phpQuery The PHP DOM Manipulation toolkit. Motivation I'm working currently with PHP, and I've missed using something like jQuery in PHP to manipulate
Objective This script is intended for finding the hidden treasure, A scraping challenge by digikala for 2021 black Friday Prerequisites Php mysql redi
Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性,基于 Workerman
roach-php-bundle Symfony bundle for Roach PHP. Roach is a complete web scraping toolkit for PHP. It is a shameless clone heavily inspired by the popul
It can scrape ZEE5 Live Streaming URL's Using The Channel ID and Direct Play Anywhere
?? Roach A complete web scraping toolkit for PHP About Roach is a complete web scraping toolkit for PHP. It is heavily inspired (read: a shameless clo
s3n Search-Scan-Save-Notify A program to scrape online web-content (APIs, RSS Feeds, or Websites) and notify if search term was hit. It is based on PH
Blacksmith is a code generation tool which automates the creation of common files that you'd typically create for each entity in your application.
Translate entity About package This package is intended for adding multi language support to your models. If your application already be working and y
select2entity-bundle Introduction This is a Symfony bundle which enables the popular Select2 component to be used as a drop-in replacement for a stand