jandieman
/
searxng
mirror of https://github.com/searxng/searxng.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
7,386 Commits 7 Branches 17 Tags 124 MiB
Commit Graph

7386 Commits

Author SHA1 Message Date
searxng-bot 7850c77c2c [translations] update from Weblate 
d2fb466c - 2023-04-02 - return42 <markus.heiser@darmarit.de>
5576f597 - 2023-04-02 - return42 <markus.heiser@darmarit.de>
4b28cab9 - 2023-03-31 - Vistaus <vistausss@fastmail.com>
 2023-04-07 07:07:51 +00:00
Markus Heiser f46d0584ef
Merge pull request #2322 from return42/fix-2321 
[fix] Gigablast.com has been erased
 2023-04-06 23:49:58 +02:00
Markus Heiser 64e221426a
Merge pull request #2312 from return42/fix-1020-part-2 
[fix] categories can't be removed from UI (categories_as_tabs)
 2023-04-06 10:36:51 +02:00
Markus Heiser 5234e45010 [fix] Gigablast.com has been erased 
[1] https://www.reddit.com/r/searchengines/comments/128wdcp/gigablastcom_has_been_erased/

Closes: https://github.com/searxng/searxng/issues/2321
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-06 08:22:57 +02:00
Markus Heiser 934249dd05
Merge pull request #2315 from return42/fix-2314 
[fix] ./manage: replace data.languages by data.traits
 2023-04-05 07:53:41 +02:00
Markus Heiser cd26f3ea2f [fix] ./manage: replace data.languages by data.traits 
Follow up of https://github.com/searxng/searxng/pull/2269

Related:

- https://github.com/searxng/searxng/issues/2314

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-05 07:44:29 +02:00
Markus Heiser 3ab85db5dd
Merge pull request #2313 from return42/limiter-route-healthz 
[fix] limiter: never block a /healthz request
 2023-04-03 19:42:26 +02:00
Markus Heiser 03f94962b6 [fix] limiter: never block a /healthz request 
Related: https://github.com/searxng/searxng/issues/2310#issuecomment-1494417531
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-03 19:36:28 +02:00
Markus Heiser 0c4003ab2d [fix] categories can't be removed from UI (categories_as_tabs) 
When using ``use_default_settings: true``, removing default categories from
settings.yml will not remove them from the UI.

The value ``categories_as_tabs`` is a dictionary type (a4c2cfb) and dictionary
types are merged additive by ``settings_loader.update_settings()``.

This patch replaces the default ``categories_as_tabs`` by the one from the
``user_settings``.

Related: https://github.com/searxng/searxng/issues/1019#issuecomment-1193145654
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-03 19:08:27 +02:00
Markus Heiser 464e69665c
Merge pull request #2309 from return42/fix-392 
[fix] engine ddg: quote !bangs in a request send to ddg
 2023-04-03 09:59:16 +02:00
Markus Heiser a762172bf7 [fix] engine ddg: quote !bangs in a request send to ddg 
Closes: https://github.com/searxng/searxng/issues/392
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-03 09:52:16 +02:00
Markus Heiser b8100e4e16
Merge pull request #2308 from return42/fix-1959-2 
[fix] engine google-News: fix decoding of URLs (part 2)
 2023-04-02 19:25:10 +02:00
Markus Heiser 0430662189 [fix] engine google-News: fix decoding of URLs (part 2) 
Follow up of 8de8070ed to fix the issue reported by AlyoshaVasilieva [1].

[1] https://github.com/searxng/searxng/issues/1959#issuecomment-1493300574

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-02 19:19:59 +02:00
Markus Heiser a5155a32c0
Merge pull request #2306 from return42/fix-1959 
[fix] engine google-News: fix decoding of URLs
 2023-04-02 08:02:37 +02:00
Paul Braeuning 24dba7634e
Merge pull request #2304 from return42/limiter-mod 
[mod] limiter: minor improvements
 2023-04-01 21:55:13 +02:00
Markus Heiser 66810ce711 [mod] limiter: minor improvements 
- requests without HTTP header 'Connection' or missing 'User-Agent' will be
  blocked by the limiter

- re_bot is related to 'User-Agent' and has been renamed to block_user_agent

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-01 19:42:49 +02:00
Markus Heiser 8de8070ed9 [fix] engine google-News: fix decoding of URLs 
Google-News returns internal links where the origin URL is encoded in a
base64 (RFC 2045 aka URL-safe) string.

Closes: https://github.com/searxng/searxng/issues/1959
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-01 19:33:13 +02:00
Markus Heiser 7592d85982
Merge pull request #2186 from return42/limiter-debug-log 
[mod] plugin limiter: improve the log messages
 2023-04-01 10:11:17 +02:00
Markus Heiser afd8fcce36 [mod] plugin limiter: improve the log messages 
In debug mode more detailed logging is needed to evaluate if an access should
have been blocked by the limiter.

BTW: remove duplicate code checking bot signature ``re_bot.match(user_agent)``

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-01 09:20:58 +02:00
Markus Heiser 901ccce664
Merge pull request #2303 from Venca24/devel_seznam 
[fix] engine seznam
 2023-03-31 17:33:09 +02:00
Markus Heiser 509afbbb84 [fix] engine seznam: fix issues reported by black & pylint 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-31 17:25:39 +02:00
Venca24 c8d78355ff [fix] engine seznam 2023-03-31 16:11:27 +02:00
Markus Heiser 27611470bf
Merge pull request #2300 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/sharp-0.32.0 
Bump sharp from 0.31.3 to 0.32.0 in /searx/static/themes/simple
 2023-03-31 14:48:25 +02:00
dependabot[bot] b99e028ed0
Bump sharp from 0.31.3 to 0.32.0 in /searx/static/themes/simple 
Bumps [sharp](https://github.com/lovell/sharp) from 0.31.3 to 0.32.0.
- [Release notes](https://github.com/lovell/sharp/releases)
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md)
- [Commits](https://github.com/lovell/sharp/compare/v0.31.3...v0.32.0)

---
updated-dependencies:
- dependency-name: sharp
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 11:39:17 +00:00
Markus Heiser 68703ba22e
Merge pull request #2282 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/ionicons-7.1.0 
Bump ionicons from 6.1.3 to 7.1.0 in /searx/static/themes/simple
 2023-03-31 13:36:12 +02:00
Markus Heiser 7e0e461aa1
Merge pull request #2298 from searxng/dependabot/pip/master/redis-4.5.4 
Bump redis from 4.5.1 to 4.5.4
 2023-03-31 13:25:25 +02:00
Markus Heiser f3b8e5734b
Merge pull request #2299 from searxng/dependabot/pip/master/selenium-4.8.3 
Bump selenium from 4.8.2 to 4.8.3
 2023-03-31 13:12:57 +02:00
dependabot[bot] 615c8ebcfd
Bump selenium from 4.8.2 to 4.8.3 
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.8.2 to 4.8.3.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](https://github.com/SeleniumHQ/Selenium/commits)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 07:56:56 +00:00
dependabot[bot] ec5739bec9
Bump redis from 4.5.1 to 4.5.4 
Bumps [redis](https://github.com/redis/redis-py) from 4.5.1 to 4.5.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.1...v4.5.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 07:56:50 +00:00
Markus Heiser a9680f0f75
Merge pull request #2297 from searxng/translations_update 
Update translations
 2023-03-31 09:24:58 +02:00
searxng-bot c1c24fc231 [translations] update from Weblate 
17ad1118 - 2023-03-29 - return42 <markus.heiser@darmarit.de>
61446791 - 2023-03-29 - return42 <markus.heiser@darmarit.de>
 2023-03-31 07:07:59 +00:00
Markus Heiser 0311d634ae
Merge pull request #2296 from return42/fix-1879 
[fix] engine flickr: adapt to the new data model from flicker's response
 2023-03-30 21:21:05 +02:00
Markus Heiser 270ad18897 [fix] engine flickr: adapt to the new data model from flicker's response 
Closes: https://github.com/searxng/searxng/issues/1879
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-30 21:04:53 +02:00
Markus Heiser 767f22eca1
Merge pull request #2293 from return42/fix-1454 
[fix] engine gigablast: add &userid=<User ID>&code=<Feed Code>
 2023-03-29 17:50:40 +02:00
Markus Heiser 2b8dfab33f [fix] engine gigablast: add &userid=<User ID>&code=<Feed Code> 
Gigablast's API does block unauthorized request[1].

[1] https://gigablast.com/searchfeed.html

Closes: https://github.com/searxng/searxng/issues/1454
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-29 16:18:02 +02:00
Markus Heiser d179b62cf5
Merge pull request #2288 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2023-03-29 13:48:32 +02:00
Markus Heiser 381c6751d6
Merge pull request #2289 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2023-03-29 13:48:03 +02:00
Markus Heiser fc51d9a0fe
Merge pull request #2291 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2023-03-29 13:46:40 +02:00
Markus Heiser 2fbe4ab0c0
Merge pull request #2292 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2023-03-29 13:46:14 +02:00
Markus Heiser f950119ca8
Merge pull request #2269 from return42/locale-revision 
Revision of the locale- and language- handling in SearXNG
 2023-03-29 09:47:21 +02:00
dalf 4c80340b62 Update searx.data - update_engine_descriptions.py 2023-03-29 00:28:45 +00:00
dalf b39ce7ff82 Update searx.data - update_currencies.py 2023-03-29 00:16:21 +00:00
dalf 814ac8cacb Update searx.data - update_ahmia_blacklist.py 2023-03-29 00:16:17 +00:00
dalf 43d30cab81 Update searx.data - update_firefox_version.py 2023-03-29 00:16:14 +00:00
Markus Heiser 6f9e678346 [fix] engine: google has changed the layout of its response 
Since 28. March google has changed its response, this patch fixes the google
engine to scrap out the results & images from the new designed response.

closes: https://github.com/searxng/searxng/issues/2287

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-28 14:39:16 +02:00
dalf 1498202b0b Update searx.data - update_engine_traits.py 2023-03-24 11:30:18 +01:00
dependabot[bot] 212de1a0f5 Bump babel from 2.11.0 to 2.12.1 
Bumps [babel](https://github.com/python-babel/babel) from 2.11.0 to 2.12.1.
- [Release notes](https://github.com/python-babel/babel/releases)
- [Changelog](https://github.com/python-babel/babel/blob/master/CHANGES.rst)
- [Commits](https://github.com/python-babel/babel/compare/v2.11.0...v2.12.1)

---
updated-dependencies:
- dependency-name: babel
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-24 11:26:15 +01:00
Markus Heiser 16f0db4493 [mod] replace utils.match_language by locales.match_locale 
This patch replaces the *full of magic* ``utils.match_language`` function by a
``locales.match_locale``.  The ``locales.match_locale`` function is based on the
``locales.build_engine_locales`` introduced in 9ae409a0 [1].

In the past SearXNG did only support a search by a language but not in a region.
This has been changed a long time ago and regions have been added to SearXNG
core but not to the engines.  The ``utils.match_language`` was the function to
handle the different aspects of language/regions in SearXNG core and the
supported *languages* in the engine.  The ``utils.match_language`` did it with
some magic and works good for most use cases but fails in some edge case.

To replace the concurrence of languages and regions in the SearXNG core the
``locales.build_engine_locales`` was introduced in 9ae409a0 [1].  With the last
patches all engines has been migrated to a ``fetch_traits`` and a
language/region concept that is based on ``locales.build_engine_locales``.

To summarize: there is no longer a need for the ``locales.match_language``.

[1] https://github.com/searxng/searxng/pull/1652

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser 4d4aa13e1f [mod] remove obsolete EngineTraits.supported_languages 
All engines has been migrated from ``supported_languages`` to the
``fetch_traits`` concept.  There is no longer a need for the obsolete code that
implements the ``supported_languages`` concept.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser 96a2eec3b5 [mod] Archlinux Wiki: improved request API & upgrade to data_type: traits_v1 
re-implementation of the Archlinux Wiki:

- fetch_traits(): fetch languages, wiki URLs and title arguments
- add content field to the result list
- add documentation

Wikis from wiki.archlinux.fr, wiki.archlinux.ro, archtr.org/wiki do no longer
exists (has been merged in the main wiki).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00