e6adb182c6
Merge 1c9b28968d into 10d3af84b8
2024-11-19 11:06:39 +01:00
10d3af84b8
[fix] engine: duckduckgo - don't quote query string
...
The query string send to DDG must not be qouted.
The query string was URL-qouted in #4011 , but the URL-qouted query string result
in unexpected *URL decoded* and other garbish results as reported in #4019
and #4020 . To test compare the results of a query like::
!ddg Häuser und Straßen :de
!ddg Häuser und Straßen :all
!ddg 房屋和街道 :all
!ddg 房屋和街道 :zh
Closed:
- [#4019 ] https://github.com/searxng/searxng/issues/4019
- [#4020 ] https://github.com/searxng/searxng/issues/4020
Related:
- [#4011 ] https://github.com/searxng/searxng/pull/4011
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-17 18:14:22 +01:00
a345cbbe51
[l10n] update translations from Weblate
...
0216898a33293db4c8574e0d683a32d9d158
2024-11-15 13:20:52 +01:00
abd9b271bc
[fix] engine: duckduckgo - only uses first word of the search terms
...
during the revision in PR #3955 the query string was accidentally converted into
a list of words, further the query must be quoted before POSTed in the ``data``
field, see ``urllib.parse.quote_plus`` [1]
[1] https://docs.python.org/3/library/urllib.parse.html#urllib.parse.quote_plus
Closed : #4009
Co-Authored-by: @return42
2024-11-14 09:33:54 +01:00
dfaf5868e2
[fix] settings.yml - enabled_plugins: document to reflect default settings
...
Remove 'Autodetect search language', which is no longer valid, from settings,
and add 'Unit converter plugin', which is now default enabled, to settings.
2024-11-10 16:09:41 +01:00
b173f3a8b9
Fix scheduler.lua
2024-11-10 15:53:58 +01:00
08c5f258d8
[l10n] update translations from Weblate
...
8d90a7e6d41ee8bb0dc1a30afab627ab7a8e
2024-11-08 08:45:07 +01:00
b07c0ae39f
[fix] annas archive: crash when no thumbnail, differing results, paging
2024-11-01 12:49:33 +01:00
cc148a76b0
[l10n] update translations from Weblate
...
a4cdaaa2646bad3a796a4096da964815d956851ae554d24f16d5e38278d1cb9
2024-11-01 08:30:38 +01:00
fa108c140f
[fix] google: display every result when keyword is contained in content field
2024-10-31 13:21:32 +01:00
fa4dfd4efe
[fix] favicons: msgspec.ValidationError: Expected `Path`, got `str` - at `$.favicons.cache.db_url`
...
Closes: https://github.com/searxng/searxng/issues/3975
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-29 18:22:22 +01:00
b183e620d8
[refactor] engine: duckduckgo - https://html.duckduckgo.com/html
...
The entire source code of the duckduckgo engine has been reengineered and
purified.
1. DDG used the URL https://html.duckduckgo.com/html for no-JS requests whose
response is also easier to parse than the previous
https://lite.duckduckgo.com/lite/ URL
2. the bot detection of DDG has so far caused problems and often led to a
CAPTCHA, this can be circumvented using `'Sec-Fetch-Mode'] = “navigate”`
Closes: https://github.com/searxng/searxng/issues/3927
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-29 14:56:27 +01:00
3e5621e1af
[refactor] replace pydantic by msgspec
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-29 13:50:38 +01:00
e392892578
[data] update searx.data - update_firefox_version.py
2024-10-29 09:30:40 +01:00
68ed8245da
[data] update searx.data - update_ahmia_blacklist.py
2024-10-29 09:29:58 +01:00
2d748d1d74
[data] update searx.data - update_currencies.py
2024-10-29 09:29:18 +01:00
2985ece0ca
[data] update searx.data - update_wikidata_units.py
2024-10-29 09:28:58 +01:00
adc38c5800
[data] update searx.data - update_engine_traits.py
2024-10-29 09:28:28 +01:00
a084436ff4
[data] update searx.data - update_engine_descriptions.py
2024-10-29 09:17:30 +01:00
b176323e89
[fix] calculator: use locale from UI (not from selected language)
...
Closes: https://github.com/searxng/searxng/issues/3956
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-28 15:53:57 +01:00
da28f5280b
[fix] limiter: don't hard code settings folder to /etc/searxng
...
The location of the local settings depends on environment ``SEARXNG_SETTINGS_PATH``
and can be different from ``/etc/searxng``. Issue was reported on Matrix [1].
To get the location function ``searx.settings_loader.get_user_cfg_folder()``
should be used.
[1] https://matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$_eLS0JpE9oVEWsiGJkqJnWcFWEeZClIMGDK6cWv_Q4g?via=matrix.org&via=tchncs.de&via=envs.net
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-28 12:51:05 +01:00
1c9b28968d
[mod] botdetection: HTTP Fetch Metadata Request Headers
...
HTTP Fetch Metadata Request Headers [1][2] are used to detect bot requests. Bots
with invalid *Fetch Metadata* will be redirected to the intro (`index`) page.
[1] https://www.w3.org/TR/fetch-metadata/
[2] https://developer.mozilla.org/en-US/docs/Glossary/Fetch_metadata_request_header
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-27 13:42:57 +01:00
e08ff05fff
[fix] add missing tomli to the requirements.txt
...
Package ``tomli`` is needed for py < 3.11, BTW remove the no longer needed
pytomlpp package.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-26 15:59:42 +02:00
ae496e9dd0
[build] /static
2024-10-26 08:34:21 +02:00
9b01e3c9d6
[mod] shrink new favicons in search results
2024-10-26 08:34:21 +02:00
446ee2dd25
[l10n] update translations from Weblate
...
21c063bf1
2024-10-26 07:29:54 +02:00
b14d885f23
[fix] favicons: don't hard code settings folder to /etc/searxng
...
The location of the local settings depends on environment ``SEARXNG_SETTINGS_PATH``
and can be different from ``/etc/searxng``. Issue was reported on Matrix [1].
To get the location function ``searx.settings_loader.get_user_cfg_folder()``
should be used.
[1] https://matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$5xNMYvONGB-mPt2B3ttoL27QncRFhkjGkO-TISdmP08?via=matrix.org&via=tchncs.de&via=envs.net
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-23 05:29:15 +02:00
050451347b
[fix] engine: duckduckgo - CAPTCHA detection
...
The previous implementation could not distinguish a CAPTCHA response from an
ordinary result list. In the previous implementation a CAPTCHA was taken as a
result list where no items are in.
DDG does not block IPs. Instead, a CAPTCHA wall is placed in front of request
on a dubious request.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-19 14:55:44 +02:00
eeae3664c2
[l10n] update translations from Weblate
...
17f8bce27fbeb82816eacea331b36156687e61cb3375d2b3c92d37d4febbf8a
2024-10-19 11:01:32 +02:00
cf7627557a
[build] /static
2024-10-16 19:46:36 +02:00
2cacc560d6
[fix] simple theme: unset width for images on mobile layout
...
* fix fallout from 2fbedc431614fb187548
2024-10-16 19:46:36 +02:00
058a072404
[build] /static
2024-10-15 15:54:58 +02:00
14fb187548
[fix] stretching pics in "pic search"
...
Issue is described in:
- https://github.com/searxng/searxng/issues/3915
The issue was caused bei merge of PR:
- https://github.com/searxng/searxng/pull/3895
Solution:
- Unset `width` for objects of class `.result-images`.
Tested by `make run` and query a list of results, containing `.result` and
`.result-images` objects:
!images !go bäder :de
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Closes: https://github.com/searxng/searxng/issues/3915
2024-10-15 15:54:58 +02:00
c96ba25f5b
[fix] online_currency.py: if more alternatives, use the last in the list
...
If there are more than one ISO 4217 numeric codes [1] for a currency use the
last one in the list of alternatives [2].
[1] https://en.wikipedia.org/wiki/ISO_4217#Active_codes_(list_one)
[2] https://en.wikipedia.org/wiki/ISO_4217#Historical_codes
Closes: https://github.com/searxng/searxng/issues/3713
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-15 15:20:39 +02:00
2986681b31
[upd] pypi: Bump pylint from 3.2.7 to 3.3.1
...
Bumps [pylint](https://github.com/pylint-dev/pylint ) from 3.2.7 to 3.3.1.
- [Release notes](https://github.com/pylint-dev/pylint/releases )
- [Commits](https://github.com/pylint-dev/pylint/compare/v3.2.7...v3.3.1 )
---
updated-dependencies:
- dependency-name: pylint
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-10-15 14:29:10 +02:00
9f48d5f84f
[feat] engine: support for openlibrary
2024-10-15 13:06:00 +02:00
3e87354f0e
[fix] float operations in calculator plugin
...
This patch adds an additional *isinstance* check within the ast parser to check
for float along with int, fixing the underlying issue.
Co-Authored: Markus Heiser <markus.heiser@darmarit.de>
2024-10-15 08:10:52 +02:00
e275f8e18e
[data] update searx.data - update_engine_traits.py
...
Patches generated by::
make data.traits
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-15 06:37:01 +02:00
8b6a3f3e11
[enh] engine: mojeek - add language support
...
Improve region and language detection / all locale
Testing has shown the following behaviour for the different
default and empty values of Mojeeks parameters:
| param | idx | value | behaviour |
| -------- | --- | ------ | ------------------------- |
| region | 0 | '' | detect region based on IP |
| region | 1 | 'none' | all regions |
| language | 0 | '' | all languages |
2024-10-15 06:37:01 +02:00
5b6f40414a
[mod] engine gitea: compatible with modern gitea or forgejo
...
Without this patch the Gitea Search Engine is only partially compatible with
modern gitea or forgejo:
- Fixing some JSON Fields
- Using Repository Avatar when Available
To Verify My results you can look at the Modern API doc and results, its
available on all Gitea and Forgejo instance by Default. Heres an Search API
result of Mine:
- https://git.euph.dev/api/v1/repos/search?q=ccna
2024-10-14 14:39:11 +02:00
7e8b330b3e
[build] /static
2024-10-12 11:08:44 +02:00
2fbedc4316
[fix] simple theme: fix deformed result item
...
Setting ``box-sizing: border-box;`` [1] and ``width`` to fix deformed results
reported in [2].
[1] https://developer.mozilla.org/en-US/docs/Web/CSS/box-sizing
[2] https://github.com/searxng/searxng/issues/3892
Closes : #3892
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-12 11:08:44 +02:00
5a32ee410b
[l10n] update translations from Weblate
...
83a8d6627c4474a60ba632dff03e8944e4862bd9c12295cb441b60aba724c8792bea9f03f574a3a3f4845ea7e27d0b4d0d96431436b230e671f306629d15cba3b4d53cc1763b224e0ea2b49a8837324445eec53d3b14cd76e531
2024-10-11 18:33:17 +02:00
f00fa76eda
[build] /static
2024-10-05 08:18:28 +02:00
a631f77401
[mod] favicons: simplify RTL in template & CSS
...
Comes from a sughgestion in:
- https://github.com/searxng/searxng/pull/3727#issuecomment-2388998803
Suggested-by: Bnyro <bnyro@tutanota.com>
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-05 08:18:28 +02:00
a7d02d4101
[doc] documentation of the favicons infrastructure
...
Run ``make docs.live`` and visit http://0.0.0.0:8000/admin/searx.favicons.html
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-05 08:18:28 +02:00
5ded9ada82
[mod] UI: add favicon's border- and background color to the definitons
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-05 08:18:28 +02:00
7ab577a1fb
[mod] Revision of the favicon solution
...
All favicons implementations have been documented and moved to the Python
package:
searx.favicons
There is a configuration (based on Pydantic) for the favicons and all its
components:
searx.favicons.config
A solution for caching favicons has been implemented:
searx.favicon.cache
If the favicon is already in the cache, the returned URL is a data URL [1]
(something like `data:image/png;base64,...`). By generating a data url from
the FaviconCache, additional HTTP roundtripps via the favicon_proxy are saved:
favicons.proxy.favicon_url
The favicon proxy service now sets a HTTP header "Cache-Control: max-age=...":
favicons.proxy.favicon_proxy
The resolvers now also provide the mime type (data, mime):
searx.favicon.resolvers
[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Basics_of_HTTP/Data_URLs
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-05 08:18:28 +02:00
c49a2707c1
[mod] sqlitedb: access to SQLite databases a little more convenient.
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-05 08:18:28 +02:00
e17d7632d0
[feat] add favicons to result urls
2024-10-05 08:18:28 +02:00
Markus Heiser
searxng-bot
Nicolas Dato
Leo Liu
Bnyro
uply23333
return42
JJ
mrpaulblack
dependabot[bot]
Grant Lanham
0xhtml
Snoweuph
Brock Vojkovic