a2c269bbac
[mod] presearch: hardening engine's response against KeyErrors
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
0a78f59aba
[fix] presearch: safesearch, time ranges, crash when no result found
2024-01-15 19:23:26 +01:00
87f18b98ec
[fix] SyntaxWarning: invalid escape sequence '\>'
...
This patch fixes issue reported by ``make test.unit``::
searx/search/checker/impl.py:39: SyntaxWarning: invalid escape sequence '\>'
rep = ['<' + tag + '[^\>]*>' for tag in HTML_TAGS]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 18:27:21 +01:00
b0b2efdc8d
[translations] update from Weblate
...
3dafa37f3a641db83fa3d2b083fb6dec1f75eb76d8b8d
2024-01-13 09:33:41 +01:00
f9c5727ddc
[mod] get rid of ./utils/brand.env and its workflow
...
All the environments defined in ./utils/brand.env are generated on the fly, so
there is no longer a need to define the brand environment in this file and all
the workflows to handle this file.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-09 16:31:19 +01:00
3dea7e609b
[feat] autocompleter: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
621e1313af
[feat] engine: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
c90dc201fc
[translations] update from Weblate
...
a04e3b59ca4d38784780521c1b3e909528152debd5992c4d54c3e51a0c9c025dc99d1390477e0114965dacdd306a20c8853
2024-01-06 16:20:13 +01:00
3535377c9a
Searx to SearXNG change error message
2023-12-31 16:19:14 +01:00
27e26b3d65
[translations] update from Weblate
...
966bbd849d4680cb39b2cf5fbaffa8654087fc759fe0bcf9b03bfd03bd7340088ffa01ec736c44d3fdd3a15279fd68404ee941e6023241dfd42d71ca048b0b
2023-12-29 08:48:24 +01:00
4647981419
Update searx.data - update_wikidata_units.py
2023-12-29 06:09:04 +01:00
a8cc101c35
Update searx.data - update_ahmia_blacklist.py
2023-12-29 06:08:35 +01:00
59a67f30c8
Update searx.data - update_firefox_version.py
2023-12-29 06:07:46 +01:00
81e8638de0
Update searx.data - update_currencies.py
2023-12-29 06:06:51 +01:00
d676ae8ab3
[build] /static
2023-12-28 19:15:04 +01:00
f6d797ef43
[fix] fix a display problem in the image detail preview.
2023-12-28 19:15:04 +01:00
0d47322ac8
[build] /static
2023-12-28 18:59:14 +01:00
07e846e91a
Prevent default browser behavior on click event
2023-12-28 18:59:14 +01:00
8dfc1dbc5c
[fix] engine - offical URL moved to https://lingva.thedaviddelta.com/
...
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com [1]
To test use translation syntax:
!lv en-de Alternative front-end for Google Translate
[1] https://fosstodon.org/@thedaviddelta/111376540936289966
Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-25 09:57:35 +01:00
2863b0f6da
Update searx.data - update_engine_traits.py
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
6df922b9da
[fix] fetch_traits of google and zlibrary
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
d6ac2b5a55
[feat] engine: implementation of bahnhof.de
2023-12-23 17:38:38 +01:00
6129b16165
[mod] simplify no results on pages > 1 to "There are no more results."
...
BTW: remove not needed whitespaces in the generated HTML
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-23 09:50:39 +01:00
2179a418c4
[mod] Change no results error message based on page number
2023-12-23 09:50:39 +01:00
b4de72a96f
[mod] Capitalize theme names/styles in theme.html view file
2023-12-23 09:07:08 +01:00
26737fda1b
Bump sharp from 0.32.6 to 0.33.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.32.6 to 0.33.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.32.6...v0.33.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-12-23 07:49:03 +01:00
3665b32aff
Revert "[fix] update user agent"
...
This reverts commit 3c6549a17fhttps://github.com/searxng/searxng/pull/2826
2023-12-23 07:48:38 +01:00
518dd97c89
[translations] update from Weblate
...
fc2dfc1083938cfbac7b7286fba1d066d218
2023-12-23 07:40:02 +01:00
8a4104b992
[feat] engine: implementation of rotten tomatoes
2023-12-11 18:59:36 +01:00
dda74fc9c9
[feat] engine: implementation of mdn
2023-12-11 18:57:40 +01:00
b5b81c9806
[feat] engine: implementation of fyyd
2023-12-11 18:56:32 +01:00
527e13ab46
[feat] engine: implementation of podcastindex.org
2023-12-11 18:55:16 +01:00
3bc85c511c
[mod] tootfinder: implement python module
2023-12-11 18:54:24 +01:00
0bcff32dd7
[fix] update check.searx.space IP addresses
2023-12-11 15:21:02 +01:00
574ed29d3e
[translations] update from Weblate
...
fa2970d07f19144327110f1b4dbc791e0c811f45cc83a5f93c2a390d735b7aa9cad06b0997554eaa22f4e19946d1dac8b5b5c57f6eb54e3908a204d2b58e4043a40da4d89f08502e
2023-12-08 08:42:24 +01:00
3829c253ff
[mod] add option max_page to bing, brave, qwant, startpage & mojeek
...
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780
Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
2274d55d5a
[mod] add option max_page
...
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
5a72977efa
Update searx.data - update_currencies.py
2023-11-29 06:34:25 +01:00
b18bef17a7
Update searx.data - update_engine_descriptions.py
2023-11-29 06:24:03 +01:00
a136b0b44d
Update searx.data - update_ahmia_blacklist.py
2023-11-29 06:18:21 +01:00
3ca84cb8d7
Update searx.data - update_wikidata_units.py
2023-11-29 06:17:32 +01:00
bf75a8c2a0
[feat] engine: implementation of bpb
2023-11-27 16:46:41 +01:00
04cfce2eb8
[feat] yep: support for images and news (and safesearch)
2023-11-27 15:07:26 +01:00
ee2675c999
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:43:43 +01:00
44392bd436
[mod] improve implementation of presearch engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:16:42 +01:00
23582aac5c
[feat] implementation of presearch engine
2023-11-27 14:16:42 +01:00
99fb565b39
[mod] Retain page numbers even when there are no results
2023-11-27 14:07:04 +01:00
c3cc24be12
[feat] engine: implementation of destatis
2023-11-27 13:54:48 +01:00
a36eae1d68
[translations] update from Weblate
...
d0511fe50e5d09a011111634b3329df37609bb415aca14b05dce9f2f730019b389a46a052620f6911716d7001d30f17f24cb7c4062e27ba200bc5
2023-11-27 07:32:05 +01:00
cc6058057d
[build] /static
2023-11-23 07:30:56 +01:00
355d2dc678
[fix] Remove anchor tag outline in image results
2023-11-23 07:30:56 +01:00
e99ebb3dec
[translations] update from Weblate
...
e245d1bd08ee33fca31c8c1557c925c63f4115908183bdd57115ef9db7544d823ce4d1f2902b8bafd2350f4a0510e6293fd477881443556b2f6113133818f8
2023-11-22 09:43:45 +01:00
3601badd84
[build] /static
2023-11-14 13:34:44 +01:00
903449e0b5
[fix] Images cannot be clicked anymore #3006
...
URL in sidedbar only exists in HTTP POST requests. On HTTP GET requests the
selector ``#search_url button#copy_url`` results in a ``null`` type and a
``.style.display`` raises::
Uncaught TypeError: d.querySelector(...) is null
As a result, the initialization of the event handler is no longer carried out.
Closes: https://github.com/searxng/searxng/issues/3003
Suggested-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-14 13:28:50 +01:00
79db70f2b7
[translations] update from Weblate
...
2b7f195db411951c72878199f48512f9981aadcaeb0c6acc01d46d32f1dd13caafe161aac910601c9
2023-11-12 20:54:35 +01:00
727de1c4ef
[build] /static
2023-11-10 13:28:28 +00:00
8adc7b0433
add a "copy" button to the "search-url" sidebar
2023-11-10 13:28:04 +00:00
96ccec1aa6
[translations] update from Weblate
...
acdcdace831a1602a9a1d1070d3
2023-11-03 10:01:28 +01:00
b5a8ddfec8
Revert "[fix] limit maximum page number of a search query to page 50." ( #2979 )
...
This reverts commit 7e2e335dd1
2023-11-01 16:55:20 +00:00
d13a8f6453
[mod] document server:public_instance & remove it out of the botdetection
...
- the option server:public_instance lacks some documentation
- the processing of this option belongs in the limiter and not
in botdetection module
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
fd814aac86
[mod] isolation of botdetection from the limiter
...
This patch was inspired by the discussion around PR-2882 [2]. The goals of this
patch are:
1. Convert plugin searx.plugin.limiter to normal code [1]
2. isolation of botdetection from the limiter [2]
3. searx/{tools => botdetection}/config.py and drop searx.tools
4. in URL /config, 'limiter.enabled' is true only if the limiter is really
enabled (Redis is available).
This patch moves all the code that belongs to botdetection into namespace
searx.botdetection and code that belongs to limiter is placed in namespace
searx.limiter.
Tthe limiter used to be a plugin at some point botdetection was added, it was
not a plugin. The modularization of these two components was long overdue.
With the clear modularization, the documentation could then also be organized
according to the architecture.
[1] https://github.com/searxng/searxng/pull/2882
[2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891
To test:
- check the app works without the limiter, check `/config`
- check the app works with the limiter and with the token, check `/config`
- make docs.live .. and read
- http://0.0.0.0:8000/admin/searx.limiter.html
- http://0.0.0.0:8000/src/searx.botdetection.html#botdetection
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
b05a15540e
Check `public_instance` in simple theme
...
Fix #2975
2023-10-31 10:40:19 +01:00
7e2e335dd1
[fix] limit maximum page number of a search query to page 50.
...
To test this PR run a local instance and try to query page 51:
http://127.0.0.1:8888/search?q=foo&pageno=51
A parameter exception will be raised:
searx.exceptions.SearxParameterException: Invalid value "51" for parameter pageno
And the client will receive a HTTP 400 (Bad request).
Closes https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-29 16:17:25 +01:00
b63841f0a1
Update searx.data - update_engine_traits.py
2023-10-29 09:04:24 +01:00
a9d778ee0f
Update searx.data - update_wikidata_units.py
2023-10-29 08:45:15 +01:00
92efb941d8
Update searx.data - update_firefox_version.py
2023-10-29 08:44:59 +01:00
fa494b9be3
Update searx.data - update_currencies.py
2023-10-29 08:44:35 +01:00
1b92ea4e70
Update searx.data - update_engine_descriptions.py
2023-10-29 08:44:17 +01:00
55e7cb3e33
Update searx.data - update_ahmia_blacklist.py
2023-10-29 08:17:29 +01:00
6af8644ead
[translations] update from Weblate
...
4e5e5db44e1a8d350884bddfb89d67a4114d62fe8e3286e37ab9752cdab3247cf7ea72340ea31389322151e440e4eaf42b6
2023-10-27 09:23:23 +02:00
ef56e1d684
[fix] HTMLParser: undocumented not implemented method
...
In python versions <py3.10 there is an issue with an undocumented method
HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed
in Python 3.5.
To be compatible to higher versions (>=py3.10) an error method is implemented
which throws an AssertionError exception like the higher Python versions do [3].
[1] https://github.com/python/cpython/issues/76025
[2] https://bugs.python.org/issue31844
[3] https://github.com/python/cpython/pull/8562
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-22 10:35:02 +02:00
01b5b9cb8e
[translations] update from Weblate
...
2325f15835090c6a8e3a38219d894a9f4164bdbeb4b30f9b483f487f1ca1997c5a701dc4
2023-10-20 10:44:11 +02:00
b013cbb4cc
[build] /static
2023-10-13 12:56:29 +02:00
df2e41c150
[fix] search.js: crash on homepage when setting form listeners
2023-10-13 12:56:29 +02:00
4280318fc5
fixing results parsing brave
2023-10-13 11:47:30 +02:00
ac82daf58d
[translations] update from Weblate
...
74e401e68897dd8db16ed046a90815ecb33665d9a0c2f3ec249ef953dc6c108
2023-10-13 09:20:54 +02:00
efada7cba2
[fix] hackernews keyerror problem
2023-10-13 08:16:47 +02:00
af071121de
[fix] imgur - incorrect wikidata id
2023-10-12 09:14:00 +02:00
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-12 08:52:28 +02:00
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
2023-10-10 09:12:30 +02:00
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10 08:40:53 +02:00
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
2023-10-09 20:50:24 +02:00
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04Closes : #2898
2023-10-09 18:13:00 +02:00
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
2023-10-09 14:00:04 +02:00
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
2023-10-09 13:25:13 +02:00
48cb58bd2e
[feat] duckduckgo: support for videos and news
2023-10-09 06:53:43 +02:00
c3ab49cd90
[fix] kickass: crash when no results
2023-10-07 11:48:23 +02:00
f22daf8b47
[mod] piped: always show video length if available
2023-10-07 11:45:46 +02:00
ce270961e8
[feat] engine: implementation of mastodon
2023-10-06 10:58:23 +02:00
48f8ac48d1
[translations] update from Weblate
...
68d74328142f091b7f2479c0d7ba4e6cd5929d4e5f5c3b79d44775746291184f24d7e8b16140911f9
2023-10-06 09:19:00 +02:00
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-05 10:55:08 +02:00
3e2ae756f0
[feat] engine: implementation of radio-browser.info
2023-10-05 10:55:08 +02:00
d56b31d674
[fix] limiter / botdetection: remove http_connection method
...
Related:
- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 20:24:22 +02:00
e509cb7c45
[typo] solved a typo in yahoo error message.
2023-10-01 08:29:06 +02:00
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
2023-10-01 08:29:06 +02:00
fe9386b58d
[fix] emojipedia: fix engine
2023-10-01 08:19:45 +02:00
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 08:01:38 +02:00
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
2023-10-01 08:01:38 +02:00
5ce1792432
[feat] engine: implementation of pinterest
2023-09-30 15:01:45 +02:00
6096457e4d
[fix] matrixrooms.info: pagination not working properly
2023-09-30 14:51:07 +02:00
Markus Heiser
Bnyro
searxng-bot
Émilien (perso)
dalf
Jinyuan Huang
ahmad-alkadri
obfuscated-loop
Jay
dependabot[bot]
Brock Vojkovic
sev
Hackurei
Alex Balgavy
Hackurei
Aine
jazzzooo