8fed5798ab
Checker: tests for bahnhof
2024-03-03 20:00:46 +01:00
b1431e1670
[feat] engine: implementation of cppreference
2024-03-03 17:07:29 +01:00
1a66bfa66c
checker: display results at the end
2024-03-03 11:18:43 +01:00
38fdd2288a
Drop typing-extensions dependency ( #3265 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-02 13:10:31 +01:00
1892a87fd2
[translations] update from Weblate
...
663d8815bf97823239480a0ec8d90521198110e90be9a3b803ba238bbaaa43e6950cdb97807c9891de16ca50cd85241d9ce
2024-03-02 09:37:52 +01:00
f3b4bf86a7
[feat] engine: implementation of void linux packages
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-29 13:12:40 +01:00
d58760ef75
[mod] pypi engine: use packages.html
2024-02-29 07:48:44 +01:00
35873b5a1c
Update searx.data - update_ahmia_blacklist.py
2024-02-29 07:47:54 +01:00
df74b5b59b
Update searx.data - update_firefox_version.py
2024-02-29 07:47:01 +01:00
473b2dd42f
Update searx.data - update_wikidata_units.py
2024-02-29 07:46:27 +01:00
9a474715e8
Update searx.data - update_engine_descriptions.py
2024-02-29 07:46:02 +01:00
c0b97c6543
[fix] re-add opensearch_url / its used in based.html
...
The URL was accidentally deleted in a85907a98
2024-02-25 18:26:16 +01:00
e8bd6c03bf
Update settings.yml
...
Changed value of "extra_proxy_timeout" from 10.0 to 10 as the variable expects an int.
Uncommenting this value with a non-int value will throw many errors and crash all engines.
2024-02-25 16:35:13 +01:00
9330a072eb
[feat] engine: implementation of pixiv
2024-02-25 16:29:57 +01:00
cf57914359
[build] /static
2024-02-25 16:22:37 +01:00
db1f9b31c9
[feat] images: show resolution inside the image and fix image details overflow
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 16:22:37 +01:00
e76ab1a4b3
[refactor] images: add resolution, image format and filesize fields
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 16:22:37 +01:00
b683aa63fb
[feat] github: use packages template
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 14:56:57 +01:00
1d6f475fbc
[feat] dockerhub: use packages template
2024-02-25 14:56:57 +01:00
34fa2b7cca
[build] /static
2024-02-25 14:56:57 +01:00
938391b050
[feat] templates: add package result template
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 14:56:57 +01:00
a85907a98f
[fix] opensearxh.xml: firefox v123 does not except self-URI (URL with param)
...
Before this patch we had a address in the rel-self-template with params [1]:
GET::
<Url method="GET"
rel="self"
template="/opensearch.xml?method=GET&autocomplete=google"
type="application/opensearchdescription+xml"/>
POST::
<Url method="POST"
rel="self"
template="/opensearch.xml?method=POST&autocomplete=google"
type="application/opensearchdescription+xml"/>
The first one (GET) is no longer accepted by firefox since v123, the latter one
was always been wrong (since it mixes GET params with a POST request).
Since Firefox v123 a template syntax [2] in the rel-self-template is no longer
supported / Firefox will report an error::
Firefox could not download the search plugin from:
http://127.0.0.1:8888//opensearch.xml?method=GET&autocomplete=google
This patch reduce the URL to::
template="http://127.0.0.1:8888/opensearch.xml "
[1] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#url-rel-values
[2] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#opensearch-url-template-syntax
Closes: https://github.com/searxng/searxng/issues/3227
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 07:33:04 +01:00
671333081c
[translations] update from Weblate
...
946267db3
2024-02-23 08:14:58 +01:00
cfbe59b6b3
[feat] engine: implementation of mozhi
2024-02-23 07:50:48 +01:00
3c42252c78
[feat] engine: implementation of yandex music
...
Access to music is limited to a few countries:
- https://yandex.com/support/music/access.html
2024-02-21 17:17:12 +01:00
fde21c8f99
[feat] engine: Add LiveSpace livestreams
2024-02-20 14:45:07 +01:00
3b80f9fe03
[translations] update from Weblate
...
df7653397c62c03816a48235060445545961275a77e510772d9b4c
2024-02-20 12:33:32 +01:00
894f164869
[fix] sort RTL_LOCALES before written into locales.json
...
To avoid unnecessary changes to the file, the list should be sorted before it is
written to the file.
You can test it by calling multiple times::
make data.locales
and searx/data/locales.json should be unchanged.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-20 12:29:13 +01:00
ed66ed758d
[mod] reduce memory footprint by not calling babel.Locale.parse at runtime
...
babel.Locale.parse loads more than 60MB in RAM. The only purpose is to get:
LOCALE_NAMES - searx.data.LOCALES["LOCALE_NAMES"]
RTL_LOCALES - searx.data.LOCALES["RTL_LOCALES"]
This commit calls babel.Locale.parse when the translations are update from
weblate and stored in::
searx/data/locales.json
This file can be build by::
./manage data.locales
By store these variables in searx.data when the translations are updated we save
round about 65MB (usually 4 worker = 260MB of RAM saved.
Suggested-by: https://github.com/searxng/searxng/discussions/2633#discussioncomment-8490494
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-20 10:43:20 +01:00
76845ea42c
[mod] engine ask.com - parse JS result to JSON
...
Parse the result list from ask.com given in the variable named
window.MESON.initialState::
<script nonce="..">
window.MESON = window.MESON || {};
window.MESON.initialState = {"siteConfig": ...
...}};
window.MESON.loadedLang = "en";
</script>
The result list is in field::
json_resp['search']['webResults']['results']
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-18 09:17:22 +01:00
3df53d6e50
[feat] engine: implementation of ask.com
2024-02-18 09:17:22 +01:00
2aef3a556f
[translations] update from Weblate
...
be989636e0e3455cb8edc279680e0d3b7f9ff68fc5440980f3846c711618f3a1d12e762fab319100b9854a5a4aebfb23f13
2024-02-16 15:48:10 +01:00
11c0651ef4
[fix] lingva: redirect and parsing error
2024-02-11 11:28:47 +01:00
bffc4905ce
Update searx.data - update_currencies.py
2024-02-10 23:55:41 +01:00
bfcd41f04a
[clean] drop obsolete py3.7 compatibility
...
- https://github.com/searxng/searxng/discussions/2356
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 09:27:19 +01:00
b0fe0924a3
[feat] engine: implementation of brave goggles
2024-02-10 08:09:50 +01:00
53898b8c37
[mod] footer: i18n for the link names in the footer
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 08:03:43 +01:00
7e1b5f6cc8
[feat] footer: support for custom entries
2024-02-10 08:03:43 +01:00
459389a2da
[translations] update from Weblate
...
2b940307ee7cdce39e171fae67dd6a7604668cc4c51a92e76559ba
2024-02-09 08:15:45 +01:00
df1a774003
[fix] KeyError: 'title' in results using key-value.html template
...
Since #2508 a title is required --> this is a bug when an engine uses the
key-value.html template [1], where no title is needed.
[1] https://github.com/searxng/searxng/blob/master/searx/templates/simple/result_templates/key-value.html
Closes: https://github.com/searxng/searxng/issues/3130
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-06 07:53:39 +01:00
11f918296f
[translations] update from Weblate
...
a001549469f220b2aa71951ae12a2f344a700f2944179f0d42961fa5cc1c6d5c5a39252dfa01c975851a86de3d4a55d6d8d3bb8adf1f1b2e23dcb7589d6bbcc04d8739c
2024-02-02 08:18:01 +01:00
be0d756ad5
[fix] libgen.fun is down, switch to libgen.rs
...
Closes: https://github.com/searxng/searxng/issues/3178
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-01 20:32:10 +01:00
6d31ca28b5
[fix] remove missing link icon macro
2024-02-01 08:13:43 +01:00
100a150a33
Remove rtl exception
...
This right-to-left exception doesn't seem to be called for.
2024-01-31 20:03:10 +01:00
f9f0c2ec03
Fix media exposure toggle
...
Make initially hidden and the toggle button consistent.
2024-01-31 20:03:10 +01:00
fa7fef7d87
Provide template for results in file category
...
This is used, for instance, by the recoll engine.
2024-01-31 20:03:10 +01:00
ab8e5383fb
[mod] remove X-XSS-Protection headers
...
Deprecated header not used by browsers nowadays[1]:
"""In modern browsers, X-XSS-Protection has been deprecated in favor of the
Content-Security-Policy to disable the use of inline JavaScript. Its use can
introduce XSS vulnerabilities in otherwise safe websites. This should not be
used unless you need to support older web browsers that don’t yet support CSP.
It is thus recommended to set the header as X-XSS-Protection: 0."""[2]
[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/X-XSS-Protection
[2] https://infosec.mozilla.org/guidelines/web_security#x-xss-protection
Closes: https://github.com/searxng/searxng/issues/3171
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 17:23:41 +01:00
dca78f920f
[build] /static
2024-01-31 17:22:03 +01:00
c85f706601
[fix] wrong engines padding
2024-01-31 17:22:03 +01:00
30dcaf1db6
[fix] equalize cached/proxied links left margin
2024-01-31 17:22:03 +01:00
1e03094dee
[fix] justify engines/cached/proxied vertically
2024-01-31 17:22:03 +01:00
c14b117121
[fix] brave.search - update result selectors to fit to new layout
...
Closes: https://github.com/searxng/searxng/issues/3167
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 16:21:56 +01:00
efbee96b1d
[feat] brave: fix empty content and parse published dates
2024-01-30 07:41:45 +01:00
90072eb6ff
[build] /static
2024-01-29 18:09:22 +01:00
a5decfb838
[feat] preferences: button to copy input to restore preferences hash
2024-01-29 18:09:22 +01:00
559b860618
[feat] engine: implementation of goodreads
2024-01-29 16:07:24 +01:00
a962aab9b0
[translations] update from Weblate
...
c1a3532a2603c6894b2920c734264cc1168a21ec41823
2024-01-29 15:01:37 +01:00
62fa85287a
Update searx.data - update_wikidata_units.py
2024-01-29 14:04:24 +01:00
0ed7548d83
Update searx.data - update_firefox_version.py
2024-01-29 14:04:03 +01:00
d763934a7a
Update searx.data - update_ahmia_blacklist.py
2024-01-29 14:03:03 +01:00
14f73ef3d9
Update searx.data - update_engine_traits.py
2024-01-29 14:02:30 +01:00
a393341403
Update searx.data - update_engine_descriptions.py
2024-01-29 13:34:12 +01:00
e4cf0a7d4f
[fix] do highlight replacement at once
...
Highlights all search queries in search result in one go.
Fixes the case where search query contains word from highlight HTML code,
which causes broken HTML to appear in search results.
Closes #3057
2024-01-29 13:15:37 +01:00
8c73aa772b
[fix] semantic scholar: bad request
2024-01-25 06:12:08 +01:00
ab5d2f32bb
[translations] update from Weblate
...
0f8246b81ce23e8ce91112731cb
2024-01-19 08:29:29 +01:00
7c80807bb8
Block HeadlessChrome ( #3116 )
2024-01-17 09:14:36 +01:00
9c5f9735cf
[fix] engine: safesearch parameter in Google Videos engine ( #2762 )
...
Closes: https://github.com/searxng/searxng/issues/2762
2024-01-16 15:29:09 +01:00
8762863ebf
[mod] presearch: set WEB timeout to 4sec & single network for all request
...
timeout: 4.0
The timeout of presearch-WEB is left up from the default of 3sec to 4sec. The
engine has to send two HTTP requests, they often exceed the default timeout of
3sec. Since all other presearch categories (images, videos, news) also have a
timeout of 4 sec, the WEB search should also have the same timeout.
network: presearch
Place all HTTP requests in the same network, named ``presearch``.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
e560d7e373
[mod] presearch: add language & region support
...
In Presearch there are languages for the UI and regions for narrowing down the
search. With this change the SearXNG engine supports a search by region. The
details can be found in the documentation of the source code.
To test, you can search terms like::
!presearch bmw :zh-TW
!presearch bmw :en-CA
1. You should get results corresponding to the region (Taiwan, Canada)
2. and in the language (Chinese, Englisch).
3. The context in info box content is in the same language.
Exceptions:
1. Region or language is not supported by Presearch or
2. SearXNG user did not selected a region tag, example::
!presearch bmw :en
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
a2c269bbac
[mod] presearch: hardening engine's response against KeyErrors
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
0a78f59aba
[fix] presearch: safesearch, time ranges, crash when no result found
2024-01-15 19:23:26 +01:00
87f18b98ec
[fix] SyntaxWarning: invalid escape sequence '\>'
...
This patch fixes issue reported by ``make test.unit``::
searx/search/checker/impl.py:39: SyntaxWarning: invalid escape sequence '\>'
rep = ['<' + tag + '[^\>]*>' for tag in HTML_TAGS]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 18:27:21 +01:00
b0b2efdc8d
[translations] update from Weblate
...
3dafa37f3a641db83fa3d2b083fb6dec1f75eb76d8b8d
2024-01-13 09:33:41 +01:00
f9c5727ddc
[mod] get rid of ./utils/brand.env and its workflow
...
All the environments defined in ./utils/brand.env are generated on the fly, so
there is no longer a need to define the brand environment in this file and all
the workflows to handle this file.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-09 16:31:19 +01:00
3dea7e609b
[feat] autocompleter: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
621e1313af
[feat] engine: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
c90dc201fc
[translations] update from Weblate
...
a04e3b59ca4d38784780521c1b3e909528152debd5992c4d54c3e51a0c9c025dc99d1390477e0114965dacdd306a20c8853
2024-01-06 16:20:13 +01:00
3535377c9a
Searx to SearXNG change error message
2023-12-31 16:19:14 +01:00
27e26b3d65
[translations] update from Weblate
...
966bbd849d4680cb39b2cf5fbaffa8654087fc759fe0bcf9b03bfd03bd7340088ffa01ec736c44d3fdd3a15279fd68404ee941e6023241dfd42d71ca048b0b
2023-12-29 08:48:24 +01:00
4647981419
Update searx.data - update_wikidata_units.py
2023-12-29 06:09:04 +01:00
a8cc101c35
Update searx.data - update_ahmia_blacklist.py
2023-12-29 06:08:35 +01:00
59a67f30c8
Update searx.data - update_firefox_version.py
2023-12-29 06:07:46 +01:00
81e8638de0
Update searx.data - update_currencies.py
2023-12-29 06:06:51 +01:00
d676ae8ab3
[build] /static
2023-12-28 19:15:04 +01:00
f6d797ef43
[fix] fix a display problem in the image detail preview.
2023-12-28 19:15:04 +01:00
0d47322ac8
[build] /static
2023-12-28 18:59:14 +01:00
07e846e91a
Prevent default browser behavior on click event
2023-12-28 18:59:14 +01:00
8dfc1dbc5c
[fix] engine - offical URL moved to https://lingva.thedaviddelta.com/
...
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com [1]
To test use translation syntax:
!lv en-de Alternative front-end for Google Translate
[1] https://fosstodon.org/@thedaviddelta/111376540936289966
Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-25 09:57:35 +01:00
2863b0f6da
Update searx.data - update_engine_traits.py
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
6df922b9da
[fix] fetch_traits of google and zlibrary
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
d6ac2b5a55
[feat] engine: implementation of bahnhof.de
2023-12-23 17:38:38 +01:00
6129b16165
[mod] simplify no results on pages > 1 to "There are no more results."
...
BTW: remove not needed whitespaces in the generated HTML
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-23 09:50:39 +01:00
2179a418c4
[mod] Change no results error message based on page number
2023-12-23 09:50:39 +01:00
b4de72a96f
[mod] Capitalize theme names/styles in theme.html view file
2023-12-23 09:07:08 +01:00
26737fda1b
Bump sharp from 0.32.6 to 0.33.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.32.6 to 0.33.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.32.6...v0.33.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-12-23 07:49:03 +01:00
3665b32aff
Revert "[fix] update user agent"
...
This reverts commit 3c6549a17fhttps://github.com/searxng/searxng/pull/2826
2023-12-23 07:48:38 +01:00
518dd97c89
[translations] update from Weblate
...
fc2dfc1083938cfbac7b7286fba1d066d218
2023-12-23 07:40:02 +01:00
8a4104b992
[feat] engine: implementation of rotten tomatoes
2023-12-11 18:59:36 +01:00
dda74fc9c9
[feat] engine: implementation of mdn
2023-12-11 18:57:40 +01:00
b5b81c9806
[feat] engine: implementation of fyyd
2023-12-11 18:56:32 +01:00
527e13ab46
[feat] engine: implementation of podcastindex.org
2023-12-11 18:55:16 +01:00
3bc85c511c
[mod] tootfinder: implement python module
2023-12-11 18:54:24 +01:00
0bcff32dd7
[fix] update check.searx.space IP addresses
2023-12-11 15:21:02 +01:00
574ed29d3e
[translations] update from Weblate
...
fa2970d07f19144327110f1b4dbc791e0c811f45cc83a5f93c2a390d735b7aa9cad06b0997554eaa22f4e19946d1dac8b5b5c57f6eb54e3908a204d2b58e4043a40da4d89f08502e
2023-12-08 08:42:24 +01:00
3829c253ff
[mod] add option max_page to bing, brave, qwant, startpage & mojeek
...
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780
Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
2274d55d5a
[mod] add option max_page
...
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
5a72977efa
Update searx.data - update_currencies.py
2023-11-29 06:34:25 +01:00
b18bef17a7
Update searx.data - update_engine_descriptions.py
2023-11-29 06:24:03 +01:00
a136b0b44d
Update searx.data - update_ahmia_blacklist.py
2023-11-29 06:18:21 +01:00
3ca84cb8d7
Update searx.data - update_wikidata_units.py
2023-11-29 06:17:32 +01:00
bf75a8c2a0
[feat] engine: implementation of bpb
2023-11-27 16:46:41 +01:00
04cfce2eb8
[feat] yep: support for images and news (and safesearch)
2023-11-27 15:07:26 +01:00
ee2675c999
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:43:43 +01:00
44392bd436
[mod] improve implementation of presearch engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:16:42 +01:00
23582aac5c
[feat] implementation of presearch engine
2023-11-27 14:16:42 +01:00
99fb565b39
[mod] Retain page numbers even when there are no results
2023-11-27 14:07:04 +01:00
c3cc24be12
[feat] engine: implementation of destatis
2023-11-27 13:54:48 +01:00
a36eae1d68
[translations] update from Weblate
...
d0511fe50e5d09a011111634b3329df37609bb415aca14b05dce9f2f730019b389a46a052620f6911716d7001d30f17f24cb7c4062e27ba200bc5
2023-11-27 07:32:05 +01:00
cc6058057d
[build] /static
2023-11-23 07:30:56 +01:00
355d2dc678
[fix] Remove anchor tag outline in image results
2023-11-23 07:30:56 +01:00
e99ebb3dec
[translations] update from Weblate
...
e245d1bd08ee33fca31c8c1557c925c63f4115908183bdd57115ef9db7544d823ce4d1f2902b8bafd2350f4a0510e6293fd477881443556b2f6113133818f8
2023-11-22 09:43:45 +01:00
3601badd84
[build] /static
2023-11-14 13:34:44 +01:00
903449e0b5
[fix] Images cannot be clicked anymore #3006
...
URL in sidedbar only exists in HTTP POST requests. On HTTP GET requests the
selector ``#search_url button#copy_url`` results in a ``null`` type and a
``.style.display`` raises::
Uncaught TypeError: d.querySelector(...) is null
As a result, the initialization of the event handler is no longer carried out.
Closes: https://github.com/searxng/searxng/issues/3003
Suggested-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-14 13:28:50 +01:00
79db70f2b7
[translations] update from Weblate
...
2b7f195db411951c72878199f48512f9981aadcaeb0c6acc01d46d32f1dd13caafe161aac910601c9
2023-11-12 20:54:35 +01:00
727de1c4ef
[build] /static
2023-11-10 13:28:28 +00:00
8adc7b0433
add a "copy" button to the "search-url" sidebar
2023-11-10 13:28:04 +00:00
96ccec1aa6
[translations] update from Weblate
...
acdcdace831a1602a9a1d1070d3
2023-11-03 10:01:28 +01:00
b5a8ddfec8
Revert "[fix] limit maximum page number of a search query to page 50." ( #2979 )
...
This reverts commit 7e2e335dd1
2023-11-01 16:55:20 +00:00
d13a8f6453
[mod] document server:public_instance & remove it out of the botdetection
...
- the option server:public_instance lacks some documentation
- the processing of this option belongs in the limiter and not
in botdetection module
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
fd814aac86
[mod] isolation of botdetection from the limiter
...
This patch was inspired by the discussion around PR-2882 [2]. The goals of this
patch are:
1. Convert plugin searx.plugin.limiter to normal code [1]
2. isolation of botdetection from the limiter [2]
3. searx/{tools => botdetection}/config.py and drop searx.tools
4. in URL /config, 'limiter.enabled' is true only if the limiter is really
enabled (Redis is available).
This patch moves all the code that belongs to botdetection into namespace
searx.botdetection and code that belongs to limiter is placed in namespace
searx.limiter.
Tthe limiter used to be a plugin at some point botdetection was added, it was
not a plugin. The modularization of these two components was long overdue.
With the clear modularization, the documentation could then also be organized
according to the architecture.
[1] https://github.com/searxng/searxng/pull/2882
[2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891
To test:
- check the app works without the limiter, check `/config`
- check the app works with the limiter and with the token, check `/config`
- make docs.live .. and read
- http://0.0.0.0:8000/admin/searx.limiter.html
- http://0.0.0.0:8000/src/searx.botdetection.html#botdetection
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
b05a15540e
Check `public_instance` in simple theme
...
Fix #2975
2023-10-31 10:40:19 +01:00
7e2e335dd1
[fix] limit maximum page number of a search query to page 50.
...
To test this PR run a local instance and try to query page 51:
http://127.0.0.1:8888/search?q=foo&pageno=51
A parameter exception will be raised:
searx.exceptions.SearxParameterException: Invalid value "51" for parameter pageno
And the client will receive a HTTP 400 (Bad request).
Closes https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-29 16:17:25 +01:00
b63841f0a1
Update searx.data - update_engine_traits.py
2023-10-29 09:04:24 +01:00
a9d778ee0f
Update searx.data - update_wikidata_units.py
2023-10-29 08:45:15 +01:00
92efb941d8
Update searx.data - update_firefox_version.py
2023-10-29 08:44:59 +01:00
fa494b9be3
Update searx.data - update_currencies.py
2023-10-29 08:44:35 +01:00
1b92ea4e70
Update searx.data - update_engine_descriptions.py
2023-10-29 08:44:17 +01:00
55e7cb3e33
Update searx.data - update_ahmia_blacklist.py
2023-10-29 08:17:29 +01:00
6af8644ead
[translations] update from Weblate
...
4e5e5db44e1a8d350884bddfb89d67a4114d62fe8e3286e37ab9752cdab3247cf7ea72340ea31389322151e440e4eaf42b6
2023-10-27 09:23:23 +02:00
ef56e1d684
[fix] HTMLParser: undocumented not implemented method
...
In python versions <py3.10 there is an issue with an undocumented method
HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed
in Python 3.5.
To be compatible to higher versions (>=py3.10) an error method is implemented
which throws an AssertionError exception like the higher Python versions do [3].
[1] https://github.com/python/cpython/issues/76025
[2] https://bugs.python.org/issue31844
[3] https://github.com/python/cpython/pull/8562
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-22 10:35:02 +02:00
01b5b9cb8e
[translations] update from Weblate
...
2325f15835090c6a8e3a38219d894a9f4164bdbeb4b30f9b483f487f1ca1997c5a701dc4
2023-10-20 10:44:11 +02:00
b013cbb4cc
[build] /static
2023-10-13 12:56:29 +02:00
df2e41c150
[fix] search.js: crash on homepage when setting form listeners
2023-10-13 12:56:29 +02:00
4280318fc5
fixing results parsing brave
2023-10-13 11:47:30 +02:00
ac82daf58d
[translations] update from Weblate
...
74e401e68897dd8db16ed046a90815ecb33665d9a0c2f3ec249ef953dc6c108
2023-10-13 09:20:54 +02:00
efada7cba2
[fix] hackernews keyerror problem
2023-10-13 08:16:47 +02:00
af071121de
[fix] imgur - incorrect wikidata id
2023-10-12 09:14:00 +02:00
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-12 08:52:28 +02:00
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
2023-10-10 09:12:30 +02:00
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10 08:40:53 +02:00
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
2023-10-09 20:50:24 +02:00
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04Closes : #2898
2023-10-09 18:13:00 +02:00
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
2023-10-09 14:00:04 +02:00
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
2023-10-09 13:25:13 +02:00
48cb58bd2e
[feat] duckduckgo: support for videos and news
2023-10-09 06:53:43 +02:00
c3ab49cd90
[fix] kickass: crash when no results
2023-10-07 11:48:23 +02:00
f22daf8b47
[mod] piped: always show video length if available
2023-10-07 11:45:46 +02:00
ce270961e8
[feat] engine: implementation of mastodon
2023-10-06 10:58:23 +02:00
48f8ac48d1
[translations] update from Weblate
...
68d74328142f091b7f2479c0d7ba4e6cd5929d4e5f5c3b79d44775746291184f24d7e8b16140911f9
2023-10-06 09:19:00 +02:00
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-05 10:55:08 +02:00
3e2ae756f0
[feat] engine: implementation of radio-browser.info
2023-10-05 10:55:08 +02:00
d56b31d674
[fix] limiter / botdetection: remove http_connection method
...
Related:
- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 20:24:22 +02:00
e509cb7c45
[typo] solved a typo in yahoo error message.
2023-10-01 08:29:06 +02:00
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
2023-10-01 08:29:06 +02:00
fe9386b58d
[fix] emojipedia: fix engine
2023-10-01 08:19:45 +02:00
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 08:01:38 +02:00
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
2023-10-01 08:01:38 +02:00
5ce1792432
[feat] engine: implementation of pinterest
2023-09-30 15:01:45 +02:00
6096457e4d
[fix] matrixrooms.info: pagination not working properly
2023-09-30 14:51:07 +02:00
e1a8b8189f
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
2023-09-30 11:29:19 +02:00
159629c588
[mod] tagesschau: add option to only use tagesschau urls
2023-09-30 11:00:11 +02:00
2ca60a19fc
[feat] engine: implementation of matrixrooms.info
2023-09-30 09:09:23 +02:00
d1a3fc5be6
[feat] engine: implementation of tootfinder
2023-09-29 23:00:30 +02:00
fc4a20f734
[mod] add movies category for tmdb, imdb and moviepilot
2023-09-29 22:37:51 +02:00
0330648b98
[mod] warn to info for failed ping limiter
2023-09-29 22:20:56 +02:00
26fed56d51
[mod] settings.yml: remove plugin settings for plugins that don't exist anymore
2023-09-29 11:26:49 +02:00
9a065832e0
[translations] update from Weblate
...
80bbf74ef5d554ef71771fd1b90d412012c81ac171d0aa004c40cc47e729f89f85b28cc475ce5d58140ce0600921f343f714c80f80fdef3c859e4
2023-09-29 09:12:12 +02:00
ae2762eb78
Update searx.data - update_firefox_version.py
2023-09-29 06:58:11 +02:00
18da3d65c5
Update searx.data - update_ahmia_blacklist.py
2023-09-29 06:57:40 +02:00
4a66fa3e7d
Update searx.data - update_wikidata_units.py
2023-09-29 06:56:50 +02:00
9be6e20256
Update searx.data - update_engine_traits.py
2023-09-29 06:56:10 +02:00
d821ec44dd
Update searx.data - update_currencies.py
2023-09-29 06:55:04 +02:00
cdee5aa3b9
Update searx.data - update_engine_descriptions.py
2023-09-29 06:53:05 +02:00
75587d03a6
[fix] categories.html: can't select social media category using search on category select
2023-09-28 10:45:49 +02:00
e37d775fa2
[fix] engine - currency fix and simplify
2023-09-28 08:29:38 +02:00
ae28d429c9
[fix] bilibili new api used
2023-09-28 08:24:51 +02:00
1a66d74673
[fix] engine - kickass update url, fix parsing, use multiple mirrors
2023-09-27 10:19:41 +02:00
0c39064d60
Update searx.data - update_engine_traits.py
...
Update searx.data - update_engine_traits.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
b428ccc5a0
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
3a456b1282
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
1f835a9f1f
solve #2839
2023-09-25 23:01:14 +02:00
3c6549a17f
[fix] update user agent
2023-09-25 22:46:22 +02:00
ffec8d1b4c
add warning about enabling public_instance setting
2023-09-25 22:31:14 +02:00
47721a3485
add new parameter called server.public_instance
...
for enabling by default advanced limiter functions
in the future allow us to add features just for the public instances
2023-09-25 22:31:14 +02:00
1df4588279
[build] /static
2023-09-25 17:45:21 +02:00
98366bcf90
[fix] settings icon invisble on mobile devices
2023-09-25 17:45:21 +02:00
19383921d7
/config: expose limiter configuration
2023-09-24 11:01:11 +02:00
1851f27154
[mod] remove twitter ( #2843 )
2023-09-24 08:32:53 +00:00
597c68b4aa
[doc] move dosc of botdetection from developer to admin section
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-23 14:00:03 +02:00
75c9de02d1
[feat] engine: implementation of imgur
2023-09-22 20:50:53 +02:00
fb72f71f0a
[fix] internet archive scholar: crash when there's no title
2023-09-22 18:49:39 +02:00
0660d20e1d
[translations] update from Weblate
...
f27a3bbd4a97336d0a91e8946b319f53731edaf10bd75ab004b8b8cdedd99c9
2023-09-22 18:05:02 +02:00
95885e7f9f
[build] /static
2023-09-22 17:54:55 +02:00
8b0b6731fc
[fix] search.less: start page search view on mobile devices
2023-09-22 17:54:55 +02:00
71358e9c67
Revert "[fix] engine - duckduckgo vqd edge-case"
...
This reverts commit 102502a4f0
2023-09-22 09:31:25 +02:00
51236ae47a
[feat] engine: implementation of chefkoch.de
2023-09-21 17:23:59 +02:00
8bcca0e620
[fix] engine - brave don't show ads
2023-09-21 16:55:39 +02:00
b729542a66
[fix] engine - google images error when no results
2023-09-21 16:38:37 +02:00
f0df53673e
[mod] search-syntax.md: add tutorial about the feeling lucky feature
2023-09-21 15:17:23 +02:00
cc2e0537a3
[feat] engine: implementation of google icons/material design icons
2023-09-21 15:16:49 +02:00
c999cfb422
[feat] engine: implementation of wallhaven
2023-09-21 14:25:43 +02:00
102502a4f0
[fix] engine - duckduckgo vqd edge-case
2023-09-20 20:05:06 +02:00
d013f51a25
[fix] Search on category select without JavaScript PR #2740
...
Small addendum to #2740 ; search_on_category_select is now no longer a plugin.
Related: https://github.com/searxng/searxng/pull/2740#issuecomment-1725437584
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 21:03:02 +02:00
0ce10046c4
[build] /static
2023-09-19 20:15:51 +02:00
a76c8e4101
Improve the layout of the search page on mobile
2023-09-19 20:15:51 +02:00
33496e7f51
Switch back to qwant web normal API
2023-09-19 17:07:22 +02:00
043dcbf7c5
[fix] engine qwant (web-lite) - ignore advertising adds
...
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 17:06:56 +02:00
3ac7c40b6a
[build] /static
2023-09-19 11:15:25 +02:00
33e722f83b
better error message when no results found
2023-09-19 11:10:48 +02:00
ad725ce7d7
wikipedia wikidata infobox + disable wikisource ( #2806 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 10:31:02 +02:00
dcee823345
[feat] implement feeling lucky feature
2023-09-19 09:40:57 +02:00
71508abcbf
[build] /static
2023-09-19 08:06:06 +02:00
2ec77ef813
[mod] reformatted keyBindingLayouts in JS client (default, vim)
2023-09-19 08:06:06 +02:00
317db5b04f
[mod] preferences: implement drop-down menu for hotkeys (default, vim)
...
Replace the on/off checkbox of the vim-hotkeys in the preferences by a drop-down
menu.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 08:06:06 +02:00
09935e2897
[build] /static
2023-09-18 21:29:11 +02:00
a55e0ac553
[feat] search on category select without JS
...
Co-authored-by: Alexandre Flament <alex@al-f.net>
2023-09-18 21:29:11 +02:00
efd3a2d6d1
[feat] engine: implementation of internet archive scholar
2023-09-18 18:12:00 +02:00
223b3487c3
[fix] spelling
2023-09-18 16:20:27 +02:00
a9b6963971
[fix] engine - qwant delivers only 5 pages maximum
...
all qwant engines (incl qwant-lite) delivers only 5 pages maximum
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-18 01:43:43 +02:00
da1446c5ed
[fix] engine - qwant wrong error type
2023-09-18 01:43:43 +02:00
7398d525c8
[fix] qwant: subsequent fix of commit d9dbcedeb
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-17 17:52:56 +02:00
d9dbcedeb6
[feat] implementation of qwant lite for web search
...
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-17 16:53:25 +02:00
b4e0d2eedc
[feat] engine: implemenation of moviepilot (de)
2023-09-17 14:30:56 +02:00
7dfcc3386e
[fix] tagesschau videos
2023-09-16 18:40:26 +02:00
89fbac5763
[build] /static
2023-09-16 13:45:43 +02:00
92d0c378e0
[fix] keyboard navigation / simple theme (UI)
...
- avoid loop select
- fix select next item in mixed result lists
Replaces: https://github.com/searxng/searxng/pull/2789
Closes: https://github.com/searxng/searxng/issues/2751
Closes: https://github.com/searxng/searxng/issues/2788
2023-09-16 13:45:43 +02:00
ec540a967a
[fix] brave.videos
2023-09-15 22:00:09 +02:00
27477f51fd
[fix] brave.news
2023-09-15 22:00:09 +02:00
140125e641
[feat] implementation of the movie database
2023-09-15 19:41:37 +02:00
4eebb25882
[translations] update from Weblate
...
4f055ccb89edaacb09ccb3e8934206640415d8db608c26db95be680792cd970949ad5db80921f948e3677f0ccb2dea9cd3a5038588e86b63e980b858a8660b5852633d292d25097b8ae9d7a20989ccd21a1c309f3fc3ee5e679e7420db0cf7327ffb1f542814e225f26236007bea3da4568a854d931781efe60016a6044200f1431198e61bb7acd04327a418412274159ed21b385914b774daff7b45ec84146f8707383602051b050d9ee48d6e7a20cee77e20720420f44b6
2023-09-15 09:12:13 +02:00
41ef73ca3a
[fix] rumble redirect
2023-09-14 19:21:21 +02:00
b701ee257b
[fix] habrahabr
2023-09-14 18:43:14 +02:00
be888810ba
[fix] pubmed content being None
2023-09-14 18:40:15 +02:00
cf734e6008
[fix] engine - pub.dev
2023-09-14 18:07:55 +02:00
92d39de410
[fix] solidtorrents redirects
2023-09-14 18:03:21 +02:00
cf8a6cf6db
[fix] solidtorrents pagination
2023-09-14 18:03:21 +02:00
8172f89075
[fix] solidtorrents
2023-09-14 18:03:21 +02:00
74600c028d
[fix] engine - Crossref
...
Crossref was broken on result types journal-issue and component .. The old code
had lots of assumptions, and broke during parsing. Now the assumptions are more
explicit and checked them with the API.
2023-09-14 17:39:23 +02:00
ed6a5a01bb
[build] /static
2023-09-14 16:26:10 +02:00
0984b00b7e
[mod] UI smooth scroll added / CSS scroll-behavior
...
This PR improves the UX by making auto-scroll more smoother. The css is changed
so all the auto-scroll will be smoother but User-scroll will not be influenced.
The scroll-behavior CSS property sets the behavior for a scrolling box when
scrolling is triggered by the navigation or CSSOM scrolling APIs.[1]
[1] https://developer.mozilla.org/en-US/docs/Web/CSS/scroll-behavior
2023-09-14 16:26:10 +02:00
bf7af99ef2
[mod] make data.traits: add Odysee
2023-09-13 21:41:33 +02:00
3568a3cafb
[feat] odysee: implement fetch_traits for language support
2023-09-13 21:41:33 +02:00
09c61dabc9
[mod] odysee: time range support
2023-09-13 21:41:33 +02:00
b98907e91f
[fix] engine - piped.music incorrect timestamps
2023-09-13 21:39:37 +02:00
6039dbf211
[fix] engine - invidious thumbnails
2023-09-13 11:37:42 +02:00
ed3819bdd5
add inv.tux.pizza
2023-09-13 11:12:01 +02:00
122b4342eb
remove invidious.snopyta.org
2023-09-13 11:12:01 +02:00
e2a5e183cc
[fix] settings.yml - change default invidious instances
2023-09-13 11:12:01 +02:00
b2fd6304bf
[fix] engine - openstreetmap currency rendering
2023-09-13 10:56:52 +02:00
976b3e21c4
[fix] engine - pypi redirect
2023-09-12 21:14:48 +02:00
54a3e03b45
[fix] engine - openstreetmap currency matching
2023-09-12 20:57:05 +02:00
64d9587ac8
[feat] new engine: svgrepo
2023-09-12 20:38:36 +02:00
aa1453db0c
[build] /static
2023-09-12 20:30:50 +02:00
a987672340
[mod] improve handling of the hotkeys
...
- KeyboardEvent: keyCode property is depricated, replaced by key property [2]
- the check for ifDetailOpened is not necessary, because the hotkeys are not
only applicable to image-results, by example:
`!goi !go !scc hello`
- Key bindings like h for help are to be used in general (not only in vim-mode)
[1] https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/keyCode
[2] https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/key
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-12 20:30:50 +02:00
e6b160da62
[feature] key bindings: left & right arrow are always on
2023-09-12 20:30:50 +02:00
b189578b6b
[fix] engine - brave
2023-09-12 11:31:43 +02:00
f182abd6f8
[mod] library of congress: fix engine
2023-09-11 19:42:31 +02:00
e73a6f5d14
[fix] engine deviantart: review of the result-scrapper
...
The deviantart site changed and hence deviantart is currently unusable.
2023-09-11 13:22:36 +02:00
1f7366060e
[build] /static
2023-09-11 12:27:56 +02:00
935aed7ca4
[feature] dark theme for code highlighter in the result list
...
Closes: https://github.com/searxng/searxng/issues/1354
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-11 12:27:56 +02:00
d07c006aed
Replace chompjs with pure Python code
...
The new implementation is good enough for the current usage (brave)
2023-09-09 13:02:36 +02:00
8e45ac4271
[build] /static
2023-09-09 00:39:51 +02:00
15a3dbf7a0
[fix] preferences - layout of the "special queries" tab
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-09 00:39:51 +02:00
9e83c0dedc
[feat] engine: implementation of Yummly
...
Co-authored-by: Markus Heiser <markus.heiser@damarit.de>
2023-09-08 11:47:13 +02:00
a3d7e9c285
[mod] utils.py: add markdown_to_text helper function
2023-09-08 11:47:13 +02:00
c62605b3e3
[translations] update from Weblate
...
304f6af5c76a4b6496
2023-09-08 09:20:19 +02:00
019bd97f4b
[fix] settings.yml - fix docs-links in the comments
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-06 11:35:39 +02:00
1f21ac7d62
[feat] engine: implementation of bilibili https://www.bilibili.com
2023-09-05 22:53:03 +02:00
696c35d2c3
[fix] engine - duckduckgo_images / determination of vqd value incorrect
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-05 22:24:51 +02:00
4fb26cd96d
[fix] engine duckduckgo weather api changes
2023-09-05 16:55:00 +02:00
01be9e0e20
[fix] engine: wikicommons - don't quoute ':|' in URL parameters
...
From [1]: It seems to be because of [2] For some reason it gets url encoded
twice, resulting in
- ``filetype%253Abitmap%257Cdrawing+birds`` instead of
- ``filetype:bitmap%7Cdrawing+birds``
[1] https://github.com/searxng/searxng/issues/2707
[2] https://github.com/searxng/searxng/blob/master/searx/engines/wikicommons.py#L43
Closes : #2707
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-03 18:45:39 +02:00
4f8895c6de
[fix] follow-up of 4da7003ae / add missing review from @Bnyro
...
[1] https://github.com/searxng/searxng/pull/2656#pullrequestreview-1607956209
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-02 09:26:45 +02:00
4da7003ae0
[feat] engine: implementation of odysee
2023-09-02 09:14:12 +02:00
9c4e9d3814
[feat] implementation of Wikimedia commons for images
2023-09-01 18:39:24 +02:00
9fce459c7f
[translations] update from Weblate
...
979909accf40af3403
2023-09-01 09:29:07 +02:00
7af66736c0
Create search-syntax.md fa
2023-08-30 16:39:10 +02:00
26cd770cf7
[mod] Persian translation of the about page (fa_IR)
2023-08-30 16:13:44 +02:00
faa4280e1a
[mod] bing: resolve redirect without additional requests
...
Remove the usage of searx.network.multi_requests
The results from Bing contains the target URL encoded in base64
See the u parameter, remove the first two character "a1", and done.
Also add a comment the check of the result_len / pageno
( from https://github.com/searx/searx/pull/1387 )
2023-08-29 07:39:06 +02:00
f57842b05d
Update searx.data - update_firefox_version.py
2023-08-29 07:21:46 +02:00
a5cd777350
Update searx.data - update_ahmia_blacklist.py
2023-08-29 07:21:21 +02:00
f361a10af6
Update searx.data - update_currencies.py
2023-08-29 07:20:42 +02:00
978062bdbe
Update searx.data - update_engine_descriptions.py
2023-08-29 07:20:06 +02:00
f59fd8dc9b
Update searx.data - update_wikidata_units.py
2023-08-29 07:17:44 +02:00
3294e7cfe4
[fix] reduce error logs related to X-Forwarded-For & X-Real-IP headers
...
To test start a `make run` instance and query multiple times for `ip` (the
answerer), you should see only once the error message(s):
ERROR searx.botdetection : X-Forwarded-For header is not set!
ERROR searx.botdetection : X-Real-IP header is not set!
[1] https://github.com/searxng/searxng-docker/discussions/174
[2] https://github.com/searxng/searxng-docker/pull/162#issuecomment-1692834457
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-28 08:05:17 +02:00
1428385d1c
[mod] preferences.py: add and use BooleanSetting for checkbox preferences
2023-08-27 21:23:43 +02:00
e5535ec078
[feat] settings: replace boolean select preferences with checkboxes
2023-08-27 21:23:43 +02:00
5a5cfc1930
[mod] random answerer: add random hex color generator
2023-08-27 18:59:54 +02:00
b0d2cd5ca9
[doc] add documentation of Mwmbl engine & autocompleter
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-27 17:25:26 +02:00
df71c24b20
[mod] autocomplete.py: add support for mwmbl completions
2023-08-27 17:25:26 +02:00
19300a5659
[mod] engine mwmbl: add link to official api docs
2023-08-27 17:25:26 +02:00
97b1df1629
[mod] searx.network: memory optimization
...
Avoid to create a SSLContext in AsyncHTTPTransportNoHttp
See:
* 0f61aa58d6/httpx/_transports/default.py (L271)https://github.com/encode/httpx/issues/2298
2023-08-27 11:49:40 +02:00
e16c007c22
[fix] openstreetmap engine
...
It seems there is an API change:
extratags can be either a dictionnary or None.
This commit avoid crash when extratags is None
Test query "!osm gare du nord"
2023-08-27 11:49:16 +02:00
0647f83a3e
[fix] google engine: don't overspecify the search query to Google
...
The method EngineTraits.get_region(..) returns engine's region string
that **best fits** to SearXNG's locale. This means it returns a
region (country) if only a language is set in the locale. By example the method
returns for a locale tag `es` a region `ES`.
Google's search parameter `cr` restricts search results to documents originating
in a particular country / in case of a locale tag (language) as described above,
this argument should be unset in the query send to Google.
Closes: https://github.com/searxng/searxng/issues/2672
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-26 07:47:07 +02:00
7d806d1020
[translations] update from Weblate
...
a6c2d198838bc33a710ff21aa3c
2023-08-25 09:36:49 +02:00
9069da051a
Merge pull request #2644 from dalf/update_httpx
...
Bump httpx 0.21.2 from to 0.24.1
2023-08-24 23:12:06 +02:00
4b42644579
[fix] engine google_video: google has changed the layout of the rsponse
...
Closes: https://github.com/searxng/searxng/issues/2664
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-22 08:34:04 +02:00
b4e4cfc026
Bump httpx 0.21.2 from to 0.24.1
2023-08-21 22:05:12 +02:00
d52919cc3e
[mod] decrease the weighting of wikivoyage, wikibooks, wikisource and wikiversity
...
The search engines deliver hits for many search terms [1], but these are usually
not the focus of the user. In order to arrange these hits further down in the
list, their weighting is reduced.
[1] https://github.com/searxng/searxng/pull/2589#issuecomment-1670915089
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-21 21:52:40 +02:00
018b0a9322
[feat] engine: XPath configuration for pkg.go.dev
2023-08-19 19:19:31 +02:00
c59ae91b76
[feat] engine: implementation of mwmbl
2023-08-19 18:23:42 +02:00
bb9e9ab773
[translations] update from Weblate
...
d8e4100b6b8e03f3bc
2023-08-18 19:22:13 +02:00
c741fc6f00
[mod] currency_convert: support for showing the answer source url
...
Show URL of the ddg-search page, not the URL of a (generic) Javascript. The
latter one is not usefull for the user.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-18 19:07:14 +02:00
e2744520f8
[mod] google: support for showing the answer source url
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-18 19:07:14 +02:00
5ec7df3480
[mod] engine duckduckgo definitions: support for answer source
2023-08-18 19:07:14 +02:00
64bc98b5fb
[mod] brave: support for showing the answer source url
2023-08-18 19:07:14 +02:00
6fc2ee514d
[build] /static
2023-08-18 19:07:14 +02:00
13d801b75d
[feat] results: show source of suggested answer
2023-08-18 19:07:14 +02:00
9100a48541
[mod] improve seekr engines and add documentation
...
Tis patch adds some more fields to the result items and changed paging to the
``nextResultSet`` given in seekr's JSON response.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-15 16:17:42 +02:00
2bab658d39
[feat] engine: implementation of seekr for news, images and videos
2023-08-15 16:17:42 +02:00
7052a1a7cf
[drop] engine archive.is / blocked by CAPTCHA [1]
...
Sadly archive.is is blocked by a CAPTCHA that can't be avoid (at least in a
XPath engine).
[1] https://github.com/searxng/searxng/issues/2643
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-14 08:50:13 +02:00
621b09b9b9
[fix] preferences: change engine table category colspan to 8
...
* this is a small fix to increase the colspan of the category in engine preferences from 7 to 8, since there was a column added
=> fixing a small fallout from 4731290317
2023-08-14 07:11:06 +02:00
f175574f37
[fix] typos in documentation & messages
2023-08-13 08:50:29 +02:00
c348427f07
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-11 10:54:50 +02:00
99df7b84d1
[translations] update from Weblate
...
12c527bcdea46b66fcae3d8dcdfab6a59e351db1affcc94b682aa007c49bb6c
2023-08-11 09:17:56 +02:00
c76c999a1e
[feat] engine: implementation of anaconda
2023-08-10 23:51:07 +02:00
e25d1c7288
[feat] engine: implementation of German news, Tagesschau
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10 20:27:54 +02:00
2256ba2ffb
[mod] settings.yml: move wolframalpha to categ general & disable by default
...
As suggested in comment [1] as a good compromise between [2] and [3].
This will help users that want Wolfram Alpha instant answers by default with
every query and don't mind the slowness. It will be disabled by default so it's
fast for all users, and those that need it can enable it as a user-configurable
option without requiring setting up their own instance to change the Wolfram
Alpha categorization.
[1] https://github.com/searxng/searxng/pull/813#issuecomment-1574851572
[2] https://github.com/searxng/searxng/pull/813#issuecomment-1020581765
[3] https://github.com/searxng/searxng/issues/966#issue-1171107451
2023-08-10 14:31:09 +02:00
834e1c3f12
[mod] engine lemmy: increase thumbnail quality to align with theme
2023-08-10 12:58:40 +02:00
c381fc001f
[mod] settings: remove lemmy from categ 'general' & enable by default
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10 12:58:40 +02:00
fda111c0c9
[mod] engine lemmy: add more info fields to the result items
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10 12:58:40 +02:00
224f2250ae
[feat] engine: support for lemmy communities, posts, comments and users
2023-08-10 12:58:40 +02:00
9f82c39610
[mod] engine google_play: raise error on unsupported category
2023-08-10 12:35:24 +02:00
0a99dc85b9
[mod] engine brave: raise error on unsupported category
2023-08-10 12:35:24 +02:00
4731290317
[mod] settings: show weight of each instance
2023-08-10 10:50:14 +02:00
733b795d53
[fix] make flask_babel.gettext() work in engine modules (L10n & threads)
...
incident:
flask_babel.gettext() does not work in the engine modules.
cause:
the request() and response() functions of the engine modules run in the
processor, whose search() method runs in a thread and in the threads the
context of the Flask app does not exist. The context of the Flask app is
needed by the gettext() function for the L10n.
Solution:
copy context of the Flask app into the threads. [1]
special case:
We cannot equip the search() method of the processors with the decorator [1],
because the decorator requires a context (Flask app) that does not yet exist
at the time of the initialization of the processors (the initialization of the
processors is part of the initialization of the Flask app).
[1] https://flask.palletsprojects.com/en/2.3.x/api/#flask.copy_current_request_context
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-09 13:27:43 +02:00
c00c0c5434
[mod] remove discontinued petalsearch engines
2023-08-09 07:17:40 +02:00
b8352eca0c
[mod] brave engines: add fetch_traits() / improve language support
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08 16:21:45 +02:00
460bbe5b81
[mod] implement brave (WEB) engine to replace XPath configuration
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08 16:21:45 +02:00
d151497db3
[feat] engine: brave - support for news
2023-08-08 16:21:45 +02:00
cae06f2781
[feat] engine: brave - support for videos
2023-08-08 16:21:45 +02:00
73364e158e
[feat] engine: brave - support for images
2023-08-08 16:21:45 +02:00
bcaaae699f
[doc] fix some minor typos in the doc-strings of class EngineTraits
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08 08:15:53 +02:00
a2108432f7
[fix] settings.yml: typo in engine name wikipecies -> wikispecies
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-07 10:35:44 +02:00
1d0abb7157
[doc] engine bt4g: add documentation to docs/dev/engines/online/
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-06 09:30:48 +02:00
0fc8f99ecc
[feat] new engine: bt4g added & enabled and disable by default btdigg
...
Disable btdigg because on most SearXNG instances, SearXNG is blocked by btdigg
due to cloudflare too many requests.
This impementation did not parse the HTML page because there is an API in
XML (RSS). The RSS feed provides fewer data like amount of seeders/leechers and
the files in the torrent file. It's a tradeoff for a "stable" engine as the XML
from RSS content will change way less than the HTML page.
Closes: https://github.com/searxng/searxng/issues/2553
2023-08-06 09:30:48 +02:00
dad16c0949
[mod] settings.yml: enable engines from Wikimedia Foundation
...
The Wikimedia wikis [1] engines provide good answers and have short response
times --> no reason to disable these enhgines by default. BTW: this patch adds
a (sub-) category ``wikimedia`` for the engines [1].
[1] https://meta.wikimedia.org/wiki/Wikimedia_wikis
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04 19:06:50 +02:00
db522cf76d
[mod] engine: wikimedia - improve results, add addition settings & doc
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04 19:06:50 +02:00
7d8c20c80d
[feat] new engine: wikispecies
2023-08-04 19:06:50 +02:00
9a5e91ce84
[translations] update from Weblate
...
310daeb7201be8a264
2023-08-04 09:30:11 +02:00
1b030d4b41
[doc] engine: Yacy
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03 19:58:51 +02:00
Alexandre Flament
Yaksh Bariya
Alexandre Flament
searxng-bot
Bnyro
dalf
Markus Heiser
templehasfallen
Austin-Olacsi
Xinos
micsthepick
Hackurei
allixx
Hermógenes Oliveira
Émilien (perso)
Jinyuan Huang
ahmad-alkadri
obfuscated-loop
Jay
dependabot[bot]
Brock Vojkovic
sev
Alex Balgavy
Hackurei
Aine
jazzzooo
ormai
bonswouar
Jafar Farganlooj
Paul Braeuning
PlayDay
ToxyFlog1627
GeckoLinux
allendema_searxng_pi