ed66ed758d
[mod] reduce memory footprint by not calling babel.Locale.parse at runtime
...
babel.Locale.parse loads more than 60MB in RAM. The only purpose is to get:
LOCALE_NAMES - searx.data.LOCALES["LOCALE_NAMES"]
RTL_LOCALES - searx.data.LOCALES["RTL_LOCALES"]
This commit calls babel.Locale.parse when the translations are update from
weblate and stored in::
searx/data/locales.json
This file can be build by::
./manage data.locales
By store these variables in searx.data when the translations are updated we save
round about 65MB (usually 4 worker = 260MB of RAM saved.
Suggested-by: https://github.com/searxng/searxng/discussions/2633#discussioncomment-8490494
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-20 10:43:20 +01:00
76845ea42c
[mod] engine ask.com - parse JS result to JSON
...
Parse the result list from ask.com given in the variable named
window.MESON.initialState::
<script nonce="..">
window.MESON = window.MESON || {};
window.MESON.initialState = {"siteConfig": ...
...}};
window.MESON.loadedLang = "en";
</script>
The result list is in field::
json_resp['search']['webResults']['results']
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-18 09:17:22 +01:00
3df53d6e50
[feat] engine: implementation of ask.com
2024-02-18 09:17:22 +01:00
2aef3a556f
[translations] update from Weblate
...
be989636e0e3455cb8edc279680e0d3b7f9ff68fc5440980f3846c711618f3a1d12e762fab319100b9854a5a4aebfb23f13
2024-02-16 15:48:10 +01:00
11c0651ef4
[fix] lingva: redirect and parsing error
2024-02-11 11:28:47 +01:00
bffc4905ce
Update searx.data - update_currencies.py
2024-02-10 23:55:41 +01:00
bfcd41f04a
[clean] drop obsolete py3.7 compatibility
...
- https://github.com/searxng/searxng/discussions/2356
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 09:27:19 +01:00
b0fe0924a3
[feat] engine: implementation of brave goggles
2024-02-10 08:09:50 +01:00
53898b8c37
[mod] footer: i18n for the link names in the footer
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 08:03:43 +01:00
7e1b5f6cc8
[feat] footer: support for custom entries
2024-02-10 08:03:43 +01:00
459389a2da
[translations] update from Weblate
...
2b940307ee7cdce39e171fae67dd6a7604668cc4c51a92e76559ba
2024-02-09 08:15:45 +01:00
df1a774003
[fix] KeyError: 'title' in results using key-value.html template
...
Since #2508 a title is required --> this is a bug when an engine uses the
key-value.html template [1], where no title is needed.
[1] https://github.com/searxng/searxng/blob/master/searx/templates/simple/result_templates/key-value.html
Closes: https://github.com/searxng/searxng/issues/3130
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-06 07:53:39 +01:00
11f918296f
[translations] update from Weblate
...
a001549469f220b2aa71951ae12a2f344a700f2944179f0d42961fa5cc1c6d5c5a39252dfa01c975851a86de3d4a55d6d8d3bb8adf1f1b2e23dcb7589d6bbcc04d8739c
2024-02-02 08:18:01 +01:00
be0d756ad5
[fix] libgen.fun is down, switch to libgen.rs
...
Closes: https://github.com/searxng/searxng/issues/3178
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-01 20:32:10 +01:00
6d31ca28b5
[fix] remove missing link icon macro
2024-02-01 08:13:43 +01:00
100a150a33
Remove rtl exception
...
This right-to-left exception doesn't seem to be called for.
2024-01-31 20:03:10 +01:00
f9f0c2ec03
Fix media exposure toggle
...
Make initially hidden and the toggle button consistent.
2024-01-31 20:03:10 +01:00
fa7fef7d87
Provide template for results in file category
...
This is used, for instance, by the recoll engine.
2024-01-31 20:03:10 +01:00
ab8e5383fb
[mod] remove X-XSS-Protection headers
...
Deprecated header not used by browsers nowadays[1]:
"""In modern browsers, X-XSS-Protection has been deprecated in favor of the
Content-Security-Policy to disable the use of inline JavaScript. Its use can
introduce XSS vulnerabilities in otherwise safe websites. This should not be
used unless you need to support older web browsers that don’t yet support CSP.
It is thus recommended to set the header as X-XSS-Protection: 0."""[2]
[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/X-XSS-Protection
[2] https://infosec.mozilla.org/guidelines/web_security#x-xss-protection
Closes: https://github.com/searxng/searxng/issues/3171
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 17:23:41 +01:00
dca78f920f
[build] /static
2024-01-31 17:22:03 +01:00
c85f706601
[fix] wrong engines padding
2024-01-31 17:22:03 +01:00
30dcaf1db6
[fix] equalize cached/proxied links left margin
2024-01-31 17:22:03 +01:00
1e03094dee
[fix] justify engines/cached/proxied vertically
2024-01-31 17:22:03 +01:00
c14b117121
[fix] brave.search - update result selectors to fit to new layout
...
Closes: https://github.com/searxng/searxng/issues/3167
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 16:21:56 +01:00
efbee96b1d
[feat] brave: fix empty content and parse published dates
2024-01-30 07:41:45 +01:00
90072eb6ff
[build] /static
2024-01-29 18:09:22 +01:00
a5decfb838
[feat] preferences: button to copy input to restore preferences hash
2024-01-29 18:09:22 +01:00
559b860618
[feat] engine: implementation of goodreads
2024-01-29 16:07:24 +01:00
a962aab9b0
[translations] update from Weblate
...
c1a3532a2603c6894b2920c734264cc1168a21ec41823
2024-01-29 15:01:37 +01:00
62fa85287a
Update searx.data - update_wikidata_units.py
2024-01-29 14:04:24 +01:00
0ed7548d83
Update searx.data - update_firefox_version.py
2024-01-29 14:04:03 +01:00
d763934a7a
Update searx.data - update_ahmia_blacklist.py
2024-01-29 14:03:03 +01:00
14f73ef3d9
Update searx.data - update_engine_traits.py
2024-01-29 14:02:30 +01:00
a393341403
Update searx.data - update_engine_descriptions.py
2024-01-29 13:34:12 +01:00
e4cf0a7d4f
[fix] do highlight replacement at once
...
Highlights all search queries in search result in one go.
Fixes the case where search query contains word from highlight HTML code,
which causes broken HTML to appear in search results.
Closes #3057
2024-01-29 13:15:37 +01:00
8c73aa772b
[fix] semantic scholar: bad request
2024-01-25 06:12:08 +01:00
ab5d2f32bb
[translations] update from Weblate
...
0f8246b81ce23e8ce91112731cb
2024-01-19 08:29:29 +01:00
7c80807bb8
Block HeadlessChrome ( #3116 )
2024-01-17 09:14:36 +01:00
9c5f9735cf
[fix] engine: safesearch parameter in Google Videos engine ( #2762 )
...
Closes: https://github.com/searxng/searxng/issues/2762
2024-01-16 15:29:09 +01:00
8762863ebf
[mod] presearch: set WEB timeout to 4sec & single network for all request
...
timeout: 4.0
The timeout of presearch-WEB is left up from the default of 3sec to 4sec. The
engine has to send two HTTP requests, they often exceed the default timeout of
3sec. Since all other presearch categories (images, videos, news) also have a
timeout of 4 sec, the WEB search should also have the same timeout.
network: presearch
Place all HTTP requests in the same network, named ``presearch``.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
e560d7e373
[mod] presearch: add language & region support
...
In Presearch there are languages for the UI and regions for narrowing down the
search. With this change the SearXNG engine supports a search by region. The
details can be found in the documentation of the source code.
To test, you can search terms like::
!presearch bmw :zh-TW
!presearch bmw :en-CA
1. You should get results corresponding to the region (Taiwan, Canada)
2. and in the language (Chinese, Englisch).
3. The context in info box content is in the same language.
Exceptions:
1. Region or language is not supported by Presearch or
2. SearXNG user did not selected a region tag, example::
!presearch bmw :en
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
a2c269bbac
[mod] presearch: hardening engine's response against KeyErrors
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
0a78f59aba
[fix] presearch: safesearch, time ranges, crash when no result found
2024-01-15 19:23:26 +01:00
87f18b98ec
[fix] SyntaxWarning: invalid escape sequence '\>'
...
This patch fixes issue reported by ``make test.unit``::
searx/search/checker/impl.py:39: SyntaxWarning: invalid escape sequence '\>'
rep = ['<' + tag + '[^\>]*>' for tag in HTML_TAGS]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 18:27:21 +01:00
b0b2efdc8d
[translations] update from Weblate
...
3dafa37f3a641db83fa3d2b083fb6dec1f75eb76d8b8d
2024-01-13 09:33:41 +01:00
f9c5727ddc
[mod] get rid of ./utils/brand.env and its workflow
...
All the environments defined in ./utils/brand.env are generated on the fly, so
there is no longer a need to define the brand environment in this file and all
the workflows to handle this file.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-09 16:31:19 +01:00
3dea7e609b
[feat] autocompleter: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
621e1313af
[feat] engine: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
c90dc201fc
[translations] update from Weblate
...
a04e3b59ca4d38784780521c1b3e909528152debd5992c4d54c3e51a0c9c025dc99d1390477e0114965dacdd306a20c8853
2024-01-06 16:20:13 +01:00
3535377c9a
Searx to SearXNG change error message
2023-12-31 16:19:14 +01:00
Alexandre Flament
Markus Heiser
Hackurei
searxng-bot
Bnyro
dalf
allixx
Hermógenes Oliveira
Émilien (perso)
Jinyuan Huang