f63ffbb22b
[fix] engine - yahoo: rewrite and fix issues
...
Languages are supported by mapping the language to a domain. If domain is not
found in :py:obj:`lang2domain` URL ``<lang>.search.yahoo.com`` is used.
BTW: fix issue reported at https://github.com/searx/searx/issues/3020
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-16 20:05:26 +00:00
38a157b56f
[pylint] engines: yahoo fix several issues reported from pylint
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-16 20:05:26 +00:00
c067c18235
[translations] update
...
4da16339
2021-10-15 20:39:33 +00:00
9730371199
[fix] typos reported from weblate translators
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-15 19:20:11 +00:00
dd04551e14
[translations] update
...
f8a46518
2021-10-15 18:43:10 +00:00
1f39b99c03
Bump eslint from 7.32.0 to 8.0.1 in /searx/static/themes/simple
...
Bumps [eslint](https://github.com/eslint/eslint ) from 7.32.0 to 8.0.1.
- [Release notes](https://github.com/eslint/eslint/releases )
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md )
- [Commits](https://github.com/eslint/eslint/compare/v7.32.0...v8.0.1 )
---
updated-dependencies:
- dependency-name: eslint
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-15 07:16:16 +00:00
00b0394e19
[fix] language param for qwant
2021-10-14 16:11:44 +00:00
ee5e9f9e1d
Merge pull request #380 from dalf/fix-339
...
[fix] interface language zh_CN and zh_TW don't work
2021-10-12 21:50:05 +02:00
4759f65b69
[fix] interface language zh_CN and zh_TW don't work
...
before this commit, when the user picks "Chinese, China" or "Chinese, Taiwan",
the locale fallbacks to English.
This commit fixes this issue (the translations branch must be updated)
close #339
2021-10-12 21:06:20 +02:00
a1d1aec6e2
[mod] locale: use hyphen everywhere except for Babel
2021-10-12 21:06:20 +02:00
988910d451
[fix] templates: lang attribute of html uses hyphen
...
https://developer.mozilla.org/en-US/docs/Web/HTML/Global_attributes#attr-lang
https://www.w3.org/TR/REC-xml/#sec-lang-tag
2021-10-12 21:06:20 +02:00
66b7be0965
[fix] fix match_language issue to make zh-TW match to zh-Hant-TW
...
pybabel separates locales with underscores but we use hyphens
everywhere babel doesn't directly touch
2021-10-12 21:06:20 +02:00
f9c6393502
[enh] verify that Tor proxy works every time searx starts
...
based on @MarcAbonce commit on searx
2021-10-12 21:01:02 +02:00
4cc1ee8565
[fix] qwant engine - only get results from categories
...
Reported-by: https://github.com/searx/searx/issues/3014
Cherry-picked: https://github.com/searx/searx/commit/3bcca43
2021-10-12 18:42:50 +00:00
64df011e2f
[mod] engines - add zlibrary engine
2021-10-11 14:58:44 +00:00
3fad483b7a
SearXNG: partial update: reference /etc/searxng/settings.yml
2021-10-11 12:28:55 +00:00
861925c50f
SearXNG: load /etc/searxng/settings.yml
...
fall back to /etc/searx/setting.yml
2021-10-11 12:28:55 +00:00
7f72844ca6
Merge pull request #355 from MrPaulBlack/simple-theme-css-vars
...
[simple theme] dark mode and some css cleanup
2021-10-10 09:41:46 +02:00
f5755ba6b9
Merge pull request #319 from dalf/mod-plugins
...
plugins: refactor initialization
2021-10-10 09:16:00 +02:00
d8c9839625
[build] /static
2021-10-09 16:03:58 +02:00
bc2c8e6ba9
[simple theme] add a dark theme
...
* add a new color theme for a dark mode
* make the device auto switch between dark and light theme
2021-10-09 16:00:56 +02:00
3daa024c04
[simple theme] new color theme and result on mobile and tablet
...
* clean up vars in defenition
* results look now the same on mobile and desktop
* reworked results on mobile
* new color theme with more vibrant colors
2021-10-09 16:00:56 +02:00
09324f3492
[template] move result url to top of article
2021-10-09 16:00:56 +02:00
740fca00cc
Redo Color Theme and css cleanup
...
* remove vars and add elements to base and btn vars
* change default border radius to 10px and padding to 0.7em
* put border radius and padding on search input form, infoxbox and buttons
* remove unused .help class in #categories_container
* remove active background from tabs to straemline design
* redo search form: 10px padding
* 2rem margin on search results on desktop
* fix modal pacement of engine reliability in prefs
* use darker accent colors
* streamline autocomplete with more padding and a hover effect
2021-10-09 16:00:56 +02:00
7c2a518d12
[theme] replace all hardcoded colors by css vars and drop ununsed vars
2021-10-09 16:00:55 +02:00
452b266387
[theme] convert less vars to css vars in simple theme
2021-10-09 16:00:55 +02:00
94de9ee61a
Bump grunt-contrib-jshint in /searx/static/themes/oscar
...
Bumps [grunt-contrib-jshint](https://github.com/gruntjs/grunt-contrib-jshint ) from 3.0.0 to 3.1.1.
- [Release notes](https://github.com/gruntjs/grunt-contrib-jshint/releases )
- [Changelog](https://github.com/gruntjs/grunt-contrib-jshint/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt-contrib-jshint/commits/v3.1.1 )
---
updated-dependencies:
- dependency-name: grunt-contrib-jshint
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-08 07:46:52 +00:00
6b643e961b
Merge pull request #397 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-contrib-jshint-3.1.1
...
Bump grunt-contrib-jshint from 3.0.0 to 3.1.1 in /searx/static/themes/simple
2021-10-08 09:45:40 +02:00
91206a5682
[translations] update
...
b2709671
2021-10-08 07:16:49 +00:00
a88ee63aca
Bump grunt-contrib-jshint in /searx/static/themes/simple
...
Bumps [grunt-contrib-jshint](https://github.com/gruntjs/grunt-contrib-jshint ) from 3.0.0 to 3.1.1.
- [Release notes](https://github.com/gruntjs/grunt-contrib-jshint/releases )
- [Changelog](https://github.com/gruntjs/grunt-contrib-jshint/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt-contrib-jshint/commits/v3.1.1 )
---
updated-dependencies:
- dependency-name: grunt-contrib-jshint
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-08 07:05:58 +00:00
5731b6b700
[mod] searx.plugins.prepare_package_resources() - use generators
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-07 18:41:56 +02:00
aa5a5147b2
[fix] searx.plugins.initialize() - don't miss module & module-name
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-07 18:41:41 +02:00
3abbe6d25b
[fix] engine torznab - categories, before join convert int to str
...
BTW add init() function and replace SearxEngineAPIException by ValueError.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-07 15:27:55 +00:00
9fb77065bd
[fix] engine torznab - marginal issues reported from linters
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-07 15:27:55 +00:00
d803df8d89
[mod] engines - add torznab WebAPI
2021-10-07 15:27:55 +00:00
7246d62770
Merge pull request #386 from return42/fix-384
...
[mod] set 'engine.supported_languages' from the origin python module
2021-10-07 09:50:43 +02:00
19e41c137e
[mod] set 'engine.supported_languages' from the origin python module
...
The key of the dictionary 'searx.data.ENGINES_LANGUAGES' is the *engine name*
configured in settings.xml. When multiple engines are configured to use the
same origin engine (e.g. `engine: google`)::
- name: google
engine: google
use_mobile_ui: false
...
- name: google italian
engine: google
use_mobile_ui: false
language: it
...
- name: google mobile ui
engine: google
shortcut: gomui
use_mobile_ui: true
There exists no entry for ENGINES_LANGUAGES[engine.name] (e.g. `name: google
mobile ui` or `name: google italian`). This issue can be solved by recreate the
ENGINES_LANGUAGES::
make data.languages
But this is nothing an SearXNG admin would like to do when just configuring
additional engines, since this just doubles entries in ENGINES_LANGUAGES and
BTW: `make data.languages` has various external requirements which might be not
installed or not available, on a production host.
With this patch, if engine.name fails, ENGINES_LANGUAGES[engine.engine] is used
to get the engine.supported_languages (e.g. `google` for the engine named
`google mobile`).
For an engine, when there is `language: ...` in the YAML settings, the engine
supports only one language, in this case engine.supported_languages should
contains this value defined in settings.yml (e.g. `it` for the engine named
`google italian`).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Closes: https://github.com/searxng/searxng/issues/384
2021-10-07 08:45:02 +02:00
2b4fef7118
plugins: refactor initialization
...
add a new function "init" call when the app starts.
The function can:
* return False to disable the plugin.
* modify the Flask app.
2021-10-06 19:18:19 +02:00
de0249ddae
[fix] don't mix loaded modules with imported modules (sys.modules)
...
The utils.load_module() function is used to load a python file (aka module) and
return the module's namespace. SearXNG uses this function to load *engines and
answerers* from arbitrary locations with arbitrary modifications. These are not
real python modules and it is not intended to mix this *engines and answerers*
with the python modules registered in sys.modules.
Closes: https://github.com/searxng/searxng/issues/312
Suggested-by: @dalf in https://github.com/searxng/searxng/issues/312
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-06 18:45:00 +02:00
feb2d4dda5
Merge pull request #377 from return42/engine-imdb
...
[mod] engines - add IMDB / Internet Movie Database
2021-10-05 08:14:01 +00:00
8a897b86f1
[mod] engines - IMDB: add thumbnails
2021-10-05 09:10:02 +02:00
47eb836c65
Merge pull request #375 from dalf/searxng_extra
...
SearXNG: searx_extra
2021-10-03 19:09:07 +02:00
715c445e9b
[build] /static
2021-10-03 19:04:18 +02:00
823d44ed0a
[mod] engines - add IMDB / Internet Movie Database
...
Merged from @Guilvareux's commit [1] and slightly modfied / see [2].
[1] https://github.com/searx/searx/pull/2980/commits/f2f90071
[2] https://github.com/searx/searx/pull/2980
2021-10-03 11:44:25 +02:00
1bb82a6b54
SearXNG: searxng_extra
2021-10-02 17:30:39 +02:00
430babca25
SearXNG: environment variables
2021-10-02 16:54:11 +02:00
e39a03cc61
Merge pull request #367 from dalf/searxng-github
...
SearXNG: .github, searxng-docker
2021-10-02 07:57:49 +02:00
fda5609a17
Merge pull request #360 from return42/ddg-lite
...
Implement a DuckDuckGo Lite engine
2021-10-02 05:16:29 +00:00
97419a770d
[upd] make data.languages
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-01 20:01:41 +02:00
a5b7ed9550
[mod] engine duckduckgo - update supported_languages_url
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-01 20:01:41 +02:00
4c9b8b29ee
[mod] engine duckduckgo - use DuckDuckGo-Lite
...
Implement a scrapper for DuckDuckGo-Lite [1]. The existing DuckDuckGo [2]
engine does not support paging. DuckDuckgo-Lite is much faster, less verbose
and does have a paging option (reversed engineered from the input form of [1]).
[1] https://lite.duckduckgo.com/lite
[2] https://duckduckgo.com/
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-01 20:01:41 +02:00
a53a4d5012
[build] /static
2021-10-01 18:09:37 +02:00
74b0830362
SearXNG: simple theme
2021-10-01 18:06:55 +02:00
499c7b3cce
SearXNG: .github, searxng-docker
2021-10-01 09:48:53 +02:00
458575c221
Merge pull request #361 from dalf/searxng-theme-oscar
...
SearXNG theme oscar
2021-10-01 09:15:46 +02:00
c74f45b1df
Merge pull request #365 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2021-10-01 07:11:13 +00:00
62ea3c7074
Merge pull request #366 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2021-10-01 06:41:09 +00:00
d814f1182f
Merge pull request #364 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2021-10-01 06:34:20 +00:00
8479a83411
Merge pull request #363 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2021-10-01 06:33:51 +00:00
db51a64390
Update searx.data - update_languages.py
2021-10-01 06:23:31 +00:00
a582e55af0
Update searx.data - update_wikidata_units.py
2021-10-01 06:23:25 +00:00
56c68beb42
Update searx.data - update_firefox_version.py
2021-10-01 06:23:14 +00:00
453114fbe4
Update searx.data - update_ahmia_blacklist.py
2021-10-01 06:23:12 +00:00
0c24a03f05
Update searx.data - update_currencies.py
2021-10-01 06:23:04 +00:00
1dfac73a64
[build] /static
2021-09-30 19:01:50 +02:00
df06dddc04
SearXNG: oscar theme
2021-09-30 18:50:21 +02:00
a582cf3d82
Merge pull request #353 from return42/stackexchange
...
[mod] engines - add Stack Exchange API v2.3
2021-09-29 10:38:50 +02:00
ecb3912bd0
[fix] engine stackexchange - decode HTML entities in title & content
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-29 08:08:18 +02:00
a9c3c88cc0
[mod] searx.network.stream returns a tuple (response, stream)
2021-09-28 19:33:29 +02:00
29893cf816
[fix] searx.network.stream: fix memory leak
2021-09-28 19:28:12 +02:00
5efe77bdf5
[mod] engines - add superuser.com (Stack Exchange API)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-28 19:20:13 +02:00
29eb06ab16
[mod] engines - add askubuntu.com (Stack Exchange API)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-28 19:17:26 +02:00
b62851559b
[mod] replace old stackoverflow engine by Stack Exchange API v2.3
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-28 19:12:37 +02:00
55fee1e45d
[mod] engines - add Stack Exchange API v2.3
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-28 19:01:04 +02:00
2eab89b4ca
[fix] checker: fix memory usage
...
* download images using the "image_proxy" network (HTTP/1 instead of HTTP/2)
* don't cache data: URL (reduce memory usage)
* after each test: purge image URL cache then call garbage collector
* download only the first 64kb of images
2021-09-28 15:26:02 +02:00
43fc136207
[build] /static
2021-09-28 00:26:43 +02:00
57f58f85bd
[fix] position of engine description tooltip
2021-09-28 00:26:17 +02:00
73cb80e71d
[build] /static
2021-09-27 17:40:11 +02:00
8ac776765c
[theme] simple: do not prefer arial over user's sans-serif font
...
The default *sans-serif* font from the browsers most often renders much better
compared to Arial font.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-27 17:37:15 +02:00
e8ed56251a
[build] /static
2021-09-27 13:47:00 +02:00
f81afed60b
[fix] backtotop and pagination on image result page
2021-09-27 13:46:40 +02:00
8268873701
[fix] several issues in the simple theme
...
- using more rem in style and definitions
- mobile width in preferences.less fix max-width: 75em to 80em (normalized with
style.less and other)
- do not display #backToTop position on tablet (when max-width: 80em)
- fix answer box on mobile (when max-width: 50em)
2021-09-27 13:17:17 +02:00
b6ae1f1c7a
[theme] margin around checkboxes is bigger now, index centers the search more and the pref, stats and about page have a max-width now
2021-09-27 12:26:54 +02:00
859179f0c9
[theme] optimize switching between different device types
2021-09-27 12:26:54 +02:00
385dce213b
[theme] cleanup grid layout and remove various margins and paddings from elements
2021-09-27 12:26:54 +02:00
cc3c54f4cd
simple theme: update
2021-09-27 12:26:54 +02:00
88c17d106d
[fix] make selected tabs not change wifth anymore compared to not being selected
2021-09-27 12:26:54 +02:00
b046322c7b
Merge pull request #333 from dalf/enh-engine-descriptions
...
RFC: /preferences: display engine descriptions
2021-09-25 11:29:25 +02:00
0c3314b338
Merge pull request #344 from dalf/osm-lang-all-fix
...
[fix] openstreetmap engine: map "all" language to English
2021-09-25 11:29:13 +02:00
ab569c1e12
[fix] openstreetmap engine: optmizer SPARQL query
...
add
hint:Query hint:optimizer "None".
to the SPARQL query to keep the response time small.
It tells the optimizer to follow the path from ?item to the different property values
instead of the other way around.
See https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/query_optimization#Property_paths
2021-09-25 11:16:22 +02:00
39876d9f14
[build] /static
2021-09-24 20:38:56 +02:00
2f1384f198
[enh] themes: display the engine descriptions
2021-09-24 20:38:05 +02:00
bfd24d1226
[mod] add /engine_descriptions.json endpoint
...
returns engine descriptions (JSON):
* key: engine name
* value: description in the user locale, use English description as a fallback
2021-09-24 20:20:30 +02:00
8961131497
[fix] fix the about section of some engines
2021-09-24 20:20:30 +02:00
6f11b61cd5
[fix] openstreetmap engine: map "all" language to English
2021-09-24 20:12:18 +02:00
3017227c14
[preferences] remove checkbox class from query section
2021-09-24 19:14:35 +02:00
30a9146bdc
[build] /static
2021-09-24 18:02:07 +02:00
7cb5099c88
[preferences] make elements in query selecter align left
2021-09-24 18:01:20 +02:00
d24bcbb6f0
[preferences] reorder tabs in simple to match oscar theme
2021-09-24 16:21:43 +02:00
45eb2b5637
[preferences] cleanup whitespaces
2021-09-24 16:15:26 +02:00
2d26ace265
[preferences] add special queries tab to preferences
2021-09-24 16:04:10 +02:00
fa95cd91a8
[build] /static
2021-09-22 21:44:35 +02:00
79351c2e4d
[fix] searx.js null pointer exception when category div is missing
2021-09-22 21:41:19 +02:00
12c90a1b47
Merge pull request #336 from MrPaulBlack/simple-search-form
...
[theme] remove categories, language and time range from index.html
2021-09-22 18:20:33 +02:00
575483ad2a
[theme] add newline at the end of the file
2021-09-21 00:12:39 +02:00
880fe67172
[theme] remove categories, language and time range from index
2021-09-21 00:10:12 +02:00
e8e81c7432
[build] /static
2021-09-19 22:01:19 +02:00
2cc6301c98
[fix] Oscar theme: fix input field on Safari
...
close #323
2021-09-19 22:00:59 +02:00
1bc50c1eb4
[translations] update
...
3834942d
2021-09-17 13:50:32 +00:00
dc74df3a55
Merge pull request #261 from dalf/upgrade_httpx
...
[upd] upgrade httpx 0.19.0
2021-09-17 11:48:37 +02:00
443bf35e09
[pylint] fix global-variable-not-assigned issues
...
If there is no write access, there is no need for global. Remove global
statement if there is no assignment.
global-variable-not-assigned:
Using global for names but no assignment is done Used when a variable is
defined through the "global" statement but no assignment to this variable is
done.
In Pylint 2.11 the global-variable-not-assigned checker now catches global
variables that are never reassigned in a local scope and catches (reassigned)
functions [1][2]
[1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html
[2] https://github.com/PyCQA/pylint/issues/1375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-17 10:14:27 +02:00
41f6359d06
[fix] error recorder: avoid RuntimeError on some rare occasion
...
httpx.RequestError (subclass of httpx.HTTPError) has a property request.
This property raises a RuntimeError if the attributes _request is None.
To avoid a cascade of errors, this commit reads directly the _request attribute.
2021-09-17 10:06:24 +02:00
b10403d3a1
[mod] searx.network: remove redundant code
...
searx.client.new_client: the proxies parameter is a dictonnary,
and the protocol (key of the dictionnary) is already normalized
(see usage of searx.network.network.PROXY_PATTERN_MAPPING)
2021-09-17 10:06:24 +02:00
8e73438cbe
[upd] upgrade httpx 0.19.0
...
adjust searx.network module to the new internal API
see https://github.com/encode/httpx/pull/1522
2021-09-17 10:06:22 +02:00
602cbc2c99
Merge pull request #297 from dalf/engine-logger-enh
...
debug mode: more readable logging
2021-09-14 07:06:28 +02:00
de5a8ee7d7
[fix] settings - displayed name is SearXNG
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-13 14:36:24 +02:00
97acedd9fe
Merge pull request #305 from dalf/fix-engine-logger
...
[fix] logger per engine: make .logger is always initialized
2021-09-13 07:03:37 +00:00
f8793fbda0
[fix] logger per engine: make .logger is always initialized
...
the openstreetmap engine imports code from the wikidata engine.
before this commit, specific code make sure to copy the logger variable to the wikidata engine.
with this commit searx.engines.load_engine makes sure the .logger is initialized.
The implementation scans sys.modules for module name starting with searx.engines.
2021-09-13 08:47:59 +02:00
644ccf16be
[theme] make engine stats clickable
2021-09-12 10:52:15 +02:00
48d4296caa
[theme] link to engine stats in footer
2021-09-12 10:37:21 +02:00
ecd6ca86d0
Merge pull request #308 from dalf/plugin_hostname_replace
...
[enh] add hostname_replace plugin
2021-09-12 07:53:09 +00:00
0f43b39eac
[enh] add hostname_replace plugin
...
* backport of https://github.com/searx/searx/pull/2724
* allow to remove result if the replacement is the boolean value false
2021-09-11 13:23:06 +02:00
2b53d718e4
[fix] PR #257 : use the image_proxy network instead of the default network
2021-09-11 11:15:51 +02:00
6abc37efc7
[mod] production mode: make sure to set the log level to WARNING
...
set:
* the root logger level to WARNING
* the werkzeug logger level to WARNING (useful when there is no uwsgi)
2021-09-11 10:13:16 +02:00
0e42db9da1
[mod] xpath engine: remove logging of the requested URL
2021-09-11 10:13:16 +02:00
91a6d80e82
[mod] debug mode: log HTTP requests with network name
...
For example wikipedia requests use the logger name "searx.network.wikipedia"
Log is disable when searx_debug is False
2021-09-11 10:13:14 +02:00
577998106a
[mod] debug mode: use coloredlogs package
...
in debug mode, add some padding to make the output more readable
in procution mode, add the timestamp
2021-09-10 21:49:34 +02:00
b513917ef9
[mod] searx.metrics & searx.search: use the engine loggers
...
metrics & processors use the engine logger
2021-09-10 21:49:34 +02:00
d9658a7f91
[fix] searx/results.py: strip result['content'] only if it exists
...
fix PR #302
2021-09-10 17:58:19 +02:00
b671e0364f
Merge pull request #302 from dalf/mod_plugin_on_result
...
[mod] plugin: call on_result for each result of each engines.
2021-09-10 09:20:26 +00:00
0b27c8698f
[doc] update docs/dev/plugins.rst
2021-09-10 10:58:22 +02:00
70c9bb6f2c
[fix] remove references to transifex
2021-09-09 21:29:55 +02:00
b941763e20
[mod] ahmia_filter: use on_result instead of post_search
...
see commit 6c9ae7911e9639bc46cd53af215734b4bdb61ba9
2021-09-09 11:31:46 +02:00
660c180170
[mod] plugin: call on_result after each engine from the ResultContainer
...
Currently, searx.search.Search calls on_result once the engine results have been merged
(ResultContainer.order_results).
on_result plugins can rewrite the results: once the URL(s) are modified, even they can be merged,
it won't be the case since ResultContainer.order_results has already be called.
This commit call on_result inside for each result of each engines.
In addition the on_result function can return False to remove the result.
Note: the on_result function now run on the engine thread instead of the Flask thread.
2021-09-09 11:31:44 +02:00
fc20c561bf
[mod] oa_doi_rewrite plugin: get_doi_resolver: remove args parameter
...
doi_resolvers.get_value('preferences') already contains the value from
request.args.get('doi_resolver')
2021-09-07 19:14:36 +02:00
a3789b3bb4
Merge pull request #295 from return42/fix-csp-2
...
[fix] make HTML templates more CSP compliant
2021-09-07 18:51:00 +02:00
b0623ac9f6
[build] /static
2021-09-07 17:48:56 +02:00
0240ca9567
[fix] oscar template - merge the two class attributes into one
...
Suggested-by: @dalf https://github.com/searxng/searxng/pull/295#discussion_r703337237
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 16:46:49 +02:00
bd830f7449
[fix] simple theme - preferences: fix tooltip overflow
...
Suggested-by: @dalf https://github.com/searxng/searxng/pull/295#discussion_r703370358
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 16:46:49 +02:00
2a3b9a2e26
[pylint] searx: drop no longer needed 'missing-function-docstring'
...
Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914168470
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 13:34:35 +02:00
f0059b80ed
[pylint] engines: drop no longer needed 'missing-function-docstring'
...
Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914168470
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 13:26:59 +02:00
9068a72c6a
[fix] oscar theme - preferences: rename col-checkbox/col-stat
...
[1] https://github.com/searxng/searxng/pull/295#discussion_r703318053
[2] https://github.com/searxng/searxng/pull/295#discussion_r703337237
Suggested-by: @dalf [1] [2]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 12:26:07 +02:00
82847df300
[fix] add 'categories' to PYLINT_ADDITIONAL_BUILTINS_FOR_ENGINES
...
androp no longer needed (see line 591 in 7b235a1https://github.com/searxng/searxng/issues/102#issuecomment-914068609
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 10:29:38 +02:00
cd033b5416
[fix] drop useless pylint: disable=undefined-variable
...
Since 7b235a1https://github.com/searxng/searxng/issues/102#issuecomment-914068609
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 10:26:15 +02:00
222031e975
[fix] make oscar theme more CSP compliant - col-checkbox
...
Add col-checkbox in::
searx/static/themes/oscar/src/less/preferences.less
Replaced style in file::
searx/templates/oscar/preferences.html
Reported-by: https://github.com/searxng/searxng/issues/57
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 08:24:48 +02:00
9d106ae972
[fix] make oscar theme more CSP compliant - default-image-style
...
Add default-image-style in::
searx/static/themes/oscar/src/less/result_templates.less
Replaced style= in files::
./oscar/result_templates/default.html:19: <img src="{{ image_proxify(result.img_src or result.thumbnail) }}" title="{{ result.title|striptags }}" style="width: auto; max-height: 60px; min-height: 60px;" class="col-xs-2 col-sm-4 col-md-4 result-content">
./oscar/result_templates/files.html:24:<img src="{{ image_proxify(result.img_src) }}" alt="{{ result.title|striptags }}" title="{{ result.title|striptags }}" style="width: auto; max-height: 60px; min-height: 60px;" class="col-xs-2 col-sm-4 col-md-4 result-content">
Reported-by: https://github.com/searxng/searxng/issues/57
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 08:20:30 +02:00
e564cef0fe
[fix] make /preferences more CSP compliant - simple & oscar theme
...
In simple & oscar theme remove ``style=`` properties which violates CSP but seem
not to have a magnification in GUI (UX).
Fixed files::
./oscar/preferences.html:25:<td class="{{ label }}" style="padding: 2px">{{- "" -}}
./simple/preferences.html:39:<td class="{{ label }}" style="padding: 2px; width: 13rem;">{{- "" -}}
./simple/preferences.html:77: <div class="engine-tooltip" style="right: 12rem;" role="tooltip" id="{{engine_name}}_reliability">
./simple/preferences.html:258: <p class="text-muted" style="margin:20px 0;">
Reported-by: https://github.com/searxng/searxng/issues/57
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07 08:20:30 +02:00
ea60c03827
[fix] fix openstreetmap engine
...
close #298
This is a workaround: inside engine code, any call to function in another engine can crash
since the logger won't be initialized except if it is done explicitly.
2021-09-06 22:44:22 +02:00
aecfb2300d
[mod] one logger per engine - drop obsolete logger.getChild
...
Remove the no longer needed `logger = logger.getChild(...)` from engines.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06 18:05:46 +02:00
7b235a1c36
[mod] one logger per engine
...
Suggested-by: @dalf in https://github.com/searxng/searxng/issues/98#issuecomment-849013518
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06 17:47:28 +02:00
0d070fde92
[build] /static
2021-09-06 11:12:17 +02:00
ad528c706e
[fix] make result template map more CSP compliant - simple & oscar
...
Add osm-map-box in::
searx/static/themes/__common__/less/result_templates.less
Replaced sty= in files::
./oscar/result_templates/map.html:64: <div style="height:300px; width:100%; margin: 10px 0;" id="osm-map-{{ index }}"></div>
./simple/result_templates/map.html:65: <div id="result-map-{{ index }}" class="invisible"><div id="osm-map-{{ index }}" style="height:300px; width:100%; margin: 10px 0;" ></div></div>
Reported-by: https://github.com/searxng/searxng/issues/57
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06 11:08:50 +02:00
48c806954e
[fix] make /preferences more CSP compliant - simple & oscar theme
...
in simple & oscar theme replace bar-graph's *styles* by CSP compliant
implementation in::
searx/static/themes/__common__/less/stats.less
Fixed files::
./oscar/preferences.html:29: <span style="width: calc(max(2px, 100%*{{ (stats[engine_name].time / max_rate95)|round(3) }}))" class="stacked-bar-chart-median"></span>{{- "" -}}
./oscar/preferences.html:30: <span style="width: calc(100%*{{ ((stats[engine_name].rate80 - stats[engine_name].time) / max_rate95)|round(3) }})" class="stacked-bar-chart-rate80"></span>{{- "" -}}
./oscar/preferences.html:31: <span style="width: calc(100%*{{ ((stats[engine_name].rate95 - stats[engine_name].rate80) / max_rate95)|round(3) }})" class="stacked-bar-chart-rate95"></span>{{- "" -}}
./simple/preferences.html:43: <span style="width: calc(max(2px, 100%*{{ (stats[engine_name].time / max_rate95)|round(3) }}))" class="stacked-bar-chart-median"></span>{{- "" -}}
./simple/preferences.html:44: <span style="width: calc(100%*{{ ((stats[engine_name].rate80 - stats[engine_name].time) / max_rate95)|round(3) }})" class="stacked-bar-chart-rate80"></span>{{- "" -}}
./simple/preferences.html:45: <span style="width: calc(100%*{{ ((stats[engine_name].rate95 - stats[engine_name].rate80) / max_rate95)|round(3) }})" class="stacked-bar-chart-rate95"></span>{{- "" -}}
Reported-by: https://github.com/searxng/searxng/issues/57
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06 11:08:50 +02:00
33ea1d5909
Merge pull request #289 from return42/fix-xpath
...
[fix] remove minimum length of content for XPath engine
2021-09-04 15:34:18 +02:00
39bbd15b39
Merge pull request #287 from return42/azlyrics
...
[enh] add engine AZLyrics.com (XPath)
2021-09-04 13:36:09 +02:00
9ff881f937
[fix] remove minimum length of content for XPath engine
...
Instead of raising an exception and therefore hiding all results of the engine.
It make sense to remove that requirement in order to allow the implementation of
search engines that do not always have a description. In fact some search
engines that in 99% of the case have a description like Brave Search or Mojeek
crash completely if they for some reason included a result with no description.
To test this patch try Mojeek:
!mjk xyz
before and after the patch.
Suggested-by: 0xhtml in https://github.com/searx/searx/discussions/2933
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-04 12:41:23 +02:00
730073b850
[enh] add suggestions to brave engine
...
Suggestions should be added too.
suggestion_xpath: //div[@class="text-gray h6"]/a
You can try it with:
!brave recurzuoin
Suggested-by: @allendema in https://github.com/searx/searx/issues/2857#issuecomment-904837023
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-04 11:38:59 +02:00
0648757e7f
[enh] add engine AZLyrics.com (XPath)
...
Upstream example query:
https://search.azlyrics.com/search.php?q=The+verbal+acupunture&w=lyrics&p=1
Cherry picked from [1] and slightly modified to pass yamllint test.
[1] https://github.com/allendema/searx/commit/8b6d5a0e5
Reviewed-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-04 10:58:34 +02:00
a5a0a4e106
[fix] Correct engine name in for Rumble
2021-09-04 10:22:26 +02:00
49bbd250d9
[fix] Update about section of Invidious
...
Another website and new documentation
2021-09-04 10:22:07 +02:00
ab4456b0d0
Merge pull request #281 from dalf/cleanup
...
Cleanup
2021-09-04 07:17:19 +00:00
df351937f4
[fix] typo in searx.webadapter.parse_lang
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-04 08:39:45 +02:00
3120c9ca79
[translations] update
...
4fd5bb5a
2021-09-03 07:16:39 +00:00
a14ea6396e
[mod] remove searx.raise_for_httperror
...
Not used anymore
2021-09-02 16:24:25 +02:00
a7d781c49d
[mod] remove remaining references to locales in settings.yml
...
see #247
2021-09-02 16:19:18 +02:00
3c377c0aa8
[mod] searx.webapp: code clean up
2021-09-02 16:16:20 +02:00
b9c73fb697
[mod] move searx/testing.py to the tests directory
...
move robot tests to tests.robot
manage calls "python -m tests.robot"
2021-09-02 16:01:34 +02:00
065b4dab56
Merge pull request #278 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2021-09-01 06:48:55 +00:00
a7a879181d
Merge pull request #279 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2021-09-01 06:46:29 +00:00
00a51fa17f
Merge pull request #280 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2021-09-01 06:44:22 +00:00
9e3113865d
Update searx.data - update_firefox_version.py
2021-09-01 06:23:44 +00:00
a45fc66e83
Update searx.data - update_currencies.py
2021-09-01 06:23:35 +00:00
44f7e1fcaa
Update searx.data - update_ahmia_blacklist.py
2021-09-01 06:23:20 +00:00
a556d0c1aa
Update searx.data - update_wikidata_units.py
2021-09-01 06:23:11 +00:00
37b3d8c33b
Merge pull request #276 from dalf/simple_eslint
...
Simple theme: eslint and bug fix
2021-08-31 16:13:47 +00:00
840a327564
Merge pull request #275 from koelle25/add-packagist
...
[enh] Add Packagist search engine
2021-08-31 16:05:24 +00:00
2b3687780c
[enh] Add Packagist search engine (JSON)
...
Packagist's API: https://packagist.org/apidoc
2021-08-31 17:59:34 +02:00
d246679dbe
[build] /static
2021-08-31 15:43:28 +02:00
f77f797f8c
[mod] simple theme: fix eslint errors, fix VIM keys
...
* VIM keys: fix the next page and previous pages (n, p keys)
* Map: Enable the wikipedia map (the layer was initialized but not included)
2021-08-31 15:41:31 +02:00
66a27757fd
Merge pull request #244 from return42/eslint-simple-client
...
[mod] simple theme - add ESLint
2021-08-31 13:24:06 +02:00
0ee316f3d1
eslint: grunt integration
2021-08-31 12:20:23 +02:00
2948a99b6e
[mod] simple theme - add ESLint
...
[1] https://eslint.org/
[2] https://eslint.org/docs/user-guide/configuring/
[3] https://eslint.org/docs/user-guide/command-line-interface
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-31 12:20:23 +02:00
7dc370efe9
[enh] new issue: include information from searx.version
2021-08-31 11:45:33 +02:00
1e942435be
Merge pull request #273 from searxng/dependabot/pip/master/pylint-2.10.2
...
Bump pylint from 2.9.6 to 2.10.2
2021-08-31 09:08:59 +00:00
03e7d423be
[pylint] Pylint 2.10 - unused-variable
...
Pylint 2.10 fixed [1]:
Fixed bug with cell-var-from-loop checker: it no longer has false negatives
when both unused-variable and used-before-assignment are disabled.
[1] https://pylint.pycqa.org/en/latest/whatsnew/2.10.html
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-31 10:51:50 +02:00
e856b563dd
[pylint] Pylint 2.10 - unspecified-encoding
...
Pylint 2.10 added new default checks [1]:
unspecified-encoding:
Emitted when open() is called without specifying an encoding [2]
[1] https://pylint.pycqa.org/en/latest/whatsnew/2.10.html
[2] https://github.com/PyCQA/pylint/issues/3826
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-31 10:49:36 +02:00
b83c14cf6b
[pylint] Pylint 2.10 - fix use-list-literal & use-dict-literal
...
Pylint 2.10 added new default checks [1]:
use-list-literal
Emitted when list() is called with no arguments instead of using []
use-dict-literal
Emitted when dict() is called with no arguments instead of using {}
[1] https://pylint.pycqa.org/en/latest/whatsnew/2.10.html
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-31 10:40:29 +02:00
9e63e20c36
[translations] update
...
18fae6202e76843c172a1a884567065b59d9d5495f135b4191b3a32e0198ea116efc4b9fa263af1e713b07f70c7b7859408c85f9
2021-08-27 07:16:35 +00:00
697ebeddcc
[mod] searx.utils.dict_subset: rewrite with comprehension
2021-08-24 15:28:08 +02:00
3b0f70ed0f
[mod] /image_proxy: use HTTP/1 instead of HTTP/2
...
httpx: HTTP/2 is slow when a lot data is downloaded.
https://github.com/dalf/pyhttp-benchmark
also, the usage of HTTP/1 decreases the load average
2021-08-24 14:51:20 +02:00
43fcaa642a
[fix] image_proxy: always close the httpx respone
...
previously, when the content type was not an image and some other error,
the httpx response was not closed
2021-08-24 14:51:20 +02:00
df15c655f7
[mod] /image_proxy: don't decompress images
2021-08-24 14:51:20 +02:00
29b40338d6
Merge pull request #260 from dalf/mod_locale
...
[mod] searx.webapp.get_locale: read locale from the preferences
2021-08-22 16:07:21 +00:00
3d5e6e0abb
[enh] google: add filter=0 to Google engine for more results
...
backport from searx ( 23b3b56a06ef831af0a1b30a12c26ebd50e329bb )
2021-08-21 17:46:16 +02:00
eafa373cff
[translations] update
...
b25c9d58
2021-08-20 07:16:15 +00:00
8290f70e24
[fix] /config add missing GIT_BRANCH value
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-18 19:51:07 +02:00
02b6f0c370
[translations] update
...
fc3041a0fcc3732d894bd655
2021-08-17 08:47:59 +00:00
28ccf47ca4
[mod] searx.webapp.get_locale: read locale from the preferences
...
pre_request already set the locale.
2021-08-17 08:18:30 +02:00
a925254c3d
Merge pull request #258 from dalf/plugin_minor_change
...
[mod] plugins: minor change
2021-08-16 17:10:28 +02:00
2f363858b8
[fix] searx.search.checker.get_result() always return a dict
...
So checker_results['status'] == 'ok' is enough to check the checker result.
See searx/webapp.py, /preferences endpoint
2021-08-16 08:29:16 +02:00
Markus Heiser
searxng-bot
dependabot[bot]
MrPaulBlack
Alexandre Flament
Marc Abonce Seguin
Noémi Ványi
Paolo Basso
Paul Alcock
dalf
Allen
Kevin Köllmann