13b0c251c4
Merge pull request #2100 from nexryai/master
...
Add goo engine
2023-01-15 23:08:28 +01:00
99b5272d9a
A little fix and modified the testing for content highlight
2023-01-15 16:51:31 +01:00
0cedb1c6d8
Add search.suspended_times settings
...
Make suspended_time changeable in settings.yml
Allow different values to be set for different exceptions.
Co-authored-by: Alexandre Flament <alex@al-f.net>
2023-01-15 09:00:32 +00:00
6c421110b5
Perso branch - added cjk check and enclosement
2023-01-14 23:00:08 +00:00
3e5ea08504
[translations] update from Weblate
...
6a57ee0bb180a8108710174a529a2591a254bd01860c3fcec140fb52
2023-01-13 07:14:55 +00:00
4e7bb1bf9a
Add goo engine
2023-01-12 16:28:09 +09:00
7fc8d72889
[fix] bing: parsing result; check to see if the element contains links
...
This patch is to hardening the parsing of the bing response:
1. To fix [2087] check if the selected result item contains a link, otherwise
skip result item and continue in the result loop. Increment the result
pointer when a result has been added / the enumerate that counts for skipped
items is no longer valid when result items are skipped.
To test the bugfix use: ``!bi :all cerbot``
2. Limit the XPath selection of result items to direct children nodes (list
items ``li``) of the ordered list (``ol``).
To test the selector use: ``!bi :en pontiac aztek wiki``
.. in the result list you should find the wikipedia entry on top,
compare [2068]
[2087] https://github.com/searxng/searxng/issues/2087
[2068] https://github.com/searxng/searxng/issues/2068
2023-01-09 15:08:24 +01:00
cf4db4be37
[fix] Mojeek Xpath showing suggestions and searches + add lang support
2023-01-09 09:33:47 +01:00
54e63839db
Merge pull request #2088 from llmII/fix-suggestions
...
Fix #2083
2023-01-08 18:53:32 +01:00
9d6b048fba
[build] /static
2023-01-08 18:39:37 +01:00
33d97fd01a
Fix #2083
...
This changes the Suggestions to be a single column, not a wrapping row,
changing the input to be incapable of overflowing into visually adjacent
elements.
2023-01-08 10:44:58 -06:00
1407a055b2
[simple theme] set tab index for search page input field #1891
...
Previously it took five tab keypresses to reach search input field
on search results page. Now one tab press is enough.
2023-01-08 13:41:48 +03:00
9ee99423fe
[fix] Bing-Web engine: XPath to get the wikipedia result
...
Modify the XPath selector to get the wikipedia result plus small fixes.
About result content: especially with the Wikipedia result, we'd get several
paragraph elements, only the first paragraph would be taken and displayed on the
search result
2023-01-08 09:11:16 +01:00
4e355564d2
Merge pull request #1903 from LalleSX/patch-1
...
Added info about adding the enginge to the brownser
2023-01-07 15:03:12 +01:00
212acf7f7b
[mod] about page: add information about adding enginge to the brownser
2023-01-07 14:48:06 +01:00
4cd3be8964
[fix] indentation and line size of the the markdown files
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-01-07 14:46:31 +01:00
b2a80347e3
[build] /static
2023-01-07 11:53:51 +01:00
db70c262c3
Add flex-wrap to the list of engines
2023-01-07 11:53:05 +01:00
128b8c7f0a
Add HTTP Referer header to DuckDuckGo requests
...
closes #2080
2023-01-06 16:07:37 -06:00
b241015e93
Merge pull request #2078 from searxng/dependabot/pip/master/pygments-2.14.0
...
Bump pygments from 2.13.0 to 2.14.0
2023-01-06 08:40:46 +01:00
e9a7a6aea6
[build] /static
2023-01-06 08:35:52 +01:00
2420ab6fc3
[translations] update from Weblate
...
b1c60c5b891335484398061a9857916a0ba500780189e64824ded833
2023-01-06 07:14:08 +00:00
38c22c8c31
[translations] update from Weblate
...
ea56f7b60dbbb03181f33cb75ff824600ea6d8c3b19bb597904fa9abe7c7d624
2022-12-30 07:14:21 +00:00
0639769274
Update searx.data - update_firefox_version.py
2022-12-29 09:17:56 +01:00
174e6851b3
Merge pull request #2054 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-12-29 08:35:51 +01:00
d531f89316
Merge pull request #2057 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-12-29 08:31:19 +01:00
76cd808a49
Merge pull request #2053 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-12-29 08:28:19 +01:00
000734cb93
Update searx.data - update_engine_descriptions.py
2022-12-29 01:25:31 +00:00
36eea5b7cc
Update searx.data - update_currencies.py
2022-12-29 01:16:59 +00:00
66780efda7
Update searx.data - update_wikidata_units.py
2022-12-29 01:16:59 +00:00
de793fb71e
Update searx.data - update_ahmia_blacklist.py
2022-12-29 01:16:52 +00:00
0d4896170f
Merge pull request #2047 from dalf/fasttext-predict
...
Use fasttext-predict instead of fasttext(-wheel)
2022-12-26 20:50:09 +01:00
f3515041af
Lazy load fasttext-predict
2022-12-26 18:44:23 +00:00
dd125321e4
[translations] update from Weblate
...
7f3e72fd5d48e55656e67eb028e1abe1b19d55f7274f7ee9ab00649b
2022-12-23 07:14:39 +00:00
6804ff048d
Fix: add trailing slash to duckduckgo url
...
Close #1854
2022-12-22 07:49:58 -06:00
735e388cec
Merge branch 'master' into fasttext
2022-12-16 19:43:10 +00:00
1f8f8c1e91
Replace langdetect with fasttext
2022-12-16 21:07:39 +02:00
2a51c85672
Merge pull request #1974 from fehho/query-string-deserial
...
[fix] Deserialize preferences which are explicitly blank strings
2022-12-16 18:56:30 +01:00
03ce848e04
[translations] update from Weblate
...
4cf39daef67457cfdee211c29eeb4290
2022-12-16 07:15:19 +00:00
9e9f57e48b
Merge pull request #1954 from dalf/fix.redis.init.2
...
[fix] follow up of PR-1856
2022-12-14 07:08:19 +01:00
ed901ab18e
[mod] improve 'Autodetect search language' plugin
...
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model
Reosurces::
import fasttext # --> +10 MB
fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB
Suggested-by: @dalf
- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
libc) --> patch Dockerfile and build from fastetxt:
sed -i s/fasttext-wheel/fasttext/ requirements.txt
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-11 11:26:07 +01:00
9925a20950
[mod] new plugin: Autodetect search language
2022-12-10 13:11:47 +01:00
b971167ced
move searx.shared.redisdb to searx.redisdb
2022-12-10 09:26:38 +01:00
34e260f88f
[fix] follow up of PR-1856
...
- the environment variable SEARXNG_REDIS_URL overrides the setting value redis.url
- ./manage sets SEARXNG_REDIS_URL to unix:///usr/local/searxng-redis/run/redis.sock if:
- the socket exists
- SEARXNG_REDIS_URL is not already defined
Update of PR #1856
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-10 09:26:38 +01:00
759d53c892
[translations] update from Weblate
...
1b4600d0e3b49827975217cf
2022-12-09 07:15:14 +00:00
269326063a
Fix: don't crash when engine or name is missing in settings.yml
...
SearXNG crashes if the engine or name fields are missing.
With this commit, the app displays an error in the log and keeps loading.
Close #1951
2022-12-04 23:43:59 +01:00
f40d1c0004
[translations] update from Weblate
...
cc5cf5d897776fbfc3c9f988a1cf339e4429167c
2022-12-02 07:15:43 +00:00
e19218c6a9
Copy client connection kwargs before mutating
2022-11-29 12:15:18 +00:00
a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-11-29 07:48:26 +01:00
1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-11-29 07:47:52 +01:00
3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-11-29 07:46:49 +01:00
82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-11-29 07:45:51 +01:00
a508cdbd4b
Update searx.data - update_engine_descriptions.py
2022-11-29 01:34:42 +00:00
c4512cf64d
Update searx.data - update_ahmia_blacklist.py
2022-11-29 01:24:48 +00:00
b0b45fd2d0
Update searx.data - update_currencies.py
2022-11-29 01:24:39 +00:00
a9be73b4da
Update searx.data - update_wikidata_units.py
2022-11-29 01:24:38 +00:00
9fc72419e1
Update searx.data - update_firefox_version.py
2022-11-29 01:24:35 +00:00
981a2c9626
[translations] update from Weblate
...
c13727fc21f638f6b8ed9e1c
2022-11-25 07:16:11 +00:00
7cab51f98f
Deserialize explicitly blank strings
...
Default behavior of urllib.parse_qs is to discard blank values, causing a preference of none to be deserialized as undefined, using the instance default rather than the selected preference.
2022-11-24 13:14:12 -06:00
9d06115d07
[translations] update from Weblate
...
7569f2666418da9aacc0dc1a6c2beba6b49457e3
2022-11-19 16:21:15 +00:00
7a39952558
[translations] update from Weblate
...
f123be21fa2cfa8f
2022-11-18 07:17:51 +00:00
46ad32343a
Switch back to protobuf for raw HTML
2022-11-11 07:39:48 +00:00
78be4b4c70
Fix Google search engine.
...
- Fix broken links. Resolves #1794
- Fix missing results. Resolves #1829
2022-11-11 07:34:19 +01:00
408200c87e
[fix] disabling zlibrary due to z-lib.org domain seizure
2022-11-10 21:18:21 +01:00
ee4475ff4b
Merge pull request #1934 from dalf/fix_user_agent
...
User agent: don't include the patch number in the Firefox version
2022-11-09 06:50:33 +01:00
73b5a58d9e
[FIX] Redis initialization
...
redis.Redis.from_url(url) doesn't check if the url is valid
Before this commit: actual error are detected later when the client is actually used.
With this commit, client() makes sure to return a valid Redis client or None.
Also, the code makes sure not to log the password of the Redis URL
2022-11-07 22:08:32 +00:00
8f19bdaf17
Merge pull request #1882 from fehho/metacpan
...
Add MetaCPAN engine
2022-11-07 21:54:11 +01:00
fe351c2802
Add MetaCPAN engine
2022-11-07 08:07:06 -06:00
1517724615
Update network.py
2022-11-06 20:35:30 +01:00
2dc5c0e1d6
Merge pull request #1928 from searxng/translations_update
...
Update translations
2022-11-06 11:29:28 +01:00
4fe5463671
Merge pull request #1869 from vgerak/1836-ddg-weather
...
Fix floating point format in DDG weather humidity
2022-11-05 22:46:50 +01:00
d8dee21277
searx.locale: add Dhivehi language
2022-11-05 21:26:15 +00:00
20d951fc5c
searx.locales: improve support for languages not supported by babel
...
* refactor get_translations() to rely on ADDITIONAL_TRANSLATIONS and LOCALE_BEST_MATCH
* update RTL_LOCALES for languages in ADDITIONAL_TRANSLATIONS
2022-11-05 21:26:07 +00:00
e473addaff
User agent: don't include the patch number in the Firefox version
...
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2
Close #1914
2022-11-05 22:04:37 +01:00
e92755d358
Initialize Redis in searx/webapp.py
...
settings.yml:
* The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0
* The default URL is now "false"
The default URL makes the log difficult to deal with:
if the admin didn't install a Redis instance, the logs record a false error.
It worked before because SearXNG initialized the Redis connection when the limiter started.
In this commit, SearXNG initializes Redis in searx/webapp.py
so various components can use Redis without taking care of the initialization step.
2022-11-05 17:45:52 +01:00
fe419e355b
The checker requires Redis
...
Remove the abstraction in searx.shared.SharedDict.
Implement a basic and dedicated scheduler for the checker using a Redis script.
2022-11-05 12:04:50 +01:00
7438e48d13
[translations] update from Weblate
...
41ebf8e71de65e6afff11c22f677049febf69b4aa21b6221ac384800c4736fd41b967129
2022-11-04 07:18:35 +00:00
fc9986de0a
Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-10-29 08:22:43 +02:00
3f1d594c23
Merge pull request #1906 from searxng/update_data_update_external_bangs.py
...
Update searx.data - update_external_bangs.py
2022-10-29 08:21:33 +02:00
a9deead102
Merge pull request #1907 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-10-29 08:20:53 +02:00
d49ccb54ea
Merge pull request #1908 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-10-29 08:20:27 +02:00
fa59ff9b78
Merge pull request #1909 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-10-29 08:19:56 +02:00
e70589c598
Update searx.data - update_engine_descriptions.py
2022-10-29 01:56:57 +00:00
985a2a87a6
Update searx.data - update_currencies.py
2022-10-29 01:46:40 +00:00
c0ecc2f865
Update searx.data - update_wikidata_units.py
2022-10-29 01:46:38 +00:00
c24abc2f8c
Update searx.data - update_firefox_version.py
2022-10-29 01:46:34 +00:00
f0c7898445
Update searx.data - update_external_bangs.py
2022-10-29 01:46:27 +00:00
799c5270ae
Update searx.data - update_ahmia_blacklist.py
2022-10-29 01:46:24 +00:00
5a181ea1f5
Merge pull request #1901 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/svgo-3.0.0
...
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
2022-10-28 10:22:56 +02:00
d913f0d8aa
[build] /static
2022-10-28 10:17:56 +02:00
bc3db6fd16
[translations] update from Weblate
...
bf52cdbcfbb36c7618cc8a367314d2b6b25147b9d39ade65cb835cdc563f4e0ba698a2e9df5ce28155b369a33eddf243edd3871d5aab9f7b0b2cfe68732b7865d652c20f0bcaaa8d6fd87821618f213c30d38ee9a934ce3bb696c22e6ee1efe2
2022-10-28 07:18:50 +00:00
3cade9a7eb
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
...
Bumps [svgo](https://github.com/svg/svgo ) from 2.8.0 to 3.0.0.
- [Release notes](https://github.com/svg/svgo/releases )
- [Changelog](https://github.com/svg/svgo/blob/main/CHANGELOG-old.md )
- [Commits](https://github.com/svg/svgo/compare/v2.8.0...v3.0.0 )
---
updated-dependencies:
- dependency-name: svgo
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-10-28 07:13:58 +00:00
18ba8628dd
[translations] update from Weblate
...
c7fddee3f559a626fe7af6628a7c3da9a84dad5c9ee1ac8bb91bedc4dff99ef4cd639f6c49507a60ad30558219e9707597581f70fcd52cea
2022-10-21 07:32:09 +00:00
947b62c9d5
Fix floating point format in DDG weather humidity
...
Fixes #1836
2022-10-20 11:44:17 +03:00
035bc507ec
[fix] startpage engine
2022-10-14 18:27:53 +00:00
32e8c2cf09
searx.network: add "verify" option to the networks
...
Each network can define a verify option:
* false to disable certificate verification
* a path to existing certificate.
SearXNG uses SSL_CERT_FILE and SSL_CERT_DIR when they are defined
see https://www.python-httpx.org/environment_variables/#ssl_cert_file
2022-10-14 13:59:22 +00:00
6e86f33342
[translations] update from Weblate
...
eee3d5e2c4eb981827423f5b9e8b7f861203aa6a22c78af56a4776f8c00bdc7de5a39537e3fad460da5f0bc35704a98bf3ef3ebb620636c1767b3bb260d38c87
2022-10-14 07:38:20 +00:00
23d797ee6f
Update searx.data - update_osm_keys_tags.py
...
Patch was generated by::
./manage pyenv.cmd searxng_extra/update/update_osm_keys_tags.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-10-11 11:49:06 +02:00
325eadfd04
[translations] update from Weblate
...
70909b19acf1f0aa94ce447f59959050e27a5c792c05470f53644516
2022-10-07 07:30:33 +00:00
8d5653e60d
Merge branch 'searxng:master' into master
2022-09-30 23:06:54 +00:00
4fea4acea1
[translations] update from Weblate
...
fbac3535cf5d71b76dc351bd42daf1f8f5fb629f4e5f2c795131835f02055902716bd1d7768c8e43e8ad24c1a88c5f91fc70c33a
2022-09-30 07:43:45 +00:00
a7d693231c
Merge pull request #1819 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-09-29 16:03:34 +02:00
f3d25f9cef
Merge pull request #1821 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-09-29 16:02:57 +02:00
5060732486
Merge pull request #1818 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-09-29 16:02:02 +02:00
520a873ab4
Merge pull request #1820 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-09-29 16:01:31 +02:00
9cb792c0d6
Update searx.data - update_engine_descriptions.py
2022-09-29 02:22:00 +00:00
2d429ebd75
Update searx.data - update_wikidata_units.py
2022-09-29 02:13:02 +00:00
8fc3940448
Update searx.data - update_currencies.py
2022-09-29 02:12:54 +00:00
b7f4a3a207
Update searx.data - update_ahmia_blacklist.py
2022-09-29 02:12:48 +00:00
3153f0a795
Update searx.data - update_firefox_version.py
2022-09-29 02:12:48 +00:00
a3148e5115
Merge pull request #1814 from return42/fix-typos
...
[fix] typos / reported by @kianmeng in searx PR-3366
2022-09-28 09:22:02 +02:00
0e00af9c26
Merge pull request #1810 from return42/fix-1809
...
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
2022-09-28 09:20:03 +02:00
ba8959ad7c
[fix] typos / reported by @kianmeng in searx PR-3366
...
[PR-3366] https://github.com/searx/searx/pull/3366
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-27 18:32:14 +02:00
212c98c9f5
Merge branch 'searxng:master' into master
2022-09-27 14:03:12 +00:00
52023e3d6e
[fix] doc of the paper.html template (isbn, issn)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25 15:46:29 +02:00
0052887929
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
...
- fix issue reported #1809
- filter out `None` value from issn and isbn list
- add comments (from publicationName)
- add publisher
Closes: https://github.com/searxng/searxng/issues/1809
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25 15:25:55 +02:00
5832c70680
correct sci-hub links/ add `.ru` and remove other 3rd party domains.
2022-09-24 11:03:57 -04:00
e36b023508
[mod] core.ac.uk: add cetgory 'scientific publications'
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 16:16:22 +02:00
b424ee255e
[mod] paper.html: simplify template by using result_link macro
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 16:13:36 +02:00
bfd6f61849
Merge pull request #1804 from return42/fix-core.ac.uk
...
core.ac.uk: use paper.html template
2022-09-24 15:12:05 +02:00
16443d4f4a
[mod] core.ac.uk: try multiple ways to get url
...
If the url is not found, using:
* the DOI
* the downloadUrl
* the ARK id
2022-09-24 15:02:39 +02:00
3198c906af
[mod] paper.html: add links to doi resolver
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 14:19:51 +02:00
c76830d8a8
[mod] core.ac.uk: use paper.html template
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 13:19:33 +02:00
3ff2ad939d
[fix] ERROR searx.engines.core.ac.uk: list index out of range
...
Some result items from core.ac.uk do not have an URL::
Traceback (most recent call last):
File "searx/search/processors/online.py", line 154, in search
search_results = self._search_basic(query, params)
File "searx/search/processors/online.py", line 142, in _search_basic
return self.engine.response(response)
File "SearXNG/searx/engines/core.py", line 73, in response
'url': source['urls'][0].replace('http://', 'https://', 1),
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 13:19:33 +02:00
caebafdd06
[fix] typo in crossref settings: disable --> disabled
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 08:12:36 +02:00
d6446be38f
[mod] science category: various update of about PR 1705
2022-09-23 20:52:55 +02:00
fe43b6e821
[build] /static
2022-09-23 20:45:58 +02:00
e36f85b836
Science category: update the engines
...
* use the paper.html template
* fetch more data from the engines
* add crossref.py
2022-09-23 20:45:58 +02:00
593026ad9c
oa_doi_rewrite: add the doi to the result when it is found.
...
Currentty, when oa_doi_rewrite find a DOI in the result URL, it replace the URL.
In this commit, the plugin adds the key "doi" to the result,
so the paper.html can show it.
2022-09-23 20:45:58 +02:00
5ba831d6a8
Add paper.html result template
2022-09-23 20:45:58 +02:00
a96f503d7b
Add searx.webutils.searxng_format_date
...
* Move the datetime to str code from searx.webapp.search to searx.webutils.searxng_format_date
* When the month, day, hour, day and second are zero, the function returns only the year.
2022-09-23 20:45:58 +02:00
bef3984d03
Merge pull request #1728 from liimee/eng-ddw
...
add duckduckgo weather engine
2022-09-23 18:14:09 +02:00
d3fec1388c
Merge pull request #1624 from liimee/eng-wttr
...
Add wttr.in engine
2022-09-23 18:13:37 +02:00
ab6e1542ff
[translations] update from Weblate
...
55133802b9309bdf6da8db13c1edbd899795e5fe
2022-09-23 07:38:23 +00:00
1a7b6872b5
Merge pull request #1792 from unixfox/google-images-internal-api
...
use the internal API for google images
2022-09-21 19:50:38 +02:00
cf7ee67f71
[mod] google-images: slightly improvements of the engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-21 18:59:55 +02:00
8b40e68c56
[fix] wording: SearXNG is 'open' and not 'hackable'
...
The word "hackable" may arouse interest in programmers to participate in the
development, but it scares the ordinary user.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-21 17:10:35 +02:00
df5f8d0e8e
use the internal API for google images
2022-09-20 22:52:38 +02:00
dcf1d408a5
[fix] google-news: origin result does not have a content area
...
The google news are in a rework, the content area of a news item has been
removed.
Closes: https://github.com/searxng/searxng/issues/1790
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-20 20:18:43 +02:00
33b43763b9
Brave engine: fix BrotliDecoderDecompressStream error
2022-09-18 22:08:38 +00:00
fbf07237ff
[fix] and improve docs generated from source code.
...
Fix::
searx/locales.py:docstring of searx.locales.get_engine_locale:17: \
WARNING: Definition list ends without a blank line; unexpected unindent.
Improvement: don't show default values in the generated documentation whe it is
more a mess than a usefull information (`:meta hide-value:`).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-18 12:44:12 +02:00
b3708e4137
Merge pull request #1757 from LencoDigitexer/master
...
add yandex autocomplete
2022-09-17 13:17:00 +02:00
bc28091557
remove the print statement
2022-09-17 11:25:14 +03:00
2ee8e5eff2
[translations] update from Weblate
...
570c4f7d0ef09ea103f97e22caddaedcaddfb0c22872e3a6d2835b09
2022-09-16 07:30:31 +00:00
3f72a79088
add yandex to autocomplete backends settings
2022-09-09 23:50:58 +03:00
7b8d6015e3
add yandex autocompleter
2022-09-09 23:42:44 +03:00
eb3d185e66
Merge pull request #1755 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/sharp-0.31.0
...
Bump sharp from 0.30.7 to 0.31.0 in /searx/static/themes/simple
2022-09-09 10:40:38 +02:00
bf8ea2020f
[translations] update from Weblate
2022-09-09 07:26:09 +00:00
cbf65e8292
Bump sharp from 0.30.7 to 0.31.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.30.7 to 0.31.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.30.7...v0.31.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-09-09 07:11:11 +00:00
691c0ed6b9
Merge pull request #1743 from dalf/update_about_metrics
...
Update about the metrics
2022-09-04 11:29:28 +02:00
ad8ffd222c
[mod] option 'ui: cache_url:' to configure internet cache or archive
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-04 09:42:20 +02:00
dd0887be18
xpath engine: change raise_for_httperror to no_result_for_http_status
...
no_result_for_http_status contains a list of HTTP status.
These HTTP status are seen an empty result list.
In other cases an exception is thrown as usual.
Previously raise_for_httperror were ignoring all HTTP error,
which make defective engines invisible in the stats.
2022-09-04 09:07:28 +02:00
a15dfa5ee1
[fix] engine woxikon.de - don't raise exception on empty result list
...
Woxikon expects a word in German, so with query "foo" the site finds nothing and
respons a 404:
httpx.HTTPStatusError: Client error '404 Not Found' \
for url 'https://synonyme.woxikon.de/synonyme/foo.php '
[1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054
Closes: https://github.com/searxng/searxng/issues/1543
Suggested-by: @allendema [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-04 09:07:28 +02:00
8e9fb0b435
Merge pull request #1647 from return42/deepl-engine
...
[mod] add deepl translation engine
2022-09-02 14:09:22 +02:00
66f72a006f
template: when enable_metrics are disabled, hide the empty stats
...
when metrics are disabled:
* hide the link to /stats at the bottom of the pages
* in /preferences, hide the columns "Response time" and "Reliability"
2022-09-02 08:52:23 +00:00
94a28ebe53
Stats: display only the score per result, no anymore the score
2022-09-02 08:30:38 +00:00
9e84cf31a4
[translations] update from Weblate
...
9b3635db875cbf387b3b12a0e60b4544dc9c17a47307cf31ae642e6f8db6b9c9d74ef6923ddf8997303d0890
2022-09-02 07:25:26 +00:00
fcccf39030
Disable brave by default
...
Brave is too unstable and will often not work by default. As seen in many issues: https://github.com/searxng/searxng/issues?q=is%3Aissue++sort%3Aupdated-desc+brave+label%3Abug+
2022-08-31 15:47:56 +02:00
85b5293e40
simplify infobox result
2022-08-31 18:29:50 +07:00
12f7d4a46b
add duckduckgo weather engine
2022-08-31 17:29:32 +07:00
242db53118
Merge pull request #1708 from dalf/result_proxy_default_settings
...
settings.yml: set default values for result_proxy
2022-08-29 19:42:04 +02:00
a7bd2b47c2
Merge pull request #1712 from dalf/remove_searx_env_var
...
Remove usage of SEARX environment variables
2022-08-29 19:41:39 +02:00
13ef9cc125
Merge pull request #1720 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-08-29 07:09:04 +02:00
e9b564d066
Merge pull request #1722 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-08-29 07:08:26 +02:00
2b65502388
Merge pull request #1723 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-08-29 07:07:54 +02:00
55d04a089d
Merge pull request #1724 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-08-29 07:07:14 +02:00
4a96480bd5
Merge pull request #1721 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-08-29 07:06:39 +02:00
c2400a8677
Update searx.data - update_engine_descriptions.py
2022-08-29 02:17:55 +00:00
e8bf907eef
Update searx.data - update_firefox_version.py
2022-08-29 02:09:34 +00:00
915c0a2bc6
Update searx.data - update_languages.py
2022-08-29 02:09:27 +00:00
b1ccecbeb3
Update searx.data - update_wikidata_units.py
2022-08-29 02:09:17 +00:00
2e6d41fa24
Update searx.data - update_ahmia_blacklist.py
2022-08-29 02:09:09 +00:00
83fbc16908
Update searx.data - update_currencies.py
2022-08-29 02:09:09 +00:00
4adc9920e9
Remove usage of SEARX environment variables
2022-08-28 17:12:57 +00:00
341ad46303
settings.yml: set default values for result_proxy
...
* initialize result_proxy with searx/settings_defaults.py
* allow result_proxy.key to be a string
this commit supersedes #1522
2022-08-28 09:27:53 +00:00
8bdc6986a1
Merge pull request #1706 from dalf/fix-autocomplete-post
...
Fix: autocomplete with the POST method: url encode the user query
2022-08-28 09:14:47 +02:00
3be847149e
Merge pull request #1707 from dalf/fix-external-bang
...
External bang: bug fix: URL encode the query so "!!g 1+1" works as intended
2022-08-28 09:07:24 +02:00
2af1a6f547
External bang: bug fix: URL encode the query so "!!g 1+1" works as intended
2022-08-27 07:10:26 +00:00
268fa7e036
[build] /static
2022-08-27 06:52:20 +00:00
4a72a6b9fc
Theme: fix autocompletion with the POST method
...
With the POST method, autocomplete.js does not URL encode the values.
For example "1+1" is sent as "1+1" which is read as "1 1" since space are URL encoded with a plus.
There is no clean way to fix the bug since autocomplete.js seems abandoned.
The commit monkey patches the ajax function of autocomplete.js
Related to #1695
2022-08-27 06:48:30 +00:00
56000d5162
Merge pull request #1699 from liimee/eng-app-store
...
add apple app store engine
2022-08-27 07:43:23 +02:00
44bc94c36e
Merge pull request #1700 from liimee/eng-ddm
...
add apple maps engine
2022-08-27 07:36:16 +02:00
5057007270
remove thumbnail from results
2022-08-27 06:23:30 +07:00
525946d7dd
add poi's website and phone number, doesn't crash when there is no `displayMapRegion`, query the token on the first request
2022-08-27 06:17:58 +07:00
5284de9137
Merge pull request #1702 from tiekoetter/limiter-accept-encoding-handling
...
[mod] limiter plugin: Accept-Encoding handling
2022-08-26 11:54:12 +02:00
e5a25e51bf
[translations] update from Weblate
...
3e03429446a4dfd3d41463fd338b67160c9d7756b422a48044c9caa0a774721fd8a322d6
2022-08-26 07:24:01 +00:00
221740f76e
[mod] limiter plugin: Accept-Encoding handling
...
Only raise "suspicious Accept-Encoding" when both "gzip" and "deflate" are missing from Accept-Encoding.
Prevent Browsers which only implement one compression solution from being blocked by the limiter plugin.
Example Browser which is currently blocked: Lynx Browser (https://lynx.invisible-island.net )
2022-08-25 23:21:30 +02:00
5dce299b22
add apple maps engine
2022-08-25 17:05:40 +07:00
5a241e545e
Merge pull request #1688 from liimee/eng-9gag
...
Add 9gag engine
2022-08-25 09:32:52 +02:00
cef7bbab22
get the not cropped version of the thumbnail when the image height is not too important
2022-08-24 18:33:11 +07:00
78bff4618c
add safesearch support
2022-08-24 18:31:04 +07:00
bcae7ae4e3
add developer info as author
2022-08-24 17:50:38 +07:00
e5c1b64b1d
add the apple app store engine
...
The Apple App Store is the digital app distribution platform for iOS & iPadOS.
2022-08-24 17:27:36 +07:00
040e24f9ad
support playing videos directly
2022-08-24 16:48:31 +07:00
c2db7b2a66
[fix] Internal server error after changing UI language to BG
...
A placeholder has been translated to BG, issue was added 8 month ago, when BG
translation was added [1]
msgid "Compute {functions} of the arguments"
msgstr "Изчислете {функции} на аргументите"
The incorrect translation has been corrected here in the message files and on
weblate.
[1] https://weblate.bubu1.eu/translate/searxng/searxng/bg/?&offset=49#history
Closes: https://github.com/searxng/searxng/issues/1692
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-23 08:11:16 +02:00
79d06509c1
add tags as suggestions
2022-08-23 05:18:35 +07:00
d22f469010
use `invalid-name` instead of `C0103` for pylint
2022-08-22 18:27:35 +07:00
dd9127492f
add 9gag engine
...
9GAG is a social media website where users upload and share user-generated images and videos
2022-08-22 17:35:07 +07:00
e64cca8c3f
don't raise error when nothing was found
2022-08-22 17:04:29 +07:00
faa32d5773
fixed xpath selector for appropriate results
2022-08-21 20:08:00 +01:00
5ed40af3ba
Merge pull request #1661 from liimee/eng-tw
...
Add twitter engine
2022-08-21 15:21:18 +02:00
ee3c5e7752
Merge pull request #1666 from return42/harden-get_engine_locales
...
[fix] typo in get_engine_locale
2022-08-21 08:22:29 +02:00
77a0f33819
[fix] engine duden - don't raise exception on empty result list
...
Duden expects a word in German, so with query "amazing" the site finds nothing
and respons a 404:
httpx.HTTPStatusError: Client error '404 Not Found' for url\
'https://www.duden.de/suchen/dudenonline/amazing '
[1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054
Suggested-by: @allendema [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-20 08:41:03 +02:00
6f28a69f12
Merge pull request #1677 from searxng/dependabot/pip/master/pygments-2.13.0
...
Bump pygments from 2.12.0 to 2.13.0
2022-08-19 10:21:22 +02:00
299635fb8b
[build] /static
2022-08-19 10:01:25 +02:00
b08a779f2e
make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-19 10:00:50 +02:00
3478c0bc8b
[translations] update from Weblate
...
2b94abf3249c92f8a331870c5aca8ddc6e7d76a02a49e5f02d2cafa6adcf97ed
2022-08-19 07:18:58 +00:00
05851978cf
add explanation of token
2022-08-17 19:45:42 +07:00
c8acd4a3b6
add profile image to user results
2022-08-17 14:30:59 +07:00
b6fd7cd571
add thumbnail to results if available
2022-08-17 14:25:22 +07:00
de1e7d12f7
[fix] get_engine_locale: better approximation of 'en' is 'en-US'
...
Compared to `en-EN` the better approximation of 'en' is 'en-US'.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 15:45:07 +02:00
ac7776663b
[fix] typo in get_engine_locale
...
Due to a typo in get_engine_locale, a language selection like `!qw :de siemens`
did not work.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 14:35:09 +02:00
ef81d14ccf
[fix] harden get_engine_locale: handle UnknownLocaleError exceptions
...
When a user selects an unknown or invalid locale by using the search syntax:
!qw siemens :de-TW
Before this patch a UnknownLocaleError exception will be rasied:
```
Traceback (most recent call last):
File "SearXNG/searx/search/processors/online.py", line 154, in search
search_results = self._search_basic(query, params)
File "SearXNG/searx/search/processors/online.py", line 128, in _search_basic
self.engine.request(query, params)
File "SearXNG/searx/engines/qwant.py", line 98, in request
q_locale = get_engine_locale(params['language'], supported_languages, default='en_US')
File "SearXNG/searx/locales.py", line 216, in get_engine_locale
locale = babel.Locale.parse(searxng_locale, sep='-')
File "SearXNG/local/py3/lib/python3.8/site-packages/babel/core.py", line 330, in parse
raise UnknownLocaleError(input_id)
```
This patch implements a simple exception handling, since e.g. `de-TW` does not
exists `de` will be used to get engines locale. On invalid terms like `xy-XY`
the default will be returned.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 13:55:42 +02:00
27385e7898
[mod] qwant - add safesearch option
...
Closes: https://github.com/searxng/searxng/issues/1640
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:36:14 +02:00
6579d6d558
[fix] qwant - API error::locale must be one ..
...
The request function should not request a language (aka locale) that is not
supported by qwant. Select a locale like zh-TW ends in qwant's API error:
ERROR searx.engines.qwant news: exception : \
API error::locale must be one of the following values: \
en_gb, en_ie, en_us, en_ca, en_my, en_au, en_nz, de_de, de_ch, de_at, fr_fr, \
fr_be, fr_ch, fr_ca, fr_ad, fc_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx, \
es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_pt, pt_ad, \
nl_be, nl_nl
The existing searx.utils.match_language function is unsuitable for this purpose,
it is replaced by function searx.locales.get_engine_locale that is based on the
methods from the babel package.
The quant's _fetch_supported_languages function has been revised to filter out
languages 8aka locales) not supported by qwant.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:36:14 +02:00
9ae409a05a
[mod] add locale.get_engine_locale to get predictable results
...
The match_language function sometimes returns incorrect results which is why a
new function get_engine_locale is required.
A bugfix of the match_language is not easily possible, because there is almost
no documentation for it and already the call parameters are undefined. E.g. the
function processes values like the ones from yahoo::
"yahoo": [
"ar",
...
"zh_chs",
"zh_cht"
]
The get_engine_locale has been documented in detail, there is a clear
description of the assumptions as well as the requirements and approximation
rules (read doc-string for more details)::
Argument ``engine_locales`` is a python dict that maps *SearXNG locales* to
corresponding *engine locales*:
<engine>: {
# SearXNG string : engine-string
'ca-ES' : 'ca_ES',
'fr-BE' : 'fr_BE',
'fr-CA' : 'fr_CA',
'fr-CH' : 'fr_CH',
'fr' : 'fr_FR',
...
'pl-PL' : 'pl_PL',
'pt-PT' : 'pt_PT'
}
.. hint::
The *SearXNG locale* string has to be known by babel!
In the following you will find a comparison:
>>> import babel.languages
>>> from searx.utils import match_language
>>> from searx.locales import get_engine_locale
Assume we have an engine that supports the follwoing locales:
>>> lang_list = {
... "zh-CN": "zh_CN",
... "zh-HK": "zh_HK",
... "nl-BE": "nl_BE",
... "fr-CA": "fr_CA",
... }
Assumption:
A. When a user selects a language the results should be optimized according to
the selected language.
B. When user selects a language and a territory the results should be
optimized with first priority on territory and second on language.
----
Example: (Assumption A.)
A user selects region 'zh-TW' which should end in zh_HK
hint:
CN is 'Hans' and HK ('Hant') fits better to TW ('Hant')
>>> get_engine_locale('zh-TW', lang_list)
'zh_HK'
>>> lang_list[match_language('zh-TW', lang_list)]
'zh_CN'
----
Example: (Assumption A.)
A user selects only the language 'zh' which should end in CN
>>> get_engine_locale('zh', lang_list)
'zh_CN'
>>> lang_list[match_language('zh', lang_list)]
'zh_CN'
----
Example: (Assumption B.)
A user selects region 'fr-BE' which should end in nl-BE
hint:
priority should be on the territory the user selected. If the user
prefers 'fr' he will select 'fr' without a region tag.
>>> get_engine_locale('fr-BE', lang_list, default='unknown')
'nl_BE'
>>> match_language('fr-BE', lang_list, fallback='unknown')
'fr-CA'
----
Example: (Assumption A.)
A user selects only the language 'fr' which should end in fr_CA
>>> get_engine_locale('fr', lang_list)
'fr_CA'
>>> lang_list[match_language('fr', lang_list)]
'fr_CA'
----
The difference in priority on the territory is best shown with a engine that
supports the following locales:
>>> lang_list = {
... "fr-FR": "fr_FR",
... "fr-CA": "fr_CA",
... "en-GB": "en_GB",
... "nl-BE": "nl_BE",
... }
----
Example: (Assumption A.)
A user selects only a language
>>> get_engine_locale('en', lang_list)
'en_GB'
>>> match_language('en', lang_list)
'en-GB'
hint: the engine supports fr_FR and fr_CA since no territory is given, fr_FR
takes priority ..
>>> get_engine_locale('fr', lang_list)
'fr_FR'
>>> lang_list[match_language('fr', lang_list)]
'fr_FR'
----
Example: (Assumption B.)
A user selects region 'fr-BE' which should end in nl-BE
>>> get_engine_locale('fr-BE', lang_list)
'nl_BE'
>>> lang_list[match_language('fr-BE', lang_list)]
'fr_FR'
----
If the user selects a language and there are two locales like the following:
>>> lang_list = {
... "fr-BE": "fr_BE",
... "fr-CH": "fr_CH",
... }
>>>
>>> get_engine_locale('fr', lang_list)
'fr_BE'
>>> lang_list[match_language('fr', lang_list)]
'fr_BE'
Looks like both functions return the same value, but match_language depends on the
order of the dictionary (which is not predictable):
>>> lang_list = {
... "fr-CH": "fr_CH",
... "fr-BE": "fr_BE",
... }
>>> get_engine_locale('fr', lang_list)
'fr_BE'
>>> lang_list[match_language('fr', lang_list)]
'fr_CH'
>>>
The get_engine_locale selects the locale by looking at the "population percent"
and this percentage has an higher amount in BE (68.%) compared to CH (21%)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:35:55 +02:00
75bb8c45d0
[mod] decouple qwant's categories from SearXNG's categories
...
By using new property `qwant_categ:` the category of qwant is no longer bound to
the category of SearXNG.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:26:54 +02:00
96ea355a1f
add twitter engine
2022-08-14 08:39:41 +07:00
0043190643
Merge pull request #1655 from return42/fix-opensearch
...
[fix] improve OpenSearch description
2022-08-13 12:36:34 +02:00
b56848e8d0
Merge pull request #1660 from liimee/eng-neeva
...
Add neeva engine
2022-08-13 02:53:27 +02:00
8fa84ee9f4
Fix time range support and add soft_max_redirects
...
Add custom time_range_url and time_range_map
Set soft_max_redirects = 2 to prevent "ErrorContext('searx/search/processors/online.py', 116, 'count_error(', None, '2 redirects, maximum: 0', ('200', 'OK', 'neeva.com')) True"
2022-08-13 07:35:15 +07:00
d6dfada1a9
add neeva web engine
...
Neeva is "the world's first ad-free, private search engine" and uses data from Apple, Bing, Yelp and "others".
They claim to crawl "hundreds of millions" of URLs a day (https://twitter.com/Neeva/status/1536447373903335426 ).
2022-08-13 07:26:36 +07:00
b4fea007f5
[translations] update from Weblate
...
f2997bfaeeca674f7478de6ac4fb9110a5b432e2eb01d415f96eb06ee7c79191f4dbd424
2022-08-12 07:18:14 +00:00
3b0f9c07b2
[fix] improve OpenSearch description
...
Some HTTP-Clients do have issues with the ``opensearch.xml`` from SearXNG
(related [1][2]) while other OpenSearch descriptions[3] (e.g. from qwant) work
flawles.
Inspired by the OpenSearch description from qwant and with informations from the
specification[4] the ``opensearch.xml`` has been *improved*.
- convert `<Url>` methods from lower case to upper case (`POST`|`GET`)
- add `<moz:SearchForm>` and `xmlns:moz="http://www.mozilla.org/2006/browser/search/ "`
- add `<Query role="example" searchTerms="SearXNG" />` [4]
OpenSearch description documents should include at least one Query element of
`role="example"` that is expected to return search results. Search clients may
use this example query to validate that the search engine is working properly.
- modified `<LongName>` to SearXNG
- modified `<Description>` the word 'hackable' scares uninitiated users and was removed
- add the `type="image/png"` to `<Image>`
Test can be done by::
make run
Visit http://127.0.0.1:8888/ and add the search engine to your WEB-Browser /
test with different WEB-Browser from desktop and Smartphones (are there any iOS
user here, please test on Safari and Chrome).
[1] https://app.element.io/#/room/#searxng:matrix.org/$xN_abdKhNqUlgXRBrb_9F3pqOxnSzGQ1TG0s0G9hQVw
[2] https://github.com/searxng/searxng/issues/431
[3] https://developer.mozilla.org/en-US/docs/Web/OpenSearch
[4] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#the-query-element
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-11 19:04:36 +02:00
73ffa0c070
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10 21:48:34 +02:00
e0215e0cc8
add sourcehut engine
2022-08-10 21:48:12 +02:00
43c545910b
Merge pull request #1648 from unixfox/google_mobile_ui_parameter
...
output format protobuf to HTML for google mobile
2022-08-10 20:50:45 +02:00
eb02cc77c5
[fix] google - simplify XPath selectors to fetch more results
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10 18:55:31 +02:00
90bdb23756
add lib.rs engine
2022-08-10 12:17:55 +02:00
b9f16a77db
output format protobuf to HTML for google mobile
2022-08-10 09:36:06 +00:00
d4acbcfe63
[mod] add deepl translation engine
...
This implements the Deepl Translation engine. It works nearly like lingva but
directly to the deepl API. This api only needs a to-lang, from-lang is a fake
by now.
There is a free option to use [1].
[1] https://www.deepl.com/pro-api?cta=header-pro-api for registering a free account.
2022-08-10 09:14:36 +02:00
24210fb10b
Revert PR #1633
...
This reverts the changes made to the Google results XPath in PR #1633 .
2022-08-10 03:41:39 +02:00
94b3656b4a
[fix] google engine: results XPath
...
Seems google rolls out changes first on the `google.com` domain and later on the
"language" domains. By example: yesterday [1] `google.com` did not work but
`google.de` and `google.fr` did work, today they do not work any longer and this
fix is needed on all domains.
Closes: https://github.com/searxng/searxng/issues/1628
[1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-09 06:23:59 +02:00
925f3ff487
Merge pull request #1627 from allendema/add-marginalia
...
[enh] Initial Marginalia.nu support (foss)
2022-08-08 06:53:02 +02:00
58f630d312
Merge pull request #1623 from return42/mod-yep.com
...
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08 06:52:15 +02:00
5b815b3966
[enh] initial Marginalia.nu support (foss)
...
Currently it uses a public api_key `/public/` [1]
The 'index' parameter selects the search index, corresponding to the drop down
next to the search field in the main GUI.
0: popular
1: blogs
2: big_sites
3: default
4: experimental
'experimental' is more up to date and does not exclude other sites, which is the
case with 'big sites' or 'blogs'.
[1] https://api.marginalia.nu/
[2] https://git.marginalia.nu/marginalia/marginalia.nu
[3] https://news.ycombinator.com/item?id=31536626
Closes: https://github.com/searxng/searxng/issues/1620
2022-08-08 06:31:04 +02:00
8b58cd1167
[fix] typo in uWSGI cache: searxcache --> searxngcache
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-07 12:31:09 +02:00
8c318562e2
add description and wikidata ID to wttr.in engine
2022-08-07 14:57:10 +07:00
8aa018db95
add wttr.in engine
2022-08-07 13:04:18 +07:00
647e6187d7
[mod] engine yep.com: show all 100 results yep.com has
...
yep.com is still in beta, the api.yep.com does not have paging support. There
is only a 'limit' argument with a maximum of 100 results.
yep.com seems fast; there is nor need for a timeout of 12 sec.
The API returns JSON nevertheless what the HTTP header is, the "show more"
button on yep.com's web site does not set a special HTTP Accept header.
FYI: The index does not support languages, the WEB UI does not offer a language
selection of the results and the entire index seems in English.
Closes: https://github.com/searxng/searxng/issues/1619
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-06 13:21:28 +02:00
0f02fcc836
[translations] update from Weblate
...
acf8bd394ad75b6eee8cbee687c19313cbe0de3245029a176eec3795f8d8f31fb3fb365faaeabbc96c71c501f7b5ba19850e7fa00cb696fc04c3785fb500f2ad0b576b830adeb6e20b025f17
2022-08-05 07:18:24 +00:00
58369e41d6
[wip] brave time range support
2022-08-04 04:47:25 +02:00
8df1f0c47e
[mod] add 'Accept-Language' HTTP header to online processores
...
Most engines that support languages (and regions) use the Accept-Language from
the WEB browser to build a response that fits to the language (and region).
- add new engine option: send_accept_language_header
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 17:01:59 +02:00
a2badb4fe4
[doc] add description of method EngineProcessor.get_params()
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 16:42:33 +02:00
2babf59adc
[fix] pyright repported errors
...
The errors make pyright usage useless since a new error won't be seen [1].
[1] https://github.com/searxng/searxng/pull/1569
```
searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]"
"Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]"
Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues)
searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str"
Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues)
searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int"
Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues)
searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['themes']" cannot be assigned to type "BytesPath"
"Literal['themes']" is incompatible with "bytes"
"Literal['themes']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "str | Any | None" cannot be assigned to type "BytesPath"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['img']" cannot be assigned to type "BytesPath"
"Literal['img']" is incompatible with "bytes"
"Literal['img']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports)
searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports)
searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource)
searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable)
searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable)
searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown
Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType)
searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
```
2022-07-30 18:04:44 +02:00
782f73540e
[utils/searxng.sh] implement new script to install SearXNG
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30 13:39:35 +02:00
953aaec6a3
[translations] update from Weblate
...
c0c9107c5b48bce679669e65520e92847cf52ff59d3ebe722d03c097388af012a4bcf09893fd0b728f68b2069007c99caeec96f269084863b48190abb6bbc0a51a503806c960cb938a2bd34b1064cea06742304556c87fda36a64f1c
2022-07-29 07:17:55 +00:00
14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-07-29 07:23:02 +02:00
7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-07-29 07:22:12 +02:00
0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-07-29 07:21:06 +02:00
7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-07-29 07:20:28 +02:00
2bdb367e8c
Update searx.data - update_engine_descriptions.py
2022-07-29 02:13:07 +00:00
fc019fb296
Update searx.data - update_currencies.py
2022-07-29 02:01:30 +00:00
c2662ec3c8
Update searx.data - update_firefox_version.py
2022-07-29 02:01:08 +00:00
385542e6c5
Update searx.data - update_ahmia_blacklist.py
2022-07-29 02:01:04 +00:00
90068b3d0b
Update searx.data - update_languages.py
2022-07-29 02:00:53 +00:00
c72d70d45c
Revert "Quick fix for google engine for EU countries"
...
This reverts commit 747cf1a246
2022-07-26 06:39:44 +02:00
950f036c03
[fix] google engine: results XPath
2022-07-26 00:24:15 +02:00
747cf1a246
Quick fix for google engine for EU countries
...
This revert part of the commit of 5fb2071cb2
2022-07-25 20:48:50 +00:00
0be0e63117
[fix] demo_online.py - fixed typo
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25 20:04:00 +02:00
5fb2071cb2
[fix] google & youtube - set EU consent cookie
...
This change the previous bypass method for Google consent using
``ucbcb=1`` (6face215b8https://www.google.com/search?q=time&tbm=isch " \
-A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \
| grep -i consent
...
location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1
set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure
...
PENDING & YES [2]:
Google change the way for consent about YouTube cookies agreement in EU
countries. Instead of showing a popup in the website, YouTube redirects the
user to a new webpage at consent.youtube.com domain ... Fix for this is to
put a cookie CONSENT with YES+ value for every YouTube request
[1] https://github.com/iv-org/invidious/pull/2207
[2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592
Closes: https://github.com/searxng/searxng/issues/1432
2022-07-25 13:27:06 +02:00
4231a5770b
[fix] sjp engine - convert enginename to a latin1 compliance name
...
The engine name is not only a *name* its also a identifier that is used in
logs, HTTP headers and more. Unicode characters in the name of an engine could
cause various issues.
Closes: https://github.com/searxng/searxng/issues/1544
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24 21:10:55 +02:00
2516e21c58
[fix] emojipedia - update XPath to be relative
2022-07-24 19:14:26 +02:00
1540891561
[fix] engine tineye: handle 422 response of not supported img format
...
Closes: https://github.com/searxng/searxng/issues/1449
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-23 16:00:58 +02:00
561433b12b
[translations] update from Weblate
...
cf6e9482918c1bfe4e65ecf6a54be8fecad6cb2fa6bd11709d0e8754
2022-07-22 07:20:00 +00:00
6d646129c3
[mod] add tor_check plugin - convenient tor checking trough searxng
2022-07-19 07:34:54 +02:00
d339e97727
[fix] preferences: missing option value
...
Fix missing option value "0".
2022-07-17 19:51:12 +02:00
7bf4e8d12d
Merge pull request #1512 from searxng/translations_update
...
Update translations
2022-07-15 09:45:03 +02:00
4e05197444
Merge pull request #1475 from return42/Emojipedia
...
[mod] Add engine for Emojipedia
2022-07-15 09:30:40 +02:00
445cba7c02
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-15 09:26:44 +02:00
10edcbe3c2
[mod] Add engine for Emojipedia
...
Emojipedia is an emoji reference website which documents the meaning and
common usage of emoji characters in the Unicode Standard. It is owned by Zedge
since 2021. Emojipedia is a voting member of The Unicode Consortium.[1]
Cherry picked from @james-still [2[3] and slightly modified to fit SearXNG's
quality gates.
[1] https://en.wikipedia.org/wiki/Emojipedia
[2] 2fc01eb20fhttps://github.com/searx/searx/pull/3278
2022-07-15 09:26:44 +02:00
f84e9f8154
[translations] update from Weblate
...
e78584e1eb3f21409160b6d118d569b8c9137f9e14d8b61fc11e318d4d53b3bb613117bfe5e383052bea37fa5ab1588132794ad3830b01f9b4d431e5c6d9841e686926568cba6d36fe45788695e7d403f02673b17d49be29fbe6e4da
2022-07-15 07:19:07 +00:00
8e509941b9
[mod] allow brand.issue_url to overwrite the step1 url
2022-07-10 18:43:53 +02:00
44f2eb50a5
Merge pull request #1219 from dalf/follow_bing_redirect
...
bing.py: remove redirection links
2022-07-10 18:06:22 +02:00
6face215b8
bypass google consent with ucbcb=1
2022-07-09 21:33:24 +00:00
84e2a3bd3f
Add infinite scroll as a setting in settings.yml
2022-07-09 17:33:25 +00:00
a1e8af0796
bing.py: resolve bing.com/ck/a redirections
...
add a new function searx.network.multi_requests to send multiple HTTP requests at once
2022-07-08 22:02:21 +02:00
7e695c6644
Merge pull request #1478 from dalf/submit_bug_workflow
...
Engine error log: Submit a new issue button: ask the user to check if there are some existing issues.
2022-07-08 20:24:00 +02:00
f90aed7ef9
locales.py: add support for Papiamento
2022-07-08 10:00:20 +02:00
cb3a31c04d
[translations] update from Weblate
...
b1809ae3cf09e8b25a854ba3e35864339465ae781e1799d056429ebbe1e040b1d04f51ef1a09e45afab4f6de782eac5c73f6dde9eb3bf7a45c3376168511391a816ec36424adf82f25e13dcff2008c3679b9b12a1f2f61c8e7a1cd6efc02ccbf3d1afa8895c871d2f8825dd1a781c97c7290ce9c0a1286c5baa49eef3d3fbc15a1eb8798a08b01a6356344468d1fe456805da3b0c6f02ceecd8246136a4b41ee53eb448a7012f64351ea1d58744d130ce92d37cd4576e883da7a9b10f20a317fcab15b1512d6021cc86a37389c6d05e22b6ca75155e9663c49fac625
2022-07-08 07:18:05 +00:00
be3ecf6e31
[build] /static
2022-07-08 09:04:57 +02:00
eb489c45ea
Submit GH bug: ask the user to do some checks before submitting a new issue
2022-07-08 09:04:57 +02:00
81e8c7370f
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 17:16:41 +02:00
c63fab6928
Merge pull request #1443 from return42/fix-online_dictionary
...
[fix] online_dictionary: regular expression
2022-07-07 16:25:10 +02:00
480476fdf3
[fix] online_dictionary: regular expression
...
The query term of a engine-type `online_dictionary` can consist of more than one
word.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 15:58:29 +02:00
df837d8b1b
Merge pull request #1428 from return42/fix-center_aligment
...
fix typo and document preference 'center_alignment' in the 'ui' section
2022-07-07 09:43:12 +02:00
c5ec8db6b3
Merge pull request #1457 from return42/fix-1435
...
[fix] engine z-zlibrary https URL
2022-07-06 13:44:08 +02:00
be2f782c9e
Merge pull request #1460 from unixfox/patch-1
...
Better explanation for the use of use_mobile_ui
2022-07-06 00:16:26 +02:00
63a995b8c1
Better explanation for the use of use_mobile_ui
2022-07-06 00:10:09 +02:00
38385e48cf
fix: return body on limiter block so there is not just a blank page
2022-07-05 22:57:26 +02:00
970a69012b
[fix] engine z-zlibrary https URL
...
before this patch:
DEBUG searx.engines.z-library : using base_url: https:https://de1lib.org
with this patch URL is fixed to:
DEBUG searx.engines.z-library : using base_url: https://de1lib.org
Closes: https://github.com/searxng/searxng/issues/1435
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-05 22:27:55 +02:00
8de0b62005
[build] /static
2022-07-04 19:06:45 +02:00
f8222eb2cd
[fix] style.less: move <dl> from infobox.attributes to .attributes class
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-04 19:06:45 +02:00
14756a2674
[mod] Adds Lingva translate engine
...
Add the lingva engine (which grabs data from google translate). Results from
Lingva are added to the infobox results.
2022-07-04 19:06:45 +02:00
61ee370e18
[mod] link to public-instances can be set to hidden
...
Some administrators may want to hide the link to public_instances: If you run a
private instance for a company that wants there employees to use the private
instance instead of any of the public instances.
2022-07-04 13:26:01 +02:00
241bde5ae3
[fix] typo: add missing 'n' in center_aligment --> center_alignment
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-03 17:35:54 +02:00
4ef6263725
Merge pull request #1404 from dalf/donation_use_external_link
...
Donation link: default value to searxng.org, can be hidden or custom
2022-07-02 17:18:05 +02:00
5831c15b49
[fix] engines/openstreetmap.py typo: user_langage --> user_language
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 16:51:25 +02:00
6716c6b0c3
openstreetmap engine: return the localized named.
...
For example: display "Tokyo" instead of "東京都" when the language is English.
2022-07-02 16:51:25 +02:00
7f30ac37e9
map.html: display the intended text for the links instead of the URL
...
For example display "Tokyo (en)" instead of https://en.wikipedia.org/wiki/Tokyo
2022-07-02 16:51:25 +02:00
Alexandre Flament
ahmad-alkadri
Léon Tiekötter
searxng-bot
nexryai
Milad-Laly
Markus Heiser
llmII
allixx
PrivateLalle
Rudis Muiznieks
dalf
ArtikusHG
Ryan Kaskel
fehho
Émilien Devos
ngosang
Ryan Draga
Alexandre FLAMENT
Evhorizon
dependabot[bot]
Vasilis Gerakaris
Mohamed Elashri
LencoDigitexer
ta
M Asenov
Johan Planchon
Thomas Renard
Brock Vojković
Allen
liimee
james-still
Solirs
Jay
Emilien Devos
mrpaulblack
Xavier horwood