fb32425d78
[mod] yacy engine: pick base_url randomly from a list of instances
...
Inspired by post [1] in the disscussion we had, while yacy.searchlab.eu was
broken.
[1] https://github.com/searxng/searxng/issues/3428#issuecomment-2101080101
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-09 17:29:15 +02:00
72be98e12f
[feat] plugins: new calculator plugin
2024-05-09 17:23:38 +02:00
742303d030
[mod] improve unit converter plugin
...
- l10n support: parse and format decimal numbers by babel
- ability to add additional units
- improved unit detection (symbols are not unique)
- support for alias units (0,010C to F --> 32,018 °F)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-09 17:16:31 +02:00
ac430a9eaf
Drop pytomlpp dependency for Python >= 3.11
...
Rely on tomllib for Python >= 3.11
2024-05-05 17:35:29 +02:00
dbed8da284
[fix] startpage engine: XPath expressions adapted for new HTML layout
...
Startpage has changed its HTML layout, classes like ``w-gl__result__main`` do no
longer exists and the result items have been slightly changed in their
structure.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-04 19:45:52 +02:00
d577817646
[fix] respect user preferences to open links in new tab for short answers
...
Previously only result urls were set to open in new tab by default, this should
make the behaviour consistent.
Also adds the missing rel="noreferrer" to the anchor tag. Although this should
not be needed as long as the `referrer-policy: no-referrer` header is set, it's
always nice to play safer than to have to say sorry. For example some reverse
proxy configurations might strip off unwhitelisted headers in which case it's
nice to have this set.
2024-05-04 06:55:37 +02:00
78077126f2
[feat] wikimedia commons: support for videos, audio and other files
2024-05-04 06:23:04 +02:00
46d7a8289b
[feat] engine: implementation of https://hex.pm
...
The package manager for the Erlang ecosystem Find packages.
Co-authored-by: Bnyro <82752168+Bnyro@users.noreply.github.com>
2024-05-03 21:37:37 +02:00
8225f88404
[l10n] update translations from Weblate
...
377c34a74079ba625bfe48c8a08e04560acc2fb6a2cfab374205ccd284cdd1d87edf2cb3f6971a077f88e23f2cc7e8506c1795e14ddd143bc6cf05d96b3d53b2cc8a6cd
2024-05-03 09:15:13 +02:00
11fe88bb40
[fix] update wikidata units - remove URL prefix from Q-name
...
Sometimes the URL prefix switches from a http to a https, this patch harden the
code that removes the URL prefix from wikidata Q-name, issue has been reported
in [1].
[1] https://github.com/searxng/searxng/pull/3437#issuecomment-2082121730
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-01 18:58:28 +02:00
c8d0b6529b
[feat] engine: implementation of searchmysite
2024-04-30 05:47:18 +02:00
f8bdf61976
[fix] yep engine: invcrease timeout from defaul 3sec to 5sec
...
In the "Engines" tab on searx.space [1] nearly all engines report a
TimeoutException: yep engine
As documented in issue #2444 [2], this problem can be fixed by increasing the
timeout. Note: on a local instance (`make run`) the timeout of 3sec was
sufficient / at least in my local test, but the balance of searx.space leads me
to believe that this tight timeout is usually not sufficient.
[1] https://searx.space/
[2] https://github.com/searxng/searxng/issues/2444
Closes https://github.com/searxng/searxng/issues/3421
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-30 05:46:15 +02:00
e45a7cc063
[data] update searx.data - update_engine_traits.py
2024-04-29 10:02:48 +02:00
c0b6c26eea
[data] update searx.data - update_firefox_version.py
2024-04-29 10:02:16 +02:00
0ec406cb7e
[data] update searx.data - update_ahmia_blacklist.py
2024-04-29 10:01:52 +02:00
ea585d4e77
[data] update searx.data - update_currencies.py
2024-04-29 09:48:56 +02:00
d4e98c03a0
[data] update searx.data - update_engine_descriptions.py
2024-04-29 09:46:26 +02:00
e6c345f890
[fix] ccc_media engine: filter video formats and ignore audio & SubRip
...
CCC media serves several recording formats, to name a few:
- application/x-subrip
- video/mp4
- video/webm
- audio/mpeg
- audio/opus
- audio/mpeg
not all of them are suitable for a video frame. If available we should prefer
video/mp4 due to its minimal data rates.
Closes: https://github.com/searxng/searxng/issues/3431
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-28 08:42:18 +02:00
ecee56533c
improve "search existing issues from github" link
2024-04-27 20:01:27 +02:00
11fdc2f56a
[fix] drop broken azlyrics XPath engine
...
Unfortunately, azlyrics has a bot blocker that makes it impossible to implement
an XPath engine for it [1][2].
[1] https://github.com/searxng/searxng/pull/3302#issuecomment-2013529271
[2] https://github.com/searxng/searxng/issues/3280
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-27 18:43:14 +02:00
648f43be1d
[build] /static
2024-04-27 18:26:23 +02:00
3ea278aff4
[feat] preferences: button to enable/disable all engines
2024-04-27 18:26:23 +02:00
46efb2f36d
[feat] plugins: new unit converter plugin
2024-04-27 18:11:33 +02:00
b3b1258e4e
[data] wikidata: update wikidata_units.json
2024-04-27 18:11:33 +02:00
d593055888
[fix] ionic.io/ionicons - add back missing class="ionicon"
...
Seems to me svg2jinja added the class in the past .. but no longer in new builds
/ this patch adds the class back by using addAttributesToSVGElement [1].
To test this patch use:
$ ./manage themes.simple
$ cat searx/templates/simple/icons.html
and check `class="ionicon"` is in the outer `<svg ..>` tags.
[1] https://svgo.dev/docs/plugins/add-attributes-to-svg-elements/
[2] https://ionic.io/ionicons
Closes: https://github.com/searxng/searxng/issues/3383
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-27 09:33:20 +02:00
42b58eb448
[feat] media.ccc.de: implement module with pagination and iframe
2024-04-27 08:55:26 +02:00
41f415aabf
[l10n] update translations from Weblate
...
f4861e2c3
2024-04-26 09:14:03 +02:00
ddaa6ed759
[fix] add missing localizable (gettext) messages to searxng.msg
...
To test this patch I used .. and checked the diff of the `messages.pot` file::
$ ./manage pyenv.cmd pybabel extract -F babel.cfg \
-o ./searx/translations/messages.pot searx/
$ git diff ./searx/translations/messages.pot
----
hint from @dalf: f-string are not supported [1] but there is no error [2].
[1] python-babel/babel#594
[2] python-babel/babel#715
Closes: https://github.com/searxng/searxng/issues/3412
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-26 07:34:32 +02:00
0a4280a137
[refactor] translation engines: add translate category
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-26 07:33:28 +02:00
91522f3801
[feat] engine: implementation of LibreTranslate
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-26 07:33:28 +02:00
af3be2b12b
[l10n] update translations from Weblate
...
b58f1136643b6019505cac16eaf88b5396d5515161ddc7f8e70b10247777e501b0c91d0ff7f160fd062cc9ce67131bec469bceb0dbec51330ae1879a2eb668b3c2827e5ba46f8672b58a3eff13a9c022ea424ea8188
2024-04-21 11:16:40 +02:00
644ae51417
[fix] yahoo: result titles are getting mixed together
2024-04-20 17:00:17 +02:00
5e4ab964b7
[feat] template: add apple-touch-icon in html header
...
* this makes it possible to add SearXNG to iOS devices homescreen with a proper icon
2024-04-18 12:34:17 +02:00
1746eecf2b
[fix] engine: youtube_api - ignore channels / prevent exceptions
...
`youtube_api.py` throws an exception if the search results contain a channel, as
channels have no videoId. This PR adds a keycheck for parsing the json response.
2024-04-13 08:41:00 +02:00
c92846dca8
[fix] dead URL in settings.yml
2024-04-13 07:03:45 +02:00
c8dca20548
[upd] npm: Bump eslint in /searx/static/themes/simple
...
Bumps [eslint](https://github.com/eslint/eslint ) from 8.57.0 to 9.0.0.
- [Release notes](https://github.com/eslint/eslint/releases )
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md )
- [Commits](https://github.com/eslint/eslint/compare/v8.57.0...v9.0.0 )
---
updated-dependencies:
- dependency-name: eslint
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-04-12 18:11:42 +02:00
6458490271
[mod] engine 'mwmbl: Update API URL
2024-04-10 06:51:28 +02:00
f1a148f53e
[fix] ddg engine: if no vqd value can be determined, don't save None
...
Closes: https://github.com/searxng/searxng/issues/3370
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 10:56:11 +02:00
bd6ff29f8f
[fix] remove usage of no longer existing names from lxml
...
In lxml 5.1.1 the private name `_ElementStringResult` in module `lxml.etree`
does no longer exists.
This code was written nearly a decade ago, its no longer clear what the
intention `_ElementStringResult` and `_ElementUnicodeResult` had been. It can be
assumed that these classes will no longer occur.
Closes: https://github.com/searxng/searxng/issues/3368
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 10:55:23 +02:00
26a92c1a8d
[fix] new builds of icons.html do miss class="ionicon"
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 09:38:18 +02:00
dddd628f48
[build] /static
2024-04-08 09:07:45 +02:00
9f5268b4a7
[enh] add keybindings for copying URLs
...
'y': for in Vim-mode (yank)
'c': for SearXNG-mode (copy)
This should help keyboard heavy users
2024-04-08 09:07:45 +02:00
4acb52f68f
[fix] even if limiter not activated, botdetection must be activated
...
Closes : #2975
Closes : #2995
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 07:53:04 +02:00
b6fe2cad71
[mod] Ask engine: remove tracking paramaters and set max page to 5
2024-04-08 07:50:14 +02:00
bf3845b093
[feat] engine: implementation of Open Meteo
2024-04-07 19:02:53 +02:00
ad9537065a
[data] update searx.data - update_firefox_version.py
2024-03-29 08:44:18 +01:00
531942ed16
[data] update searx.data - update_ahmia_blacklist.py
2024-03-29 08:43:50 +01:00
433cfd868a
[data] update searx.data - update_currencies.py
2024-03-29 08:42:16 +01:00
22d68aa2a7
[data] update searx.data - update_engine_traits.py
2024-03-29 08:41:44 +01:00
cc124b8f14
[data] update searx.data - update_engine_descriptions.py
2024-03-29 08:41:00 +01:00
550ca55778
[l10n] update translations from Weblate
...
cd974f62f98335c289986969118285674006
2024-03-29 08:23:44 +01:00
b21aaa8907
Add user-agent to stract requests
2024-03-22 13:40:46 +01:00
32bd55e268
[l10n] update translations from Weblate
...
522463f6a8ec374759ac6b5dff066b28f3e4a8e6cb73bcd153923a06110caf76bc307e8aeef184a70e5d537357d592adfb00645b3404da95a5907122a67a1f39a7e1553
2024-03-22 08:15:19 +01:00
f78cf94507
[l10n] update translations from Weblate
...
5ab8a41238fdac20fdf904a2b41da78b59cbc3ee00845a1a4001e9b8ddc37d9257c6e52bde689997706f9a81ee0b916dcc02f78ef012098a448131bcbfb4b91c561b9ca44ab09c8b5b767a16c8dec572be28e8c648d77ce678451d044f989a10834f13eaa1cdd6eb49e3879af55b61fb74954e6e4933b08dc6658df517d4cee7ec3f0
2024-03-15 09:49:09 +01:00
542f7d0d7b
[mod] pylint all files with one profile / drop PYLINT_SEARXNG_DISABLE_OPTION
...
In the past, some files were tested with the standard profile, others with a
profile in which most of the messages were switched off ... some files were not
checked at all.
- ``PYLINT_SEARXNG_DISABLE_OPTION`` has been abolished
- the distinction ``# lint: pylint`` is no longer necessary
- the pylint tasks have been reduced from three to two
1. ./searx/engines -> lint engines with additional builtins
2. ./searx ./searxng_extra ./tests -> lint all other python files
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-11 14:55:38 +01:00
8205f170ff
[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-11 14:55:38 +01:00
707d6270c8
[doc] engine: mullvad leta
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 18:20:07 +01:00
9d6896a771
[feat] engine: implementation of mullvad leta
2024-03-10 18:20:07 +01:00
3edaa26dae
[data] make data.all
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 15:56:50 +01:00
0ffec440b2
[doc] annas_archive: ctegs journal_article & book_any has been removed
...
In commit 8af181533https://github.com/searxng/searxng/pull/3321
the category `journal_article` has been removed, `book_any` has been removed
longer time ago.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 12:46:00 +01:00
33b4ffee29
[data] update searx.data - update_engine_traits.py
2024-03-10 12:46:00 +01:00
a5d36211a3
[data] update searx.data - update_ahmia_blacklist.py
2024-03-10 12:45:15 +01:00
2cb389e9ce
[data] update searx.data - update_currencies.py
2024-03-10 12:44:44 +01:00
4a8867e646
[data] update searx.data - update_engine_descriptions.py
2024-03-10 12:01:33 +01:00
7bbcf1be9a
[data] update searx.data - update_external_bangs.py
2024-03-10 12:01:00 +01:00
e97e1f9110
[fix] duckduckgo.fetch_traist - URL of region definitions has changed
...
- https://duckduckgo.com/dist/util/u.7669f071a13a7daa57cb.js
updated from u661.js to u.7669f071a13a7daa57cb / should be updated
automatically? The last change was on March 23rd in dba8977b09https://github.com/searxng/searxng/pull/2269
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 10:32:54 +01:00
33c099022b
[drop] engine framalibre - sarch URL is no longer supported
...
Closes: https://github.com/searxng/searxng/issues/3286
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-09 18:00:45 +01:00
42515d98f7
engine npm use the packages.html template
2024-03-09 10:24:49 +01:00
6dd07b88a4
[feat] lib.rs: use packages.html template
2024-03-09 10:17:16 +01:00
50d5a9ff60
[fix] issues reported by pylint 3.1.0
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-09 09:28:13 +01:00
a7b51f023e
[black] upgrade black 22.12.0 --> 24.2.0
...
The issue discussed in [1] has been solved since [2] has been merged into black
/ now we can upgrade without touching 69 files as it was needed with black
23.1.0 [3].
[1] https://github.com/searxng/searxng/pull/2159#issuecomment-1425723977
[2] https://github.com/psf/black/pull/4060
[3] https://github.com/searxng/searxng/pull/2159/files
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-09 08:15:50 +01:00
44decaa524
[feat] pkg.go.dev: use packages.html template
2024-03-08 17:18:54 +01:00
fbea0dd3ce
[l10n] Italian translation of infopages
2024-03-08 17:18:29 +01:00
9c08a0cddd
[translations] update from Weblate
...
184c000d87a107e46cf02911c4be4e8977cc4a9923cee05e7bb2f84b466efdc
2024-03-08 08:21:21 +01:00
fba8371396
[fix] XPath engine hoogle - hoogle.haskell.org has no paging support
...
Search on hoogle.haskell.org does no longer have pages.
Closes: https://github.com/searxng/searxng/issues/3278
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-07 17:31:25 +01:00
a5b81e2555
[fix] nyaa engine - paging support & filesize (GiB)
...
BTW: pylint engine
Closes: https://github.com/searxng/searxng/issues/3290
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-07 07:38:31 +01:00
3179993847
[fix] XPath engine lobste.rs - argument utf8 is no longer needed
...
Closes: https://github.com/searxng/searxng/issues/3279
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 13:24:50 +01:00
3529f0af50
[fix] engine searchcode.com - paging is broken in searchcode.com's API
...
paging is broken in searchcode.com's API .. not sure it will ever been fixed /
this commit disables paging in the engine and BTW pylint `searchcode_code.py`.
Closes: https://github.com/searxng/searxng/issues/3287
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 12:33:29 +01:00
76b18545e4
[fix] XPath engine naver - content selector needed an update
...
Closes: https://github.com/searxng/searxng/issues/3282
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 11:11:31 +01:00
5602f0bf96
[fix] engine pinterest - ignore result type 'story'
...
Close: https://github.com/searxng/searxng/issues/3289
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 07:33:43 +01:00
d97b84bea2
[fix] ddg engines (get_vqd) - the vqd value is no longer in the form
...
Closes: https://github.com/searxng/searxng/issues/3276
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-05 16:27:04 +01:00
0e2566db68
internetarchivescholar engine: set timeout to 15 seconds
2024-03-03 20:16:32 +01:00
7c5c11949b
Checker: tests for wikispecies
2024-03-03 20:00:46 +01:00
8fed5798ab
Checker: tests for bahnhof
2024-03-03 20:00:46 +01:00
b1431e1670
[feat] engine: implementation of cppreference
2024-03-03 17:07:29 +01:00
1a66bfa66c
checker: display results at the end
2024-03-03 11:18:43 +01:00
38fdd2288a
Drop typing-extensions dependency ( #3265 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-02 13:10:31 +01:00
1892a87fd2
[translations] update from Weblate
...
663d8815bf97823239480a0ec8d90521198110e90be9a3b803ba238bbaaa43e6950cdb97807c9891de16ca50cd85241d9ce
2024-03-02 09:37:52 +01:00
f3b4bf86a7
[feat] engine: implementation of void linux packages
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-29 13:12:40 +01:00
d58760ef75
[mod] pypi engine: use packages.html
2024-02-29 07:48:44 +01:00
35873b5a1c
Update searx.data - update_ahmia_blacklist.py
2024-02-29 07:47:54 +01:00
df74b5b59b
Update searx.data - update_firefox_version.py
2024-02-29 07:47:01 +01:00
473b2dd42f
Update searx.data - update_wikidata_units.py
2024-02-29 07:46:27 +01:00
9a474715e8
Update searx.data - update_engine_descriptions.py
2024-02-29 07:46:02 +01:00
c0b97c6543
[fix] re-add opensearch_url / its used in based.html
...
The URL was accidentally deleted in a85907a98
2024-02-25 18:26:16 +01:00
e8bd6c03bf
Update settings.yml
...
Changed value of "extra_proxy_timeout" from 10.0 to 10 as the variable expects an int.
Uncommenting this value with a non-int value will throw many errors and crash all engines.
2024-02-25 16:35:13 +01:00
9330a072eb
[feat] engine: implementation of pixiv
2024-02-25 16:29:57 +01:00
cf57914359
[build] /static
2024-02-25 16:22:37 +01:00
db1f9b31c9
[feat] images: show resolution inside the image and fix image details overflow
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 16:22:37 +01:00
e76ab1a4b3
[refactor] images: add resolution, image format and filesize fields
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 16:22:37 +01:00
Markus Heiser
Bnyro
Alexandre Flament
Yaksh Bariya
Daniel Kukula
searxng-bot
Austin-Olacsi
return42
Jinyuan Huang
mrpaulblack
singletail
dependabot[bot]
Diagonalo
Mikkel Denker
Grant Lanham
centralscrutinizer21
Alexandre Flament
dalf
templehasfallen