ef56e1d684
[fix] HTMLParser: undocumented not implemented method
...
In python versions <py3.10 there is an issue with an undocumented method
HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed
in Python 3.5.
To be compatible to higher versions (>=py3.10) an error method is implemented
which throws an AssertionError exception like the higher Python versions do [3].
[1] https://github.com/python/cpython/issues/76025
[2] https://bugs.python.org/issue31844
[3] https://github.com/python/cpython/pull/8562
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-22 10:35:02 +02:00
01b5b9cb8e
[translations] update from Weblate
...
2325f15835090c6a8e3a38219d894a9f4164bdbeb4b30f9b483f487f1ca1997c5a701dc4
2023-10-20 10:44:11 +02:00
b013cbb4cc
[build] /static
2023-10-13 12:56:29 +02:00
df2e41c150
[fix] search.js: crash on homepage when setting form listeners
2023-10-13 12:56:29 +02:00
4280318fc5
fixing results parsing brave
2023-10-13 11:47:30 +02:00
ac82daf58d
[translations] update from Weblate
...
74e401e68897dd8db16ed046a90815ecb33665d9a0c2f3ec249ef953dc6c108
2023-10-13 09:20:54 +02:00
efada7cba2
[fix] hackernews keyerror problem
2023-10-13 08:16:47 +02:00
af071121de
[fix] imgur - incorrect wikidata id
2023-10-12 09:14:00 +02:00
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-12 08:52:28 +02:00
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
2023-10-10 09:12:30 +02:00
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10 08:40:53 +02:00
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
2023-10-09 20:50:24 +02:00
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04Closes : #2898
2023-10-09 18:13:00 +02:00
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
2023-10-09 14:00:04 +02:00
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
2023-10-09 13:25:13 +02:00
48cb58bd2e
[feat] duckduckgo: support for videos and news
2023-10-09 06:53:43 +02:00
c3ab49cd90
[fix] kickass: crash when no results
2023-10-07 11:48:23 +02:00
f22daf8b47
[mod] piped: always show video length if available
2023-10-07 11:45:46 +02:00
ce270961e8
[feat] engine: implementation of mastodon
2023-10-06 10:58:23 +02:00
48f8ac48d1
[translations] update from Weblate
...
68d74328142f091b7f2479c0d7ba4e6cd5929d4e5f5c3b79d44775746291184f24d7e8b16140911f9
2023-10-06 09:19:00 +02:00
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-05 10:55:08 +02:00
3e2ae756f0
[feat] engine: implementation of radio-browser.info
2023-10-05 10:55:08 +02:00
d56b31d674
[fix] limiter / botdetection: remove http_connection method
...
Related:
- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 20:24:22 +02:00
e509cb7c45
[typo] solved a typo in yahoo error message.
2023-10-01 08:29:06 +02:00
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
2023-10-01 08:29:06 +02:00
fe9386b58d
[fix] emojipedia: fix engine
2023-10-01 08:19:45 +02:00
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 08:01:38 +02:00
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
2023-10-01 08:01:38 +02:00
5ce1792432
[feat] engine: implementation of pinterest
2023-09-30 15:01:45 +02:00
6096457e4d
[fix] matrixrooms.info: pagination not working properly
2023-09-30 14:51:07 +02:00
e1a8b8189f
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
2023-09-30 11:29:19 +02:00
159629c588
[mod] tagesschau: add option to only use tagesschau urls
2023-09-30 11:00:11 +02:00
2ca60a19fc
[feat] engine: implementation of matrixrooms.info
2023-09-30 09:09:23 +02:00
d1a3fc5be6
[feat] engine: implementation of tootfinder
2023-09-29 23:00:30 +02:00
fc4a20f734
[mod] add movies category for tmdb, imdb and moviepilot
2023-09-29 22:37:51 +02:00
0330648b98
[mod] warn to info for failed ping limiter
2023-09-29 22:20:56 +02:00
26fed56d51
[mod] settings.yml: remove plugin settings for plugins that don't exist anymore
2023-09-29 11:26:49 +02:00
9a065832e0
[translations] update from Weblate
...
80bbf74ef5d554ef71771fd1b90d412012c81ac171d0aa004c40cc47e729f89f85b28cc475ce5d58140ce0600921f343f714c80f80fdef3c859e4
2023-09-29 09:12:12 +02:00
ae2762eb78
Update searx.data - update_firefox_version.py
2023-09-29 06:58:11 +02:00
18da3d65c5
Update searx.data - update_ahmia_blacklist.py
2023-09-29 06:57:40 +02:00
4a66fa3e7d
Update searx.data - update_wikidata_units.py
2023-09-29 06:56:50 +02:00
9be6e20256
Update searx.data - update_engine_traits.py
2023-09-29 06:56:10 +02:00
d821ec44dd
Update searx.data - update_currencies.py
2023-09-29 06:55:04 +02:00
cdee5aa3b9
Update searx.data - update_engine_descriptions.py
2023-09-29 06:53:05 +02:00
75587d03a6
[fix] categories.html: can't select social media category using search on category select
2023-09-28 10:45:49 +02:00
e37d775fa2
[fix] engine - currency fix and simplify
2023-09-28 08:29:38 +02:00
ae28d429c9
[fix] bilibili new api used
2023-09-28 08:24:51 +02:00
1a66d74673
[fix] engine - kickass update url, fix parsing, use multiple mirrors
2023-09-27 10:19:41 +02:00
0c39064d60
Update searx.data - update_engine_traits.py
...
Update searx.data - update_engine_traits.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
b428ccc5a0
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
3a456b1282
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
1f835a9f1f
solve #2839
2023-09-25 23:01:14 +02:00
3c6549a17f
[fix] update user agent
2023-09-25 22:46:22 +02:00
ffec8d1b4c
add warning about enabling public_instance setting
2023-09-25 22:31:14 +02:00
47721a3485
add new parameter called server.public_instance
...
for enabling by default advanced limiter functions
in the future allow us to add features just for the public instances
2023-09-25 22:31:14 +02:00
1df4588279
[build] /static
2023-09-25 17:45:21 +02:00
98366bcf90
[fix] settings icon invisble on mobile devices
2023-09-25 17:45:21 +02:00
19383921d7
/config: expose limiter configuration
2023-09-24 11:01:11 +02:00
1851f27154
[mod] remove twitter ( #2843 )
2023-09-24 08:32:53 +00:00
597c68b4aa
[doc] move dosc of botdetection from developer to admin section
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-23 14:00:03 +02:00
75c9de02d1
[feat] engine: implementation of imgur
2023-09-22 20:50:53 +02:00
fb72f71f0a
[fix] internet archive scholar: crash when there's no title
2023-09-22 18:49:39 +02:00
0660d20e1d
[translations] update from Weblate
...
f27a3bbd4a97336d0a91e8946b319f53731edaf10bd75ab004b8b8cdedd99c9
2023-09-22 18:05:02 +02:00
95885e7f9f
[build] /static
2023-09-22 17:54:55 +02:00
8b0b6731fc
[fix] search.less: start page search view on mobile devices
2023-09-22 17:54:55 +02:00
71358e9c67
Revert "[fix] engine - duckduckgo vqd edge-case"
...
This reverts commit 102502a4f0
2023-09-22 09:31:25 +02:00
51236ae47a
[feat] engine: implementation of chefkoch.de
2023-09-21 17:23:59 +02:00
8bcca0e620
[fix] engine - brave don't show ads
2023-09-21 16:55:39 +02:00
b729542a66
[fix] engine - google images error when no results
2023-09-21 16:38:37 +02:00
f0df53673e
[mod] search-syntax.md: add tutorial about the feeling lucky feature
2023-09-21 15:17:23 +02:00
cc2e0537a3
[feat] engine: implementation of google icons/material design icons
2023-09-21 15:16:49 +02:00
c999cfb422
[feat] engine: implementation of wallhaven
2023-09-21 14:25:43 +02:00
102502a4f0
[fix] engine - duckduckgo vqd edge-case
2023-09-20 20:05:06 +02:00
d013f51a25
[fix] Search on category select without JavaScript PR #2740
...
Small addendum to #2740 ; search_on_category_select is now no longer a plugin.
Related: https://github.com/searxng/searxng/pull/2740#issuecomment-1725437584
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 21:03:02 +02:00
0ce10046c4
[build] /static
2023-09-19 20:15:51 +02:00
a76c8e4101
Improve the layout of the search page on mobile
2023-09-19 20:15:51 +02:00
33496e7f51
Switch back to qwant web normal API
2023-09-19 17:07:22 +02:00
043dcbf7c5
[fix] engine qwant (web-lite) - ignore advertising adds
...
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 17:06:56 +02:00
3ac7c40b6a
[build] /static
2023-09-19 11:15:25 +02:00
33e722f83b
better error message when no results found
2023-09-19 11:10:48 +02:00
ad725ce7d7
wikipedia wikidata infobox + disable wikisource ( #2806 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 10:31:02 +02:00
dcee823345
[feat] implement feeling lucky feature
2023-09-19 09:40:57 +02:00
71508abcbf
[build] /static
2023-09-19 08:06:06 +02:00
2ec77ef813
[mod] reformatted keyBindingLayouts in JS client (default, vim)
2023-09-19 08:06:06 +02:00
317db5b04f
[mod] preferences: implement drop-down menu for hotkeys (default, vim)
...
Replace the on/off checkbox of the vim-hotkeys in the preferences by a drop-down
menu.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 08:06:06 +02:00
09935e2897
[build] /static
2023-09-18 21:29:11 +02:00
a55e0ac553
[feat] search on category select without JS
...
Co-authored-by: Alexandre Flament <alex@al-f.net>
2023-09-18 21:29:11 +02:00
efd3a2d6d1
[feat] engine: implementation of internet archive scholar
2023-09-18 18:12:00 +02:00
223b3487c3
[fix] spelling
2023-09-18 16:20:27 +02:00
a9b6963971
[fix] engine - qwant delivers only 5 pages maximum
...
all qwant engines (incl qwant-lite) delivers only 5 pages maximum
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-18 01:43:43 +02:00
da1446c5ed
[fix] engine - qwant wrong error type
2023-09-18 01:43:43 +02:00
7398d525c8
[fix] qwant: subsequent fix of commit d9dbcedeb
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-17 17:52:56 +02:00
d9dbcedeb6
[feat] implementation of qwant lite for web search
...
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-17 16:53:25 +02:00
b4e0d2eedc
[feat] engine: implemenation of moviepilot (de)
2023-09-17 14:30:56 +02:00
7dfcc3386e
[fix] tagesschau videos
2023-09-16 18:40:26 +02:00
89fbac5763
[build] /static
2023-09-16 13:45:43 +02:00
92d0c378e0
[fix] keyboard navigation / simple theme (UI)
...
- avoid loop select
- fix select next item in mixed result lists
Replaces: https://github.com/searxng/searxng/pull/2789
Closes: https://github.com/searxng/searxng/issues/2751
Closes: https://github.com/searxng/searxng/issues/2788
2023-09-16 13:45:43 +02:00
ec540a967a
[fix] brave.videos
2023-09-15 22:00:09 +02:00
27477f51fd
[fix] brave.news
2023-09-15 22:00:09 +02:00
140125e641
[feat] implementation of the movie database
2023-09-15 19:41:37 +02:00
4eebb25882
[translations] update from Weblate
...
4f055ccb89edaacb09ccb3e8934206640415d8db608c26db95be680792cd970949ad5db80921f948e3677f0ccb2dea9cd3a5038588e86b63e980b858a8660b5852633d292d25097b8ae9d7a20989ccd21a1c309f3fc3ee5e679e7420db0cf7327ffb1f542814e225f26236007bea3da4568a854d931781efe60016a6044200f1431198e61bb7acd04327a418412274159ed21b385914b774daff7b45ec84146f8707383602051b050d9ee48d6e7a20cee77e20720420f44b6
2023-09-15 09:12:13 +02:00
41ef73ca3a
[fix] rumble redirect
2023-09-14 19:21:21 +02:00
b701ee257b
[fix] habrahabr
2023-09-14 18:43:14 +02:00
be888810ba
[fix] pubmed content being None
2023-09-14 18:40:15 +02:00
cf734e6008
[fix] engine - pub.dev
2023-09-14 18:07:55 +02:00
92d39de410
[fix] solidtorrents redirects
2023-09-14 18:03:21 +02:00
cf8a6cf6db
[fix] solidtorrents pagination
2023-09-14 18:03:21 +02:00
8172f89075
[fix] solidtorrents
2023-09-14 18:03:21 +02:00
74600c028d
[fix] engine - Crossref
...
Crossref was broken on result types journal-issue and component .. The old code
had lots of assumptions, and broke during parsing. Now the assumptions are more
explicit and checked them with the API.
2023-09-14 17:39:23 +02:00
ed6a5a01bb
[build] /static
2023-09-14 16:26:10 +02:00
0984b00b7e
[mod] UI smooth scroll added / CSS scroll-behavior
...
This PR improves the UX by making auto-scroll more smoother. The css is changed
so all the auto-scroll will be smoother but User-scroll will not be influenced.
The scroll-behavior CSS property sets the behavior for a scrolling box when
scrolling is triggered by the navigation or CSSOM scrolling APIs.[1]
[1] https://developer.mozilla.org/en-US/docs/Web/CSS/scroll-behavior
2023-09-14 16:26:10 +02:00
bf7af99ef2
[mod] make data.traits: add Odysee
2023-09-13 21:41:33 +02:00
3568a3cafb
[feat] odysee: implement fetch_traits for language support
2023-09-13 21:41:33 +02:00
09c61dabc9
[mod] odysee: time range support
2023-09-13 21:41:33 +02:00
b98907e91f
[fix] engine - piped.music incorrect timestamps
2023-09-13 21:39:37 +02:00
6039dbf211
[fix] engine - invidious thumbnails
2023-09-13 11:37:42 +02:00
ed3819bdd5
add inv.tux.pizza
2023-09-13 11:12:01 +02:00
122b4342eb
remove invidious.snopyta.org
2023-09-13 11:12:01 +02:00
e2a5e183cc
[fix] settings.yml - change default invidious instances
2023-09-13 11:12:01 +02:00
b2fd6304bf
[fix] engine - openstreetmap currency rendering
2023-09-13 10:56:52 +02:00
976b3e21c4
[fix] engine - pypi redirect
2023-09-12 21:14:48 +02:00
54a3e03b45
[fix] engine - openstreetmap currency matching
2023-09-12 20:57:05 +02:00
64d9587ac8
[feat] new engine: svgrepo
2023-09-12 20:38:36 +02:00
aa1453db0c
[build] /static
2023-09-12 20:30:50 +02:00
a987672340
[mod] improve handling of the hotkeys
...
- KeyboardEvent: keyCode property is depricated, replaced by key property [2]
- the check for ifDetailOpened is not necessary, because the hotkeys are not
only applicable to image-results, by example:
`!goi !go !scc hello`
- Key bindings like h for help are to be used in general (not only in vim-mode)
[1] https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/keyCode
[2] https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/key
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-12 20:30:50 +02:00
e6b160da62
[feature] key bindings: left & right arrow are always on
2023-09-12 20:30:50 +02:00
b189578b6b
[fix] engine - brave
2023-09-12 11:31:43 +02:00
f182abd6f8
[mod] library of congress: fix engine
2023-09-11 19:42:31 +02:00
e73a6f5d14
[fix] engine deviantart: review of the result-scrapper
...
The deviantart site changed and hence deviantart is currently unusable.
2023-09-11 13:22:36 +02:00
1f7366060e
[build] /static
2023-09-11 12:27:56 +02:00
935aed7ca4
[feature] dark theme for code highlighter in the result list
...
Closes: https://github.com/searxng/searxng/issues/1354
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-11 12:27:56 +02:00
d07c006aed
Replace chompjs with pure Python code
...
The new implementation is good enough for the current usage (brave)
2023-09-09 13:02:36 +02:00
8e45ac4271
[build] /static
2023-09-09 00:39:51 +02:00
15a3dbf7a0
[fix] preferences - layout of the "special queries" tab
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-09 00:39:51 +02:00
9e83c0dedc
[feat] engine: implementation of Yummly
...
Co-authored-by: Markus Heiser <markus.heiser@damarit.de>
2023-09-08 11:47:13 +02:00
a3d7e9c285
[mod] utils.py: add markdown_to_text helper function
2023-09-08 11:47:13 +02:00
c62605b3e3
[translations] update from Weblate
...
304f6af5c76a4b6496
2023-09-08 09:20:19 +02:00
019bd97f4b
[fix] settings.yml - fix docs-links in the comments
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-06 11:35:39 +02:00
1f21ac7d62
[feat] engine: implementation of bilibili https://www.bilibili.com
2023-09-05 22:53:03 +02:00
696c35d2c3
[fix] engine - duckduckgo_images / determination of vqd value incorrect
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-05 22:24:51 +02:00
4fb26cd96d
[fix] engine duckduckgo weather api changes
2023-09-05 16:55:00 +02:00
01be9e0e20
[fix] engine: wikicommons - don't quoute ':|' in URL parameters
...
From [1]: It seems to be because of [2] For some reason it gets url encoded
twice, resulting in
- ``filetype%253Abitmap%257Cdrawing+birds`` instead of
- ``filetype:bitmap%7Cdrawing+birds``
[1] https://github.com/searxng/searxng/issues/2707
[2] https://github.com/searxng/searxng/blob/master/searx/engines/wikicommons.py#L43
Closes : #2707
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-03 18:45:39 +02:00
4f8895c6de
[fix] follow-up of 4da7003ae / add missing review from @Bnyro
...
[1] https://github.com/searxng/searxng/pull/2656#pullrequestreview-1607956209
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-02 09:26:45 +02:00
4da7003ae0
[feat] engine: implementation of odysee
2023-09-02 09:14:12 +02:00
9c4e9d3814
[feat] implementation of Wikimedia commons for images
2023-09-01 18:39:24 +02:00
9fce459c7f
[translations] update from Weblate
...
979909accf40af3403
2023-09-01 09:29:07 +02:00
7af66736c0
Create search-syntax.md fa
2023-08-30 16:39:10 +02:00
26cd770cf7
[mod] Persian translation of the about page (fa_IR)
2023-08-30 16:13:44 +02:00
faa4280e1a
[mod] bing: resolve redirect without additional requests
...
Remove the usage of searx.network.multi_requests
The results from Bing contains the target URL encoded in base64
See the u parameter, remove the first two character "a1", and done.
Also add a comment the check of the result_len / pageno
( from https://github.com/searx/searx/pull/1387 )
2023-08-29 07:39:06 +02:00
f57842b05d
Update searx.data - update_firefox_version.py
2023-08-29 07:21:46 +02:00
Markus Heiser
searxng-bot
Bnyro
Émilien (perso)
Hackurei
Alex Balgavy
Hackurei
Aine
Jinyuan Huang
jazzzooo
dalf
Alexandre Flament
ormai
bonswouar
Jafar Farganlooj