jandieman
/
searxng
mirror of https://github.com/searxng/searxng.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
5,044 Commits 8 Branches 17 Tags 124 MiB
Commit Graph

5044 Commits

Author SHA1 Message Date
Markus Heiser e179dba7e4 [fix] ./manage script, prompt the unknown command 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-17 17:15:28 +02:00
dependabot[bot] 594e549839
Bump flask from 1.1.2 to 2.0.1 
Bumps [flask](https://github.com/pallets/flask) from 1.1.2 to 2.0.1.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/1.1.2...2.0.1)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-17 12:57:51 +00:00
Alexandre Flament 555bea6f24
Merge pull request #89 from searxng/dependabot/pip/master/jinja2-3.0.1 
Bump jinja2 from 2.11.3 to 3.0.1
 2021-07-17 14:57:05 +02:00
Alexandre Flament f523fd3ea7
Merge pull request #211 from MarcAbonce/onions_v3_fix_searxng 
Update onion engines to v3
 2021-07-16 17:25:37 +02:00
Alexandre Flament 5f4d05db33
Merge pull request #210 from searxng/dependabot/pip/master/sphinx-4.1.1 
Bump sphinx from 4.0.2 to 4.1.1
 2021-07-16 16:16:05 +02:00
Alexandre Flament d47b8e36cf
Merge pull request #207 from return42/mongodb 
[enh] add mongodb offline engine
 2021-07-16 16:15:01 +02:00
dependabot[bot] 048100be3e
Bump jinja2 from 2.11.3 to 3.0.1 
Bumps [jinja2](https://github.com/pallets/jinja) from 2.11.3 to 3.0.1.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/2.11.3...3.0.1)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-16 13:59:22 +00:00
Alexandre Flament 401f7d38f6
Merge pull request #209 from searxng/dependabot/pip/master/python-dateutil-2.8.2 
Bump python-dateutil from 2.8.1 to 2.8.2
 2021-07-16 15:58:33 +02:00
Alexandre Flament 8237cb557e
Merge pull request #206 from return42/improve-qwant 
[mod] improve video results of the qwant engine
 2021-07-16 15:33:56 +02:00
Alexandre Flament 0d65a81b1c [mod] qwant engine: fix typos / minor change 
minor modification of commit 628b5703f3
(no functionnal change)
 2021-07-16 15:32:12 +02:00
Marc Abonce Seguin 1b05ea6a6b update onion engines to v3 
remove not_evil which has been down for a while now:
https://old.reddit.com/r/onions/search/?q=not+evil&restrict_sr=on&t=year
 2021-07-16 01:36:34 -07:00
dependabot[bot] 7d3320974d
Bump python-dateutil from 2.8.1 to 2.8.2 
Bumps [python-dateutil](https://github.com/dateutil/dateutil) from 2.8.1 to 2.8.2.
- [Release notes](https://github.com/dateutil/dateutil/releases)
- [Changelog](https://github.com/dateutil/dateutil/blob/master/NEWS)
- [Commits](https://github.com/dateutil/dateutil/compare/2.8.1...2.8.2)

---
updated-dependencies:
- dependency-name: python-dateutil
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-16 08:05:05 +00:00
Alexandre Flament 1ba3e5afa0
Merge pull request #208 from searxng/dependabot/pip/master/uvloop-0.15.3 
Bump uvloop from 0.15.2 to 0.15.3
 2021-07-16 10:03:56 +02:00
dependabot[bot] 595ad77b8d
Bump sphinx from 4.0.2 to 4.1.1 
Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 4.0.2 to 4.1.1.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/4.x/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v4.0.2...v4.1.1)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-16 07:05:27 +00:00
dependabot[bot] 41dda87531
Bump uvloop from 0.15.2 to 0.15.3 
Bumps [uvloop](https://github.com/MagicStack/uvloop) from 0.15.2 to 0.15.3.
- [Release notes](https://github.com/MagicStack/uvloop/releases)
- [Commits](https://github.com/MagicStack/uvloop/compare/v0.15.2...v0.15.3)

---
updated-dependencies:
- dependency-name: uvloop
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-16 07:05:10 +00:00
Markus Heiser 0a9cd08bf1 [enh] add mongodb offline engine 
Cherry-Pick: https://github.com/searx/searx/commit/198aad43
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-15 21:35:33 +02:00
Markus Heiser 628b5703f3 [mod] improve video results of the qwant engine 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-15 20:10:37 +02:00
Alexandre Flament f376b4ed3e
Merge pull request #205 from unixfox/patch-2 
Add missing parameter for mobile UI search
 2021-07-15 17:19:12 +02:00
Alexandre Flament 7efb527719
Merge pull request #204 from return42/fix-qwant 
[fix] Qwant engine - implement API v3 and add engine "qwant videos"
 2021-07-15 17:19:06 +02:00
Émilien Devos 6c9f276571
Add missing parameter for mobile UI search 2021-07-15 13:00:32 +00:00
Markus Heiser 420e3caba3 [mod] enable Qwant engines (web, news, images, video) by default 
Qwant is a fast and reliable search engine and AFAIK there is no CAPTCHA.  Let
us enable Qwant engines by default.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-14 09:47:32 +02:00
Markus Heiser ef6e1bd6b9 [fix] Qwant engines - implement API v3 and add 'quant videos' 
The implementation uses the Qwant API (https://api.qwant.com/v3). The API is
undocumented but can be reverse engineered by reading the network log of
https://www.qwant.com/ queries.

This implementation is used by different qwant engines in the settings.yml::

  - name: qwant
    categories: general
    ...
  - name: qwant news
    categories: news
    ...
  - name: qwant images
    categories: images
    ...
  - name: qwant videos
    categories: videos
    ...

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-14 09:47:32 +02:00
Alexandre Flament ff180cf2db
Merge pull request #203 from return42/drop-dogpile 
[fix] drop engine dogpile
 2021-07-13 15:58:37 +02:00
Markus Heiser 2767046065 [fix] drop engine dogpile 
The engine was added in commit a4b07460 but now it shows new issues [1].

In the 90'th of the last century, dogpile had its own WEB index, but nowadays it
is a meta-search engine [2]

  Powered by technology, Dogpile returns all the best results from leading
  search engines including Google and Yahoo!

Using dogpile as an engine in SearXNG needs more investigation, a XPath solution
like we have is not enough.   It is questionable whether it still makes sense to
investigate more into a meta-search engine with a ReCAPTCHA in front.

With this patch the dogpile engine is removed

[1] https://github.com/searxng/searxng/issues/202
[2] https://www.dogpile.com/support/aboutus

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-13 14:42:09 +02:00
Alexandre Flament 4f09c7ba0c
Merge pull request #201 from return42/drop-torrentz 
[drop] engine torrentz: torrentz2.eu and torrentz2.is are offline
 2021-07-12 08:22:49 +02:00
Markus Heiser 513c73a309 [drop] engine torrentz: torrentz2.eu and torrentz2.is are offline 
[1] https://torrentfreak.com/torrentz2-eu-domain-suspended-by-registry-on-public-prosecutors-order-200628/

Suggested-by: @rasos https://github.com/searx/searx/issues/1875#issuecomment-877755872
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-11 13:24:33 +02:00
Markus Heiser 438357a5b8
Merge pull request #200 from unixfox/patch-1 
Fix google images
 2021-07-10 16:17:21 +00:00
Émilien Devos d9d9bd720d
Fix google images 
Proposed fix in https://github.com/searx/searx/pull/2115#issuecomment-876716010
 2021-07-10 14:09:29 +00:00
Markus Heiser c72cca69de
Merge pull request #198 from return42/gpodder.net 
[enh] add gpodder.net (JSON)
 2021-07-03 20:46:51 +00:00
Markus Heiser 373259e9bd
Merge pull request #197 from return42/woxikon 
Add woxikon.de synonyme (Xpath)
 2021-07-03 20:31:46 +00:00
Allen 3b2e0a93b7 [enh] add gpodder.net (JSON) 
Engine just for Podcasts.  An API which returns Podcasts and their Info like:
website, author etc.

Upstream query example: https://gpodder.net/search.json?q=linux
 2021-07-03 22:30:20 +02:00
Markus Heiser d5eedf1b61 [yamllint] fix some warning issues reported by yamllint 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 21:55:36 +02:00
Allen 9648d71ad8 [enh] add woxikon.de synonyme (Xpath) 
Added synonyme.woxikon.de using the xpath engine.  Adds a site which returns
word synonyms although just in German.

Depending on the query not all synonyms are shown because of not the best xpath
selection.  But should do the job just fine.

Upstream example query: https://synonyme.woxikon.de/synonyme/test.php
 2021-07-03 21:51:26 +02:00
Markus Heiser bb98a07b50
Merge pull request #196 from return42/fix-brave 
[fix] brave engine: shows descriptions with their correct URLs
 2021-07-03 19:44:48 +00:00
Markus Heiser 9d97b2e854 [fix] brave engine: shows descriptions with their correct URLs 
BTW add about section to the YAML configuration

It now shows descriptions with their correct URLs when there are videos in the
search results, pulling content_xpath from snippet-description instead of
snippet-content.

Suggested-by: @eagle-dogtooth https://github.com/searx/searx/issues/2857#issuecomment-869119968
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 20:57:55 +02:00
Markus Heiser 72a55f68c8
Merge pull request #191 from searxng/dependabot/pip/master/transifex-client-0.14.3 
Bump transifex-client from 0.14.2 to 0.14.3
 2021-07-03 18:03:09 +00:00
Markus Heiser debcbab561 [fix] add missing transifex configuration (./tx/config) 
BTW: update the documentation about transifex usage

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 19:31:31 +02:00
Markus Heiser b558c5aa36
Merge pull request #194 from return42/fix-misc 
[fix] some minor issues in Makefile and shell scripts
 2021-07-03 16:40:19 +00:00
Markus Heiser 129ed4c9fa [mod] add Makfile target lxc.clean which deletes ./lxc-env 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 18:25:46 +02:00
Markus Heiser b3ff510e10 [fix] pacman --noprogressbar in shell scripts 
From pacman's man page:

  --noprogressbar
    Do not show a progress bar when downloading files. This can be useful for
    scripts that call pacman and capture the output.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 18:24:55 +02:00
Markus Heiser 73fc6499d8 [fix] utils/lib.sh: in a pipe, do not print ASCII escape code 
In 2a12637 an ASCII escape code was added, such escape codes should not be
written to pipes (when the output is not a terminal).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 18:24:49 +02:00
Markus Heiser 7e8d1f9935
Merge pull request #178 from return42/whaleslide.com 
[enh] Add WhaleSlide engine (JSON)
 2021-07-03 16:22:47 +00:00
dependabot[bot] 0c256b378b
Bump transifex-client from 0.14.2 to 0.14.3 
Bumps [transifex-client](https://github.com/transifex/transifex-client) from 0.14.2 to 0.14.3.
- [Release notes](https://github.com/transifex/transifex-client/releases)
- [Commits](https://github.com/transifex/transifex-client/compare/0.14.2...0.14.3)

---
updated-dependencies:
- dependency-name: transifex-client
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-03 16:19:20 +00:00
Markus Heiser e153ad131c
Merge pull request #192 from searxng/dependabot/pip/master/splinter-0.15.0 
Bump splinter from 0.14.0 to 0.15.0
 2021-07-03 16:18:39 +00:00
dependabot[bot] f255c8a101
Bump splinter from 0.14.0 to 0.15.0 
Bumps [splinter](https://github.com/cobrateam/splinter) from 0.14.0 to 0.15.0.
- [Release notes](https://github.com/cobrateam/splinter/releases)
- [Changelog](https://github.com/cobrateam/splinter/blob/master/docs/news.rst)
- [Commits](https://github.com/cobrateam/splinter/compare/0.14.0...0.15.0)

---
updated-dependencies:
- dependency-name: splinter
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-03 16:09:46 +00:00
Markus Heiser 6ae8ae6c7b
Merge pull request #190 from searxng/dependabot/pip/master/pylint-2.9.3 
Bump pylint from 2.8.3 to 2.9.3
 2021-07-03 16:08:42 +00:00
dependabot[bot] 19e2b72367 Bump pylint from 2.8.3 to 2.9.3 
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.8.3 to 2.9.3.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.8.3...v2.9.3)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-03 17:54:17 +02:00
Markus Heiser 24f2376c11 [pylint] prepare for pylint v2.9.3 / fix some (new) pylint issues 
Upgrade from pylint v2.8.3 to 2.9.3 raise some new issues::

  searx/search/checker/__main__.py:37:26: R1732: Consider using 'with' for resource-allocating operations (consider-using-with)
  searx/search/checker/__main__.py:38:26: R1732: Consider using 'with' for resource-allocating operations (consider-using-with)
  searx/search/processors/__init__.py:20:0: R0402: Use 'from searx import engines' instead (consider-using-from-import)
  searx/preferences.py:182:19: C0207: Use data.split('-', maxsplit=1)[0] instead (use-maxsplit-arg)
  searx/preferences.py:506:15: R1733: Unnecessary dictionary index lookup, use 'user_setting' instead (unnecessary-dict-index-lookup)
  searx/webapp.py:436:0: C0206: Consider iterating with .items() (consider-using-dict-items)
  searx/webapp.py:950:4: C0206: Consider iterating with .items() (consider-using-dict-items)

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-03 17:54:08 +02:00
Alexandre Flament 961dd287a1
Merge pull request #185 from searxng/update_data_update_external_bangs.py 
Update searx.data - update_external_bangs.py
 2021-07-01 18:43:18 +02:00
Alexandre Flament 508195a850
Merge pull request #186 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-07-01 18:41:54 +02:00