AnyBT: A BitTorrent Search Engine Works on ENS and IPFS

9/22/2023 at 12:37:20 PM

Is this meant to be decentralized to avoid shutdown? Where is the engine itself hosted? Ens is just a naming system and ipfs is just a file address system right? So the engine itself still needs to be hosted somewhere? Would like to hear more about it, but no info available on the site.

by dumbfounder

9/22/2023 at 12:43:48 PM

Actually the engine itself is also decentralized, there are multiple nodes running the search index over the network. There will be more docs coming out.

by jerry374

9/22/2023 at 1:10:34 PM

How is it decentralized? Are you using Filecoin VM? Doing your own thing?

by dumbfounder

9/22/2023 at 1:19:45 PM

The index files are stored on Filecoin, and there are multiple nodes loading those index files and serving queries.

by jerry374

9/22/2023 at 2:04:42 PM

Multiple nodes that you run? What's the incentive for others to run them?

by dumbfounder

9/22/2023 at 12:43:54 PM

That’s the very goal of IPFS: hosting is distributed. Every node taking part in the IPFS network may or may not have pieces of this particular website.

Eth.link seems to be a centralized proxy enabling you to access that without an IPFS/EthDNS browser.

It should also be noted that what is hosted is a simple list of hashes with a name (and a size). The search engine is trivially looking through the name and displaying matching hashes.

Then, your bittorrent client try to find any torrent matching the hash (this is the magnet protocol).

So, yeah, you download something from nowhere. This is the real "cloud" we have been expecting for the last 20 years ;-)

by ploum

9/22/2023 at 1:12:21 PM

IPFS only serves files, there is no server side compute. You can’t just scan ipfs like a database so there needs to be some other tech used for the engine itself, as OP indicates.

by dumbfounder

9/22/2023 at 1:34:22 PM

yeah, indeed, my bad.

by ploum

9/22/2023 at 12:32:46 PM

Adding a tracking parameter to the link is very uncool

by promiseofbeans

9/22/2023 at 2:59:26 PM

Tracking saying this came from hn is not uncool it's slightly cool. It's a way to say all of these people are from that cool site hackernews. Uncool is browser fingerprinting, tracking mouse movements and forcing signups through gmail. uncool.

by ipaddr

9/22/2023 at 12:54:48 PM

Sorry for that, first time ever post on Hacker News. Didn't know this, and I can't edit the link after I posted.

by jerry374

9/22/2023 at 1:04:35 PM

No worries. Cool project by the way!

by promiseofbeans

9/22/2023 at 10:43:20 PM

uncool would be blindly objecting something without even understanding why you do it.

by nsonha

9/22/2023 at 12:51:08 PM

What's uncool about the creator knowing which social media outlet worked the best for their "advertising"? It doesn't hurt you.

by Double_a_92

9/23/2023 at 5:00:19 PM

Maybe it's marketed as ENS and IPFS, but in the end it's an .ru domain running SQL. What's old is new again!

    curl 'https://gateway.magnode.ru/blockved/glitterchain/index/sql/simple_query' -H 'Content-Type: application/json' --data-raw @- <<"JSON"
    {
      "sql": "select /*+ SET_VAR(full_text_option='{\"highlight\":{ \"style\":\"html\",\"fields\":[\"file_name\"]}}') */ file_name,filesize,total_count,_id,category,firstadd_utc_timestamp,_score from library.dht where query_string('file_name:\\\"debian\\\"^1') order by total_count desc limit 0, 200",
      "arguments": []
    }
    JSON

by mdaniel

9/24/2023 at 5:19:33 PM

--data-raw is incorrect, as it does not parse the "@-", it takes it as a literal value. You want --data @- ...

by WirelessGigabit

9/22/2023 at 7:24:52 PM

Where's the code?

by devdao

9/22/2023 at 12:37:44 PM

Qbit search works fine, why would I choose a rewrite?

by ramon156

9/22/2023 at 12:46:56 PM

no files inside listed unlike btdig

by sampa