Search will be offline until the dread rewrite is done : Dread

38 points

3 years ago

(Please read admins) Dread Is one of the best .onion platforms to perform research on everything dark web related, that being said, the search bar is by far the most important function of the platform for me and many others. I desperately need a real ETA on when the re-script is complete. It becomes extremely hard to search for opinions and facts without the search bar.

/u/CaponeMalone33

16 points

3 years ago

Its been more than 2 weeks, please u/Paris, dread is one of the best platforms to conduct research on TOR, without the search bar feature, the site is almost useless to me and many others. I and many others would love an ETA on when the rewrite will be complete, not just "soon".

/u/newbieforever2018 P ☆Cares About Noobs☆

12 points

3 years ago

" new captchas"

Oh no, after I finally learned the current ones. Flying Spaghetti Monster help me!!!

/u/Paris 📢 A

7 points

3 years ago

The ⚠️new captcha⚠️ is much better than what we currently have. Can't wait for it to finally land in production.

/u/BigDaddy2K

2 points

3 years ago

That password length and speed tho

/u/[deleted]

2 points

3 years ago

lucky for me, I don't have to do captchas any more. Oh wait, yeah i do cuz you shot me

D
O
W
N

/u/backitupterry

2 points

3 years ago

can we get an ETA for the new dread update plzz we really need that search bar function asap

/u/Paris 📢 A

0 points

3 years ago

SOON VERRRRYRYYYYYY SOON ;)

It's worth it. So worth it.

/u/Kyle

2 points

3 years ago

Better be, you yourself said it's going to be at the end of this month. HAHAHA.

/u/Shakybeats what are your thoughts on this???

/u/katewatts

1 points

3 years ago

It's gonna be bodacious

/u/AutoModerator M Judge Dread

-1 points

3 years ago

Dread's search bar has been disabled until the new dread update comes online.

For more information read the pined post on /d/dread: /post/817f72072a6318fb7b19

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/newbieforever2018 P ☆Cares About Noobs☆

1 points

3 years ago

The fear is palpable. I hope this proves to be true! Thanks for all that you do for us.

/u/HugBunter A

1 points

3 years ago

Both the new end game captcha and new Dread captcha are very much user friendly

/u/newbieforever2018 P ☆Cares About Noobs☆

1 points

3 years ago

That sounds fantastic. Thank you for always improving this wonderful one of a kind forum.

/u/greatwhitelemonshark

1 points

3 years ago

was that a meme or is that really how long your password is xD

/u/silentsound

1 points

3 years ago

A phrase, whether random words, or an actual sentence or something is a great way to make a strong password. Maybe throwing in a few numbers and symbols for good measure.

I'm lazy and just copy and paste from my password manager. If I ever got locked out of, or lost my password file, I'd be fucked though, lol.

/u/footsteps

1 points

3 years ago

or a poem

/u/tabsmasher

1 points

3 years ago

Jesus this man's out here with a 35 character password, don't think anyone's gonna crack that.

/u/NietzcheBuddhaJobs

1 points

3 years ago

I might be really nuts going for 60-80 charachter passwords most of the time :D

/u/tabsmasher

1 points

3 years ago

Bruh you could literally have a 15 character alpha-numeric password with a couple symbols and they would never crack it

Also fun info for people: https://www.eff.org/issues/know-your-rights#17

/u/NietzcheBuddhaJobs

1 points

3 years ago

For the quantum days maybe :D

That's pretty helpful to know the rights. Are these fro US. i am in australia.

/u/tabsmasher

-1 points

3 years ago

Yeah US rights sorry, you guys kinda lost your power as citizens when you gave up your guns. Like bruh, your country literally has "re-edcuation camps", you guys have no rights.

/u/NietzcheBuddhaJobs

4 points

3 years ago

Isn't that a lot to say for country with no healthcare, huge student depts, low wage rates and people dropping like flies due to covid.

/u/tabsmasher

-1 points

3 years ago

I mean I have great health care, I actually tried in high school so I went to college for free, so no student debt, just got over covid and it had a 0.0001% chance of killing me. And peopel who make low wages are lazy people who refuse to seek a higher education, and we have medicare for people making under like 50k a year, which is free health insurance for about half the country. Do some research next time, it's old people with preexisting lung problems that are dying of covid, that's about it, the media just hypes it up and suckers like you fall for it.

/u/[deleted]

1 points

3 years ago

That's a substantially more user-friendly captcha and I don't know that much about how they work but I also struggle to believe that isn't a substantial decrease in spam/DDOS protection. Is the current level of security somewhat overkill or is this problem uninituitively hard for a neural network? I feel like the same cues that make this easy for a human could work for a CNN or similar.

/u/plainEngrish

0 points

3 years ago

i mean... if you had a working understanding of neural networks or even basic machine learning you wouldn't need to be tossing around buzzwords you heard elon saying on some podcast and doubting things that you admit you have no working knowledge of while also trying to make an informed conclusion as if you do know. you would just be doing it. until then the whole " i dont know jack shit about this but..." heres me trying to act like i know just enough to make a blanket statement but really fishing for an answer isnt a good look. just read some stuff.

/u/[deleted]

1 points

3 years ago

There isn't a single buzzword in that entire sentence and while I won't doxx myself I have relevant graduate-level education and experience with applied machine learning on real data in real world settings and also half-decent educational experience using synthetic data to assess to performance of novel optimization approaches. I'm moderately but broadly familiar with most modern SOTY architectures, if I wanted to a buzzword laden ramble I could pull one out of my ass on a dime.

/u/locabuena

1 points

3 years ago

thank you jesus

/u/marcgolds

1 points

3 years ago

[removed]

/u/AutoModerator M Judge Dread

0 points

3 years ago

We do not allow Wickr IDs and you are posting in the wrong sub, this is for Dread information only.

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/FrogToot

8 points

3 years ago

The absence of this feature has darkened the darknet itself. Single most useful feature of the site to me, and this is a useful site.

/u/dreadred441

6 points

3 years ago

Any timeline on when the search feature will be back up?

It's hard (impossible) to do research without it.

/u/CaponeMalone33

1 points

3 years ago

Seriously.

/u/nowimlearnt

2 points

3 years ago

bruuuuuuuuuuuuh fr

/u/plainEngrish

1 points

3 years ago

seriously, fuck off. who the fuck are you? nobody. wait patiently with your trap shut cunt.

/u/CaponeMalone33

1 points

3 years ago

Stfu, don't you understand that people actually relate to what I am talking about, maybe not you but most people felt this way over the Dread rewrite. Maybe not for you, but others needed the search function. So please, shut the fuck up you are just making yourself look like a dick.

/u/itsbabymilohoe

6 points

3 years ago

How long till the search button will be added? its useless dread without it. Everyone needs it to search thru reviews of vendors. Please hurry!

/u/LarryBird3000

3 points

3 years ago

bring it back

/u/CaponeMalone33

1 points

3 years ago

Seriously!

/u/personaluse

5 points

3 years ago

The search function really needs to be reinstated, currently we have no way of checking out posts on vendors.

Peoples money and safety are at risk currently, I respectfully urge a reconsideration, the search function is vital.

/u/HugBunter A

1 points

3 years ago

It is a choice between the site being potentially offline due to the search being exploited for DDOS attacks or the site being online without search. It will return soon without that risk.

/u/someFX

4 points

3 years ago

Was just about to create a new post: "Is it just me or ... blah blah search feature?"

/u/mikeloxford

4 points

3 years ago

How do I find what I'm looking for ?

/u/mrbenzo666

4 points

3 years ago

when we have the searchbar back? this is killing me

/u/decibelsour

4 points

3 years ago

Yea kind of defeats the entire purpose of this website being unable to search and find information

/u/robbierotten

4 points

3 years ago

This site is dead and useless untill the search function comes back, this shit better be the most advanced search engine I've ever seen. Google should be trembling in their boots when this finally comes out.

/u/Dewie

4 points

3 years ago

4 months and counting, cannot wait for this feature to return

/u/flipthewhip

3 points

3 years ago

3 weeks?? Please let us know when the search function returning! This site is basically pointless without.

/u/CaponeMalone33

0 points

3 years ago

EXACTLY!!!

/u/rustler266

3 points

3 years ago

hey so its been a Month since you posted this. is there a eta on the search feature? to me and most likely others the site is kinda useless (no offensive) to work around since the search feature is gone.

/u/CaponeMalone33

2 points

3 years ago

Exactly, I keep on asking this question on this thread and get no response from U/paris, which is understandable. Although, he has not replied to any recent comments, which has me thinking if he is really working on the re-script right now? The only comment reply he made about the ETA said "soon"...

/u/plainEngrish

1 points

3 years ago

im sure they just dont want to acknowledge a whiny ass entitled ungrateful annoying pussy ass beta bitch

/u/FrogToot

1 points

3 years ago

Yeah, I've been checking back in just to see if search is back, but man Dread without search is a fraction of what it is with search, can't wait for it to resurface.

/u/shyidle

3 points

3 years ago

waiting for search

/u/cheezypretz

1 points

3 years ago

Yeah thats like a huge function, and elimates 99 percent of the same fucking questions being asked. makes it hard to track down info on potential vendors that id like to work with though...

/u/BlackSabbath

2 points

3 years ago

Success with the coding !!

/u/CodeJoe

2 points

3 years ago

You should try to use CQRS with an isolated search service, it'll help you to scale your search query independently from the rest of your application and greatly optimize performance.

/u/Kodakblackzzz

2 points

3 years ago

Will the search section be back anytime soon guys

/u/MandarksBankLab

2 points

3 years ago

thank you /u/Paris , we are eagerly waiting for the new updates with right search indexing. Thankyou for everything. also fix the issue with recon as i am not able to claim my vendor account on it even after having the same PGP keys on every market and being a TOP vendor on ToRReZ for selling Business checks and FUllz .
whenever i login into Recon it shows me as a USER account, and i do not see a CLAIM VENDOR Box . everything is appreciated /u/Paris .

/u/Fume

2 points

3 years ago

ITS BEEN 4 WEEKS!

/u/SV2MG

2 points

3 years ago

IT'S BEEN 6 WEEKS!

/u/rustler266

2 points

3 years ago

until this is up is there a work around?

/u/Alissa0612

2 points

3 years ago

hope the search comes back soon.

/u/locabuena

2 points

3 years ago

All right folks common.It doesn't take a genius to see hat something else is up here because no one upgrades something as central as the search function for a site like this by taking it down altogether until it's been replaced as if you can't work on the upgrade while the current search functionality remains in place.your dev environment is not your testing environment which is not you live environment, etc. to put it simply. I've managed many types of enterprise dev projects and I've never heard of this approach. when you add to that the inexplicable lack of response to questions about time frame it becomes even less believable. So what's the deal really? You don't actually expect to ever restore search right? are you wanting to wind down usage before closing? are you worried about LE finding specific content?....... the truth will set you free :)

/u/Paris 📢 A

1 points

3 years ago

I get that you are pissed we don't have the search online yet. We wanted to have this update done weeks ago. The limits to the search and load are because of how the database is designed. Until a new search layer is online we simply can't bring it back while keeping up performance. I recently made a post on /d/cafedread about the search.

Dread is fully scraped. There is very little to hide. That's the truth. It will come when it's ready for production.

/u/locabuena

3 points

3 years ago

you don't have to keep up performance while you are developing the new layer. I guarantee people would much rather have a super slow search temporarily than no search at all.

/u/CaponeMalone33

1 points

3 years ago

Thank you for the update, I hope to have the search function back very soon. Cannot complete much method research without it.

/u/plane11

2 points

3 years ago

When is the search option coming back up if i may ask?

/u/locabuena

2 points

3 years ago

Like I said before this search function thing doesn't make sense in more ways than one. I'm not going to assume this will get "fixed." Sooooo, what are people using as a dread alternative?

/u/riseandshine

2 points

3 years ago

any updates on search guys ?

/u/Coldstorm

2 points

3 years ago

Any update on when search will be back? Anything at all? I know its hard giving ETA's on this things. Thanks for your working so hard on this.

/u/Paris 📢 A

3 points

3 years ago

Within the month.

/u/aufreedom

1 points

3 years ago

thanks for an ETA. :)

/u/DreadDentistPatrick

1 points

3 years ago

I feel betrayed.

/u/Paris 📢 A

1 points

3 years ago

Don't be. Still within the month :P

/u/AnusPainsHurt

1 points

3 years ago

Since you guys haven't re-implemented the search function and I can't search randomly, I'll search here. Do you know what happened to luxsocks? It's been down for 3+ days I'm pretty sure.

/u/Paris 📢 A

1 points

3 years ago

There is no recent message of them right now. But you will be able to search really really soon. Calyx is being a pain in the butt to organize the staging deployment but it's so close.

/u/oiuyp221173322vcx00

2 points

3 years ago

How's the progress? Now I finally understand why I couldn't find anything. :)

/u/DreadDentistPatrick

2 points

3 years ago

so... is the search bar coming back any time soon ?

/u/Paris 📢 A

1 points

3 years ago

VERRRRRRRRRRRRYYYYYYY SOOOOOONNNNNN

/u/AutoModerator M Judge Dread

0 points

3 years ago

Dread's search bar has been disabled until the new dread update comes online.

For more information read the pined post on /d/dread: /post/817f72072a6318fb7b19

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/jarlaxle

2 points

3 years ago

Any update on Search function? No search function really cripples a forum. We are all looking for an update here.

/u/Paris 📢 A

1 points

3 years ago

I know. /u/hugbunter get me your part of the needed code. You are holding everything up.

It's a good update and it's worth the wait. Growing pains. Growing pains.

/u/peepisanonymous

1 points

3 years ago

will it be ready by the end of feb?

/u/Paris 📢 A

1 points

3 years ago

The moment hug gives me his part of the update code with bug fixes we will have it online in a couple days afterwards.

/u/kidwithdaxan

2 points

3 years ago

Maaan this some bullshit how TF we supposed to know if our connects are still safe to use or look up information ? Can't yall just LEAVE the old search ON until you are ready to change it??

/u/Paris 📢 A

1 points

3 years ago

No we can't. "I fundamentally can't scale with this mysql nosql database design enough to provide overall site performance with the search functionality. It's blocking the processes and is becoming a central point for load attacks."

/u/ghosttits

2 points

3 years ago

man i cant even search up if my vendors are scamming ppl are not.

/u/Salvin0rin

2 points

3 years ago

/u/Paris when will the search function be available again?

/u/TTTz 3 year Allstar Trophy

1 points

3 years ago

I know it has been a long time coming.

Just do not Gracefully exit on us. ;0

Will there be a refresh? Do any of the mods need to save anything or prepare for anything?

Do not fuck up you guys,

Insert Joke here

I know Winter will keep things going if all else fails

/u/HugBunter A
/u/syntax M
/u/Paris A
/u/wintermute M
/u/Shakybeats M

/u/Paris 📢 A

4 points

3 years ago

Nothing will be lost. It's just a code adjustment to be more efficient at the scale we are moving towards. The site should seem more consistently responsive now from this single change by removing the shitty search. The next update has some major performance improvements which will allow us to keep operating without frontpage loads taking 5 seconds to complete. After that comes a much needed rewrite which I hope will be simple enough to release to the public so they can understand how some of these things work.

/u/TTTz 3 year Allstar Trophy

5 points

3 years ago

The Whole Dread Team is A+
Admiration for the whole crew

/u/lsdagoround

1 points

3 years ago

possibly related to this? sorting of all new shows posts from 2 hours ago, not the most recent of posts?

/u/Paris 📢 A

1 points

3 years ago

The database layer has been... adjusted is one word for it. I've time-code corrected it which has resulted in some submissions in the index moving ahead in time compared to the system running time. The ordering should be correct just the time ago settings will be off. After a few hours it will just go away.

/u/[deleted]

1 points

3 years ago

Hey have u considered just putting the search function on a separate website? Voat does that im pretty sure.

/u/Paris 📢 A

1 points

3 years ago

No. That is a stupid idea and hurts the user experience. We can make dread have a search again very soon. Just need to index things in a different way and get rid of all the trash.

/u/[deleted]

1 points

3 years ago

k was just throwing it out there. sorry for being stupid :(

/u/drippindroppin

1 points

3 years ago

its okay i still love you

/u/StarScream999

1 points

3 years ago

Oh no! I use the search function all the time! :( What's the ETA on it being back online?

/u/Paris 📢 A

3 points

3 years ago*

soon™

Overall the search feature needs to be fully rewritten so it doesn't block the whole site when someone searches "drugs" within a subdread. It will be done. When it is released back to the public it will be MUCH MUCH improved.

/u/StarScream999

2 points

3 years ago

> soon™

That sounds bad.

Btw, /u/Paris, is there a limit on the number of saved posts you can have? I've been trying to add a post to my saved post list, but it won't show up.

/u/Paris 📢 A

1 points

3 years ago

There shouldn't be a limit to the amount of saved posts to my knowledge. How many saved posts do you have?

/u/StarScream999

1 points

3 years ago

18. I noticed some of the posts I saved finally showed up, but it they didn't show up immediately, and not at the top of the saved list, it stuck it down in the middle for some reason.

/u/MisterMeatMan

2 points

3 years ago

Could you securely cache the DB search query so that if someone created an identical search in the last N hours, it checks for a smaller number of new entries, then simply loads the cached results?
I know how to accomplish on sites where OpSec is not an issue, and with universal UTC, over the course of a day or 12 hours the searches are querying an abstraction of the generated cache.

Haven't given the OpSec a consideration (tokens and whatnot), just throwing it out there. It works well to speed up searches on P2P networks.

/u/Paris 📢 A

1 points

3 years ago

We already have that. But it still wasn't enough. People search for crazy random things and most times multiple things because the first or second result doesn't turn back what they are searching for. The improved search is much MUCH better at finding what the user is really searching for. It's a big improvement.

/u/MisterMeatMan

1 points

3 years ago

That's awesome to hear! Very interested from a developers perspective to see what you've managed to come up with.
Will the schema be open source?
Any info about the type of data structuring you'll be using I'd be interested to hear about, I've really gotten into optimizing indexing queries after making some improvements to The Graph web3 protocol.

Thank you to the team for your tireless work making dread a shining light in the dark web.

/u/Paris 📢 A

2 points

3 years ago

The goal of the rewrite is to release dread to the public as an open source project which can be adjusted and played around with. It won't have everything, like the anti-manipulation systems or the sort algorithms, but it would be a clean project people can run (with enough development and cluster experience). Graph data systems are core of the anti-manipulation process.

You can probably guess what the schema is based with a full nosql design. The search for the posts and comments are not that complex itself. Just needed to parse away the bbcode and index it properly to make it searchable.

/u/MisterMeatMan

1 points

3 years ago

[removed]

/u/AutoModerator M Judge Dread

0 points

3 years ago

Dread's search bar has been disabled until the new dread update comes online.

For more information read the pined post on /d/dread: /post/817f72072a6318fb7b19

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/MisterMeatMan

1 points

3 years ago

I like the roadmap that's actually awesome news, sounds like it's mostly the time consuming busy work at this point. Shame text entry isn't in a lightweight markdown.

The depth of how integral dread is for the DN and finding reliable data really hit home when there was way to query. Thankfully Recon exists.

If dread is going open source this might be moot, but if you all ever need another developer to write or submit anything... *hands business card*.

/u/hatbroth

1 points

3 years ago

/u/Paris So these are the most recent things ive seen you post on this thread. I know everyone is asking a million questions, and complaining. I don't want to annoy you with everything going on, but it sounds like everything might be done, or almost at least? Therefore do you have a guess, even a general one, as to when the updates / search bar will be back? Thank you for this post and all the information, and all the hard work

/u/FrankBaud

1 points

3 years ago

r/fakeid much?

/u/TTTz 3 year Allstar Trophy

1 points

3 years ago

You can not search for dirty words now

-TTTz™

/u/ukbenzogod

1 points

3 years ago

Thanks for the update

/u/lostruMQUaRd

1 points

3 years ago

is code open source? I want to contribute

/u/Paris 📢 A

4 points

3 years ago

We have been planning to make dread open source for the longest time. But truth be told this code is so complex and hard to manage that even an experienced developer like me has the hardest time developing things on it. This was very much designed just for hugbunter to work on. But he didn't account that we would grow to be the largest English speaking forum on the darknet.

/u/douglasfastcar

1 points

3 years ago

You did say dread rewrite. Did you mean just the search is being rewritten or the entire site?

And honestly, what's stopping us from crowd building a new dread from the ground up?

Pick a popular PHP framework that most any dev can work with, slap on a private git server, get some people of varying experience levels all together to develop and push commits and we could probably build a pretty badass dread.

You and hug lead the charge.

/u/Paris 📢 A

1 points

3 years ago

The WHOLE site will be rewritten. The problem with the crowd building a new dread is that overall most of the code work is done (at least for the front end) and the things are are going to doing is quite complex. PHP is also too slow for this site now. We will be moving to a complied language (not sure which anymore but probably golang) with a micro-service design. Something which will be able to fully scale to the point where page loads are under 500ms on the Tor network.

/u/USNova

4 points

3 years ago

i can only get so moist

/u/dom0

1 points

3 years ago

^^^^^

/u/douglasfastcar

1 points

3 years ago

Holy shit is all I can say to that.

/u/fire2

1 points

3 years ago*

Why not NodeJS + an event driven Microservice architecture ? Going event driven would be really helpful when trying to archive your sub 500ms goal.

Any synchronous TCP based communication processes / data transactions between Microservices (HTTP for example) (probably even proxied through TOR) will make it nearly impossible for you to reach that goal.

NodeJS handles all async I/O via LibUV (written in C) and uses V8.

It would make things much easier.

No manual memory management etc.

Just a recommendation. Love Dread and keep up the good work !!!!

/u/Paris 📢 A

1 points

3 years ago

That's a reasonable assessment but if you ever worked with NodeJs you will realize how bloated it can become with many performance edge cases that can occur. Golang's ability to be complied down to machine code and run things concurrently makes it extremely fast and lightweight. Far far faster than NodeJS. I'm not going to be parting off many different microservices. Just the database, application logic, loadbalancer (with firewall), search engine, payment systems, and development stack.

Plus TypeScript. Yuck.

/u/fire2

1 points

3 years ago

I have worked with NodeJS for years. Same goes for Golang, C and C++. Would you mind elaborating on what you mean by "bloated" ?

> Far far faster than NodeJS

I disagree with you on that. You can"t just simply say that. Obviously Golang is a compiled language but it doesnt make it "far" faster than NodeJS.

> By firewall are you referring to your Captcha that you serve via Nginx (Openresty) and generate with the help of LUA on your reverse proxy ? THATS a performance killer.

> Plus TypeScript. Yuck.

Yes, TS is gay

/u/Paris 📢 A

1 points

3 years ago

Sure. We are using a containerized microservice architecture. It is extremely important that the code can compile down to a single binary with no dependencies (which we can run in a scratch container). Full length concurrency built right into the language itself prevents the single-threaded CPU bound tasks blocking the program. Concurrency is the main performance reason why I would choose go over NodeJS for a site as large and complex as dread.

NodeJS is based on Javascript which is an interpreted language, that by itself makes it generally slower than other complied languages like golang or rust. The raw pure performance, just taking single threaded workloads in account, will render better results in a complied language. We need scalability and efficient resource usage. It takes a lot of CPU usage and information to compute the front pages and comment trees. Taking into account the full dynamic nature of this site, if I can't effectively do tasks on the CPU layer with multiple cores per request it would be a big downside.

When it comes to bloat, all you need to look at is most large project's node_modules directory. There is so much bloat to even compile the application itself. NodeJS also, from my (dated) experience, has issues with proper memory allocation. Javascript engines generally have this problem (which gets exploited and is the reason why most browsers sandbox the engine). I can control the lower level memory usage right in go without needing to worry about a leak with the underlining engine.

Being that Tor is mainly the bottleneck in the connection line it makes little difference on load times with how the firewall works on nginx. Other than the captcha generation (which can be pregenerated and served) the performance decrease is just a few milliseconds under local proxy. Well worth it for the added security and bot protection.

/u/fire2

1 points

3 years ago*

> Concurrency is the main performance reason why I would choose go over NodeJS for a site as large and complex as dread.

So what about Netflix? They are pretty happy with Node.

> Prevents the single-threaded CPU bound tasks blocking the program. Concurrency is the main performance reason why I would choose go over NodeJS

As I said. All async I/O in NodeJS is handled via LibUV (which is written in C). The only synchronous thing here is the process of iterating over the poll queue of the Event Loop. There wont be any big notable difference.

> Taking into account the full dynamic nature of this site, if I can't effectively do tasks on the CPU layer with multiple cores per request it would be a big downside.

Refer to what I said above.

> NodeJS also, from my (dated) experience, has issues with proper memory allocation.

Googles V8 engine has greatly improved over the years.

Anyways. I am not trying to argue about whats the best language on here. Using NodeJS was just an idea that came to my mind. It seemed and still seems like a good language / runtime environment for dread to use / consider when rewriting the source code.

Love, fire2

/u/fire2

1 points

3 years ago

[removed]

/u/Paris 📢 A

1 points

3 years ago

I do, it's on my profile, but I need to first add your jabber so the authentication request is accepted.

/u/fire2

1 points

3 years ago

Check DM in approx 5 mins

/u/Treesweed

1 points

3 years ago

That is amazing !

/u/BeastMasterMain

1 points

3 years ago

I came here to search up m vendors but i don't mind the updating at all, cheers

/u/Paris 📢 A

2 points

3 years ago

If you want to search vendors you should probably use /d/recon to see their feedback and markets they are on.

/u/doobiedomestic

1 points

3 years ago

Nice its important to regularly update for better performance. You will do the best /u/Paris
Thank You

/u/Pacco

1 points

3 years ago

opensource wen ?

/u/FizDing

1 points

3 years ago

Never. Solly Challie

/u/HaYA4dF5643NKq

1 points

3 years ago

Good luck and thanks for the effort.

/u/jasonblockchain

1 points

3 years ago

Hi Paris
Thank You for updating Captcha, they are real headache to login.

/u/branchbox

1 points

3 years ago

Thank you and team for all that you do for the community.

/u/Channel2news

1 points

3 years ago

Is there any possible way to make you re-think your decision

/u/darknetinside

1 points

3 years ago

what i did when the workload on the database went to high was simply split the database in parts. since then i give every years database a new prefix and everything is fine. It took me little of a learning process to use one CMS with multiple databases, but since then the loading time of my pages was shortened significant and also the servers are not that vulnerable anymore.

/u/Paris 📢 A

1 points

3 years ago

Due to dread's database design we can't shard the database. Believe me I tried. It's a full multi master design right now and the simple point is certain operations still take too fucking long.

/u/TheDrugsCompany

1 points

3 years ago

New captcha .... hmmm

/u/unrulyowl

1 points

3 years ago

Thanks

/u/iamnotgainzy

1 points

3 years ago

I recommend just using postgres. That way you don't need any sort of additional indexer (elastic, lucene, etc). Can get away with a simple ts_vector.

https://thoughtbot.com/blog/optimizing-full-text-search-with-postgres-tsvector-columns-and-triggers

Ignore the RoR code and suit to your needs.

/u/Paris 📢 A

1 points

3 years ago

The issue doesn't come really from what kind of database server we are using but the fundamental mysql nosql database design dread has. We already used full text search but because of the database design the indexing can't be done in the standard way and there is a lot of non-relevant junk the process needs to clean out before showing to the user.

/u/iamnotgainzy

1 points

3 years ago

yeah, hard to say without looking at the current implementation, but thankfully postgres has been improving more and more and I'd use it for all projects without hesitation. can even search json: https://www.postgresql.org/docs/current/static/functions-textsearch.html

but if you feel you need elastic or something you can add this extension: https://github.com/zombodb/zombodb

/u/hrV2ds8o

1 points

3 years ago

lol, nice kitchen sink.. you can tell, just by how the repo is organized, that its a hot mess and certainly not something I would consider for a production environment. I am not a dyed in the wool, kiss proponent, but this tool is insane: is it creating a bespoke index type, as a means of encapsulating work against an ES cluster? Instead of a clean separation of concerns, where postgres is the source of truth and elastic is our search index, this becomes an attempt to just hide complexity with complexity. That's sounds like a fun fire to manage, every saturday at 2AM, after drinking everything.

Just use an RDMBS and Elastic, and if you need (and I don't know what your volume looks like), some type of volatile cache like redis, plus a job queue to manage the eventual consistency of every service downstream from your SoT. ES sucks to manage, so, enjoy the soul crushing nonsence that is the jvm.

/u/notauser

1 points

3 years ago

hahah ah shit that last line actually me cackle like a bitch for like 2 whole sec until the humor transformed into a bottomless hole of despair and devops PTSD...maintainers beware there be dragons down that ES road.

/u/plkqcs

1 points

3 years ago

Thanks. I'm looking forward to the new captchas. The machines must be as confused as I am. The amount of continuous grinding effort the admins put into the work of these services cannot be overstated

/u/Ivermectin

1 points

3 years ago

Good luck /u/Paris <3

/u/DWdenizen777

1 points

3 years ago

Understood, thanks for the heads up.

/u/thebiglez

1 points

3 years ago

coming back after months ...it sure is a dis-benefit rn...

/u/EmpBomb

1 points

3 years ago*

Is it possible to add Enable- Disable feature to Mods were you could get notifications if any news posts submitted on the Subdreads you Mod?

And how about "Last Seen" feature on member profile so you could easily know if the member is MIA or not, maybe it's opsec nightmare but you could turn it on and off whenever you want?

/u/lickdickstick

1 points

3 years ago

Thanks Paris a+ for new captcha

/u/goatsnhoes

1 points

3 years ago

It could be years...

/u/delhifpo P

1 points

3 years ago

new captchas, again
didn't the ddos attacks stop? 0_0

/u/usernamer

1 points

3 years ago

So I was literally gonna make a post asking if I was the only one hating the deCAPTCHA and find it so difficult to solve. I come here and the first post I read is from Dread developer saying new captchas are coming. Wow.

/u/Gnome

1 points

3 years ago

Looking forward to it. Keep up the great work.

Sincerly,
Gnome.

/u/OceanBattery

1 points

3 years ago

I'm scared and excited.

/u/FizDing

1 points

3 years ago*

Thanks for keeping your site up and functional. I hope you make enough money on your banner ads and donations to make it worth your while. Might I suggest everybody here done just $1 or $2 to Dread? With as many users as we have out here that would generate a nice Christmas for all who run the site. DONATE link is at the bottom of every Dread page.

EDIT: I will do my part and donate $2 sometime today

/u/dbow05

1 points

3 years ago*

For as much as dread does for the community the ovious aswer is we all give anthing we can even if its a dollar. But if this turns out to be them extorting the search bar for money then, well....i guess ill just keap using dread and be like damn remeber when they had that search bar shit, damn yeah tha was dope.

/u/[deleted]

1 points

3 years ago

A new dread update with a new captchas and tons of feature improvements coming very soon.

I hope downvote button aboliton is one of these. free us from the shackles of downvote bondage, paris!!!!

/u/NancyReagan

1 points

3 years ago

use elasticsearch!

/u/mouldybiscuit

1 points

3 years ago

This no search is tearing me apart Lisa!

/u/waytoodank

1 points

3 years ago

Damn gonna be hard to find reviews for vendors now. Hope it's back soon

/u/butterflygas

1 points

3 years ago

this is sad because i wanted to see the reputations of some vendors here, like pygmalion, has anyone ordered from him because i think im gonna make an order

/u/Paris 📢 A

1 points

3 years ago

You can search for the vendor feedback on /d/recon. Just looking at reviews which could easily be posted by the vendor themselves isn't something I recommend.

/u/empty

1 points

3 years ago

I thought I was losing my mind when I noticed it's gone lol, jut now seeing this.

/u/datpurp420

1 points

3 years ago

was just about to make a post on the search bar

/u/mommy

1 points

3 years ago

How can I check if my vendor is reputable? I always used their vendor name in the search function to see what people have to say :(

/u/Paris 📢 A

1 points

3 years ago

You can search for the vendor on /d/recon which is what we recommend from the start.

/u/chemzilla

1 points

3 years ago

/u/paris any idea how much longer it will take to get search back?

/u/Sun

1 points

3 years ago

I hope you never burn out. Looking forward to the new search.

/u/Layla

1 points

3 years ago

Even with broken search feature, it was dope. Its so hard to use Dread now.

/u/whycantisearchondread

1 points

3 years ago

okay my questions is answered thanks

/u/cattleprodbiscuit

1 points

3 years ago

This post was 5 days ago. How long is search expected to be down for? Another few days, or are we talking about weeks here?

/u/WizzardOfOzz

1 points

3 years ago

just wanted to write new post asking wtf is hapening with search bar lol

/u/Tyrel2020

1 points

3 years ago

When can we use the search function on this site again? It's been like 10 days now....

/u/CaponeMalone33

1 points

3 years ago

SERIOUSLY, we need it back desperately for research.

/u/__j

1 points

3 years ago

/u/__j

1 points

3 years ago

Hi Im here.

/u/Paris 📢 A

1 points

3 years ago

Hi. I'm /u/paris

/u/[deleted]

1 points

3 years ago

But ... the hookers

/u/abu7

1 points

3 years ago

Hey /u/Paris I came to this sub to actually ask where is the search tab and found this thread. Well you gotta try to bring it back faster man, it is the most useful tool I consider on dread..

coffee in the morning, cocaine afternoons.

/u/Lady_Saw

1 points

3 years ago

/u/Paris, just wanted to post and say thanks for all of your hard work. Despite how pushy everyone else is being in the replies, a lot of users out there appreciate your efforts. Dread is such an important .onion on the dark net and we wouldn't have access to all of this with out you. Literally out here changing lives!

/u/lacedcandy

1 points

3 years ago

you guys should change the clock captcha im probably not the only user with dyscalculia aaha

/u/doobiedomestic

1 points

3 years ago

now realizing the search option was so convenient for all. Thanks /u/Paris for making life easier.

/u/Westhoff

1 points

3 years ago

Any timeline on when the search feature will be back up?

/u/qdpresearch

1 points

3 years ago

Just here to say

Bruh

(Seriously though keep it up dude)

/u/stankroniza

1 points

3 years ago

wow i just made a post about this and was linked to this thread. happy i wasnt going crazy, just overlooking the search bar, but damn 3 weeks with no searching? how yall been doing this?? forums instead now i guess?

btw i fucking hate these captchas so bad, i swear some images have what it is asking for, but since it's not the 'focus' of the image it's a crapshoot as to whether or not you will actually pass the captcha. hope the new ones are much easier.

also, do def want to say thanks for your hard work regardless of the little gripes.

/u/AutoModerator M Judge Dread

0 points

3 years ago

Dread's search bar has been disabled until the new dread update comes online.

For more information read the pined post on /d/dread: /post/817f72072a6318fb7b19

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/reefahchiefer

1 points

3 years ago

need that search bar soon no capp. way harder without it

/u/AutoModerator M Judge Dread

0 points

3 years ago

Dread's search bar has been disabled until the new dread update comes online.

For more information read the pined post on /d/dread: /post/817f72072a6318fb7b19

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/kingkuch01

1 points

3 years ago

[removed]

/u/AutoModerator M Judge Dread

0 points

3 years ago

Bad OpSec!

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/locabuena

1 points

3 years ago

I'm imagining what would happen if major sites out there from amazon to wikipedia took entire core functions off line every time they did a major upgrade instead developing the upgrade separately while the existing site remains unchanged until the ready upgrade is integrated.

/u/Paris 📢 A

1 points

3 years ago

You must have missed the start where I said we can't scale to provide site performance with the search functionality blocking things.

/u/NietzcheBuddhaJobs

1 points

3 years ago

New Captchas :) :D

I haven't been this happy since loosing my virginity.

/u/thechaoz

1 points

3 years ago

Ok ty. I haven't been here in a grip and honestly thought I was losing my mind. This top post was right there for the reading.

Sanity intact. Kind of.

/u/Salvin0rin

1 points

3 years ago

If you need a UX Designer do let me know :D

/u/markk

1 points

3 years ago

[removed]

/u/AutoModerator M Judge Dread

0 points

3 years ago

nice try!

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/tabsmasher

1 points

3 years ago

/u/Paris Hey so it's been like a month now, any idea when the search function will be back on? Like I know it's a process but do you guys have any kind of timeline whatsoever?

/u/regularsizednuts

1 points

3 years ago

Damn. Was wondering what happened. Makes sense. Many clearnet sites have this problem too with search being a heavy attack vector, especially "underground" topic forums.

We wish you luck! Hopefully someone with the right skills can volunteer some guidance even if they can't access the code for security reasons or however your process works I know nothing about that.

Is it possible to use another search engine to search this site? Like Torch?

Or is it blocked by crawlers or something like that? I tried using Torch for things on this site but it didn't return very many results. But it would make sense if Dread blocked search engines for all kinds of reasons.

/u/bonesy

1 points

3 years ago

*5 HOURS LATER*

OH

/u/bonesy

1 points

3 years ago

I'd like to provide a little clarity to this post for the folks in the back:

ah, i see, another market retired
ah, i see, classy tho this time no neg vibes or acts, chill (whm auto-pass to cyber-heaven)
ah, i see, new market, total sketch
ah, i see, new vendor, total noob wait.. now im total noob
ah, i see, well, times atickin ill place my order
ah, i see, sweaty palms lemme check some forums for vendor
ah, i see, only one forum that i actually know of
ah, i see, no idea what cool old login could be
ah, i see, can't find search new cool redesign maybe?, oh here my bus
ah, ok, back to dread
ah, ok no word yet on order
ok where the button
ok well

OH

/u/Paris 📢 A

2 points

3 years ago

I get it man. It will be back soon and better than ever.

/u/CaponeMalone33

2 points

3 years ago

Damn what yall doing with the search, just give us an ETA, boutta mark the 5th year anniversary since the search function suddenly dissapeared.

/u/bonesy

0 points

3 years ago

*some time units in the future*

whoa, new dread update? sick
whoa, search function finished
whoa, it is cold out 22 degrees farenheit and joe biden is still president.. hmm this is hell and it has froze over so
whoa, time to look for search button
whoa, robotic dog is barking fuk those kids from mit selling me a robotic dog
whoa, chip quit barkin up there
whoa, u barkin at a bird chip u are a stupid dog go pee on an elec--
whoa, thats no bird thats pre-bacon before meat was outlawed

excuse me

whoa, who this

excuse me yes hi my name is MrHardBaked and I'm looking for information or pics on bugsy malone

whoa, mf i am bonesy not bugsy this not your day

ah, stupid auto-correct. well, toodles.

whoa, damn chip that dude just dissapeared in a flash of--

hi, I'm looking for the bones of my dead father

whoa, where you come from. i am bonesy not .. ur dads bones but there was that one time

hey dis bonesy?

ya who dis

dis u lookin up u on dreads new search hru

gr8 m8 but tha fuk?

listen the new search button can be found--

STOP THIS MADNESS WE ARE THE TIME LORDS COME TO PREVENT ANY OF THIS FROM HAPPENING

/u/p2psolutions

1 points

3 years ago

[removed]

/u/Paris 📢 A

1 points

3 years ago

On a contrary I think you need the ban. We have an anti FUD rule for a reason. Get out with your toxicity.

/u/Channel2news

1 points

3 years ago

if I get a crawler to download the website.. isnt there a way to search it from there.

/u/LesbianApe

1 points

3 years ago

WHY DOES DREAD NOT HAVE A SEARCH FUNCTION!!!!!

/u/LonnieWolf

1 points

3 years ago

Hahaha I'm new here and for the past week or so thought this place just didn't have a search function. I see now... Godspeed!

/u/batwings20

1 points

3 years ago

I feel blind without the search

/u/migozz

1 points

3 years ago

[removed]

/u/AutoModerator M Judge Dread

0 points

3 years ago

We do not allow Wickr IDs and you are posting in the wrong sub, this is for Dread information only.

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/BizBlack

1 points

3 years ago

Is Dread open source? Maybe I could contribute

/u/Paris 📢 A

1 points

3 years ago

Not at this time. A goal in the future is to open source this stuff. I do doubt people would be able to run this at the scale we have it at right now.

/u/Treesweed

1 points

3 years ago*

I doubt it too.Btw search function development has been completed yet ?

/u/usagoldtraveler

1 points

3 years ago

The lack of search functionality is making it a lot harder to track down my vendors this time around (I had found all my old vendors on Torrez, and now I can't find all my old vendors anywhere and I'm having to use new vendors)... I wish vendors would add themselves on recon or somewhere and keep an up-to-date list of where they are selling at, for when markets close

/u/210e9380ey2387e23iueg2g

1 points

3 years ago

Hey, please just change it for now so that the search function requires a captcha everytime, or you have to be registered to use it. I understand it is a rather large load on the server to search through so many posts. It would help to have some sort of min charcount, also to change the clock captcha. It was broken a while ago and I can give you a script to break it with 100% success. Unironically dread is borderline useless without the search function. I cant sift through scams like this.

/u/210e9380ey2387e23iueg2g

1 points

3 years ago

https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/35157.pdf

/u/kingston_sandisk

1 points

3 years ago

Thanks for the good work bros!

/u/reefahchiefer

1 points

3 years ago

Cant do no kinda research without the search bar

/u/AutoModerator M Judge Dread

-1 points

3 years ago

Dread's search bar has been disabled until the new dread update comes online.

For more information read the pined post on /d/dread: /post/817f72072a6318fb7b19

This comment was posted automatically by a bot. All AutoModerator settings are configured by individual communities. Contact this community's Moderators to have your post approved if you believe this was in error.

/u/ProvocativeSal

1 points

3 years ago

jesus christ Dread is completely useless without search. Its impossible to sort through the spam on the front pages. 3 months?? give me a break

/u/PabloCapone12

1 points

3 years ago

Same, I barely even bother logging on here now

/u/MitchPatch

1 points

3 years ago

It's pretty much impossible now for me to read discussions about vendors which was one of the main reasons I used dread. Can't look the name up and see what people are saying. I didn't think search would be down for this long.

/u/InTheNight225

1 points

3 years ago

This is a fucking fever dream from hell!!!!!

/u/InTheNight225

1 points

3 years ago

Damn man we just wanna search shit. Any word on when this update is coming out ??

/u/Paris 📢 A

1 points

3 years ago

We got staging up and getting tested. When the bugs are sorted out and things are polished a bit more it will be back and better than ever!

/u/InTheNight225

1 points

3 years ago

awsome thank you! sorry for being annoying

/u/[deleted]

1 points

3 years ago

If we think correctly. Not having the option to search is a good thing for everyone. Let's say dread forgets everything. Amnesia. It's easier to forget if you can't look into the past. All the best

/u/leery898

1 points

3 years ago

In the meantime, while the search function is unavailable...anyone have any recommendations for where to go to find a current list of scammy vendor usernames? Especially on Dark0de?

/u/cashewquarters

1 points

3 years ago

Dread is fully scraped. There is very little to hide. That's the truth. It will come when it's ready for production.

Wait so, the site is fully scraped. By whom is it scraped? How was this response prompted by the questions?

Can dread users get access to the scraped version?

If I built a scraper and hosted it, would you provide a backend/API/ CAPCHA-free connection to my scraper, so that everyone can use it to search Dread, without impacting performance at all?

There is a reasonable concern that the massive scamming happening right now is in part due to this. Worse yet, anyone who does have a real time scraper, and thus a search function, will be at a great advantage over others, and could abuse the power to scam worse than ever before.

The movement of the darknet may be in jeapordy

/u/gnomeTR0

0 points

3 years ago

MEGA LAME

/u/freddy_rumsen

-1 points

3 years ago

removing the search engine with all that just went down... sus as fuck.

/u/waltcranston

4 points

3 years ago

Why is everything a conspiracy with retards?

/u/authentic

1 points

3 years ago

Fuck you.

/u/waltcranston

1 points

3 years ago

Rude!

/u/StarScream999

1 points

3 years ago

"Everything that just went down" meaning what?

/u/douglasfastcar

1 points

3 years ago

He's referring to the white house exit scam thing I suppose.

/u/StarScream999

2 points

3 years ago

I don't think that was an exit scam, just a mitigated shut down and AFAIK the last remaining customers got their money out and their last orders.

/u/authentic

1 points

3 years ago

/d/conspiracy.

/u/waltcranston

1 points

3 years ago

Why is everything a conspiracy with retards?

/u/swordfish

2 points

3 years ago

I heard that the Dread admins are the same people that faked the Apollo moon landings, were responsible for 911 and also Covid-19.

/u/waltcranston

1 points

3 years ago

Bush did 9/11, I did apollo and covid

/u/plkqcs

1 points

3 years ago

NOW THIS GUY ...

/u/freddy_rumsen 0 points
16 hours ago
removing the search engine with all that just went down... sus as fuck.

What a fuckn' beauty. Reading through this post, I had nearly forgotten that Dread is as full of numb butts and nameless assholes as any mall in America. Thanks for trashing my high /u/freddy_rumsen . You cunt

Search will be offline until the dread rewrite is done : Dread | Torhoo darknet markets