How difficult is it to create a search engine?
1 02 May 2018 17:22 by u/stillinit
Don't know much about crawlers, or the expense but you'd think by now there would be a non-corporate search engine equivalent to google circa 2004.
1 02 May 2018 17:22 by u/stillinit
Don't know much about crawlers, or the expense but you'd think by now there would be a non-corporate search engine equivalent to google circa 2004.
12 comments
0 u/DukeofAnarchy 02 May 2018 17:49
Easy to make one, hard to make a good one, hard to fund it.
0 u/fluffyego 12 May 2018 17:13
cough bing cough /s0 u/Jimmycog 02 May 2018 19:52
Not hard if the Nsa, Cia, FBI, Dod, Tsa, Nypd, fund it for you.
0 u/stillinit [OP] 02 May 2018 20:09
fund and promote
0 u/SquarebobSpongebutt 07 May 2018 17:30
You have to have servers and bandwidth to do all that crawling, and then you have to store the results so you can retrieve them. And you better retrieve them fast. And it better be accurate and up to date and available 24/7/365. Google sets the standard now and you will be expected to approximate that as much as you can. There is a reason the better search engines either leech off Google or have a lot of ads.
0 u/obvious-throwaway- 10 May 2018 23:42
Google search turned to shit, start using Bing. I was extremely skeptical at first but after a few months it's hard to go back. Google has apparently replaced all their programmers with purple haired dykes.
0 u/avgwhtguy1 10 May 2018 02:40
not that hard. there are a lot of search engines out there. you need to maintain, which means fund. the more popular it is, the more expensive it gets.
need self funding model. maybe open source but programmer/admin hours entitles you to ad profit.
searching the entire internet has always been a bit of a misnomer. and specialist search engines perform better.
0 u/MrKequc 13 May 2018 21:39
Nobody would trust you and more importantly nobody would trust that you provide the best search results. For some reason people actually do trust Google, to the extent that hundreds of millions tell google where they are every second of every day. So to use google search isn't exactly a leap for them.
On top of that google's search results will actually be better than yours, potentially forever. Because even if you caught up, the expenses you had faced would have investors kicking your door down to augment the results to better serve your income sources. The income sources would be the same people that own everything.
0 u/RiverWind 18 May 2018 00:38
https://searx.me
The code is Free. It is much better than other engines.
0 u/YesMaddyHussy 25 May 2018 06:50
There are four core activities in a search engine: crawling, indexing, ranking and query serving. If you understand this well and with good programming skills you can develop it.
0 u/mondgott 30 May 2018 17:37
i think so hard mate.
0 u/stillinit [OP] 04 Jun 2018 03:01
It's called not being a retard.