Getting a website listed on Yahoo in 1996 required persuading a living, breathing person that your business had earned its place.
Nicole M. Radziwill spent that decade working as a systems administrator, programmer and project manager, and the ritual has stayed with her. “I was a sysadmin for an ‘ecommerce shop’ in 1995 and 1996,” she said, “and when we would turn up websites for new clients, the highlight of our process was submitting the site to Yahoo. Yahoo was like the Yellow Pages, but only for websites. There was a form you would fill out, and you had to justify to the real people at Yahoo that this business you were submitting was legit and important enough to be in Yahoo’s main directory.”
Now and then, those people turned you down.
“I remember one time submitting the website for a regional branch of the American Cancer Society and getting rejected because it ‘wasn’t significant enough,'” Radziwill said. “They recommended we contact the main ACS and have them link the site from their page… that they didn’t have yet.”
Nobody yet assumed everything was searchable
This is where the popular account of the pre-Google web goes astray. The point isn’t that the early engines simply did a worse job. They were serving a different Internet — one in which directories genuinely mattered, crawling remained a craft, ranking was brittle, and “search” had not yet been compressed into one dominant box.
Discovery happened through Yahoo-style directories, bookmarks, newsgroups, email signatures and links handed around person to person. The web remained small enough that human organization could still hold its own against machine indexing. Search engines were around, sure. They were one choice among many rather than the front door.
Usenet arrived first. Dreamed up in 1979, it gave people topic-based newsgroups and a culture of distributed conversation, so online information already felt communal long before the first significant web engines appeared.
“It was the way to find out about websites that might interest you,” Radziwill said. “I got on Usenet in 1990 as a student in Durham, North Carolina… it was delightful, especially the alt.* and misc.* groups. People would put links in at the bottom of their posts, and awareness grew organically. And if you wanted safer or more reliable recommendations, you could limit yourself to moderated groups.”
Webrings operated on trust that went unexamined
“Then a couple of years later, webrings popped up,” Radziwill said. “You’d get a block of code and put it on the bottom of your site’s HTML page, and it would embed a link to the next website related to this one. Someone else would manage the list of what could come next, so it was a great way to increase your exposure. The people putting together the lists for the webrings were generally pretty upstanding, so we didn’t even think about sabotage.”
Go back over that final sentence. Here was an open, unverified chain of redirects, kept up by volunteers, and the threat model simply never came up.
Webrings cultivated microcommunities in much the same way the BBS era had — people bound by one shared niche interest, occasionally living down the street from each other. Well before Reddit absorbed that role, a webring was among the handful of ways to track down sites devoted to whatever you happened to love.
Retrieval wasn’t yet what the web did. Services were designed so you could browse through topical categories rather than throw a query at some universal index, and turning to a directory wasn’t a consolation prize. Frequently it was the entire idea.
Curation by hand performed better than anyone had a right to expect. Editors could recognize quality, screen out junk and bring order to a medium expanding at speed. What it couldn’t do was scale, and it grew slower and costlier as content outpaced the people doing the classifying. The moment pages outnumbered editors, crawlers took the win by default.
AltaVista gave you 40,000 results and sent you on your way
AltaVista, Lycos, Excite and HotBot went after the scale problem with software rather than staff. Their methods differed, but the ambition was shared: vacuum up as much of the web as they could and let the algorithm work it out.
AltaVista pushed the idea furthest. It combined a quick crawler with indexing software that scaled, and within a short time of launching it was handling millions of HTTP requests a day. Search stopped resembling a stroll through a catalog and began to feel like interrogating a machine.
Later releases could handle natural language-style queries. To anyone still figuring out what the web actually was, that bordered on miraculous — rough-edged results and all.
Mark Friend, director of the IT support firm Classroom365 Limited, was working as a systems operator in the late ’90s and has no interest in romanticizing it.
“Most people have completely forgotten how chaotic it really was,” Friend said. “Back then, if you typed a question into AltaVista, the odds were stacked against you if you were looking for anything specific. You’d receive 40,000 results that would leave you just as confused as shouting into a crowded room.”
Learning to mine an AltaVista results page took months of practice. Still, AltaVista locked in one expectation for good: search ought to be instantaneous. After people experienced an enormous index swept in seconds, sluggish and partial systems had no future. AltaVista lost the war, yet it set the rules of engagement.
Lycos and Excite were chasing destinations, not tools
Each was simultaneously a search brand and a portal, with news, email, sports, weather and finance piled around the query box — every bit of it built to hold you on the page rather than hand you off to results.
There was no consensus on what the category actually was. Certain engines went after breadth, others after speed, and some mixed editorial channels into automated results in ways that look strange in hindsight. The phrase “search engine” stretched across directories, crawlers and portals that had a search field tacked on as an afterthought.
HotBot carried itself as the serious contender. It showed up right as users began to realize that quality rested on index size and ranking sophistication in combination, and Inktomi supplied its scalable backend. Crawling fast no longer sufficed. Users were after results that were relevant, up to date and not visibly manipulated.
That was the soft spot. Depend too heavily on on-page text signals and anybody can pad a page with word bloat to rise through the rankings. Marketing wins out over quality. The early web became a laboratory for manipulation before the phrase “search engine optimization” was in circulation.
Ask Jeeves sold a conversation the tech couldn’t hold up
To Friend, Ask Jeeves seemed like the future because it invited you to type out a question rather than think in keywords, creating the sense of a well-informed assistant working the web for you. It’s tempting — and worth resisting — to overstate how much it resembles today’s chatbots: Ask Jeeves had nothing approaching an LLM-based conversational interface.
Natural language is a hard problem. The questions users typed weren’t clean, and the machinery beneath couldn’t reliably work out intent at scale. What Ask Jeeves is remembered for is claiming a grasp of people that the technology of its day couldn’t back up.
Burying white text on a white background counted as strategy
Optimization was already happening. What didn’t exist was the professionalized version, complete with teams of specialists tracking Google’s latest unexplained shift. The early engines responded to obvious signals: repeated keywords, metadata, submission tricks.
“People didn’t talk about ranking back then,” Friend recalled. “They submitted their URL and waited patiently to see if it would show up in a search. Everyone took the Meta keyword tag seriously and the practice of utilizing ‘white text on a white background’ to hide hidden keywords was a legitimate tactic that webmasters would use to include keywords in their website for search engine crawlers. There was no fear of penalties, and you built a website, crossed your fingers, and hoped for the best.”
Toward the end of the ’90s the engines had given that trick a name — spamdexing — and begun penalizing it. Ranking back then was both simpler and more delicate. The rules hadn’t set, and the feedback loop between publishers and engines was still small enough to probe and interpret. All of that ended once search became the primary gateway to the web, and the relationship went adversarial.
“The hard truth that most people do not want to face is that scraping and ranking turned the Internet into a manufacturing facility of content,” Friend said. “Websites went from being written for people to being written primarily for search engine crawlers.”
What Google really invented was the logic of ranking
Search itself wasn’t its discovery. PageRank read links as markers of authority, so relevance became partly a matter of how the rest of the web pointed toward a given page. The results felt more credible, and blunt manipulation became harder. Not impossible.
The interface pulled as much weight as the algorithm did. A pared-back page that stepped aside signaled to users that search was a utility, not a portal amusement park, and the search box turned into the front door to everything.
What it displaced was slower and untidier. It also contained more rival theories about how information ought to be located, sorted and judged. Some systems put their faith in people, some in crawlers, some in directories, some in a question typed out in plain English.
“The Internet contained an inherent level of clutter and chaos,” Friend remembered. “But at the same time, it was a much more humanized place before. It’s why many of us feel nostalgic for that time. The Internet had an artisanal feel to it. It was made by real people using text editors such as Notepad and Dreamweaver. You might start at one destination and find yourself at a fan site of an obscure band, and then end up at a forum discussing vintage synthesizers, and ultimately end up on a NASA page.”
Those engines were not rough drafts of Google that failed. They were earnest responses to a problem the web had made pressing without making solvable, and there was nothing inevitable about search ending up in its present form. Google prevailed by combining technical rank, usability and scale precisely when everyone else was prepared to abandon the old order.