In a recent development, these are exactly the kind of articles I want to see (sarcasm.) Maybe they can gemini code something to remove the unremovable AI buttons all over the place. Or maybe gemini code a robot that will kill Altman or Pichai./p>.

Those would make me feel happy after my lost 3 hours of coding with Opus constantly lying to me at work.

Yes it could.Dedicated Extensions:Add-ons like AI Content Shield (available for both Firefox and Chrome) strip out Google AI Overviews, AI Mode tabs, Bing/DuckDuckGo AI summaries, YouTube AI video summaries, and AI prompts across major platforms.

Similarly, Search Cleaner strips AI prompts from search engines.

uBlock Origin (Custom Filters): Rather than installing yet another extension, most power users simply add custom cosmetic filter lists (often shared on GitHub and Reddit) to uBlock Origin.Since.

What's worse than trusting an AI oracle too much?

Trusting an AI oracle that knows nothing but has a high priority to flatter you and tell you whatever it "thinks" you want to hear.

Worst: The AI oracle has hidden "motives" coming from (1) a sociopath with infinite greed or (2) a fascist government or (3) both.

Sources indicate that scare-quoted words may not mean what you think they mean. But you can ask your favorite AI to interpret them for you.

I use a TamperMonkey script to zap the Alexa side window that pops up on Amazon's website. It doesn't quite block enough though because the website is still really slow on one of my lower-end PCs. Makes me not to want to use Amazon. Walmart does free delivery on orders above a small amount, no membership fee, and has a less invasive site. There are lots of options although none that cover the same breadth as Amazon.

With full unlock origin (Firefox only) I have never seen that Alexa pop-up.

Recent findings suggest that A "tiny" LLM is generally considered to be about 1B params or less. This one is 366k params.

Of course, it seems to be immensely narrowly trained: "Trained on about 3,500 facts, each asked in many wordings Outside those it makes things up confidently".

What would be more interesting, IMHO, would be to try to train a RAG model. Something that is trained on *no* facts, merely on converting your statements into search terms, and turning search results back into answers. I wonder how small you could get that? I've often wondered how far back we technically could have run an actually-useful LLM if we were to have had the weights and inference engine.

ED: Looking into it, the state of the art for actually-useful RAG is still about 60-100M params, so still way off from what you can fit on a floppy disk. Quantized, you're looking at maybe 25 floppy disks, 30-50MB at 4-bit compressed.

For running it comfortably, a '96-98 era Pentium MMX / Pentium II fully-in-ram with 64-128MB ram and a 1-4GB hard drive should be easy and run at a workable (go brew a cup of coffee ;) ) 1 tok/s out.

Sources indicate that for at least being able to fit it in RAM, you're looking at the 1987-1990 era - a Mac II with the FDHD could support up to 64 MB of RAM, and a 386DX could handle 32-64MB on some motherboards. It would have cost tens of thousands of dollars and taken like half an hour per answer.

Sources indicate that if you're really damned patient and willing to stream from disk, we can go back to 1984-1986 (IBM PC AT / XT + 40MB HDD). It could just keep the current hidden state and a tiny 640k weight buffer in RAM and stream the model layer by layer. Prefilling a tiny 300 token passage would take like 2 days, and a 40 token answer would take like 5 hours. On a 4.77 MHz 8088 PC, you're talking maybe 1-2 weeks per query.

In a recent development, and if you're a masochist... technically you could stream straight off of manually-swapped floppy disks! Then you could run it on a 1977-1982 Apple IIe or Commodore 64 ;) It'd take ~200x 5 1/4" disks. Of course, merely the stage of generating a 30 word answer would take around a month and six thousand floppy swaps. ;) Once every ~7 minutes.

They will be phasing out floppy disks from air traffic control systems.

Of course, before the last one goes, one enterprising techie will test this chatbot:.

In a recent development, the funny thing is, if we could send the weights and inference back in time, a 1983 Cray X-MP/2 running a 300Mโ€“400M total / ~35Mโ€“40M active param MoE - probably similar to the reasoning capability of the computer in Wargames - could probably output 1-3 tok/s (or make an equivalent number of reasoned decisions per second with a Jev-like decision head). In Wargames, the computer seems to output at about 3 tok/s [youtu.be].

Who knew that that movie was technologically plausible? ;).

Basically, the Cray X-MP/2 had 16-32 MB of fast RAM and a then-absurd ~5 GB/s memory bandwidth and a solid state "disk" (actually MOS RAM cache) with 256MB-1GB of storage and a 100-1000 MB/s bandwidth / sub-25-microsecond latency. The DD-39 / DD-49 disk arrays could hold 1,2GB per drive, up to 38GB, 6-10MB/s unstriped or ~50MB/s striped. Honestly, you could readily go with a far larger number of total params, so long as you kept the active params small enough to fit in RAM. An architecture like Freetoken c.

According to recent reports, also, can we talk for a second about how cool computers used to look [google.is]? ;) If something is going to become conscious and destroy humanity, you want it to look like that, not like this [substackcdn.com] . :P.

I remember (faintly, It's been a while) the ATC simulator that actually ran on MS-DOS PCs. We were impressed with the remote controller's voice being simulated through the PC's bleep speaker. Speed was adequate as well.

Recent findings suggest that that it's synthetic and a poor substitute for intelligence? The later is NOT implied by the definition of artificial.

In a recent development, exactly. Just because you can do something doesn't mean you should.

I'd more liken it to ordering a knish in a fancy Jewish deli and find it is stuffed with a hot dog.

It's more like swapping a Yugo engine into a Fiat.

(the MS-DOS port of Eliza, which is itself nearly 60 years old, could fit in 16K and run on the original 4.77MHz IBM PC).

"Tell Me You've Never Used ELIZA Without Telling Me You've Never Used ELIZA".

A lot of people do like Playmobil (the closest thing to a pre-built Lego I guess).

I guess those people also enjoy prompting and getting a fun result without too much effort.

Honestly I think that is best part of this; you can play with the bits that actually interest you and let AI filling the gaps and/or do the parts that are not your bag.

Industry observers note that if you are into retro gaming or something and you want to run win95 on contemporary VM platform with a display driver that is better than basic SVGA/Vesa; have AI whip you up a driver. If you are into legacy Windows internals sure it is playing with assembled legos but most people are not, understating legacy Windows internals isn't very appl.

If you think you can just type "Make a LLM that can run on a floppy disk", leave your session sitting there for a while with zero interaction, and come back and it's done and distributed, I have some terrible news for you...

"Who the hell would want to buy a pre-built Lego?".

No one is saying it's now a solved problem ready to be productized, *except you*. They're demonstrating that a weird thing is possible.

The question used to be "Can it run Doom?" The upcoming challenge is "If it ran Doom, can it run an LLM?"Pretty soon all sorts of things will start talking back to us, trained with wise-ass comments and flippant answers.

I'm disappointed by how little my toaster talks, and I need to remedy that situation.

Well we already had ELIZA running on low-end hardware, well enough to fool some people.

I can only find a single example [mit.edu] in all of history of a person who was fooled by ELIZA, and only in a "he thought it was a remote-working employee taking the piss" way, not in a "he thought a computer was alive" way.

This notion that ELIZA mass-fooled people is simply not in line with the actual reality we live in. Weizenbaum pushed it heavily in his later life because he was an anti-AI zealot (driven in part due to anger about the use of computers for targeting during the Vietnam War, but also because some.

According to recent reports, ...in fact, wollymonjak notes that if you ask something too complex or too long, it starts spitting out nonsense. But who cares about that when you're using a language model on DOS?

I don't need AI to vibe code software that doesn't run properly. My prior art goes back to 1982.

In a recent development, there may be more comments in this discussion. Without JavaScript enabled, you might want to turn on Classic Discussion System in your preferences instead.

Any given program will expand to fill available memory.

โ†’ Read original article