Price is a function of supply and demand. Increase demand and price goes up. Increase supply and price goes down. Bitcoin has a fixed supply of 21 million coins forever. So we don’t need to worry about supply, it is 100% predictable and limited to 21,000,000 BTC in the year 2140. With fixed supply, the … Read more
Wow, Tesla Full Self-Driving (FSD), the most incredible real-world software system humanity has ever seen, doesn’t rely on explicit code. It’s an end-to-end neural network solution. The new paradigm is: there is no explicit coding; the code is … neural net weights trained on massive data! 🤯 In a recent live stream, Elon Musk and … Read more
The much-awaited feature for GPT-3.5 Turbo is here: fine-tuning. And guess what? GPT-4 is next in line this autumn. Dive in to discover how this can revolutionize your applications and user experiences. What’s New? OpenAI now empowers you to tailor GPT-3.5 Turbo with your data, ensuring the model aligns perfectly with your specific needs. Preliminary … Read more
Let’s dive into the fascinating world of scaling laws, mechanistic interpretability, and how they impact the development of artificial intelligence. From asking why the universe responds to throwing large amounts of computing power at vast amounts of data to discussing the emergence of specific abilities in AI models, Dario, the CEO of Anthropic AI, provides … Read more
I’ve written extensively on the advent of alien technology that is large language models (LLMs) and transformers. Magical files with numbers that can take thousands of tokens as inputs and generate thousands of tokens as outputs. If you’re like me, you may have wondered: How does a machine’s creativity compare to that of a human? … Read more
With the rising interest in generative AI, all of us are seeking signal in a noisy world. Those passionate about AI understand that a model’s effectiveness is only as good as its input training data. The principle of “Garbage in, Garbage out” applies here. If you regularly consume superficial news with a negativity bias, it’s … Read more
With the unexpected release of its advanced language model, LLaMA 2, Meta has opened up new avenues for commercial and research applications. Unlike its predecessor, this second iteration of the model is (primarily) free and open-source. 🧑💻 Recommended: Llama 2: How Meta’s Free Open-Source LLM Beats GPT-4! The source code and data that forms the … Read more
The universal basic income (UBI) in Worldcoin isn’t directly funded by the Worldcoin Protocol but will eventually require a separate funding source, such as a share of profits from an AI Lab. There’s no guarantee or explicit sustainable protocol rule. However, the Worldcoin Whitepaper envisions the possibility to set a 1.5% annual inflation rate, essentially … Read more
Executive Summary Before we dive into Med-PaLM 2, let’s learn about the underlying technology: PaLM 2: 👇 What Is PaLM 2? Google’s PaLM 2 is a next-generation language model with enhanced multilingual understanding, reasoning, and coding capabilities. The Advent of PaLM 2 We recently published an article about the fact that Google actually developed the … Read more
There has been a lot of drama on Twitter about the new Stanford UC Berkely collab paper titled “How Is ChatGPT’s Behavior Changing over Time?” (source) The paper’s authors selectively provide examples where newer versions of GPT-4 seem to perform “worse” and have “formatting mistakes” than older versions. The first evaluation they provide is the … Read more
Meta (formerly Facebook) has released Llama 2, a new large language model (LLM) that is trained on 40% more training data and has twice the context length, compared to its predecessor Llama. Llama 2 is open-source so researchers and hobbyist can build their own applications on top of it. Llama 2 is trained on a … Read more
Consider the following screenshot of a code snippet: Let’s say I want to extract the code from the image. I don’t want to type it out. What can I do? I just discovered that Google Bard has sufficient image recognition skills that you can upload images and ask it to extract the code from the … Read more