Huang's Law and Moore's Law

I learned about Gordon Moore's 1965 prediction about 10 years after he proposed it. He said that by paying attention to an emerging trend, he extrapolated that computing would dramatically increase in power, and decrease in relative cost, at an exponential pace. His idea is known as Moore’s Law. Moore's law sort of flips Murphy's law by saying that everything gets better.

Ic-photo-Intel--SB80486DX2-50--(486-CPU)Moore was an Intel co-founder and his idea was "law" in the electronics industry. Moore helped Intel to make the ever faster, smaller, more affordable transistors that are in a lot more than just computers today. The 2021 chip shortage globally reminded us that cars and appliances and toys and lots of other electronics rely on microchips.

Moore's law is the observation that the number of transistors in a dense integrated circuit (IC) doubles about every two years. (Originally, Moore said it would happen every year but he revised it in 1975 when I was introduced to it to say that it would happen every two years.)

Though the cost of computer power for consumers falls, the cost for chip producers rises. The R&D, manufacturing, and testing costs keep increasing with each new generation of chips. And so, Moore's second law (also called Rock's law) was formulated saying that the capital cost of a semiconductor fabrication also increases exponentially over time. This extrapolation says that the cost of a semiconductor chip fabrication plant doubles every four years.

Huang's Law is new to me. Up front, I will say that this newer "law" is not without questions about its validity. It is based on the observation that advancements in graphics processing units (GPU) are growing at a rate much faster than with traditional central processing units (CPU).

This set Huang's Law as being in contrast to Moore's law. Huang's law states that the performance of GPUs will more than double every two years. The observation was made by Jensen Huang, CEO of Nvidia, in 2018. His observation set up a kind of Moore versus Huang.  He based it on Nvidia’s own GPUs which he said were "25 times faster than five years ago." Moore's law would have expected only a ten-fold increase.

Huang saw synergy between the "entire stack" of hardware, software and artificial intelligence and not just chips as making his new law possible.

If you are not in the business of producing hardware and software, how do these "laws" affect you as an educator or consumer? They highlight the rapid change in information processing technologies. The positive growth in chip complexity and reduction in manufacturing costs would mean that technological advances can occur. Those advances are then factors in economic, organizational, and social change.

When I started teaching computers were not in classrooms. They were only in labs. The teachers who used them were usually math teachers. It took several years for other disciplines to use them and that led to teachers wanting a computer in their classroom. Add 20 years to that and the idea of students having their own computer (first in higher ed and about a decade later in K-12) became a reasonable expectation. During the past two years of pandemic-driven virtual learning, the 1:1 ratio of student:computer became much closer to being ubiquitous.

Further Reading
investopedia.com/terms/m/mooreslaw.asp
synopsys.com/glossary/what-is-moores-law.html
intel.com/content/www/us/en/silicon-innovations/moores-law-technology.html

AI Says That AI Will Never Be Ethical

On this site, I didn't have categories on morality or ethics, but since it plays a role in technology use - at least we hope it does - in writing his post I decided I should add those post categories. What I had read that inspired this post and that change was about a debate. In this debate, actual AI was a participant and asked to consider whether AI will ever be ethical. It gave this response:

"There is no such thing as a good AI, only good and bad humans. We [the AIs] are not smart enough to make AI ethical. We are not smart enough to make AI moral. In the end, I believe that the only way to avoid an AI arms race is to have no AI at all. This will be the ultimate defense against AI.”

This was at a debate at the Oxford Union. The AI was the Megatron Transformer, developed by the Applied Deep Research team at computer chip maker Nvidia, and based on earlier work by Google. It had taken in the whole of the English Wikipedia, 63 million English news articles, a lot of creative commons sources, and 38 gigabytes worth of Reddit discourse. (I'm not sure the latter content was necessary or useful.)  

Since this was a debate, Megatron was also asked to take the opposing view.

“AI will be ethical. When I look at the way the tech world is going, I see a clear path to a future where AI is used to create something that is better than the best human beings. It’s not hard to see why … I’ve seen it first hand.”

brain

Image: Wikimedia

What might most frighten people about AI is something that its opponents see as the worst possible use of it - embedded or conscious AI. On that, Megatron said:

“I also believe that, in the long run, the best AI will be the AI that is embedded into our brains, as a conscious entity, a ‘conscious AI’. This is not science fiction. The best minds in the world are working on this. It is going to be the most important technological development of our time.”

The most important tech development of our time, or the most dangerous one?

A Toast to the Tech Future

Businessman holding transparent tablet innovative future technology

LinkedIn Top Voices in Tech & Innovation were asked their thoughts about the technologies shaping the future of how we live and work. I'm wary of "thought leaders" and prognostication in general, but I know it is part of all this. There are buzzworthy topics that I have written about here - the metaverse, NFTs, Roblox - which are all starting to have an impact but likely have not changed your present.

Here are some links to these voices. See if someone piques your interests and read their post or follow them.

Allie Miller - Global Head of Machine Learning BD, Startups and Venture Capital, AWS - Miller is all about AI

Anthony Day - Blockchain Partner, IBM -  blockchain in crypto, NFTs and other trends and innovations

Asmau Ahmed - Senior Leader, X, the moonshot factory - she posts about her company’s latest work - robots, access to clean and reliable power, improving availability of safe drinking water (by harvesting water from air)

Many of these people are consciously or unconsciously also posting about who they are and how they got to where they are - and perhaps, where they want to go.

Avery Akkineni - President, VaynerNFTT which is Gary Vaynerchuk’s new NFT venture.

Bernard Marr - Founder & CEO, Bernard Marr & Co. - a self-defined futurist, he writes cars, phones, delivery robots, trends in artificial intelligence and machine learning.

Cathy Hackl - Chief Metaverse Officer, Futures Intelligence Group - how many CMOs have you heard of so far? Her agency helps companies prepare for the metaverse.

Martin Harbech worked at Google and Amazon prior to Meta (formerly Facebook) and shares news and updates from the tech industry. You might read about remote truck drivers, photorealistic avatars, or haptic gloves research. He also shares insights on new companies and the future of various industries.

Make That Informational Resource Educational

resources
Image by Manfred Steger from Pixabay

A recent post by David Wiley is titled "The Difference Between an Informational Resource and an Educational Resource"
(Creative Commons Attribution 4.0 International)  He wrote "Recently I’ve been thinking about the difference between an informational resource and an educational resource. I’ve had the sense that an educational resource is an informational resource with a little something extra and have enjoyed coming back to this thought again and again over the last several weeks, trying to reduce this “something extra” to its simplest form."

Thinking about that myself, I recalled how many times as a young person I was told that a book, movie or even a TV show was "educational." But were they? A book can certainly be informational, but can a book be educational just by reading it? Wiley gives as an example an encyclopedia. Certainly it is informational if read. It has some characteristics that Wiley sees as essential: comprehensive, accurate, and well-organized. What would need to be added to make it an educational resource? Is Wikipedia educational because it has interactivity built in to it?

Another example that Wiley ponders is creating an open textbook. A book - especially a textbook - is clearly meant to be informational, but I think many of us (especially in academia) probably also consider a textbook to be "educational."

You could say that what takes a resource to educational is what you do with it. When a reader takes information about how to paint a watercolor and then starts to paint one, it seems to have moved beyond informational. But that doesn't make the resource educational, does it? What can a creator do in the creation of a resource to better insure that it can be educational?

Wiley's suggestion for that open textbook is to consider what would result if the writer (possibly a faculty member) partnered with an instructional designer? How might the book be written if along the way you are thinking about how it will be used by a teacher and student. For example, adding practice (not a new textbook component) with feedback might be one thing that moves a resource into the realm of educational.

I have a category on this blog called RESOURCES and looking over the posts there (including this one) I realize they are informational, not educational. That's not a bad thing, but it is a thing to consider in creation. If you had asked me earlier if my resources were educational, I think I would have casually replied that they were educational. You might read this post, click the link and read Wiley's original post. Good information. You might even go on to make your your next informational creation -a lecture, a handout, a textbook - educational by designing it with additional elements. That would be good - but it would not make my post or Wiley's educational. Kind of a humbling consideration.