China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans

The creators of the Taichi chiplet claim it’s more energy-efficient and scalable than other photonic components and can be used to train superhuman AI models in the future.

Close-up Shot of CMOS Semiconductor Silicon Wafer/Getty Images

Scientists in China have designed a tiny, modular chip that is powered by light rather than electricity — and they want to use it to train and run a future artificial general intelligence (AGI) model.

The new chiplet, called “Taichi,” is one small piece of a wider jigsaw formed of many individual chiplets (including Taichi modules) that, together, could form a sophisticated and powerful computing system. If scaled up sufficiently, this would be powerful enough to train and run an AGI in the future, the scientists argued in their paper, published April 11 in the journal Science

AGI is a hypothetical advanced form of artificial intelligence (AI) that would, in theory, be just as smart as humans in terms of its cognitive reasoning abilities. AGI could be applied across many disciplines, whereas today’s AI systems can only be applied very narrowly. 

Some experts believe such systems are many years away, with a bottleneck in computing power being a key blocker, while others believe we’ll build an AGI agent as soon as 2027.

In recent years, scientists have begun to reach the limitations of conventional electronics-based components, especially given the growth of AI and the sheer amount of power required to service these increasingly demanding systems. 

Related: Light-powered computer chip can train AI much faster than components powered by electricity

Graphics processing units (GPUs) have emerged as key components in training AI systems, because they are better at performing parallel calculations than central processing units (CPUs). But the energy consumption levels required are becoming unsustainable as systems become larger, the scientists argued. 

window.sliceComponents = window.sliceComponents || {};

externalsScriptLoaded.then(() => {
window.reliablePageLoad.then(() => {
var componentContainer = document.querySelector(“#slice-container-newsletterForm-articleInbodyContent-gDCqejVkdJEffohy2ejDLZ”);

if (componentContainer) {
var data = {“layout”:”inbodyContent”,”header”:”Sign up for the Live Science daily newsletter now”,”tagline”:”Get the worldu2019s most fascinating discoveries delivered straight to your inbox.”,”formFooterText”:”By submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over.”,”successMessage”:{“body”:”Thank you for signing up. You will receive a confirmation email shortly.”},”failureMessage”:”There was a problem. Please refresh the page and try again.”,”method”:”POST”,”inputs”:[{“type”:”hidden”,”name”:”NAME”},{“type”:”email”,”name”:”MAIL”,”placeholder”:”Your Email Address”,”required”:true},{“type”:”hidden”,”name”:”NEWSLETTER_CODE”,”value”:”XLS-D”},{“type”:”hidden”,”name”:”LANG”,”value”:”EN”},{“type”:”hidden”,”name”:”SOURCE”,”value”:”60″},{“type”:”hidden”,”name”:”COUNTRY”},{“type”:”checkbox”,”name”:”CONTACT_OTHER_BRANDS”,”label”:{“text”:”Contact me with news and offers from other Future brands”}},{“type”:”checkbox”,”name”:”CONTACT_PARTNERS”,”label”:{“text”:”Receive email from us on behalf of our trusted partners or sponsors”}},{“type”:”submit”,”value”:”Sign me up”,”required”:true}],”endpoint”:”https://newsletter-subscribe.futureplc.com/v2/submission/submit”,”analytics”:[{“analyticsType”:”widgetViewed”}],”ariaLabels”:{}};

var triggerHydrate = function() {
window.sliceComponents.newsletterForm.hydrate(data, componentContainer);
}

if (window.lazyObserveElement) {
window.lazyObserveElement(componentContainer, triggerHydrate);
} else {
triggerHydrate();
}
}
}).catch(err => console.log(‘Hydration Script has failed for newsletterForm-articleInbodyContent-gDCqejVkdJEffohy2ejDLZ Slice’, err));
}).catch(err => console.log(‘Externals script failed to load’, err));

Light-based components could be one way to overcome the limitations of conventional electronics — including the energy efficiency problems.

Looking to the light for superhuman AI

Scientists previously outlined the design for a new type of photonic microchip in February, which uses photons, or particles of light, instead of electrons to operate transistors — tiny electrical switches that turn on or off when voltage is applied. Generally speaking, the more transistors a chip has, the more computing power it has and the more power it requires to operate. Light-based chips are far less energy-intensive and can perform calculations much faster than traditional chips, as they can perform calculations in parallel.

Current photonic chip architectures for AI models consist of hundreds or thousands of parameters, or training variables. This makes them powerful enough for basic tasks like pattern recognition, but large language models (LLMs) like ChatGPT are trained using billions or even trillions of parameters. 

An AGI agent would likely require many orders of magnitude greater — as part of a broader network of AI architectures. Today, the blueprints for building an AGI system do not exist.

In the new study, the scientists designed Taichi to work the same way as other light-based chips, but it can be scaled much better than competing designs, they said in their paper. This is because it combines several advantages of existing photonic chips — including “optical diffraction and interference,” which are ways of manipulating the light in the component.  

To test the design, the researchers stitched together several Taichi chiplets and compared their architecture with other light-based chips in key areas. 

Their architecture achieved a network scale of 13.96 million artificial neurons — compared to 1.47 million in the next biggest competing design — with an energy efficiency metric of 160.82 trillion operations per watt (TOPS/W). The next best result they highlighted in their paper came from research published in 2022, in which a photonic chip achieved 2.9 TOPS/W. Many conventional neural processing units (NPUs) and other chips achieve well under 10 TOPS/W.

The researchers also claimed that their Taichi-based architecture is twice as powerful as other photonic systems, but they did not directly cite these. In tests, meanwhile, they used the distributed Taichi network to perform tasks including image categorization and classification, as well as image content generation, as a proof of concept rather than to benchmark performance.

“Taichi indicates the great potential of on-chip photonic computing for processing a variety of complex tasks with large network models, which enables real-life applications of optical computing,” the scientists said. “We anticipate that Taichi will accelerate the development of more powerful optical solutions as critical support for the foundation model and a new era of AGI.”

READ MORE

Potent alpaca nanobodies neutralize SARS-CoV-2 variants

Fu2 nanobody bound to the viral spike. Credit: Hrishikesh Das and Martin Hällberg Researchers at [...]

AI method for describing soft matter opens up new chapter in density functional theory

The illustration shows the workflow inherent in the neural functional theory, starting with data acquisition [...]

Everyone’s on the Hunt for the Element Lithium

This aerial view shows a lithium mine in Silver Peak, Nevada. After the brine is [...]

Terrifying footage showing inside of Egyptian pyramids has people ‘panicking’

The video shows how the pyramid is riddled with tunnels and chambers. The gigantic pyramids [...]

World’s tiniest plumbing could one day funnel drugs to individual human cells

Tubes, visible in light green, are roughly seven nanometers in diameter — about two million [...]

Into the Fold

/ “Part of the challenge of folding is to capture the feeling I get when [...]

5 Recipes for Leftover Corn on the Cob

Before you begin, cut the ears in half to create a flat surface to stand [...]

10 Environmentally Friendly Architectural Styles

This Berkeley Hills, Ca. home built in 1957 and designed by architect Robert S. Chang [...]