New Chipset Set To Bring Generative AI To Mid-Range Phones

New Chipset Set To Bring Generative AI To Mid-Range Phones

Published on December 22nd, 2023

Here Are 5 Key Takeaways: Generative AI To Mid-Range Phones

  • Adaptive Gaming Technology
  • Camera Enhancements
  • No 8K Recording
  • Comprehensive Connectivity
  • Launch Timeline

Both Qualcomm and MediaTek have introduced high-end smartphone processors that incorporate generative AI capabilities.

However, the wait for this advanced technology to reach mid-range phones is now over.

MediaTek recently unveiled the Dimensity 8300, marking the first mid-range smartphone chipset to feature on-device generative AI support.

The key highlight of the Dimensity 8300 is its APU 780 AI silicon, which is designed to accommodate large language models (LLMs) with an impressive capacity of up to 10 billion parameters.

However, one crucial detail not disclosed by MediaTek is the token rate or speed of the chipset.

Read More: How To Improve Your Business Processes With AI

Typically, a speed of 15 to 20 tokens per second is considered sufficient for generating conversational responses from large language models.

In comparison, the flagship Dimensity 9300 supports up to 33 billion parameters at a rate of three to four tokens per second for a seven billion parameter model, or 20 tokens per second for a ten billion parameter model.

Similarly, the Snapdragon 8 Gen 3 supports a ten billion parameter model at a speed of 15 tokens per second.

Additionally, the Dimensity 8300 introduces support for Stable Diffusion image generation, although the speed of this process was not disclosed by MediaTek.

It is hoped that users won’t experience significant delays in image generation.

Notably, both Qualcomm and MediaTek claim that their flagship System-on-Chips (SoCs) can achieve Stable Diffusion image generation in under a second.

The new chipset also brings support for LPDDR5X RAM at speeds of up to 8,533Mbps. MediaTek emphasizes the need for faster RAM to efficiently run large language models on the Dimensity 8300.

Overall, this announcement signifies a notable advancement in bringing generative AI capabilities to mid-range smartphones, enhancing their performance and capabilities.

Read More: Unleash Creativity With Meta’s Imagine AI Image Generator

Dimensity 8300: Elevating Mid-Range Power

If generative AI capabilities aren’t a priority for you, you’ll be pleased to learn that the rest of the Dimensity 8300 is impressively robust.

This mid-range chipset is built on a second-generation TSMC 4nm process.

The CPU configuration of the Dimensity 8300 comprises one Cortex-A715 clocked at 3.35GHz, three Cortex-A715 cores clocked at 3GHz, and four Cortex-A510 cores clocked at 2.2GHz.

MediaTek claims a 20% performance boost over the Dimensity 8200, along with an efficiency improvement of up to 30%.

Notably, the GPU in the new Dimensity 8300 has undergone a substantial upgrade. The Mali-G615 MC6 GPU promises a 60% performance boost and an impressive 55% increase in efficiency.

This enhancement makes the chipset particularly appealing for budget-conscious gamers, making it worthwhile to keep an eye on affordable phones powered by this chip.

What Else Is Worth Knowing?

MediaTek’s latest chipset, the Dimensity 8300, introduces “adaptive gaming technology,” allowing apps/games to communicate with the chipset to understand thermal load and make adjustments, potentially reducing power consumption by up to 14%.

The chipset includes camera improvements like 4K/60fps HDR video, more power-efficient video recording, and AI-Color functionality for nuanced color adjustments.

While lacking 8K recording, it features AV1 decoding, Bluetooth 5.4, Wi-Fi 6E, and supports refresh rates up to 120Hz at WQHD+ resolutions.

The first phones with Dimensity 8300 are expected to launch by year-end, with specific markets yet to be announced.