Newsletter
As the smartphone industry gears up for a transformative year in 2024, the spotlight is on on-device generative AI, with major players like Samsung, OnePlus, Apple, and Google set to introduce innovative functionalities. Joining the ranks, OPPO has announced its AndesGPT, a large language model boasting a staggering 7 billion parameters. It will make its debut on the OPPO Find X7 series next month, promising an array of AI capabilities.
With features like Swapped Attention and solutions for challenges like first-word reasoning, AndesGPT is set to help the smartphone AI landscape move forward. Leveraging 4-bit quantized model compression, the model ensures efficient performance, offering users access to AI boost inference, engine optimizations, and collaborative deep optimization.
Notably, the AndesGPT stands out with its rapid 2.9-second response time, a remarkable 2.5 times faster than the industry standard. However, the ‘industry standard’ remains a bit vague with a plethora of models with a diverse set of capabilities present in the industry right now. Nonetheless, this generative AI model from OPPO showcases its prowess by generating abstracts of up to 14,000 words, hinting at an unparalleled user experience.
AndesGPT has undergone a two-year development process, building upon the success of OPPO’s earlier models like OBERT
AndesGPT, at its core, forms the upgraded Xiao Bu Assistant, developed by OPPO’s Andes Intelligent Cloud team. The model operates on a hybrid cloud architecture and has undergone a two-year development process, building upon the success of OPPO’s earlier models like OBERT. The OBERT models, ranging from one hundred million to one billion parameters, gained notable recognition, briefly ranking fifth in the Chinese language understanding benchmark CLUE1.1 and gaining the top spot in the large-scale knowledge graph question-answering KgCLUE1.0 grading.
Building on the foundation laid by OBERT, AndesGPT incorporates key technologies, including continuous learning from Chinese dialogue data, instruction fine-tuning, topping up learning with human feedback, and an improved knowledge base. This mixture of technologies positions AndesGPT as a big project, showing OPPO’s commitment to improving creative AI. Notably, AndesGPT claimed the fifth position in the C-Eval evaluation rankings in June, proving its contextual awareness and responsiveness.
The OPPO Find X7 series, slated for release next month, will serve as the launchpad for AndesGPT. While the international availability of this AI model remains unknown, its capabilities extend beyond textual interactions, offering users a fully functional, generative visual experience. As the smartphone landscape evolves with each company vying for AI supremacy, OPPO’s AndesGPT promises to push the boundaries of what’s possible in the realm of on-device generative AI.
