Tensilica HiFi  Audio/Voice DSP IP

Home: IP Portfolio > Tensilica IP > Audio, Voice, and Speech

HiFi Audio, Voice, and Speech

Audio dataplane diagramPut the WOW in Your Audio, Voice, and Speech Processing with HiFi DSPs

Looking for the best quality audio, voice, and/or speech processing core for your next design? With all the software already ported for immediate deployment?

Put the WOW in your SoC design with Cadence® Tensilica® HiFi Audio DSPs. More than 55 top-tier semiconductor companies and system OEMs have picked our HiFi Audio DSPs for their products, with good reason.

Expansive Range of Codecs

Cadence delivers the software support you need, with support for more than 125 audio, voice, speech recognition, and audio and voice enhancement software packages. No porting is required. You can also port your own proprietary software, porting completely in C while maintaining or surpassing the performance of assembly on other DSPs.

Watch Whiteboard Wednesday - Implementing Always-On Audio.

A Strong Partner Ecosystem

Cadence has over 60 partners in its comprehensive ecosystem.. See our list on our Partners page. These companies, ranging from industry giants like Dolby and DTS to innovative companies for sensor fusion, always-on, sound enhancement, and noise reduction, have ported their software to the HiFi architecture so you don't have to, and you can get up and running very quickly.

Your Choice of Four Cores

  1. The HiFi Mini Audio DSP—Our smallest, lowest power DSP core for always-listening voice trigger and voice recognition
  2. The HiFi 2 Audio DSPThis highly efficient DSP core provides the lowest power MP3 audio processing
  3. The HiFi EP Audio DSPA superset of HiFi 2 with advanced optimizations for DTS Master Audio, improved voice pre- and post-processing, and improved cache memory subsystem
  4. The HiFi 3 Audio DSPFull 32-bit processing makes this DSP super efficient for many of the audio enhancement algorithms, wideband voice codecs, and multi-channel audio

Features for a Wide Range of Audio, Voice, and Speech Processing

The Features You Need for Designs Ranging from Ultra-Low Power to High Performance

Audio DSP Plus Control

All Cadence Tensilica HiFi Audio DSPs are click-box additions to our customizable Xtensa® LX processor and include the base Xtensa instruction set. In other words, they are excellent targets for control applications as well as audio.

Customizable to Meet Your Requirements

Because our HiFi Audio DSPs use our Xtensa LX DPUs, you get all of the customization advantages that our DPUs are known for, along with incredible flexibility, including (but not limited to):

  • Complete flexibility to add/configure caches and local memories
  • Option to add direct RTL-like interfaces via Ports, Queues, and Lookup Interfaces
  • Option to add custom instructions with full compiler support

See our Xtensa product section for more details.

Lowest Power

MP3 playback requires just 5.7MHz when running at 128Kbps, 44.1KHz, and dissipates only 0.45mW in the TSMC® 65nm LP process (including memories) with our HiFi 2 Audio DSP. This assures you of more than 100 hours of battery life.

Optimized for Audio and Voice

Our HiFi Audio DSPs are optimized solutions for digital audio and voice. The performance levels of these DSPs approach those of fixed-gate implementations. They offer the flexibility, fast time-to-market, and lower risk of a processor-based solution, while simultaneously reducing silicon area and power consumption.

Our HiFi Audio DSPs utilize Xtensa LX processor technology with custom instructions (better code density, fewer cycles), flexible datapath widths (higher efficiency per cycles), multiple instructions per cycle (VLIW—higher efficiency per cycle), and simultaneous data operations (SIMD—parallelization). A comprehensive Eclipse-based software development environment is provided, with everything from a source code editor, debugger, and ISS to an optimized compiler for exceptional code density.

Optimized for Always-Listening Voice Trigger and Recognition

HiFi Mini is our smallest, lowest power DSP core supporting always-listening voice trigger and speech command modes. The HiFi Mini DSP IP core enables a hands-free experience. Cadence is working with Sensory and other software partners who provide innovative voice activation, speech command recognition, voice pre-processing and noise reduction products—all optimized on the HiFi Mini DSP.

We optimized the HiFi Mini DSP core to be as small and power-efficient as possible for voice trigger and voice recognition in two major ways. First, the core uses compact 40-bit encoding, which significantly improves code size. Second, we added efficient 16-bit instructions that are optimized for voice and audio codecs. 

All the Digital Radio Codecs You Need

Our HiFi DSPs run all the decoders required around the world for digital audio, including:

  • HD Radio™—From iBiquity™ Digital
  • DAB—In the MP3 decoder
  • DAB+—Certified by Dolby®
  • DRM—Certified by Dolby
  • XM-Satellite—From XM® Satellite
  • T-DMB—In the BSAC decoder
  • ISDB—In the AAC, HE-AAC decoders

Fully Programmable in C

All HiFi Audio DSPs are fully programmable in C, with no assembly required. So if you have proprietary algorithms to port for a HiFi DSP, it’s easy and quick.

Ready for Immediate Design-In

All HiFi DSPs are pre-packaged, ready to drop into DOC designs. They provide programmable support for over 90 audio, voice, and sound enhancement packages, which are pre-ported and ready to use, with no software porting required.

Capable of the Best Sound Enhancement Algorithms

Audio requirements for everything from smartphones to home stereo receivers are being driven by audio post-processing.

For voice, smartphone requirements are moving from narrowband to wideband codecs with improved noise suppression, noise dependent volume control, and other algorithms to improve sound quality in crowded environments.

For home and car audio, audio enhancement software is significantly enriching the user experience, creating important competitive advantages.

And gaming requirements in all environments are driving requirements for up to 32 streams for immersive play.

Efficient for Blu-ray Discs

Our HiFi Audio DSPs have been designed into Blu-ray Disc™, set-top box, and high-end home theater receiver SoCs.

Architectural enhancements to our HiFi EP significantly improves DTS Master Audio decoding and tolerance to high external memory latency. With HiFi EP, single-core Blu-ray Disc SoCs can easily be implemented in 65GP with additional MHz to spare for other audio functions.

The 32-bit architecture of our HiFi 3 DSPs significantly lowers the required MHz for complex audio enhancement algorithms, thus lowering the required power.

Performance to Spare

Because of the efficiency of Tensilica HiFi architectures, our HiFi Audio DSPs require only a fraction of the available MHz to perform audio decoding and encoding functions, leaving extra headroom for other control as well as media and signal-processing tasks.

HiFi Comparison Chart

What are the differences among the four Hifi Audio/Voice DSPs?

 HiFi MiniHiFi 2HiFi EPHiFi 3
ARCHITECTURAL COMPARISON
Architecture 24-bit 24-bit 24-bit 32-bit
Slots for VLIW 2 2 2 3
MACs 24x24 32x16 24x24 32x16 24x24 32x16 32x24 4 MACs operating as: 4 24x24 or 4 32x16 or 2 32x32 or 2 32x24
Load/store 64-bit 64-bit 64-bit 64-bit
DSP optimizations for voice pre- and post-processing X X
Predictive prefetch to improve performance of cache memory subsystem X X
DSP performance enhancements for FFT, FIR, and IIR X
ITU support for voice codecs X
Eclipse-based software development environment X X X X
Software Codec Library X X X X
DTS Master Audio

Primary Audio: DTS Master Audio 24.5Mbps, 5.1 channels, 192kHz

Secondary Audio: DTS-LBR (DTS Express) 256Kbps, 48kHz Decoding

DTS Transcode, Upsample, Downsample, Mixing, Others

Not Applicable 362MHz 296MHz 233MHz

HiFi Mini Always On Voice Recognition and Sensor Fusion

Need Always-On Functionality? HiFi Mini is Great for Voice or Face Recognition and Sensor Fusion

Low-power always-on wake-up is now a must have feature for mobile applications.  Voice trigger functions have been widely adopted.  Face trigger is becoming more popular.  And sensor fusion also requires low-power always-on DSP processing.  HiFi Mini is a DSP core that's ideal for all these applications, so you can use one core for all.

Always-On Wake Capabilities

Low-power always-on wake capabilities will continue to evolve. Right now this is commonly used for voice trigger, face trigger, and ultrasonic motion detection.  For these evolving applications, you need both ease of development and performance headroom. You need HiFi Mini.

HiFi Mini's low-power audio buffer sharply reduces MIPS requirements, up to 8X lower than other solutions.  The RAM includes phrase memory and data buffers (1.6-1.8x).  ROM includes recognizer code and constants for acoustic model and vocabulary.

Sensor Fusion

Sensor fusion combines control and signal processing. HiFi Mini can easily support both, as it's based on the Xtensa 32-bit RISC CPU core. It is efficient in both control and DSP-intensive tasks and features smart power management. Cadence works with several software partners to bring the best software for sensor fusion to the HiFi Mini. 

HiFi Audio Tunneling for Android Prolongs Battery Life

The Industry's Most Efficient, Lowest Power Way to Offload Audio/Voice in Your Android Device

The CadenceTensilica HiFiAudio Tunneling (HAT) for Andoid solution allows OEMs to quickly take advantage of the new audio tunneling features contained in KitKat, the latest release of Android. Tremendous power savings are realized by completely offloading the audio decoding and post-processing functionality from the host CPU to the HiFI Audio DSP. Additionally, this audio tunneling solution allows the DSP to send the audio content directly out for retendering, eliminating the need to move uncompressed audio data back to the host. We estimate that this cuts audio power by up to 14X, thereby doubling phone mp3 playback.

The new Audio Tunneling feature in Android is the optimal audio offloading solution as it greatly reduces the amount of data passed back to the host from the DSP. See the chart below for an illustration of this reduced interprocessor communications.

NOTE: Above shows the amount of interprocessor data exchanged to decode 5 minutes of high quality MP3 (stereo, 256Kbps)

HAT Reference Design for Android

Cadence offers HAT, a solution which includes the HiFi Kernel drive and an audio framework. The HiFi Kernel driver loads the DSP firmware and manages interprocessor communications. The framework schedules the audio tasks and manages the audio processing components including codec and post-processing modules. This solution is available in source code format and can be easily adapted to a particular platform or SOC. Consulting services are available to port to a customer's board. 

Cadence provides a HiFi Kernel Driver - a reference for porting to a given platform or SoC. This defines communication between the host and the HiFi DSP. It includes firmware loading for the HiFi DSP on system start.

True Tunneling - Totally Offloaded to DSP

With HiFi Mini, audio decode and post-processing are totally offloaded from the host controller.  The HiFi Mini is able to output directly to the renderer, maximizing the off-time for the host processor and minimizing the amount of data copied back to the host.  Cadence provides an easy-to-use driver for interprocessor ommunications, compatible with Android.  Most other approaches only use the OMX layer or proprietary interfaces and are not as efficient.

Learn More - Watch our MWC Demo Video

See our blog and watch the demo.

Design Tools Speed Your Adoption and Integration Processes

The Industry's Most Powerful and Complete Design Environment

Port C to HiFi

Port Software Quickly in C

A key advantage of the HiFi DSPs is that they use a simple programming model. Software developers can port audio, voice, and enhancement software codecs completely in C, while maintaining or surpassing the performance of assembly on other DSP and CPU architectures. This minimizes the time required to port and maintain special or proprietary audio software.

 

DPU design process

For Processor Designers

We deliver patented, proven tools that automate the process of generating your HiFi-based DPU along with matching software tools. These tools have been proven in hundreds of designs and the results are guaranteed correct by construction.

View the complete set of tools for processor designers.

Softwre development process

For Software Developers

The Xtensa® Software Developer's Toolkit provides a comprehensive collection of code generation and analysis tools that speed the software development process. The Cadence Tensilica Eclipse-based Xtensa Xplorer Integrated Development Environment (IDE) serves as the cockpit for the entire development experience.

View the complete set of tools for software developers.

Audio, Voice, and Speech Software—Over 125 Codecs Available Now

Over 125 Software Packages Already Supported by HiFi

The following audio, voice, and audio and voice enhancement software packages are available for the HiFi DSPs.

Audio Codecs

  • AEC Wideband
  • AMR Wideband+ Decoder
  • AMR Wideband+ Encoder
  • DAB/MP2 Decoder
  • DAB+ Decoder
  • Digital Radio Mondiale (DRM) Decoder
  • Dolby Digital AC-3 Decoder, 5.1 ch
  • Dolby Digital AC-3 Consumer Encoder (DDCE) 2, 5.1 ch
  • Dolby Digital Compatible Output Encoder 5.1 ch
  • Dolby Digital Live Encoder
  • Dolby Digital Plus Consumer Decoder 7.1 ch
  • Dolby Digital Plus Decoder/Converter 5.1 ch
  • Dolby Mobile 3+
  • Dolby MS10 Decoder
  • Dolby MS11 Decoder
  • Dolby ProLogic II and IIx Decoder
  • Dolby TrueHD Decoder 7.1 ch
  • Dolby Volume 2, 5.1 ch
  • DRA Decoder, 7.1 ch
  • DTS Boost
  • DTS Broadcast and DMP 5.1 ch
  • DTS Core Decoder 5.1 ch
  • DTS Envelo Headphone and Speaker
  • DTS-HD (Master Audio), Express, Transcoder, and Neo:6
  • DTS-HD PP
  • DTS Interactive Encoder
  • DTS M6 Decoder, 5.1 ch>/li>
  • DTS Neural Surround
  • DTS Symmetry
  • FLAC Decoder, 7.1 ch
  • MP3 Decoder
  • MP3 Encoder
  • MPEG-2 Layer 2 Decoder, 5.1 ch
  • MPEG-4 aacPlus v2 Decoder 2, 7.1 ch
  • MPEG-4 aacPlus v2 Encoder
  • MPEG-4 aacPlus v1 Decoder 2, 7.1 ch
  • MPEG-4 aacPlus v1 Encoder
  • MPEG-2/4 AAC LC Decoder 2, 7.1 ch
  • MPEG-4 AAC LC Encoder
  • MPEG-4 BSAC Decoder
  • mSBC Bluetooth Decoder
  • mSBC Bluetooth Encoder
  • mSBC Decoder
  • mSBC Encoder
  • Ogg Vorbis Decoder
  • RealAudio 8, 9, and 10 Decoder
  • Sample Rate Converter
  • SBC Bluetooth Decoder
  • SBC Bluetooth Encoder
  • WMA Decoder
  • WMA Encoder
  • WMA 10 Pro Decoder 2, 7.1 ch
  • WMA 10 Pro Lossless Decoder 2, 7.1 ch

Voice Codecs

  • AAC-ELD
  • AMR Narrowband Speech Codec
  • AMR Wideband Speech Codec
  • Bluetooth CVSD Decoder
  • Bluetooth CVSD Encoder
  • G711 Speech Codec
  • G722 Speech Codec
  • G723.1 Speech Codec
  • G726 Speech Codec
  • G.729AB Speech Codec
  • GSM-EFR Speech Codec
  • GSM-FR Speech Codec
  • GSM-HR Speech Codec
  • Opus
  • SILK Speech Codec

Audio Voice, Sensor Fusion, and IoT Partners

Please see our listing of the specialty of each partner here.

Partner Software Offerings for Audio, Voice, Sensory Fusion and IoT

The Strongest Partner Ecosystem for Audio, Voice, Sensor Fusion and IoT

Cadence has the largest partner ecosystem for audio, voice, sensor fusion and IoT.  Here's a list of our partners, by speciality.

Partner Application Home Entertainment Mobile/ Tablet/PC Automotive IoT Engineering Services
AM3D Audio post-processing check mark check mark check mark
Arkamys Audio post-processing check mark check mark
Audyssey Audio post-processing check mark check mark check mark
Cogent Embedded Services check mark
Digital Wave Audio post-processing check mark
Dolby Audio codecs, post-processing check mark check mark check mark
DTS Audio codecs, post-processing check mark check mark check mark
DVSI Voice codecs check mark
eInfochips Services check mark
Forte Media Voice pre-processing check mark
Fraunhofer Codecs check mark check mark
iBiquity Digital radio codec check mark check mark
Inband Software Services check mark
IntegrIT Services check mark
Ittiam Services check mark
Kronoton Audio post-processing check mark
Malaspina Labs Voice pre-processing, voice activation codecs check mark check mark
Microsoft Codecs check mark check mark
Movea Sensor fusion, management check mark check mark
Audio post-processing check mark
Nuance Communications Voice activation, recognition check mark check mark
NXP Software Voice pre-processing check mark
PProduct Services check mark
QNX ANC, voice pre-processing check mark
QSound Voice pre-processing, audio post-processing check mark
Real Codecs check mark check mark
Rubidium Voice activation, recognition check mark check mark
Sensor fusion, management check mark check mark
Sensory Voice activation, recognition check mark check mark
Skype Voice codec check mark check mark
Sonic Emotion Audio post-processing check mark
Spirit DSP Voice codecs check mark
SPL Audio post-processing check mark
Tata Services check mark
Technicolor MP3 check mark check mark
Waves Audio post-processing check mark check mark

HiFi Customers Are Designing Exciting Products

Smartphone AMD Asus R7 260x board LG G2 Samsung Blu-ray Disc player Yamaha receiver

Used by the Best in the Industry

Cadence Tensilica HiFi Audio/Voice DSPs are at work in many popular products.  See our Customer Profiles section to learn more.

 

Literature, Videos, and Other Resources—Learn More About HiFi Audio/Voice DSPs

Learn More About HiFi DSPs

Product Literature

HiFi 3 High-Performance Audio/Voice DSP
HiFi Mini Low-Power DSP
 

Hardware/Software Design Tools

Xtensa Processor Developer's Toolkit
Xtensa Software Developer's Toolkit
 

White Papers

Put Low-Power, Low-Overhead, High-Fidelity Digital Sound in Your Next ASIC or SOC
Seven Critical Questions to Ask When Selecting a Digital Audio Solution for Your Next Mobile SOC Design

Videos

Watch Jason from RealTEK as he gives a hands-on demo of RealTEK's ALC5677 at the Consumer Electronics Show 2014 (CES2014). The ALC5677 is a HiFi audio CODEC integrated with Tensilica's HiFi EP DSP. The demo highlights voice trigger and voice command functionality and how this is an ideal audio solution for mobile devices.

Watch Jason from RealTEK as he gives a hands-on demo of RealTEK's ALC5677 at the Consumer Electronics Show 2014 (CES2014). The ALC5677 is a HiFi audio CODEC integrated with Tensilica's HiFi EP DSP. The demo highlights multi-microphone voice processing functionality and how this is an ideal audio solution for mobile devices.

Chris Rowen Discusses the Growing Demands of Audio Devices

Chris Rowen, Cadence Fellow, discusses the explosion of audio and the growing technical demands across a wide range of devices and applications at Globalpress 2012.