Unlocking New Possibilities: djay Pro’s Innovative Use of NPU for Enhanced Performance

 In the world of digital music production and performance, Algoriddim has always been at the forefront of innovation, continually pushing the boundaries of what is possible with their application djay Pro. A recent conversation with one of their developers revealed some groundbreaking advancements, particularly in their utilization of the Neural Processing Unit (NPU) to enhance the app’s performance and capabilities.

Harnessing the NPU

Traditionally, djay Pro for Windows has relied heavily on both the Central Processing Unit (CPU) and the Graphics Processing Unit (GPU) to deliver its gaming-like performance. This intense graphical performance underscores the significant resources required for other applications, highlighting how much the app utilizes the device’s capabilities. However, relying solely on the CPU and GPU has its limitations, especially when trying to introduce new features and experiences.

In a discussion with Federico Tessmann COO & Co-founder of Algoriddim, he framed the NPU as a third block, distinct from the CPU and GPU, with a crucial role in AI local processing. This on-device processing is essential as running expensive inferences on the CPU and GPU can be resource-intensive. Tessmann noted that while they could add more capabilities using just the CPU and GPU, this often led to a degraded user experience due to the constrained resources and increased latency when running neural nets on the CPU. In his estimation, the NPU was critical for enabling djay Pro’s newest feature the Neural Mix.

“Thanks to the NPU, we are revolutionizing the way our users interact with music on Windows, bringing best-in-class AI features to djay Pro that make DJing even more accessible.” – Federico Tessmann

Key New Experiences Enabled by the NPU

One of the newest features of djay Pro enabled by the NPU is advanced source separation. This feature, called Neural Mix, instantly isolates beats, instruments, and vocals of any song, allowing DJs to play and remix singular elements from multiple tracks in real-time. Although djay Pro for Windows had previously implemented source separation, it was the raw power of the NPU that enabled them to achieve best-in-class separation quality with unprecedented low latency.

The introduction of the NPU has revolutionized this feature, bringing it to life in a way they had always envisioned. Now, the inference for source separation is performed entirely on the NPU, functioning like a smart equalizer to identify and separate source material continuously and seamlessly in the background during a session. This advancement has significantly enhanced the user experience, making it more intuitive and responsive.

Efficiency and Future Potential

Another key benefit of utilizing the NPU the Algoriddim development team noticed is the effective distribution of computational loads. By offloading specific tasks to the NPU, the full system is not maxed out, leading to better efficiency of the app within the System on Chip (SoC). This load distribution is crucial in ensuring that the app runs smoothly without overburdening any single component of the device.

Tessmann emphasized the potential for future advancements in NPU technology, hinting at even more sophisticated experiences and features that could be unlocked as the NPU evolves. This continuous advancement is vital for unlocking new levels of developer creativity and innovation.

Conclusion

djay Pro’s use of the NPU highlights the importance of leveraging specialized processing units to enhance application performance and user experience. By effectively utilizing the NPU, Algoriddim has not only improved the efficiency and quality of existing features but also paved the way for future innovations that will continue to push the boundaries of what’s possible in digital music production and performance. As NPU technology evolves, we can expect even more groundbreaking features and experiences from Algoriddim and many other developers.

Here is a video demo of djay Pro using the NPU on Snapdragon X Elite captured by Max Weinbach.

One of the coolest demos from @Qualcomm #AI day is this DJ Pro demo pic.twitter.com/DJR72RB2Mt

— Max Weinbach (@MaxWinebach) June 25, 2024

Join the newsletter and stay up to date