How AI is shifting industrial edge hardware toward PoE+

Nov. 17, 2022
Investigating how adding AI at the industrial edge requires hardware suited to the task.

Ed. Note -- Taiwan's Cervoz Technology Co., Ltd. (Taipei) recently brought forth a press release in the form of technology marketing article explaining how industrial-strength memory and storage components bring a sliver of data center power and connectivity to the edge for enabling next-generation AI technologies.

Citing nearly two decades of experience in designing and developing high-performing memory and storage devices for industrial applications, Cervoz Technology supplies embedded components for the industrial PC market.

The lightly edited piece quoted below is a succinct explanation of edge technologies that winds up discussing the implementation of PoE+ technologies to support the addition of cameras in industrial IoT (IIoT) sites.

Minimum requirements are growing as AI opens the door to innovative applications that need more and faster processing, storage, and memory. How much computing power is needed at the edge? How much memory and storage are enough for AI at the edge? How can today’s memory and storage technologies meet the stringent requirements of these challenging new edge applications?

What do we mean by “the edge?"

Edge includes any distributed application where specific processing occurs away from the server, even if the data is eventually sent to a data center.

The big idea is to avoid sending all the data over the internet for processing on a server, and instead allow data to be processed closer to where it’s collected, avoiding latency issues with long data roundtrips, and enabling near real-time response on site.

Data latency and bandwidth at the industrial edge

In industrial applications, edge computers are typically designed to take inputs from sensors or other devices and act on the inputs accordingly.

For example, preventative maintenance takes vibration, temperature, or pressure sensor readings and analyzes them to identify anomalies that indicate slight faults in machines. Machines can be taken offline immediately or when needed to enable maintenance to occur ahead of catastrophic failure.

Reaction times must be quick, but data quantity is low. However, AI is putting a strain on these edge systems. AI places a different kind of load on computer systems. AI workloads require faster processors, more memory, and powerful GPUs.

AOI, for example, [is a manufacturer that] has seen widespread adoption for PCB inspection, using video input from high-speed cameras to identify missing components and quality defects.

Bringing a sliver of data center power to the edge

Essentially, to tackle AI tasks at the edge, we’re bridging the gap between the edge and the data center. Servers tucked away in temperature-controlled data centers have terabytes of memory and vast amounts of storage on hand to handle specific high-capacity loads and keep systems working fast.

But when it comes to inference happening far from the data center, it’s a different story. Edge computers don’t enjoy such idyllic settings and must be built to withstand harsh environments. The edge needs hardware that strives for maximum performance, while accounting for less-than-ideal conditions.

Hardware for the edge

Adding AI at the industrial edge requires hardware suited to the task. Three things are needed for vision systems, the most prolific AI application to date, memory to support efficient AI inference, storage for the incoming data, and PoE to support the addition of cameras.

Vision systems need cameras. PoE+ is the simplest and most efficient way to add high-speed cameras to the system, providing both power and data transmission through a single cable. Cervoz’s PoE Ethernet Modular PCIe Expansion Card adds this functionality through a small add-on for power.

Getting more memory in a smaller space can be accomplished with the latest DDR5. It provides more memory capacity at the edge with higher speeds. Extending capacity is needed for edge applications, as the data must go to the server or stay at the edge for some time, so SSDs are needed for interim storage.

The shift from SATA to NVMe has opened the doors to greater speeds and performance and the NVMe PCIe G4X4 SSD, available soon, is the latest SSD in Cervoz’s pipeline, providing the industrial performance for these applications.

For more news, projects, and profiles in the ICT cabling and connectivity industry, subscribe to CI&M’s newsletter and follow us on LinkedInTwitter, and Facebook.

Sponsored Recommendations

Cat 6A Frequently Asked Questions

April 29, 2024
At CommScope we know about network change and the importance of getting it right. Conclusion Category 6A cabling and connectivity.

Revolutionize Your Network with Propel Fiber Modules

Oct. 24, 2023
Four sizes of interchangeable Propel fiber modules provide the breadth of capabilities for virtually any configuration.

Elevate Your Network with Propel High-Density Panels

Oct. 24, 2023
Propel Series Sliding Fiber Optic Panels

Constellation™ - Explore power and data products

Oct. 24, 2023
Discover the Essentials for Building Your Power and Data System!