Providing Out-of-Band Connectivity to Mission-Critical IT Resources

The Importance of Out-of-Band Data Center Connectivity

The importance of data center connectivity is illustrated with overlapping digital globes superimposed over racks of data center equipment

Data center connectivity is more crucial than ever. Data, applications, and digital services power every aspect of business, which means your infrastructure needs to be available 24/7. However, according to the Uptime Institute’s 2022 Outage Analysis report, outages are still a frequent problem for enterprises and data centers, and the financial consequences of the resulting business interruptions are staggering.

One of the best tools for maintaining data center connectivity is remote out-of-band (OOB) management. OOB management creates an alternative path to remote infrastructure on a dedicated management network. An OOB management solution uses serial consoles and data center infrastructure management (DCIM) software to give administrators the ability to monitor and control remote data center infrastructure. With OOB, you can recover from outages faster and regain control over remote data center infrastructure even when the main network is down.

The importance of out-of-band data center connectivity

The first major takeaway from the Uptime Institute report is that outage rates have remained high over recent years. Twenty percent of responding organizations experienced a serious outage in the last three years, which is slightly higher than in the 2021 report. It was noted that 80% of data centers reported an outage of some kind (with varying severity), which hasn’t changed much since previous reports. The implication here is that businesses and data centers are both still struggling to maintain the 24/7 availability expected by their customers. Let’s dig deeper into the causes and effects of data center outages and discuss how out-of-band management can help.

  1. Network issues are the biggest cause of downtime
    According to the 2022 report, networking problems were the single largest cause of outages over the last three years. These issues are frequently due to the complexity of distributed and software-defined network architectures, especially in cloud or hybrid cloud deployments.Out-of-band data center connectivity solutions use serial consoles which directly connect to other data center devices using the serial port. That means administrators can access and manage those devices without needing to use their IP addresses. So, if a configuration mistake causes the production LAN to go down, administrators can still remotely fix the problem, shortening the duration of the outage. And, since OOB serial consoles provide a secondary network interface—often an LTE cellular modem—you’ll still have remote access even if human error brings down the WAN or SD-WAN architecture.
    .
  2. Power failures are another leading cause of outages
    Respondents reported that 43% of significant outages—ones that resulted in business interruption and financial loss—were caused by power issues. Many of those incidents were due to uninterruptible power supply (UPS) failures.As part of a data center infrastructure management (DCIM) solution, an OOB serial console gives administrators the ability to remotely monitor and manage UPS devices in the rack. Admins get alerts when devices aren’t performing efficiently or begin to show signs of imminent failure. That means organizations can proactively schedule repairs or deploy replacements before a power outage occurs.
    .
  3. Out-of-band data center connectivity shortens recovery time
    One of the most alarming statistics from the report is the percentage of public outages lasting more than 24 hours. In 2017, just 8% of outages lasted longer than a day, but that increased to nearly 30% in 2021.Out-of-band data center connectivity can significantly reduce the time to recovery by ensuring administrators always have remote access to data center infrastructure. That means your organization will waste less time waiting for on-site managed services to arrive or for in-house technicians to travel to the data center. As soon as DCIM monitoring alerts them to an issue, admins can begin diagnosing and fixing the problem from their remote desktop.
    .
  4. Outages are more expensive than ever
    Over 60% of reported outages resulted in at least $100,000 in losses, an increase of 21% since 2019. The number of outages costing more than $1 million also increased by 4%.OOB management gives teams the ability to remotely troubleshoot and recover from many issues, so you don’t need to pay for truck rolls or on-site managed services. If remote troubleshooting reveals that the problem requires an on-site fix, technicians can go in already knowing the source of the issue and with all the necessary tools to repair it. Either way, your organization saves time and money.

Out-of-band data center connectivity gives organizations reliable access to remote infrastructure even during a network outage. OOB serial consoles also provide visibility into the health and performance of critical data center devices like UPSs, so you can proactively address issues and prevent downtime from occurring. Through 24/7 remote access, monitoring, and management, you can reduce the incidence, duration, cost, and impact of data center downtime.

Gen 3 OOB data center connectivity with Nodegrid

The Nodegrid Serial Console Plus (NSCP) is a Gen 3 out-of-band data center connectivity solution that delivers reliable and blazing-fast remote access to up to 96 data center devices from a single 1U rack-mounted box. Nodegrid’s vendor-neutral OOB DCIM platform supports integrations with your choice of infrastructure solutions and automation tools, giving you total and efficient control over your data center infrastructure.

Ready to learn more about out-of-band data center connectivity?

To learn more about out-of-band data center connectivity with Nodegrid, contact ZPE Systems today.

Contact Us

What Is uCPE, and How Does It Benefit Enterprise Customers?

ucpe

uCPE stands for universal Customer Premises Equipment. A uCPE box is a general purpose networking device used to run virtual network functions, or VNFs. VNFs are essentially software versions of network devices such as routers, switches, and firewalls. That means you can consolidate an entire networking tech stack into a single uCPE box, saving money and reducing management complexity.

Despite the promise of uCPE, the technology has been slow to catch on. In this article, we’ll explore the reasons for the lack of popularity of early uCPE before discussing how newer generations overcome these issues to deliver cost savings, simplified management, and other benefits to enterprise customers.

The shortcomings of gen 1 uCPE

Early uCPE devices were generally provided by telecoms and ISPs to host their specific networking software. Customers didn’t get to choose the software or virtualization solutions—they had to use whatever the vendor gave them. That meant enterprises didn’t have the flexibility to swap out VNFs and software to get the specific features or pricing they wanted, and they couldn’t continue using existing solutions that they really liked.

However, the larger issue was that the virtualization technology itself was ahead of its time. Many organizations still didn’t have use cases that justified the business disruption and expense of swapping out networking infrastructure with virtualized solutions. Plus, software-based networking was so new that many network administrators and engineers didn’t have the skills and experience needed to configure, deploy, and manage fully virtualized tech stacks.

Due to these limitations, enterprises showed minimal interest in uCPE for a long time, leading many to believe that the technology would die out entirely. Instead, forward-thinking hardware and software vendors continued to improve uCPE technology to overcome these shortcomings. In addition, enterprises have been pushing their computing and business operations out to remote locations at the network edge, resulting in the rapid adoption of SD-WAN (software-based wide-area networking) solutions for distributed network management. A greater interest in software-based networking technology, and a need for hardware capable of running that software, has led to a renewed enthusiasm for uCPE.

The next evolution of uCPE

The current generation of uCPE focuses on delivering a truly universal, vendor-neutral platform from which to host, manage, and troubleshoot an entire consolidated tech stack. This is provided in two parts:

  1. The device itself, which runs on an open, Linux-based operating system and supports multiple pinout standards.
  2. An orchestration platform which consolidates the monitoring and management of all uCPE solutions behind a single pane of glass.

Through its a vendor-agnostic hardware, software, and orchestration platform, uCPE benefits enterprise customers in numerous ways, including:

Vendor freedom

Next-gen uCPE devices are capable of hosting any software or virtualization solution from any vendor. This gives enterprise customers the ability to shop around for the best features and pricing for their particular use case. If customers already have a software-based networking solution that works well for them, they can simply migrate it to the uCPE with minimal hassle.

Tech consolidation

A single uCPE box can take the place of an entire rack of networking equipment, reducing the number of devices to install, license, and maintain. This is especially vital for organizations that want to expand their operations to branch offices, edge data centers, and even hard-to-reach locations like oil rigs and research stations. Tech consolidation reduces the time and expense required to deploy remote infrastructure.

Centralized management

The current generation of uCPE includes an orchestration platform capable of observing and controlling the entire distributed network of uCPE boxes and connected infrastructure. Enterprises can deploy hundreds or even thousands of uCPE boxes to locations all over the globe, but they only need to log in to one platform to manage them all. uCPE gives organizations the ability to orchestrate network functions, monitor remote infrastructure, and troubleshoot and respond to issues from behind a single pane of glass, which results in simplified and optimized network management.

SD-WAN capabilities

As organizations have sped up their SD-WAN adoption plans in response to the rise of remote work, edge computing, and distributed network management, the need for universal networking hardware has also quickly increased. Next-gen uCPE devices are the perfect hosts for SD-WAN software solutions because they allow for easy integration with the underlying WAN infrastructure, which run as VNFs on the same box. That means enterprises don’t need to invest in new SD-WAN-capable routers and gateways for each remote site. Plus, with a uCPE orchestration platform, it is easier to view and control the entire SD-WAN architecture. 

To take advantage of the benefits promised by uCPE technology, you need to ensure that you choose a platform that’s truly vendor-neutral to support your choice of SD-WAN and VNF solutions. The hardware also needs to be powerful enough to run your entire edge networking stack from a single box.

Universal network management with Nodegrid

Nodegrid is a next-gen uCPE platform that delivers universal infrastructure orchestration for enterprise customers. Nodegrid’s flexible hardware and open OS give you the freedom to bring your choice of networking devices, SD-WAN solutions, and VNFs. Nodegrid devices are built with CPU and memory headroom and expansive storage options so you can run your entire branch from a single box. Plus, the ZPE Cloud infrastructure orchestration platform gives you complete control over your distributed network, including third-party automation playbooks and workflows.

Ready to learn more?

To learn more about Nodegrid next-gen uCPE, contact ZPE Systems today.

Contact Us

Network Engineers: 5 Must-Have Tools During a Slow Economy

Network Engineers: 5 Must-Have Tools During a Slow Economy

Network engineers need powerful tools to keep digital services online and customers happy. This is especially true during economic downturn, when organizations must freeze hiring and put more strain on existing staff. Revenue relies on network availability, and with experts predicting a recession this winter, significant operational challenges are inevitable for most organizations.

The burden of overcoming these challenges falls on network engineers. Success means maintaining reliable services and reaping any professional benefits (salary increases, promotions, etc.). Failure, on the other hand, means the very realistic possibility of major business losses and job cuts, including yours.

In order to make sure you don’t fall into the latter scenario, here are five must-have tools and techniques to help network engineers overcome these challenges.

Tool 1. OOBI-LAN™

Out-of-band (OOB) management is an essential part of a network engineer’s toolkit. At the conceptual level, out-of-band is meant to provide management access to production equipment, even if the production equipment is offline.

One major problem is that many organizations invest a lot of time and money into their production infrastructure, but not into any dedicated OOB infrastructure. In other words, they deploy OOB solutions that rely in part on their production equipment, such as OOB VLANs connected to in-band switches. All it takes is a mistake, misconfiguration, or attack to bring down the production and management networks, leaving network engineers to rebuild the entire system from scratch while their services remain offline to customers. This is simply not acceptable in a slow economy, where the business’ resources and revenue are already too thin.

From the pandemic lockdowns, organizations have learned that they need a way to more quickly recover their network locations. According to the Uptime Institute’s 2022 Outage Analysis, outages lasting longer than 24 hours increased to nearly 30% in 2021. This has led many to build dedicated OOB infrastructure for the LAN (OOBI-LAN). They deploy a serial console locally to establish connectivity to the management ports of their sensitive equipment. Network engineers must use this serial console to access their production infrastructure. This serial console minimizes the attack surface since it’s the only device connected to the Internet, and allows network engineers to restore services even if production equipment is down.

Tool 2. OOBI-WAN™

A critical tool for network engineers is out-of-band that enables remote WAN management. But typically, organizations employ a WAN management strategy that also relies on their production infrastructure, such as for creating VPN tunnels for management traffic. If a VPN tunnel becomes broken or the production gear fails, network engineers are suddenly left without remote access to their equipment.

Aside from a lack of availability, traditional OOB access comes with real security risks. Exposing LTE modems to the Internet, leveraging untrusted third-party VPN services, using OOB hardware that’s old and unpatched, and worse — exposing the management port of devices to public Internet. All of these are attack surfaces, any of which can give access to your infrastructure and be used as the pivot point to get to the rest of the infrastructure.

traditional WAN management approach

Image: Management access depends on production equipment to establish VPN tunnels. 

On top of their OOBI-LAN, organizations have built dedicated OOB infrastructure for the WAN (OOBI-WAN – there’s a Star Wars reference somewhere in there) for added resilience against these scenarios.

OOBI-WAN is the WAN best practice

Image: OOBI-WAN and OOBI-LAN create a fully separate out-of-band infrastructure that can be used to completely rebuild production infrastructure. 

OOBI-WAN uses MPLS, IPsec, or SD-WAN links to create an overlay network dedicated specifically to management traffic. This gives network engineers private access to their infrastructure for management and troubleshooting, essentially creating a completely separate OOB network that does not rely on any part of the production network. OOBI-WAN lets network engineers use their WAN connection to remotely access their OOBI-LAN and fully rebuild their distributed networks, regardless of the state of their production infrastructure.  

A key part of OOBI-WAN is the inherent security that is built at all layers. To build secure OOBI-WAN, the best practice is to use OOBI-SDWAN™ which automates the building of VPN tunnels between all the nodes that need to be managed. OOBI-SDWAN provides the expected auto-VPN feature which means VPN encryption keys remain secure, as they don’t need to be copied/pasted/typed into multiple third-party devices. OOBI-SDWAN also ensures that an SLA is provided on the OOBI network along with observability dashboards of connectivity and the access state of the network. The combination of OOBI-SDWAN with a zero trust security framework is the best way to gain reliability in a way that reduces your risk.

OOBI-WAN hub and spoke

Tool 3. Fully independent automation infrastructure

Another tool that network engineers are becoming familiar with is automation. Network automation codifies repetitive tasks to reduce workloads for configuration management, compliance, and troubleshooting. During a slow economy, being able to scale an IT team’s efforts is especially valuable to business operations and end customers.

There is one major concern, however: having automation that runs loose and begins destroying the network, much like a bull in a China shop. Network engineers typically must learn new automation tools and programming languages, which requires trial and error. And because there is a lack of a best practice reference architecture, teams don’t know any better than to automate directly on the production network. This causes anxiety, as one mistake could bring down the network, cause catastrophic losses, and leave network engineers without an efficient way to recover.

Image: The orange section describes dedicated automation infrastructure used for safely implementing automation.

In recent years, teams have been deploying automation on dedicated infrastructure like their OOB network. This automation infrastructure sits between the production infrastructure and the orchestration infrastructure, and serves as a safe way to build an automation pipeline. Open, Linux-based appliances like the Nodegrid Net SR combine a variety of functions and can host automation tools, like those for observability and analytics, version control, and source of truth. This independent automation infrastructure allows network engineers to ensure the integrity of configuration changes, software updates, and remediation protocols in an out-of-band manner, rather than testing directly on the production network. They can scale their capabilities, and in case of errors, roll back to a golden configuration that keeps services online.

Tool 4. Remote access to local jump box

Network engineers have another tool at their disposal: the jump box (a.k.a. jump server, jump host). A jump box hosts tools for maintaining operations, and these include file servers, image storage, configuration management tools, and troubleshooting commands. The jump box is a valuable asset for normal operations and for restoring services, such as when a device fails and needs its image rebuilt.

The issue with jump boxes is that they are typically a separate device that requires power, cooling, rack space, and maintenance. Some jump boxes also require on-site technicians to physically connect to the equipment needing repair.

Many organizations have adapted by upgrading their OOB infrastructure with appliances that can run full virtual machines (VMs). These can run all the tools mentioned above as well as with Docker containers, while consolidating power consumption, cooling resources, and rack space. The OOB appliance can double as a jump box. Combined with OOBI-LAN and OOBI-WAN, network engineers get remote access to re-image a device, diagnose DNS/routing issues, and perform any other necessary tasks. Key point is that discrete jump boxes – Like the Intel NUC — to be converted to virtual jump boxes running on a secure OOB platform like the Nodegrid Service routers.

Tool 5. Smart hands

A final way that network engineers get help through a slow economy is by outsourcing to so-called ‘smart hands.’ Employing smart hands means involving a third-party expert who can take on some of the IT workload. It’s a viable strategy, especially for teams feeling crushed by corporate belt tightening and the resulting mountain of tasks.

Companies who take this approach must be aware that the skills of smart hands varies greatly, as does the cost. This means it’s essential to strike a balance between which tasks to outsource, and which tasks to keep in house. For example, many organizations use smart hands for simple jobs such as replacing hardware and installing equipment at new sites. For more specialized jobs that require deeper knowledge of the environment, such as fixing a misconfigured IP address or route, teams use in-house personnel. This balance helps organizations get the support they need to keep operations running.

Get a cheat sheet to implement these tools fast

Some companies thrive during economic downturn, because they’ve intelligently placed these tools within their network architecture. Over the past decade, we’ve worked with these companies — including the largest tech giants — to describe in painstaking detail how they set up their infrastructure. We just released all 40+ pages of this validated reference architecture, complete with implementation diagrams and examples.

It’s called the network automation blueprint and it combines all of these tools. Network engineers can confidently answer questions like:

  • How do we meet SLAs with a smaller workforce?
  • How can we keep sites operating without physical access to equipment?
  • How can we perform weekly updates/patching without breaking things?

The blueprint is your cheat sheet to implementing a more resilient network, and fast. Click the button below to download your copy now.

ZPE Systems launches smartphone-size cloud gateway for IoT, OT, & IoMD applications

ZPE Systems launches smartphone-size cloud gateway for IoT, OT, & IoMD applications

The Nodegrid Mini SR is ideal for secure remote out-of-band connectivity, automation, and security for critical edge devices

Fremont, CA October 19, 2022 — ZPE Systems announces the Mini SR, a smartphone-size, cloud-orchestrated gateway that solves the operational challenges of running security and connectivity at the network edge.

Organizations must solve evolving business needs by deploying applications and devices at locations including branch offices, third-party manufacturing sites, powerplants, emergency response locations, and urgent care facilities. Even with cloud SaaS-based applications, organizations still require equipment, and they typically outsource to MSPs and MSSPs who can manage the SLA and operational challenges presented by this physical stack. These providers need a simple platform to host third party applications, enable remote operation, and ensure security. The Mini SR solves this problem.

Roughly the size of an iPhone, this cloud-managed, out-of-band gateway collapses multiple boxes. The Mini SR delivers wired and wireless connectivity, hosts third-party security apps and critical tools, and provides centralized cloud orchestration. Its fanless, ruggedized design can be tucked away and extends management capabilities via physical Gigabit Ethernet and USB interfaces, offering remote access via ZPE Cloud.

The Mini SR is ideal for MSPs/MSSPs and for following use cases:

  1. Out-of-band edge rack management with environmental sensor support
  2. SASE/SSE on-ramp for Netskope, Palo Alto Networks’ Prisma Access, and Zscaler connectors
  3. Secure IoT/OT gateway with simple cloud orchestration
  4. Secure work-from-anywhere gateway (home, car, temp office)
  5. Police/emergency response (in-vehicle edge compute router)
  6. SCADA industrial OT/IoT zero-trust, pico segmentation gateway
  7. Medical and industrial device cloaking to prevent detection and exploitation during hacker reconnaissance scans
  8. SaaS applications requiring a box to host agents for vulnerability scanning, experience monitoring, and critical DDI (DHCP/DNS/IPAM) services

The Mini SR was designed after collaborating with industry tech giants, who during the pandemic needed a secure resilience solution for their sprawling IoT and OT infrastructures. This compact gateway connects, controls, and isolates critical assets via out-of-band (OOB) management. This secure path uses the Mini SR’s Wi-Fi, LTE, or Ethernet connections to establish a tunnel or connect to zero trust destinations, keeping management traffic separate & secure.

Joe Quenneville, CEO of security service provider CyberGRC, states, “The Mini SR is perfect for managing remote manufacturing equipment, SCADA systems, medical imaging devices, and even oil & gas equipment sensors. It lets my IT team get inside their distributed systems without having to physically be on site.”

Matt Robinson, CTO of Rahi, says, “The Mini SR makes life easy for MSPs and VARs managing remote branch offices or industrial locations. It gives actionable observability into the environment for quick troubleshooting and recovery without requiring an on-site resource. The Mini SR’s out-of-band and hosted tools let teams remotely rebuild entire stacks of infrastructure, making efficient use of smart hands resources. We anticipate savings ranging from $600 to $4,000 on each smart ticket incident.”

Koroush Saraf, ZPE Systems’ VP of Marketing and Product Management, explains: “Anyone considering Raspberry Pi or Intel NUC needs the Mini SR instead. Many IT use cases and SaaS services require a physical device on premises to act as the hosting platform or cloud gateway, and this device needs to be regularly updated with the latest patches. The entire Nodegrid SR fleet, including the Mini SR, can be upgraded and orchestrated from ZPE Cloud just like iPhone users receive updates from the App Store. The Mini SR connects to ZPE Cloud via out-of-band to keep its OS and guest applications up to date.”

The Mini SR uses the Intel x86 CPU and is preloaded with Nodegrid OS, which combines secure cloud out-of-band management and an open platform with the ability to run your preferred VMs, Docker containers, and LXC applications. The device also accommodates Nodegrid’s environmental sensors and feeds data to Nodegrid Data Lake for analytics. These integrations increase uptime by giving visibility into infrastructure heat, moisture, dust, device tampering, user experience, and hidden machine log data. On top of this the SR family incorporates encrypted disk and secure boot to prevent tamper and supply chain risks are detected and thwarted. Organizations can now cut downtime by 50% or more, predictably configure and scale sites in hours, and keep edge users connected without interruption.

Click the button to visit our Mini SR announcement page.

 

Upgrade Network Infrastructure With Minimal Business Interruption

upgrade network infrastructure

Outdated network infrastructure poses a significant risk to the security and continuity of business operations. According to NTT’s “2020 Global Network Insights Report,” obsolete devices contain nearly twice as many security vulnerabilities as currently supported solutions. Outdated network hardware is also more likely to fail, and the ability to recover from a failure is severely hampered by a lack of vendor support. However, network upgrades can be highly disruptive, so many organizations delay network upgrades to avoid business interruption. They don’t realize that their outdated devices are like ticking time bombs that could bring down their network at any moment. In this post, we’ll provide advice that helps answer the question: How do I upgrade network infrastructure without disrupting business operations?

Why and when to upgrade network infrastructure

Obsolete network infrastructure no longer receives updates and security patches from the vendor. That means any vulnerabilities that exist on the device will remain open, giving cybercriminals time to find and exploit them. In addition, older network solutions often lack the advanced security features like SSO and MFA, which are required for Zero Trust.

Even supported legacy devices suffer from limitations that can prevent a business from achieving its technological goals. For instance, legacy devices may not support automation, making it difficult to achieve NetDevOps transformation. Plus, as enterprise networks grow more distributed, there’s a need for solutions that support SD-WAN and SD-Branch technology.

Sometimes the solutions themselves aren’t terribly outdated, it’s just that business requirements have changed in such a way that the existing infrastructure can’t support. For example, an organization may migrate some applications and systems to the cloud, so they need networking solutions that support hybrid environments. In addition, the mix of old and new devices and cloud and on-premises resources increases management complexity and prevents teams from effectively leveraging network orchestration.

Obsolete devices, outdated security, limited automation support, and changing business requirements are all important reasons to upgrade network infrastructure. However, these upgrades must be approached with a thoughtful strategy to reduce the impact on the performance and availability of business resources.

How to upgrade network infrastructure with minimal business interruption

Vendor agnostic platforms are the key to smooth network infrastructure upgrades. Vendor agnostic (a.k.a. vendor neutral) network management platforms support integrations with all or most viable and established network solutions, including legacy devices.

Vendor-neutral management devices, such as the Nodegrid Serial Console, support both legacy and modern Cisco pinouts. That means Nodegrid provides a single, unified platform from which to manage all the outdated devices you already have as well as any new solutions you add to your infrastructure. This reduces management complexity for network administrators, giving them more time to focus on optimizing performance and planning future network upgrades.

Additionally, a vendor-neutral network orchestration platform can use that management device to extend modern automation and orchestration to legacy hardware. A truly vendor-agnostic platform, such as Nodegrid Manager (for on-premises and private cloud deployments) or ZPE Cloud (for public cloud and hybrid deployments) can run third-party automation playbooks and custom Python scripts. This gives network administrators the unprecedented ability to implement a fully-automated NetOps environment even while still rolling out infrastructure upgrades.

The final piece of the puzzle is vendor-neutral Zero Touch Provisioning (ZTP). ZTP gives you the ability to deploy new devices efficiently and securely in remote data centers, branch offices, and edge compute sites. ZTP devices are provisioned automatically over the network, reducing the need for onsite deployments or pre-staging. A vendor-neutral ZTP solution like Nodegrid can extend ZTP to other vendors’ devices so you can quickly deploy upgraded infrastructure.

Nodegrid delivers vendor-neutral management, orchestration, and ZTP so you can upgrade network infrastructure with minimal business interruption.

Need Help Upgrading Your Network Infrastructure?

Contact ZPE Systems to learn how to upgrade your network infrastructure with Nodegrid.

Contact Us