Tag Archives: datacentre

How Managed Services Keep the Edge Ecosystem Afloat

As the amount of connected “things” — vehicles, devices, equipment, sensors — proliferate, organisations continue to look for ways to securely harness the data those things generate. An entire ecosystem dedicated to collecting and analysing that data has erupted, and it’s taking data infrastructures to the edge of their capabilities.

Edge computing represents a vast opportunity for IT organisations if implemented well. Unfortunately, the data centre infrastructure required to host edge computing implementations is a patchwork affair. Today, organisations must leverage centralised data warehouses, regional edge data centres and local edge micro data centres.

person in blue suit jacket holding a black smartphone
Photo by Barbara Olsen on Pexels.com

Tech Research Asia (TRA) revealed in 2020 that organisations in Malaysia who has deployed edge computing were able to lower their costs in IT and operations, resulting in an overall improvement in employee experiences. However, most local organisations still find edge computing a fairly new concept. How can local organisations effectively tap into the full potential of Edge computing?

With so many geographically dispersed locations without on-site IT staff and often limited in-house resources, many organisations are turning to managed services providers to help deploy, monitor, and maintain their edge data centres. Still others, such as existing managed service providers and IT solutions providers, are expanding their services portfolio to help clients with the edge. This represents a vast opportunity for IT solution providers.

Managed services providers enable end-users to focus on core competencies

Edge locations need the same resilience, security, and fault tolerance as centralised locations, especially as they support more and more mission-critical applications. Managed service providers with the right capabilities offer peace of mind and operational efficiencies for edge deployments.

hands on a laptop keyboard
Photo by cottonbro on Pexels.com

Ensuring the necessary resilience and availability at the edge is not a simple matter. It requires having at least two major capabilities in place:

  • Remote monitoring and management of UPS and physical infrastructure
  • Data collection and analytics from monitoring equipment. This data improves the reliability and cost-effectiveness of assets at the edge.

These highly specific capabilities are not the core competencies of most companies. They don’t even cover all the expertise and manpower necessary to maintain support infrastructure. Turning to a managed services provider places the responsibility for infrastructure uptime into the hands of experts so end users can focus on the core of their business.  

Managed services boost revenues for existing providers

An increased need for managed services also represents an opportunity for existing providers. For example, power protection at the edge is not something many end-users consider. But an unmanned edge computing deployment without power is just another cost centre. For existing services providers, adding power monitoring and protection to their portfolio of offerings invites additional recurring revenue streams.

The story is the same for monitoring and dispatch services. When physical infrastructure in remote locations goes down, those sites need immediate attention. Most organisations don’t have a full-time response staff for such incidents, opening the door to managed services providers. Solutions and services providers can earn additional business by offering remote monitoring or dispatch services.

Managed services keep the edge ecosystem running smoothly

Edge computing has come a long way despite still having challenges to overcome. There are still operational issues to be considered in order for organisations to effectively ensure edge of network availability during this proliferation. The global health crisis too played a role in the impact of data centre downtime, making the availability of data centres, at the core and at the edge, a key concern for organisations.

close up view of system hacking
Photo by Tima Miroshnichenko on Pexels.com

Maintaining availability is challenging, given edge data centres experience more frequent total facility outages than their centralised counterparts. The primary methods companies leverage to improve edge availability — investing in improved equipment and redundant equipment — are not cost-effective ways of ensuring uptime.

It’s clear that the growing edge ecosystem represents a two-pronged opportunity for managed services. End users can turn to managed services providers for cost-effective uptime of their edge deployments, and existing providers can work with partners to add new services to their portfolios.

Regardless of where companies fall in the spectrum of offered services, the first step is to cultivate true partnerships. A typical service provider contract lasts three years. Customers must feel at ease knowing that the contract brings them the latest offerings, keeps equipment in optimal condition, and prepares them for uncertainties and surprises.

The edge is the present and future of infrastructure investments. Appropriate managed services can keep the ecosystem running smoothly for all parties involved.

NVIDIA Grace CPU for Datacentres for Next Generation Super Computers

NVIDIA’s GTC 2021 just happened last night. If you remembered 2020, you would remember that GTC 2020 was also the time where NVIDIA introduced their new A100 GPU chips for super computers. 2020 was also the yea NVIDIA launched their highly anticipated, and highly capable RTX 3000 series consumer grade GPUs.

GTC’s keynote is always a highly anticipated event. Not because the conference always brings a new GPU. Recent years of GTC has always been exciting because somehow GPU is able to push the limits of what is possible with computing and cloud. NVIDIA has made itself relevant not just in the graphics world, but also in the super computing world, Artificial Intelligence (AI), and even cybersecurity. NVIDIA’s own AI even composed its own song, and it is a good song mind you.

With GTC 2021, NVIDIA shows that they are not done innovating just yet. Now, they also want to give the likes of Intel a new sort of headache. NVIDIA has introduced Project Grace.

Source: NVIDIA

NVIDIA’s CEO, Jensen Huang mentions that the name Grace refers to a particular pioneer in the computer science field, Grace Hopper. The project is NVIDIA’s first dip into the datacentre CPU industry. Fitting to the Grace Hopper namesake, project Grace is supposed to be 10x more powerful than the current NVIDIA GDX x86 supercomputer platform.

Why is this a problem for Intel? The world’s fastest supercomputer today is all powered by Intel’s x86 CPU platform. The x86 platform has also existed for about a decade now and the platform has approached its technological limits in 2021. Of course, NVIDIA took matters into their own hands and the Grace CPU is an ARM based chip for the fastest ever datacentre and servers in the world.

Just saying that the CPU will be the fastest ever server-based CPU though means nothing. What you want to know is numbers, and these are big numbers. The new Grace architecture allows the CPU and GPU to communicate at up to 900GB/s speed thanks to NVLink technology. According to NVIDIA, that is 30x faster than most servers today. Of course, paired to LPDDR5x memory modules, you get up to 10x the speed of today’s machines.

Before anyone can say that NVIDIA’s Grace dreams is just that; dreams, NVIDIA also announced that they will be installing their Grace based datacentre in the United States Department of Energy’s Los Alamos National Labrotory and the Swiss National Supercomputing Centre (CSCS). The two clients will feature their very own NVIDIA powered supercomputer soon.

Source: NVIDIA

In those two places though, the servers and supercomputers are not built just to push cloud storage to corporations. They are purpose built for AI training and implementations. They are built for neural and language programming and training. They are built to progress humanity and probably cure cancer one day.

Of course, because Grace is a giant processor made for datacentres and supercomputers, we will not be expecting to see NVIDIA dive into consumer level ARM-based processors for PCs anytime soon. NVIDIA is working with MediaTek to bring their GPU technology into the mobile space and even ARM based PCs though. In that case, us regular consumers can expect a Qualcomm Snapdragon notebook PC with NVIDIA GeForce graphics power soon, probably. Catch NVIDIA’s GTC 2021 keynote on their website.