Gcore Unveils Inference at the Edge—Bringing AI Applications Closer to End Users for Seamless Real-Time Performance
- June 6, 2024
- 2 min read
Luxembourg, June 6, 2024—Gcore, the global edge AI, cloud, network, and security solutions provider, today announced the launch of Gcore Inference at the Edge, a breakthrough solution that provides ultra-low latency experiences for AI applications. This innovative solution enables the distributed deployment of pre-trained machine learning (ML) models to edge inference nodes, ensuring seamless, real-time inference.
Gcore Inference at the Edge empowers businesses across diverse industries—including automotive, manufacturing, retail, and technology—with cost-effective, scalable, and secure AI model deployment. Use cases such as generative AI, object recognition, real-time behavioural analysis, virtual assistants, and production monitoring can now be rapidly realised on a global scale.
Gcore Inference at the Edge runs on Gcore’s extensive global network of 180+ edge nodes, all interconnected by Gcore’s sophisticated low-latency smart routing technology. Each high-performance node sits at the edge of the Gcore network, strategically placing servers close to end users. Inference at the Edge runs on NVIDIA L40S GPUs, the market-leading chip designed specifically for AI inference. When a user sends a request, an edge node determines the route to the nearest available inference region with the lowest latency, achieving a typical response time of under 30 ms.
The new solution supports a wide range of fundamental ML and custom models. Available open-source foundation models in the Gcore ML Model Hub include LLaMA Pro 8B, Mistral 7B, and Stable-Diffusion XL. Models can be selected and trained agnostically to suit any use case, before distributing them globally to Gcore Inference at the Edge nodes. This addresses a significant challenge faced by development teams where AI models are typically run on the same servers they were trained on, resulting in poor performance.
Benefits of Gcore Inference at the Edge include:
- Cost-effective deployment: A flexible pricing structure ensures customers only pay for the resources they use.
- Inbuilt DDoS protection: ML endpoints are automatically protected from DDoS attacks through Gcore’s infrastructure.
- Outstanding data privacy and security: The solution features built-in compliance with GDPR, PCI DSS, and ISO/IEC 27001 standards.
- Model autoscaling: Autoscaling is available to handle load spikes, so a model is always ready to support peak demand and unexpected surges.
- Unlimited object storage: Scalable S3-compatible cloud storage that grows with evolving model needs.
Andre Reitenbach, CEO at Gcore comments: “Gcore Inference at the Edge empowers customers to focus on getting their machine learning models trained, rather than worrying about the costs, skills, and infrastructure required to deploy AI applications globally. At Gcore, we believe the edge is where the best performance and end-user experiences are achieved, and that is why we are continuously innovating to ensure every customer receives unparalleled scale and performance. Gcore Inference at the Edge delivers all the power with none of the headache, providing a modern, effective, and efficient AI inference experience.”
Gcore Inference at the Edge is available now.
Learn more at https://gcore.com/inference-at-the-edge.
About Gcore
Gcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps.
Gcore Press Contact
Press contact
More press releases
Mirantis and Gcore Partner to Tackle AI Infrastructure Challenges
San Jose, NVIDIA GTC, March 18, 2025—Mirantis, a leader in open-source cloud infrastructure and platform engineering, and Gcore, the global edge AI, cloud, network, and security solutions provider, today announced an agreement to facilitate the deployment of artificial intelligence (AI) workloads. The cornerstone of this collaboration is the integration of Gcore Everywhere Inference with Mirantis k0rdent open-source platform, enabling users to effortlessly scale AI inference workloads globally.“Enterprise AI adoption has entered a new phase and open source has a critical role to play – bridging public, private and managed service clouds, so that users can maintain autonomy and control over their global infrastructure,” said Alex Freedland, CEO, Mirantis. “Combining our expertise and commitment to open-source technologies with Gcore’s AI expertise will accelerate our ability to create solutions and critical capabilities to address these issues for MLOps and platform engineers.”Mirantis recently launched k0rdent for large-scale application management across any infrastructure anywhere and intends to integrate Gcore Everywhere Inference to help global organizations deliver AI inference wherever needed, optimizing compute resource allocation, simplifying AI model deployment, enhancing performance monitoring and cost management, and streamlining compliance with regional data sovereignty requirements. This flexible technology can be deployed in the cloud, on-premises, or in hybrid and edge environments.“The collaboration between Mirantis and Gcore addresses today’s AI inference challenges by combining scalable infrastructure management with efficient workload deployment,” said Seva Vayner, product director, Edge Cloud and AI, Gcore. “Mirantis’ recently announced k0rdent project provides platform engineers with a Kubernetes-native, open-source solution for managing infrastructure sprawl and operational complexity across multi-cloud and hybrid environments. With the integration of Gcore Everywhere Inference, an accelerator-agnostic solution for managing AI inference workloads, the project will provide businesses with an easy-to-use platform for deploying and operating distributed AI inference at scale.”“Deploying AI at scale today can be time and resource consuming: under the wrong setup, it can take businesses a long time to onboard new GPUs, and hours or even days to deploy new models,” said Misch Strotz, CEO and co-founder of LetzAI. “Partnerships like the one between Gcore and Mirantis can simplify this: model deployment can be done in a few clicks and new GPUs can be onboarded within hours, enabling infrastructure and ML teams to be much more productive.”Gcore, as a global AI infrastructure provider, has helped enterprises navigate AI adoption. Now, with the increased demand for AI inference, Gcore Everywhere Inference helps businesses efficiently leverage their resources when deploying AI inference, improving time-to-market and ROI from AI projects.Mirantis and Gcore will showcase their joint technologies at upcoming industry events, such as GTC 2025 and KubeCon Europe, where they will demonstrate the power of their combined technologies.About MirantisMirantis helps organizations simplify operations, reduce complexity, and accelerate innovation with open-source solutions for managing modern distributed applications at scale. Its Kubernetes-native k0rdent project enables platform engineering teams to build and operate secure, scalable, and customizable Internal Developer Platforms (IDPs) across any environment—on-premises, public cloud, hybrid, or edge. With a deep commitment to open-source innovation and avoiding vendor lock-in, Mirantis empowers enterprises to run infrastructure and services on their terms.Mirantis serves many of the world’s leading enterprises, including Adobe, DocuSign, Inmarsat, PayPal, and Societe Generale.About GcoreGcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps.
Gcore Radar report reveals 56% year-on-year increase in DDoS attacks
Luxembourg, February 11, 2025—Gcore, the global edge AI, cloud, network, and security solutions provider, today announced the findings of its Q3-Q4 2024 Radar report into DDoS attack trends. DDoS attacks have reached unprecedented scale and disruption in 2024, and businesses need to act fast to protect themselves from this evolving threat. The report reveals a significant escalation in the total number of DDoS attacks and their magnitude, measured in terabits per second (Tbps).Key highlights from Q3-Q4 2024Compared to Q3–Q4 2023, the number of DDoS attacks have risen by 56%, which highlights a steep long-term growth trend.The gaming industry continues to be the most targeted by DDoS attacks, accounting for 34% of all attacks.In Q3-Q4 2024, the financial services sector experienced a significant increase, accounting for 26% of all DDoS attacks, up from 12% in the previous period.There was a 17% increase in the total number of attacks compared with Q1-Q2 2024.The largest attack peaked at 2 Tbps in Q3-Q4 2024, which is an 18% increase from Q1-Q2 2024.DDoS attacks are becoming shorter in duration but more powerful.Attackers are shifting their focusThe sectors that were targeted in Q3-Q4 2024 reflect a changing focus among DDoS attackers. The technology industry has seen a steady increase in its share of DDoS attacks, increasing from 7% to 19% since Q3-Q4 2023. This is because DDoS attackers recognize the wide-reaching disruption potential of attacking technology services. A single successful attack can take out a service that countless organizations depend on—causing significant harm to people and businesses. Another reason that technology platforms have seen an increase in DDoS attacks is due to their vast computational power, which malicious actors can exploit to intensify their attacks.The gaming industry continues to be the most-attacked industry, although there were 31% fewer attacks compared with Q1-Q2 2024. The decline in attacks may be attributed to several factors. For instance, gaming companies are strengthening their DDoS defenses in response to ongoing attacks, which may result in fewer successful attacks. Another explanation is that attackers may be shifting their focus towards other high-value sectors, such as financial services, which saw a 117% increase in the number of attacks. The sector’s critical online services and susceptibility to ransom-based attacks make it a prime target.Andrey Slastenov, Head of Security at Gcore, commented: “The latest Gcore Radar should be a wake-up call to businesses across all industries. Not only is the number and intensity of attacks increasing, but attackers are expanding the scope of their attacks to reach an increasingly wide range of sectors. Businesses must invest in robust DDoS detection, mitigation, and protection to prevent the financial and reputational impact of an attack.”The geographical distribution of DDoS attacksWith a presence that spans six continents, Gcore can accurately track the geographical sources of DDoS attacks. Gcore derives these insights from the attackers’ IP addresses and the geographic locations of the data centers where malicious traffic is targeted.Gcore’s findings have highlighted the Netherlands as a key source of attacks; leading application-layer attacks with 21% and ranking second for network-layer attacks at 18%. The U.S. ranked highly across both layers, reflecting its vast internet infrastructure for hackers to exploit.Brazil featured prominently in network-layer attacks at 14%. Brazil’s growing digital economy and connectivity make it an emerging source of attacks. China and Indonesia also featured prominently, with Indonesia showing a growth in application-layer attacks at 8%, which reflects a broader trend of increased attack activity in Southeast Asia.Short but potent attacks continue to take holdDDoS attacks are becoming shorter in duration, but no less disruptive. The longest DDoS attack duration during Q3-Q4 2024 was five hours, which is a significant decrease from 16 hours in the first half of the year. This is reflective of an increasing trend towards shorter but more intense attacks. These ‘burst attacks’ can be more difficult to detect as they may blend in with normal traffic spikes. The delay in detection gives attackers a window of opportunity to disrupt services before cyber defenses can kick in.The trend of shorter DDoS attack durations can in part be attributed to improvements in cybersecurity. As security tightens, attackers have learned to adapt with short burst attacks designed to bypass defenses. A short DDoS attack can also double as a smokescreen to conceal a secondary attack, such as ransomware deployment.To access the full report, please visit https://gcore.com/resources/reports/gcore-radar-ddos-attack-trends-q1-q2-2024.About GcoreGcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps.Learn more at gcore.com and follow them on LinkedIn, Twitte, and Facebook.Gcore press contactpr@gcore.comPR agency contactgcore@aspectusgroup.com
Gcore enhances Everywhere Inference with flexible deployment options, including cloud, on-premise, and hybrid
Luxembourg, January 16, 2025—Gcore, the global edge AI, cloud, network, and security solutions provider, today announced a major update to Everywhere Inference, formerly known as Inference at the Edge. This update offers greater flexibility in AI inference deployments, delivering ultra-low latency experiences for AI applications. Everywhere Inference now supports multiple deployment options including on-premise, Gcore’s cloud, public clouds, or a hybrid mix of these environments.Gcore developed this update to its inference solution to address changing customer needs. With AI inference workloads growing rapidly, Gcore aims to empower businesses with flexible deployment options tailored to their individual requirements. Everywhere Inference leverages Gcore’s extensive global network of over 180 points of presence, enabling real-time processing, instant deployment, and seamless performance across the globe. Businesses can now deploy AI inference workloads across diverse environments while ensuring ultra-low latency by processing workloads closer to end users. It also enhances cost management and simplifies regulatory compliance across regions, offering a comprehensive and adaptable approach to modern AI challenges.Seva Vayner, Product Director of Edge Cloud and Edge AI at Gcore, commented: “The update to Everywhere Inference marks a significant milestone in our commitment to enhancing the AI inference experience and addressing evolving customer needs. The flexibility and scalability of Everywhere Inference make it an ideal solution for businesses of all sizes, from startups to large enterprises.”The new update enhances deployment flexibility by introducing smart routing, which automatically directs workloads to the nearest available compute resource. Additionally, Everywhere Inference now offers multi-tenancy for AI workloads, leveraging Gcore’s unique multi-tenancy capabilities to run multiple inference tasks simultaneously on existing infrastructure. This approach optimizes resource utilization for greater efficiency.These new features address common challenges faced by businesses deploying AI inference. Balancing multiple cloud providers and on-premises systems for operations and compliance can be complex. The introduction of smart routing enables users to direct workloads to their preferred region, helping them stay compliant with local data regulations and industry standards. Data security is another key concern and with Gcore’s new flexible deployment options, businesses can securely isolate sensitive information on-premise, enhancing data protection.Learn more at https://gcore.com/everywhere-inference.About GcoreGcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps. Learn more at gcore.com and follow them on LinkedIn, Twitter, and Facebook.Gcore press contactpr@gcore.comPR agency contactgcore@aspectusgroup.com
Gcore and Qareeb Data Centres Forge Strategic Partnership to Elevate GCC AI and Cloud Infrastructure
Luxembourg, November 27, 2024―Gcore, the global edge AI, cloud, network, and security solutions provider, and Qareeb Data Centres, the Middle East’s first edge data centre provider, signed a Memorandum of Understanding (MoU) at the Touchdown Middle East 2024 conference in Bahrain. This strategic partnership is set to boost digital infrastructure in the Gulf Cooperation Council (GCC) and support the region’s journey to becoming a hub of innovation, with a special focus on delivering cutting-edge AI and cloud computing services.Qareeb will leverage its edge data centre infrastructure to deliver Gcore solutions to customers across the GCC market, fostering local digitalisation and supporting Gcore’s expansion in the region. By integrating Gcore’s advanced AI, cloud, and edge solutions with Qareeb’s data centre capabilities, this collaboration aims to enable innovation and scalability as well as provide reliable and secure cloud solutions to address the growing demand from businesses and public sector organisations throughout the GCC.“We are thrilled to partner with Qareeb Data Centres to deliver cutting-edge AI and cloud services to the GCC,” said Fabrice Moizan, Chief Revenue Officer at Gcore. “Together, we will empower businesses with robust infrastructure solutions, driving innovation, economic growth, and technological advancement across the region.”“Partnering with Gcore aligns with our vision to drive digital innovation across the GCC region,” said Annemarie Van Zadelhoff, Chief Strategy Officer at Qareeb Data Centres. “With the data centre market experiencing rapid growth, particularly in the demand for local edge colocation facilities, this partnership provides a strong foundation for our ambitious expansion across the Middle East while delivering advanced AI and cloud computing solutions to meet the shifting needs of organisations today and into the future.”About GcoreGcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps.About Qareeb Data CentresQareeb Data Centres is on a mission to deliver world-class Edge Data Centre solutions in the Middle East, enabling businesses in their digital transformation through delivering best in class infrastructure tailored for cloud and AI-driven growth, with transparency and a customer-first approach at the core. Headquartered in Bahrain, Qareeb fuses international and local expertise to ensure a consistent exceptional customer experience tailored to regional needs.To find out more, visit www.qareebdc.com.Gcore Press Contactpr@gcore.com
Gcore and Ezditek Launch Joint Venture to Accelerate Building, Training, and Deploying AI Solutions in the Kingdom of Saudi Arabia
Riyadh, Saudi Arabia, November 19, 2024—Gcore, the global edge AI, cloud, network, and security solutions provider, and Ezditek, an innovator in data center and digital infrastructure services in the Kingdom of Saudi Arabia (KSA), have launched a joint venture focused on providing high-performance AI infrastructure in the KSA. The joint venture will develop an ‘AI factory’, which can be used for building, training, and deploying generative AI solutions locally and across the globe.The joint venture brings together Gcore’s expertise in cloud-based AI infrastructure and Ezditek’s innovative approach to sustainable and AI-centric data center design and build. The joint venture is the result of an agreement signed by Gcore and Ezditek in May 2024 and will support the KSA’s position as a leading global AI hub. The incorporation process of the joint venture is currently underway and is subject to regulatory approvals, including from the General Authority for Competition in the KSA.“We are excited to join forces with Ezditek in building this groundbreaking AI factory. By combining our cloud services and AI infrastructure capabilities with Ezditek’s expertise in data center development, we are setting a new standard for AI infrastructure in the region,” said Andre Reitenbach, CEO at Gcore.The AI factory will be deployed in an Ezditek data center and be home to tens of thousands of GPUs that will empower organizations to train and deploy sophisticated generative AI models. This will enable the rapid training and development of predictive analytics models, deep data analysis, and process optimization, as well as a growing number of AI use cases.“Over the last six months, we have worked in collaboration with Gcore to identify areas where we can deliver the most value for customers, and support the KSA’s vision for AI leadership. Together, we are developing an AI factory purpose-built for enabling and accelerating AI innovation and adoption,” said Ibrahim Almulhim, CEO at Ezditek. “We’re extremely proud to be working with a global leader in AI enablement and bringing a visionary approach to AI innovation to market in the KSA.”“This partnership will accelerate the adoption of AI and cloud computing solutions, benefiting businesses and citizens alike,” said Eng. Bassam Al-Bassam, Deputy Minister of Telecommunications and Digital Infrastructure at MCIT. Al-Bassam also pointed out that this partnership will boost digital investment and national digital capacity in Saudi Arabia, underpinned by its digital capabilities and reliable infrastructure.About GcoreGcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps.Learn more at gcore.com and follow them on LinkedIn, Twitter, and Facebook.About EzditekEzditek is a leading Saudi Arabian company specializing in the development and operation of state-of-the-art data centers. With a proven track record in delivering scalable and energy-efficient data center solutions, Ezditek plays a key role in supporting the Kingdom’s growing digital economy. Learn more at Ezditek.com.Gcore Press Contactpr@gcore.com
Gcore Named as a Major Player in IDC MarketScape Report for European Public Cloud Infrastructure (IaaS) 2024
Luxembourg, October 10, 2024—Gcore, the global edge AI, cloud, network, and security solutions provider, today announced that it has been positioned as a Major Player by industry research firm IDC, in its recent “IDC MarketScape: European Public Cloud Infrastructure (IaaS) 2024” (document number: #EUR151035423, August 2024) report.The report evaluates public cloud infrastructure-as-a-service (IaaS) providers in Europe and covers qualifying global and regional cloud providers that offer IaaS across Europe (including CEE as well as Western Europe).“We believe being recognised by the IDC MarketScape as a Major Player is a testament to our commitment to delivering high-quality edge cloud computing services that empower our customers to securely build and scale their applications,” commented Andre Reitenbach, CEO at Gcore. “Our services prioritize performance, security, and scalability, enabling businesses to grow without the complexities of infrastructure management, so they can focus on innovation and business outcomes.”Gcore operates a global network with 180+ points of presence and 50+ strategically placed cloud locations, offering low-latency access to key markets. The platform supports a variety of workloads, providing solutions from virtual machines to bare metal servers, delivering flexible compute capacity for both standard and high-performance applications.About IDC MarketScapeIDC MarketScape vendor assessment model is designed to provide an overview of the competitive fitness of technology and service suppliers in a given market. The research methodology utilizes a rigorous scoring methodology based on both qualitative and quantitative criteria that results in a single graphical illustration of each vendor’s position within a given market. IDC MarketScape provides a clear framework in which the product and service offerings, capabilities and strategies, and current and future market success factors of IT and telecommunications vendors can be meaningfully compared. The framework also provides technology buyers with a 360-degree assessment of the strengths and weaknesses of current and prospective vendors.About GcoreGcore is a global edge AI, cloud, network, and security solutions provider. Headquartered in Luxembourg, with a team of 600 operating from ten offices worldwide, Gcore provides solutions to global leaders in numerous industries. Gcore manages its global IT infrastructure across six continents, with one of the best network performances in Europe, Africa, and LATAM due to the average response time of 30 ms worldwide. Gcore’s network consists of 180 points of presence worldwide in reliable Tier IV and Tier III data centers, with a total network capacity exceeding 200 Tbps.
Subscribe
to our newsletter
Get the latest industry trends, exclusive insights, and Gcore updates delivered straight to your inbox.