NordLink
NordLink is a Northern Europe Federated Open Web Search Data Center. NordLink Project primary goal is to integrate the university’s storage and high-performance computing (HPC) resources with the Open-WebSearch (OWS) infrastructure, facilitating participation in web crawling and indexing activities. This integration aims to demonstrate the technical feasibility of local data centers contributing to the distributed OWS infrastructure. The project is funded by the European Union under the Horizon 2020 program.
About NordLink
The NordLink project, which is a third-party contribution to the Open-WebSearch (OWS) project—part of the Horizon 2020 initiative—aims to establish an independent and transparent internet search index, comparable to Google, for services such as LLM training in AI applications. This project involves European universities and computing centers, including LRZ and CERN, for web crawling.
The primary objective of the NordLink project is to integrate our storage and HPC resources with the OWS infrastructure and participate in web crawling and indexing activities.
The goal is to demonstrate that we are technically capable of participating in the crawling and further processing of index data as a local data center. The main challenge in this initial phase is not merely the provision of technical resources but rather the integration of storage and computing resources (HPC) with the distributed OWS infrastructure via specialized interfaces.