Real AI Launches Europe's First Open-Source Humanistic Large Language Model Project HOMINIS
-
At the Data Science Conference held in Belgrade on November 23, 2023, Real AI announced the successful bid for the ISCRA project. Real AI will build Europe's first humanistic large language model (LLM) based on the LEONARDO supercomputer.
The LEONARDO supercomputer, located at the CINECA data center in Bologna, is a high-performance computing behemoth. Built on the Atos BullSequana XH2000 computer system, it integrates nearly 14,000 Nvidia Ampere GPUs. As of its launch in November 2022, LEONARDO ranks fourth globally and second in Europe, serving as a critical asset for advancing AI applications across the continent.
Real AI CEO Tarry Singh stated: "Our goal is to provide Europe with a response to responsible AI development. By collaborating with UNINA and the AI supercomputer cluster LEONARDO, we can achieve this vision." Real AI will leverage the substantial computational power from LEONARDO to accelerate the development of LLMs from scratch. This ambitious project will position Real AI at the forefront of AI development, committed to environmental protection and technological innovation.
Project HOMINIS aims to revolutionize AI by developing ethical and unbiased systems through the use of open, inspectable datasets. The project proposes sustainable alternatives to foundational AI models to minimize environmental impact. Its four primary objectives include: 1) Compiling high-value, diverse datasets from various sources, including scientific papers and knowledge bases, while eliminating biased content; 2) Conducting extensive ablation studies on transformer models and exploring alternative architectures; 3) Optimizing foundational models using advanced techniques for an initial release to foster community collaboration; 4) Implementing guided tuning for ethical alignment, culminating in the release of responsibly trained AI models. Additionally, HOMINIS aims to reduce energy consumption through innovative methods such as Flash Attention and routing, enhancing data processing efficiency and improving model inference and knowledge integration.
Real AI has also partnered with the University of Naples Federico II (UNINA) and NVIDIA, the world's largest AI company. UNINA has a notable track record in key areas and recently co-founded Europe's first Humanistic AI Master's program with Real AI.
REAL AI B.V. is dedicated to developing innovative solutions and products across various sectors, including energy, environment, education, healthcare, banking, and services. The company simplifies AI, enabling clients to evaluate, transform, and grow their data assets. REAL AI incubates projects to revolutionize AI in industry verticals, participating in EU-funded initiatives in healthcare, ethics, and energy sectors.
Project website: https://hominis.io