Luma AI Launches Discord Bot Genie for Text-to-3D Model Generation
-
November 3 News: Silicon Valley startup Luma AI specializes in combining AI technology with 3D content, such as generating NeRF or other 3D formats from smartphone videos. Now, the company has released a Discord bot called Genie for text-to-3D generation.
It can generate 3D content from text prompts and provide four simple 3D models in about 20 seconds. This innovation brings significant changes to game development, virtual production, and artistic creation.
Genie operates very simply: users just need to input text instructions, and after about 20 seconds, they receive four preliminary 3D models, each with an interactive link for viewing or downloading as a 3D object in glb format. Additionally, users can choose to further refine the models for higher resolution and more accurate results, although this process currently takes about 20 minutes. This provides creators with a powerful tool.
The long-term applications of Genie are exciting, especially in game development and virtual production. Traditionally, creating complex game worlds and 3D assets was a time-consuming task requiring extensive expertise and often a team of professionals. With Genie, game developers can easily translate their ideas into text, allowing artists to focus more on refining existing assets rather than creating them from scratch.
Beyond game development, Luma AI sees great potential for Genie in virtual production studios. Currently, Genie is available for free as a "research preview," with plans to launch it as a paid service in the future while continuously improving its underlying model.
Generative AI for text and images has already transformed many industries and job fields. Now, generative models for 3D and video are seen as the next frontier for research labs and companies to overcome.
Particularly, text-to-3D models, much like previous 2D image models such as Stable Diffusion, Midjourney, or DALL-E3, primarily affect artists. Since at least 2021, the development of such models has been steadily progressing, with examples including Google's Dream Fields and Dreamfusion, CLIP-Mesh, OpenAI's Point-E and Shap-E, Nvidia's Magic3D, Tencent's Dream3D, or the recent 3D Gaussian Splatting.
Luma AI's Genie is available through Discord. The link can be found on Luma AI's website.
Project URL: https://lumalabs.ai/genie