๐Ÿš€ Next-Gen Causal World Simulator

LingBot-World 2.0 (Infinity)

2D ์ด๋ฏธ์ง€ 1์žฅ์œผ๋กœ ๋ฌดํ•œํ•œ 3D ๊ฐ€์ƒ ์„ธ๊ณ„๋ฅผ ์ฐฝ์กฐํ•˜๊ณ , ํ‚ค๋ณด๋“œ WASD ๋ฐฉํ–ฅํ‚ค๋กœ ๊ฒŒ์ž„์ฒ˜๋Ÿผ ์‹ค์‹œ๊ฐ„ ํƒํ—˜ํ•˜๋Š” ์ธ๊ณต์ง€๋Šฅ ์›”๋“œ ๋ชจ๋ธ

3D Interactive World Viewport Simulation
โ— Online / In-Memory GPU
World Viewport
๐ŸŽฎ 3D ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ ์ค€๋น„ ์™„๋ฃŒ | WASD ํ‚ค๋ณด๋“œ๋กœ ์กฐ์ž‘ํ•˜์„ธ์š”!

๐Ÿ•น๏ธ ์‹ค์‹œ๊ฐ„ WASD ์กฐ์ž‘ ํŒจ๋“œ

์•„๋ž˜ ๋ฒ„ํŠผ์„ ํด๋ฆญํ•˜๊ฑฐ๋‚˜ ํ‚ค๋ณด๋“œ์˜ [W, A, S, D, Q, E] ํ‚ค๋ฅผ ์ง์ ‘ ๋ˆŒ๋Ÿฌ๋ณด์„ธ์š”.

Q
์ขŒํšŒ์ „
W
์ „์ง„
E
์šฐํšŒ์ „
A
์ขŒ์ด๋™
X
์ •์ง€
D
์šฐ์ด๋™
Space
์ƒ์Šน
S
ํ›„์ง„
C
ํ•˜๊ฐ•
๐Ÿ’ก GPU ์‹ค์‹œ๊ฐ„ ์ถ”๋ก  ํ™œ์„ฑํ™”: Cloudflare Edge GPU ํ„ฐ๋„์ด ์ƒ์‹œ ์—ฐ๊ฒฐ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. ์•„๋ž˜ ๋ฒ„ํŠผ์„ ๋ˆ„๋ฅด๋ฉด ๋ˆ„๊ตฌ๋‚˜ ์ฆ‰์‹œ NVIDIA RTX 6000 Ada GPU์—์„œ ์‹ค์‹œ๊ฐ„ 3D ์›”๋“œ๋ฅผ ์ƒ์„ฑํ•˜๊ณ  WASD๋กœ ์ž์œ ๋กญ๊ฒŒ ํƒํ—˜ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿš€ ์‹ค์‹œ๊ฐ„ Web UI ์—ด๊ธฐ (GPU ์ถ”๋ก )
โšก LingBot-World 2.0 ์‹ค์‹œ๊ฐ„ GPU ์ถ”๋ก  ์—”์ง„ (Live Web UI) NVIDIA RTX 6000 Ada (48GB VRAM) ์—ฐ๊ฒฐ๋จ
์ „์ฒดํ™”๋ฉด ์ƒˆ ์ฐฝ ์—ด๊ธฐ โ†—

๐ŸŒŸ LingBot-World 2.0 ํ•ต์‹ฌ ๊ธฐ์ˆ  ์•„ํ‚คํ…์ฒ˜

โ™พ๏ธ

๋ฌดํ•œ ์ƒํ˜ธ์ž‘์šฉ (Unbounded Horizon)

์ธ๊ณผ์ (Causal) ์‚ฌ์ „ํ•™์Šต ํŒจ๋Ÿฌ๋‹ค์ž„๊ณผ ๋™์  KV ์บ์‹œ ์Šค์ผ€์ค„๋ง์„ ํ†ตํ•ด ๋ฉ”๋ชจ๋ฆฌ ํญ๋ฐœ์ด๋‚˜ ๋“œ๋ฆฌํ”„ํŠธ ์™œ๊ณก ์—†์ด ๋์—†๋Š” ์„ธ๊ณ„๋ฅผ ํƒํ—˜ํ•ฉ๋‹ˆ๋‹ค.

โšก

์ดˆ๊ณ ์† ์‘๋‹ต (Real-Time Distillation)

13์–ต ํŒŒ๋ผ๋ฏธํ„ฐ(1.3B)์™€ 14B Causal-Fast ์ฆ๋ฅ˜ ๋ชจ๋ธ๋กœ, ๋‹จ์ผ GPU(RTX 6000 Ada)์—์„œ 1์Šคํ…๋‹น 1.6์ดˆ ๋””๋…ธ์ด์ง•์„ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค.

๐ŸŽฌ

๋””๋ ‰ํ„ฐ-ํŒŒ์ผ๋Ÿฟ ์—์ด์ „ํŠธ ํ•˜๋„ค์Šค

VLM(๋น„์ „-์–ธ์–ด ๋ชจ๋ธ)์ด '๊ฐ๋…(Director)'์ด ๋˜์–ด ๊ฑฐ์‹œ์  ์‚ฌ๊ฑด์„ ๊ณ„ํšํ•˜๊ณ , Causal DiT๊ฐ€ '์กฐ์ข…์‚ฌ(Pilot)'๊ฐ€ ๋˜์–ด ๋ฌผ๋ฆฌ์  ๋น„๋””์˜ค๋ฅผ ์‹ค์‹œ๊ฐ„ ๋ Œ๋”๋งํ•ฉ๋‹ˆ๋‹ค.

๐ŸŽฎ

Plรผcker ์นด๋ฉ”๋ผ ๊ด‘์„  ์ฃผ์ž…

OpenCV 3D ์ขŒํ‘œ๊ณ„ ๊ธฐ์ค€์˜ ์นด๋ฉ”๋ผ ํšŒ์ „ ๋ฐ ์ด๋™ ๋ฒกํ„ฐ๋ฅผ Plรผcker ๊ด‘์„  ์ž„๋ฒ ๋”ฉ์œผ๋กœ ์ธ๊ณผ์  ํŠธ๋žœ์Šคํฌ๋จธ์— ์ฃผ์ž…ํ•˜์—ฌ ์™„๋ฒฝํ•œ ์‹œ์  ์ œ์–ด๋ฅผ ๋ณด์žฅํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ’ป ๋กœ์ปฌ ์‹คํ–‰ ๊ฐ€์ด๋“œ (Quick Start)

์ €์žฅ์†Œ๋ฅผ ํด๋ก ํ•˜๊ณ  ์•„๋ž˜ ๋ช…๋ น์–ด๋ฅผ ์‹คํ–‰ํ•˜๋ฉด, ๋ธŒ๋ผ์šฐ์ €์—์„œ ์ฆ‰์‹œ ์‹ค์‹œ๊ฐ„ ํƒํ—˜์„ ์ฆ๊ธธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค:

# 1. ์ €์žฅ์†Œ ์ด๋™ ๋ฐ ๊ฐ€์ƒํ™˜๊ฒฝ ํ™œ์„ฑํ™” cd lingbot-world-v2 # 2. ์‹ค์‹œ๊ฐ„ ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ Web UI ์‹คํ–‰ python app.py --host 0.0.0.0 --port 7860 # 3. ๋ธŒ๋ผ์šฐ์ €์—์„œ ์ ‘์†: http://localhost:7860