Skip to content

vinay-lgtm-code/world-model-apps-omnisight

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Mock-Operation-Neptune-Spear (A world model reconstruction of the site of a US Special Forces operation in Abbottabad, Pakistan on May 2, 2011)

Reconstructing history in navigable 3D using World Labs' generative AI

World Labs API License: MIT Browser

MOCK-SPEAR demonstrates the power of World Labs' World API to reconstruct historical locations from publicly available imagery—transforming 2D reference materials into fully navigable 3D environments accessible from any browser.

The Demo: Abbottabad Compound (2011)

This project recreates the Abbottabad compound (Waziristan Haveli)—site of Operation Neptune Spear on May 2, 2011. The compound was demolished in February 2012, but extensive documentation exists through:

  • CIA-released diagrams (public domain)
  • Historical satellite imagery (Google Earth archives)
  • News footage (BBC, Al Jazeera coverage)
  • Journalistic floor plans (The Independent, GlobalSecurity.org)

We combine these sources with World Labs' multimodal generation to produce a spatially-accurate, explorable 3D reconstruction—entirely from free, open-source materials.

CIA Compound Layout
CIA-released compound diagram (public domain)

Why This Matters

Challenge Solution
Historical sites demolished Generative 3D preserves spatial understanding
2D references insufficient World API creates navigable environments
VR headsets limit access Browser-first ensures universal accessibility
Licensed imagery costs prohibitive Built entirely from free/open sources

Quick Start

# Clone the repository
git clone https://github.com/YOUR_USERNAME/mock-spear.git
cd mock-spear

# Set your World Labs API key
export WORLD_API_KEY="your_key_here"

# Serve locally
cd src && python -m http.server 8080
# Open http://localhost:8080

Architecture

mock-spear/
├── assets/
│   ├── imagery/       # Satellite screenshots, aerial views
│   ├── diagrams/      # Floor plans, CIA diagrams
│   └── reference/     # Ground-level photos, news stills
├── prompts/
│   ├── compound_exterior.md    # Exterior generation prompt
│   ├── floor_1.md              # Ground floor interior
│   ├── floor_2.md              # Second floor interior
│   └── floor_3.md              # Third floor
├── src/
│   ├── index.html     # Main interface
│   ├── viewer.js      # Three.js navigation
│   └── annotations.js # Overlay system
└── output/
    └── worlds/        # Generated .glb outputs

Generation Pipeline

graph LR
    A[Reference Images] --> B[World API]
    C[Text Prompts] --> B
    B --> D[glTF/GLB Output]
    D --> E[Three.js Viewer]
    E --> F[Browser Experience]
Loading

Phase 1: Collect Reference Materials

Source Type Location
Google Earth Pro Historical satellite (2005-2011) assets/imagery/
CIA Museum Compound layout diagram assets/diagrams/
Wikimedia Commons Public domain photos assets/reference/
News archives Ground-level footage stills assets/reference/

Phase 2: Generate with World API

# Generate exterior compound
curl -X POST https://api.worldlabs.ai/v1/generate \
  -H "Authorization: Bearer $WORLD_API_KEY" \
  -H "Content-Type: multipart/form-data" \
  -F "prompt=@prompts/compound_exterior.md" \
  -F "image=@assets/imagery/satellite_view.png" \
  -o output/worlds/exterior.glb

# Generate each floor
for floor in 1 2 3; do
  curl -X POST https://api.worldlabs.ai/v1/generate \
    -H "Authorization: Bearer $WORLD_API_KEY" \
    -F "prompt=@prompts/floor_${floor}.md" \
    -o output/worlds/floor_${floor}.glb
done

Phase 3: Browser Viewer

  • Navigation: WASD + mouse (FPS-style)
  • Floor Selection: Toggle between exterior and F1/F2/F3
  • Annotations: Historical context overlays
  • Performance: Targets 60fps on standard hardware

Compound Specifications

Reconstructed dimensions based on public documentation:

Element Specification
Plot area 3,500 m² (38,000 sq ft)
Perimeter walls 3.7–5.5m height
Main building 3 stories
Guesthouse 1 story
Third-floor privacy wall 2.1m

Building Layout

Ground Floor (F1)

  • 4 bedrooms, 3 bathrooms, kitchen
  • Internal staircase access

Second Floor (F2)

  • 4 bedrooms, 4 bathrooms

Third Floor (F3)

  • Bedroom, study, small bathroom/kitchen
  • Balcony with 7-foot privacy wall

Tech Stack

Component Technology
3D Generation World Labs API
Rendering Three.js
Format glTF/GLB
Interface Vanilla JS (zero dependencies)
Serving Any static host

Roadmap

  • Project structure and documentation
  • Collect all free reference imagery
  • Write optimized World API prompts
  • Generate exterior compound
  • Generate floor interiors
  • Build Three.js viewer
  • Add annotation system
  • Performance optimization
  • Demo video walkthrough

Contributing

  1. Fork the repository
  2. Collect additional public reference materials
  3. Improve World API prompts for accuracy
  4. Submit PRs for viewer enhancements

Legal

  • All reference materials are from public/open sources
  • CIA diagrams are public domain (U.S. government works)
  • News footage used under fair use for research/education
  • No classified or restricted materials used
  • The physical compound was demolished February 26, 2012

License

MIT License - see LICENSE for details.


Built with World Labs
Demonstrating generative AI for historical preservation and spatial understanding

About

world model experiments

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors