An intelligent interior design tool that leverages Google's Gemini 3 Pro model to identify, count, and localize Furniture, Fixtures, and Equipment (FF&E) in uploaded photos.
Example analysis showing detected FF&E items in an interior scene, with bounding boxes highlighting furniture, artwork, and decor elements.
Photo by Thai Nguyen Anh on Unsplash
- AI Object Detection: Automatically identifies furniture, lighting, and decor items in interior images.
- Visual Localization: Draws precise bounding boxes around detected items to visualize placement.
- Detailed Analysis: Provides a specific label and visual description (material, color, style) for each item.
- Design Summary: Generates a brief overview of the room's style and collection.
- Export to Excel: Download the analyzed inventory list as a CSV file for reporting.
- Frontend: React 19, TypeScript
- Styling: Tailwind CSS
- AI Model: Google Gemini 3 Pro (via
@google/genaiSDK)
- Node.js: v18 or higher
- Google Gemini API Key: Obtain one from Google AI Studio
-
Clone the repository
git clone https://github.com/EyalIv/ffe-analyzer-ai.git cd ffe-analyzer-ai -
Install dependencies
npm install
-
Set up your API key
Create a
.envfile in the root directory:GEMINI_API_KEY=your_api_key_here
-
Run the development server
npm run dev
-
Open your browser and navigate to
http://localhost:5173
- Image Upload: The user provides an image of a room or specific furniture piece.
- Gemini Analysis: The image is sent to the Gemini 3 Pro model with a specialized system instruction to act as an FF&E expert.
- Data Extraction: The model returns a structured JSON response containing:
- A list of items with labels and descriptions.
- 2D bounding box coordinates for each item.
- A summary of the design.
- Visualization: The app renders the bounding boxes over the original image and populates a data table.
- Export: Data is formatted into a CSV structure for easy export to Excel.
- Upload: Drag and drop or select an interior design photo.
- Analyze: Wait for the AI to process the image and identify objects.
- Review: Hover over the bounding boxes to see labels, or check the table for full descriptions.
- Export: Click "Download Excel Report" to save the data.
This project is open source and available under the MIT License.
