Skip to content

[FEATURE] AI Auto Reframe with Smart Subject Tracking #1186

@shivv2430

Description

@shivv2430

Feature description

Add an AI-powered auto reframe feature that automatically keeps the main subject centered while resizing videos into different aspect ratios like 9:16, 1:1, and 16:9.

Problem this solves

Currently, users need to manually adjust crop positions while converting videos for social media formats. This becomes difficult for moving subjects and longer clips.

Proposed solution

Implement smart reframing using:

  • Face detection
  • Subject tracking
  • Auto center crop
  • Dynamic crop adjustment based on movement

The feature should:

  1. Detect the main subject in the video
  2. Track movement across frames
  3. Automatically reposition the crop area
  4. Export properly framed videos for selected aspect ratios

Possible implementation

  • MediaPipe face detection
  • OpenCV tracking
  • FFmpeg crop pipeline integration

Inspired by

  • AutoCrop Vertical
  • ClipsAI smart reframing

Alternatives considered

Basic static center crop, but it does not work well for moving subjects.

Additional context

This feature would greatly improve short-form content generation and reduce manual editing effort for creators.

cc: @magic-peach assign this issue to me.

Metadata

Metadata

Labels

enhancementImprovement to existing functionalityfeatureNew feature requesttype:featureNew feature

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions