Skip to content

feat(extract): Add observable extraction module#44

Merged
PakitoSec merged 2 commits into
mainfrom
extract
Feb 3, 2026
Merged

feat(extract): Add observable extraction module#44
PakitoSec merged 2 commits into
mainfrom
extract

Conversation

@PakitoSec
Copy link
Copy Markdown
Owner

  • Implement tests for refang and defang functions to ensure proper handling of defanged URLs and email addresses.
  • Create tests for URL extraction covering various protocols, defanged URLs, and encoded formats.
  • Add tests for IP address extraction, including IPv4 and IPv6, with defanged variations.
  • Implement email extraction tests to validate standard and defanged formats.
  • Add hash extraction tests for MD5, SHA1, SHA256, and SHA512, including case insensitivity and deduplication.
  • Create domain extraction tests to validate standard domains and defanged formats.
  • Implement combined extraction tests to ensure all observable types are extracted correctly.
  • Add tests for extracting observables from URLs and CLI commands.
  • Include edge case tests for empty input, whitespace, and mixed content formats.

- Implement tests for refang and defang functions to ensure proper handling of defanged URLs and email addresses.
- Create tests for URL extraction covering various protocols, defanged URLs, and encoded formats.
- Add tests for IP address extraction, including IPv4 and IPv6, with defanged variations.
- Implement email extraction tests to validate standard and defanged formats.
- Add hash extraction tests for MD5, SHA1, SHA256, and SHA512, including case insensitivity and deduplication.
- Create domain extraction tests to validate standard domains and defanged formats.
- Implement combined extraction tests to ensure all observable types are extracted correctly.
- Add tests for extracting observables from URLs and CLI commands.
- Include edge case tests for empty input, whitespace, and mixed content formats.
@PakitoSec PakitoSec self-assigned this Feb 3, 2026
…occurrence counting

- Added support for markdown output formats (`markdown` and `markdown-table`) in the `cyvest.extract` module.
- Implemented occurrence counting for extracted observables, allowing tracking of duplicates.
- Updated CLI to include new options for markdown output, including title, grouping by type, and original text inclusion.
- Enhanced `ExtractedObservable` class to include a count attribute and methods for markdown serialization.
- Added tests for new markdown output features and occurrence counting functionality.
@PakitoSec PakitoSec merged commit dca88ee into main Feb 3, 2026
10 checks passed
@PakitoSec PakitoSec deleted the extract branch February 3, 2026 18:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant