Skip to content

Feature/multimodal neat detection - #907

Open
BhakktiGautam wants to merge 3 commits into
Userunknown84:mainfrom
BhakktiGautam:feature/multimodal-neat-detection
Open

BhakktiGautam wants to merge 3 commits into
Userunknown84:mainfrom
BhakktiGautam:feature/multimodal-neat-detection

Conversation

@BhakktiGautam

Copy link
Copy Markdown
Contributor

🎯 Multimodal Spam Detection using NEAT

📝 Description

This PR implements a multimodal spam detection system using NEAT (NeuroEvolution of Augmenting Topologies) that detects spam across text, images, and voice modalities. Attackers now hide malicious content in images and audio to evade text-based filters - this solution provides comprehensive multi-modal protection.

🚀 Core Components

1. Text Modality Detector

Detects spam in SMS, emails, and text messages:

Feature Description
Text Length Length-based analysis
Word Count Message complexity
Uppercase Ratio ALL CAPS detection
Punctuation Ratio Excessive punctuation
Special Characters Obfuscation detection
Spam Keywords free, win, prize, claim

2. Image Modality Detector

Detects spam in screenshots and embedded images:

Feature Description
Color Histogram Visual pattern analysis
Image Entropy Randomness detection
Size Analysis Image dimensions
Statistical Features Mean, std deviation
Obfuscation Detection Noise, fragmentation

3. Voice Modality Detector

Detects spam in voice messages and robocalls:

Feature Description
Audio Length Duration analysis
Frequency Analysis Speech pattern detection
Compression Ratio Audio quality analysis

4. NEAT Dynamic Weighting

NeuroEvolution for optimal modality weighting:

Feature Description
Dynamic Weights Adapts to modality performance
Generation Tracking Evolution monitoring
Performance History Accuracy tracking
Self-Optimization Continuous improvement

5. Ensemble Detection

Combines all modalities for final prediction:

  • ✅ Weighted voting based on NEAT optimization
  • ✅ Multi-modal confidence scoring
  • ✅ Modality-specific results
  • ✅ Comprehensive detection history

#Closes #900

…unknown84#900)

### Description
Implements multimodal spam detection using NEAT (NeuroEvolution of Augmenting Topologies) for text, image, and voice modalities.

### Features
- ✅ Text Modality Detection
- ✅ Image Modality Detection
- ✅ Voice Modality Detection
- ✅ NEAT-based Dynamic Weighting
- ✅ Ensemble Detection
- ✅ Weight Optimization

### Modalities Covered
- Text: SMS, email spam
- Image: Screenshots, embedded images
- Voice: Robocalls, vishing

### Security Benefits
- Multi-modal detection
- Dynamic weight optimization
- Adaptive ensemble

Closes Userunknown84#900
@vercel

vercel Bot commented Jul 16, 2026

Copy link
Copy Markdown

@BhakktiGautam is attempting to deploy a commit to the Aditya Sharma's projects Team on Vercel.

A member of the Team first needs to authorize it.

@Userunknown84 Userunknown84 left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

<<<<<<< Updated upstream

Stashed changes

===== these show removed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Implement Multimodal Spam Detection Using NeuroEvolution of Augmenting Topologies (NEAT)

2 participants