|
--- |
|
title: Medical Analysis System |
|
emoji: 🤖 |
|
colorFrom: blue |
|
colorTo: purple |
|
sdk: gradio |
|
sdk_version: 5.20.1 |
|
app_file: run.py |
|
pinned: false |
|
--- |
|
|
|
# MediSync: Multi-Modal Medical Analysis System |
|
|
|
MediSync is an AI-powered healthcare solution that combines X-ray image analysis with patient report text processing to provide comprehensive medical insights. |
|
|
|
## Features |
|
|
|
- **X-ray Image Analysis**: Detects abnormalities in chest X-rays using pre-trained vision models from Hugging Face. |
|
- **Medical Report Processing**: Extracts key information from patient reports using NLP models. |
|
- **Multi-modal Integration**: Combines insights from both image and text data for more accurate diagnosis suggestions. |
|
- **User-friendly Interface**: Simple web interface for uploading images and reports. |
|
|
|
## Project Structure |
|
|
|
``` |
|
mediSync/ |
|
├── app.py # Main application with Gradio interface |
|
├── models/ |
|
│ ├── image_analyzer.py # X-ray image analysis module |
|
│ ├── text_analyzer.py # Medical report text analysis module |
|
│ └── multimodal_fusion.py # Fusion of image and text insights |
|
├── utils/ |
|
│ ├── preprocessing.py # Data preprocessing utilities |
|
│ └── visualization.py # Result visualization utilities |
|
├── data/ |
|
│ └── sample/ # Sample data for testing |
|
└── tests/ # Unit tests |
|
``` |
|
|
|
## Setup Instructions |
|
|
|
1. Clone this repository: |
|
```bash |
|
git clone [repository-url] |
|
cd MediSync |
|
``` |
|
|
|
2. Install dependencies: |
|
```bash |
|
pip install -r requirements.txt |
|
``` |
|
|
|
3. Run the application: |
|
```bash |
|
python app.py |
|
``` |
|
|
|
4. Access the web interface at `http://localhost:7860` |
|
|
|
## Models Used |
|
|
|
- **X-ray Analysis**: facebook/deit-base-patch16-224-medical-cxr |
|
- **Medical Text Analysis**: medicalai/ClinicalBERT |
|
- **Additional Support Models**: Medical question answering and entity recognition models |
|
|
|
## Use Cases |
|
|
|
- Preliminary screening of chest X-rays |
|
- Cross-validation of radiologist reports |
|
- Educational tool for medical students |
|
- Research tool for studying correlation between visual findings and written reports |
|
|
|
## Note |
|
|
|
This system is designed as a support tool and should not replace professional medical diagnosis. Always consult with healthcare professionals for medical decisions. |
