stiff owl
Transform Wikipedia articles into high-quality AI training datasets with automatic subtitle detection, bulk processing, and dual format support.
WikiAI Converter is a powerful, free, and open-source tool that converts Wikipedia articles into structured JSONL (JSON Lines) format for AI model training. Perfect for creating instruction-following datasets, chat training data, and fine-tuning language models.
✨ Features
🔧 Core Functionality
🎯 Multiple Input Methods: Single URL, bulk URL processing, or HTML file upload
📊 Dual Format Support: Instruction format (Alpaca/Vicuna) and Chat format (ChatGPT/Claude)
🏷️ Automatic Subtitle Detection: Intelligently combines main title with subsections
🧹 Smart Text Cleaning: Removes citations, edit links, and normalizes whitespace
📦 Bulk Processing: Process multiple Wikipedia URLs simultaneously
🗜️ ZIP Archive Support: Download multiple files in a convenient ZIP package
🌟 Advanced Features
🔍 Metadata Enrichment:
Source URL tracking
Language detection
Category extraction
Publication dates
Author information
Page type classification
Extraction timestamps
⚙️ Configurable Processing:
Include/exclude list items
Citation removal options
Edit link filtering
Custom title override
🌙 Modern UI: Dark/light theme with responsive design
👀 Live Preview: See converted content before processing
🔄 Version History
v3.0 (Current)
✨ Multi-URL bulk processing
🔍 Metadata enrichment options
🌙 Dark/light theme support
📦 ZIP archive downloads
🎨 Modern responsive UI
v2.0
🎯 Dual format support (Instruction/Chat)
🧹 Enhanced text cleaning
👀 Live preview functionality
v1.0
🚀 Initial release
📄 Basic Wikipedia to JSONL conversion
🔧 File upload support
restive yew