Skip to content

cctv2206/mimir-opensource

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

1 Commit
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿง  Mimir

Named after the wise head from Norse mythology, Mimir is an AI-powered intelligence system that aggregates, processes, and distributes critical information across industries.

Python License: MIT

๐ŸŒŸ Overview

Mimir is an intelligent information aggregation and distribution system that harnesses the power of AI to identify, process, and deliver the most important and urgent information from across various sources. Just as the mythological Mimir possessed infinite wisdom, this system serves as your all-knowing intelligence hub.

๐ŸŽฏ Core Concept

Collect โ†’ Process โ†’ Distribute

Mimir operates on three fundamental pillars:

  • ๐Ÿ“ก Information Collection: Aggregate data from multiple sources
  • ๐Ÿค– AI Processing: Identify critical and time-sensitive information
  • ๐Ÿ“ค Smart Distribution: Deliver insights to the right channels

๐Ÿ—๏ธ Architecture

๐Ÿ“ก Information Collection

  • ๐Ÿฆ Twitter Monitoring: Real-time tweet collection and analysis
  • ๐Ÿ“ฐ RSS Feed Integration: Automated monitoring of news websites
  • ๐Ÿ’น Market Data: Historical and real-time price data from crypto exchanges
  • ๐ŸŒ Web Scraping: Content extraction from various web sources

๐Ÿค– AI Processing Engine

  • โšก Hourly Flash News: Real-time event processing and alerts
  • ๐Ÿ“Š Daily Digest: Comprehensive daily intelligence reports
  • ๐ŸŽฏ Smart Filtering: AI-powered relevance and urgency detection
  • ๐Ÿ“ˆ Trend Analysis: Pattern recognition and market insights

๐Ÿ“ค Distribution Channels

  • ๐Ÿ’ฌ Telegram Bot: Instant notifications and interactive queries
  • ๐Ÿ”” Feishu Bot: Enterprise-grade team collaboration integration
  • ๐Ÿ“ง Custom Webhooks: Flexible integration with your existing tools

๐Ÿš€ Quick Start

Prerequisites

  • Python 3.8+
  • Virtual environment (recommended)

Installation

  1. Clone the repository
git clone https://github.com/cctv2206/mimir-opensource.git
cd mimir
  1. Set up virtual environment
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate
  1. Install dependencies
pip install -r requirements.txt
  1. Configure environment variables
# Copy and edit the environment configuration
cp .env.example .env
# Edit .env with your API keys and configuration
  1. Initialize the database
python -m storage.initialize_supabase
  1. Start the server
python run_server.py

๐Ÿ“ Project Structure

mimir/
โ”œโ”€โ”€ ai/                     # AI processing and analysis
โ”‚   โ”œโ”€โ”€ daily_digest.py     # Daily intelligence reports
โ”‚   โ”œโ”€โ”€ hourly_digest.py    # Real-time flash news
โ”‚   โ””โ”€โ”€ openai_util.py      # AI utilities and prompts
โ”œโ”€โ”€ cex/                    # Crypto exchange integrations
โ”‚   โ”œโ”€โ”€ binance_connector.py
โ”‚   โ””โ”€โ”€ crypto_price_collector.py
โ”œโ”€โ”€ twitter/                # Twitter monitoring system
โ”‚   โ”œโ”€โ”€ twitter_monitor_with_supabase.py
โ”‚   โ””โ”€โ”€ twitter_service.py
โ”œโ”€โ”€ web/                    # Web scraping and monitoring
โ”‚   โ”œโ”€โ”€ cointelegraph_monitor.py
โ”‚   โ””โ”€โ”€ web_extract.py
โ”œโ”€โ”€ storage/                # Data storage and management
โ”‚   โ”œโ”€โ”€ supabase_storage.py
โ”‚   โ””โ”€โ”€ crypto_price_storage.py
โ”œโ”€โ”€ dispatcher/             # Message routing and distribution
โ”œโ”€โ”€ tg/                     # Telegram bot integration
โ”œโ”€โ”€ feishu/                 # Feishu bot integration
โ””โ”€โ”€ tests/                  # Test suites

๐Ÿ”ง Configuration

Environment Variables

Create a .env file with the following variables:

# AI Services
OPENAI_API_KEY=your_openai_api_key
DEEPSEEK_API_KEY=your_deepseek_api_key

# Social Media APIs
TWITTER_BEARER_TOKEN=your_twitter_bearer_token
TWITTER_API_KEY=your_twitter_api_key
TWITTER_API_SECRET=your_twitter_api_secret

# Crypto Exchanges
BINANCE_API_KEY=your_binance_api_key
BINANCE_SECRET_KEY=your_binance_secret_key

# Database
SUPABASE_URL=your_supabase_url
SUPABASE_KEY=your_supabase_key

# Bot Integrations
TELEGRAM_BOT_TOKEN=your_telegram_bot_token
FEISHU_APP_ID=your_feishu_app_id
FEISHU_APP_SECRET=your_feishu_app_secret

๐ŸŽฎ Usage Examples

Starting Information Collection

# Monitor Twitter for specific keywords
python -m twitter.twitter_monitor_with_supabase

# Collect crypto price data
python -m cex.crypto_price_collector

# Monitor web sources
python -m web.cointelegraph_monitor

AI Processing

# Generate hourly digest
python -m ai.run_hourly_digest

# Create daily report
python -m ai.daily_digest

Bot Operations

# Start Telegram bot
python -m tg.tg_bot

# Start Feishu bot
python -m feishu.feishu_bot

๐Ÿ› ๏ธ Development

Contributing

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Commit your changes (git commit -m 'Add amazing feature')
  4. Push to the branch (git push origin feature/amazing-feature)
  5. Open a Pull Request

๐Ÿ“Š Features

  • โœ… Real-time information aggregation
  • โœ… AI-powered content analysis
  • โœ… Multi-platform distribution
  • โœ… Crypto market integration
  • โœ… Social media monitoring
  • โœ… RSS feed processing
  • โœ… Telegram bot interface
  • โœ… Feishu enterprise integration
  • โœ… Configurable alert system
  • โœ… Historical data storage

๐Ÿ”ฎ Roadmap

  • Discord Bot Integration
  • Slack Workspace Support
  • Web Dashboard Interface
  • Mobile App Notifications
  • Advanced Analytics Dashboard
  • Multi-language Support
  • Custom Plugin System

๐Ÿ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.

๐Ÿค Support

๐Ÿ™ Acknowledgments

  • Named after Mimir from Norse mythology, the severed head that provided wisdom to Odin
  • Built with modern Python technologies and AI capabilities
  • Inspired by the need for intelligent information processing in today's data-rich world

๐Ÿง  Mimir - Where Information Becomes Intelligence

About

๐Ÿง  Mimir - AI-powered information aggregation and distribution system

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

โšก