Database Configuration

SmartRAG database configuration - multi-database connections, schema analysis and security settings

Database Configuration

SmartRAG can perform intelligent cross-database queries with multi-database support:

Multi-Database Connections

Configure multiple database connections to enable cross-database queries:

Configure databases in appsettings.json:

{
  "SmartRAG": {
    "DatabaseConnections": [
      {
        "Name": "Sales Database",
        "ConnectionString": "Server=localhost;Database=Sales;...",
        "DatabaseType": "SqlServer",
        "IncludedTables": ["Orders", "Customers"],
        "MaxRowsPerQuery": 1000,
        "Enabled": true
      },
      {
        "Name": "Inventory Database",
        "ConnectionString": "Server=localhost;Database=Inventory;...",
        "DatabaseType": "MySQL",
        "MaxRowsPerQuery": 1000,
        "Enabled": true
      }
    ]
  }
}

DatabaseConnectionConfig Parameters

Parameter	Type	Default	Description
Name	string	-	Friendly name for database connection (auto-generated if not provided)
ConnectionString	string	-	Database connection string (required)
DatabaseType	DatabaseType	-	Database type (SqlServer, MySql, PostgreSql, Sqlite) (required)
Description	string	-	Optional description to help AI understand the database content
Enabled	bool	true	Whether this connection is enabled
MaxRowsPerQuery	int	0	Maximum rows to retrieve per query (0 = use default)
QueryTimeoutSeconds	int	0	Query timeout in seconds (0 = use default)
SchemaRefreshIntervalMinutes	int	0	Auto-refresh interval in minutes (0 = no auto-refresh)
IncludedTables	string[]	[]	Specific tables to include (empty = all tables)
ExcludedTables	string[]	[]	Tables to exclude from analysis

Supported Databases

SmartRAG supports the following database types:

SQL Server

{
  "DatabaseConnections": [
    {
      "Name": "SQL Server DB",
      "Type": "SqlServer",
      "ConnectionString": "Server=localhost;Database=MyDb;User Id=user;Password=pass;TrustServerCertificate=true;"
    }
  ]
}

MySQL

{
  "DatabaseConnections": [
    {
      "Name": "MySQL DB",
      "Type": "MySql",
      "ConnectionString": "Server=localhost;Database=MyDb;Uid=user;Pwd=pass;"
    }
  ]
}

PostgreSQL

{
  "DatabaseConnections": [
    {
      "Name": "PostgreSQL DB",
      "Type": "PostgreSql",
      "ConnectionString": "Host=localhost;Database=MyDb;Username=postgres;Password=password;"
    }
  ]
}

SQLite

{
  "DatabaseConnections": [
    {
      "Name": "SQLite DB",
      "Type": "Sqlite",
      "ConnectionString": "Data Source=./mydb.db;"
    }
  ]
}

Security and Sensitive Data Sanitization

SmartRAG automatically detects and sanitizes sensitive data types:

Automatically Sanitized Sensitive Data Types:

• password, pwd, pass
• ssn, social_security
• credit_card, creditcard, cc_number
• email, mail
• phone, telephone
• salary, compensation

// Disable sensitive data sanitization
new DatabaseConnectionConfig
{
    Name = "Secure Database",
    Type = DatabaseType.SqlServer,
    ConnectionString = "Server=localhost;Database=SecureDB;...",
    SanitizeSensitiveData = false  // Use with caution!
}

Schema Analysis and Refresh

SmartRAG Options for Schema Management

These global options control schema analysis behavior for all databases:

builder.Services.AddSmartRag(configuration, options =>
{
    // Automatically analyze database schemas on startup
    options.EnableAutoSchemaAnalysis = true;
    
    // Periodically refresh schemas to detect schema changes
    options.EnablePeriodicSchemaRefresh = true;
    
    // Default refresh interval for all databases (unless overridden per-database)
    options.DefaultSchemaRefreshIntervalMinutes = 60;
});

Configuration in appsettings.json:

{
  "SmartRAG": {
    "EnableAutoSchemaAnalysis": true,
    "EnablePeriodicSchemaRefresh": true,
    "DefaultSchemaRefreshIntervalMinutes": 60
  }
}

Manual Schema Refresh

// Custom refresh interval for specific database
new DatabaseConnectionConfig
{
    Name = "Frequently Changing Database",
    Type = DatabaseType.SqlServer,
    ConnectionString = "Server=localhost;Database=DynamicDB;...",
    SchemaRefreshIntervalMinutes = 15  // Refresh every 15 minutes
}

Performance Optimization

Table Filtering

// Include only specific tables
new DatabaseConnectionConfig
{
    Name = "Main Tables Only",
    Type = DatabaseType.SqlServer,
    ConnectionString = "Server=localhost;Database=LargeDB;...",
    IncludedTables = new List<string> { "Users", "Orders", "Products" },
    ExcludedTables = new List<string> { "Logs", "TempData", "Cache" }
}

Row Limits

// Row limit for large tables
new DatabaseConnectionConfig
{
    Name = "Large Table",
    Type = DatabaseType.SqlServer,
    ConnectionString = "Server=localhost;Database=BigDB;...",
    MaxRowsPerTable = 5000  // Maximum 5000 rows per table
}

Error Handling

// Handle connection errors
try
{
    var result = await _multiDatabaseQueryCoordinator.QueryMultipleDatabasesAsync(query);
}
catch (Exception ex)
{
    _logger.LogError(ex, "Database connection error");
    // Implement fallback strategy
}

Next Steps

Audio & OCR

Whisper.net and Tesseract OCR configuration

Audio & OCR

Advanced Configuration

Fallback providers and best practices

Advanced Configuration