Skip to main content

Post-Installation Validation

Complete checklist to verify Chatty AI deployment is working correctly.

Container Health

Verify All Containers Running

docker ps

Expected: All 11 containers should be running:

  • nginx
  • chattyai
  • db (PostgreSQL)
  • qdrant
  • pipelines
  • n8n
  • chattydatabases
  • chattydatabases-engine
  • chattydatabases-ibis
  • chattydatabases-ai-service
  • chattydatabases-bootstrap (may exit after initialization)

Check Container Logs

# Check for errors in main application
docker logs chattyai

# Check nginx for startup issues
docker logs nginx

# Check database connectivity
docker logs db

# Check Qdrant
docker logs qdrant

Look for:

  • No error messages
  • Successful startup messages
  • Database connections established

Network Connectivity

External Access

Test HTTPS access to all services:

# Chatty AI main application
curl -k https://YOUR_CHATTYAI_DOMAIN

# n8n workflow automation
curl -k https://YOUR_N8N_DOMAIN

# Databases UI
curl -k https://YOUR_DATABASES_DOMAIN

Expected: HTTP 200 responses or login pages

Certificate Validation

Check TLS certificates are valid:

# Check certificate
openssl s_client -connect YOUR_CHATTYAI_DOMAIN:443 -servername YOUR_CHATTYAI_DOMAIN < /dev/null

# Verify certificate chain
curl -vI https://YOUR_CHATTYAI_DOMAIN

Expected:

  • Valid certificate chain
  • No certificate errors
  • Correct domain name in certificate

Internal Connectivity

Verify containers can communicate:

# Test database connection from chattyai container
docker exec chattyai nc -zv db 5432

# Test Qdrant connection
docker exec chattyai nc -zv qdrant 6333

# Test pipelines connection
docker exec chattyai nc -zv pipelines 9099

Expected: All connections successful


Service Functionality

Web UI Access

  • Chatty AI UI loads at https://YOUR_CHATTYAI_DOMAIN
  • Login page displays correctly
  • No JavaScript errors in browser console
  • CSS/styling loads properly

Admin Login

  • Admin user can log in with credentials from .env
    • Email: CHATTYAI_ADMIN_EMAIL
    • Password: CHATTYAI_ADMIN_PASSWORD
  • Dashboard loads after login
  • Admin settings accessible

Database Connectivity

  • PostgreSQL accessible from chattyai container
  • Database tables created automatically
  • No connection errors in logs

Qdrant Vector Database

  • Qdrant accessible at internal port 6333
  • Collections can be created
  • Vector storage working

Test Qdrant:

# Check Qdrant health
docker exec chattyai curl http://qdrant:6333/health

Expected: {"status":"ok"}


Feature Testing

Chat Functionality

  • Create new chat session
  • Send test message to LLM
  • Receive response from AI
  • No timeout errors
  • Response time acceptable (< 5 seconds)

Document Upload (RAG)

  • Upload test document (PDF, DOCX, or TXT)
  • Document processes successfully
  • Document appears in knowledge base
  • Can query document content
  • RAG retrieval works

n8n Workflows

  • n8n UI accessible at https://YOUR_N8N_DOMAIN
  • Can create workflow
  • Chatty AI node available
  • Can connect to Chatty AI via API key

Databases

  • Databases UI accessible at https://YOUR_DATABASES_DOMAIN
  • Can connect to data source
  • Natural language queries work
  • SQL generation functional

Authentication Testing

Local Authentication

  • Can create new user
  • New user can log in
  • Password reset works (if configured)
  • User roles enforced

LDAP (If Configured)

  • LDAP connection successful
  • LDAP users can log in
  • LDAP groups mapped correctly
  • LDAP sync working

Test LDAP:

# Check LDAP connectivity from container
docker exec chattyai ldapsearch -x -H ldap://YOUR_LDAP_SERVER -b "dc=example,dc=com"

SSO (If Configured)

  • SSO login button appears
  • Redirect to SSO provider works
  • Can authenticate via SSO
  • User created in Chatty AI
  • Callback URL correct

Integration Testing

Microsoft 365 (If Configured)

  • M365 apps visible in admin panel
  • OAuth flow works
  • Can connect to Outlook
  • Can access OneDrive
  • Can read Teams transcripts

Jira (If Configured)

  • Jira app visible in admin panel
  • OAuth flow works
  • Can connect to Jira
  • Can query issues

Performance Validation

Resource Usage

Check resource consumption:

# Check container resource usage
docker stats --no-stream

# Check disk usage
df -h

# Check memory usage
free -h

Expected:

  • CPU usage < 50% at idle
  • Memory usage within limits
  • Disk usage < 80%

Response Times

  • UI loads in < 3 seconds
  • Chat responses in < 5 seconds
  • Document upload completes reasonably
  • Search queries return in < 2 seconds

Security Validation

TLS/SSL

  • HTTPS enforced (HTTP redirects to HTTPS)
  • Valid certificates in use
  • No mixed content warnings
  • TLS 1.2 or higher

Network Isolation

  • PostgreSQL NOT accessible externally
  • Qdrant NOT accessible externally
  • Only Nginx ports exposed (80, 443, 8000)

Test:

# These should FAIL from external network
nc -zv YOUR_SERVER_IP 5432 # PostgreSQL
nc -zv YOUR_SERVER_IP 6333 # Qdrant

Secrets Management

  • No secrets in logs
  • Environment variables set correctly
  • API keys working
  • JWT tokens generated

Backup Validation

Volume Verification

Check Docker volumes exist:

docker volume ls | grep chatty

Expected volumes:

  • chatty-app_db_data
  • chatty-app_qdrant
  • chatty-app_chattyai
  • chatty-app_pipelines
  • chatty-app_n8n_data
  • chatty-app_chattydatabases_data

Backup Test

  • Can create manual backup
  • Backup files created successfully
  • Backup size reasonable
# Test backup (example)
docker exec db pg_dump -U chattyAdmin chattydb > test_backup.sql

Monitoring Setup

Log Access

  • Can access container logs
  • Logs rotating properly
  • No excessive log growth
# Check log sizes
docker inspect chattyai | grep LogPath
ls -lh /var/lib/docker/containers/*/

Health Endpoints

Test health endpoints:

# Chatty AI health
curl -k https://YOUR_CHATTYAI_DOMAIN/health

# Qdrant health
docker exec chattyai curl http://qdrant:6333/health

Common Issues

Containers Not Starting

Check:

  • Docker logs for errors
  • Port conflicts
  • Volume permissions
  • Resource availability

Cannot Access UI

Check:

  • Nginx configuration
  • Certificate paths
  • DNS resolution
  • Firewall rules

Database Connection Errors

Check:

  • PostgreSQL container running
  • Database password correct
  • Network connectivity
  • DATABASE_URL format

LLM Not Responding

Check:

  • CHATTYAI_AI_API_KEY set
  • CHATTYAI_AI_API_BASE_URL correct
  • Outbound HTTPS access
  • LLM endpoint reachable

RAG Not Working

Check:

  • Qdrant container running
  • QDRANT_URI correct
  • Embedding model configured
  • Documents uploaded successfully

Validation Complete

Once all checks pass:

Deployment is successful System is ready for use Can proceed to user onboarding

Next Steps

  1. Configure users and permissions
  2. Set up monitoring and alerting
  3. Schedule backups
  4. Document custom configuration
  5. Train administrators
  6. Onboard end users

Troubleshooting

If validation fails, see:

Support

For assistance: