Post-Installation Validation
Complete checklist to verify Chatty AI deployment is working correctly.
Container Health
Verify All Containers Running
docker ps
Expected: All 11 containers should be running:
- nginx
- chattyai
- db (PostgreSQL)
- qdrant
- pipelines
- n8n
- chattydatabases
- chattydatabases-engine
- chattydatabases-ibis
- chattydatabases-ai-service
- chattydatabases-bootstrap (may exit after initialization)
Check Container Logs
# Check for errors in main application
docker logs chattyai
# Check nginx for startup issues
docker logs nginx
# Check database connectivity
docker logs db
# Check Qdrant
docker logs qdrant
Look for:
- No error messages
- Successful startup messages
- Database connections established
Network Connectivity
External Access
Test HTTPS access to all services:
# Chatty AI main application
curl -k https://YOUR_CHATTYAI_DOMAIN
# n8n workflow automation
curl -k https://YOUR_N8N_DOMAIN
# Databases UI
curl -k https://YOUR_DATABASES_DOMAIN
Expected: HTTP 200 responses or login pages
Certificate Validation
Check TLS certificates are valid:
# Check certificate
openssl s_client -connect YOUR_CHATTYAI_DOMAIN:443 -servername YOUR_CHATTYAI_DOMAIN < /dev/null
# Verify certificate chain
curl -vI https://YOUR_CHATTYAI_DOMAIN
Expected:
- Valid certificate chain
- No certificate errors
- Correct domain name in certificate
Internal Connectivity
Verify containers can communicate:
# Test database connection from chattyai container
docker exec chattyai nc -zv db 5432
# Test Qdrant connection
docker exec chattyai nc -zv qdrant 6333
# Test pipelines connection
docker exec chattyai nc -zv pipelines 9099
Expected: All connections successful
Service Functionality
Web UI Access
- Chatty AI UI loads at
https://YOUR_CHATTYAI_DOMAIN - Login page displays correctly
- No JavaScript errors in browser console
- CSS/styling loads properly
Admin Login
- Admin user can log in with credentials from
.env- Email:
CHATTYAI_ADMIN_EMAIL - Password:
CHATTYAI_ADMIN_PASSWORD
- Email:
- Dashboard loads after login
- Admin settings accessible
Database Connectivity
- PostgreSQL accessible from chattyai container
- Database tables created automatically
- No connection errors in logs
Qdrant Vector Database
- Qdrant accessible at internal port 6333
- Collections can be created
- Vector storage working
Test Qdrant:
# Check Qdrant health
docker exec chattyai curl http://qdrant:6333/health
Expected: {"status":"ok"}
Feature Testing
Chat Functionality
- Create new chat session
- Send test message to LLM
- Receive response from AI
- No timeout errors
- Response time acceptable (< 5 seconds)
Document Upload (RAG)
- Upload test document (PDF, DOCX, or TXT)
- Document processes successfully
- Document appears in knowledge base
- Can query document content
- RAG retrieval works
n8n Workflows
- n8n UI accessible at
https://YOUR_N8N_DOMAIN - Can create workflow
- Chatty AI node available
- Can connect to Chatty AI via API key
Databases
- Databases UI accessible at
https://YOUR_DATABASES_DOMAIN - Can connect to data source
- Natural language queries work
- SQL generation functional
Authentication Testing
Local Authentication
- Can create new user
- New user can log in
- Password reset works (if configured)
- User roles enforced
LDAP (If Configured)
- LDAP connection successful
- LDAP users can log in
- LDAP groups mapped correctly
- LDAP sync working
Test LDAP:
# Check LDAP connectivity from container
docker exec chattyai ldapsearch -x -H ldap://YOUR_LDAP_SERVER -b "dc=example,dc=com"
SSO (If Configured)
- SSO login button appears
- Redirect to SSO provider works
- Can authenticate via SSO
- User created in Chatty AI
- Callback URL correct
Integration Testing
Microsoft 365 (If Configured)
- M365 apps visible in admin panel
- OAuth flow works
- Can connect to Outlook
- Can access OneDrive
- Can read Teams transcripts
Jira (If Configured)
- Jira app visible in admin panel
- OAuth flow works
- Can connect to Jira
- Can query issues
Performance Validation
Resource Usage
Check resource consumption:
# Check container resource usage
docker stats --no-stream
# Check disk usage
df -h
# Check memory usage
free -h
Expected:
- CPU usage < 50% at idle
- Memory usage within limits
- Disk usage < 80%
Response Times
- UI loads in < 3 seconds
- Chat responses in < 5 seconds
- Document upload completes reasonably
- Search queries return in < 2 seconds
Security Validation
TLS/SSL
- HTTPS enforced (HTTP redirects to HTTPS)
- Valid certificates in use
- No mixed content warnings
- TLS 1.2 or higher
Network Isolation
- PostgreSQL NOT accessible externally
- Qdrant NOT accessible externally
- Only Nginx ports exposed (80, 443, 8000)
Test:
# These should FAIL from external network
nc -zv YOUR_SERVER_IP 5432 # PostgreSQL
nc -zv YOUR_SERVER_IP 6333 # Qdrant
Secrets Management
- No secrets in logs
- Environment variables set correctly
- API keys working
- JWT tokens generated
Backup Validation
Volume Verification
Check Docker volumes exist:
docker volume ls | grep chatty
Expected volumes:
- chatty-app_db_data
- chatty-app_qdrant
- chatty-app_chattyai
- chatty-app_pipelines
- chatty-app_n8n_data
- chatty-app_chattydatabases_data
Backup Test
- Can create manual backup
- Backup files created successfully
- Backup size reasonable
# Test backup (example)
docker exec db pg_dump -U chattyAdmin chattydb > test_backup.sql
Monitoring Setup
Log Access
- Can access container logs
- Logs rotating properly
- No excessive log growth
# Check log sizes
docker inspect chattyai | grep LogPath
ls -lh /var/lib/docker/containers/*/
Health Endpoints
Test health endpoints:
# Chatty AI health
curl -k https://YOUR_CHATTYAI_DOMAIN/health
# Qdrant health
docker exec chattyai curl http://qdrant:6333/health
Common Issues
Containers Not Starting
Check:
- Docker logs for errors
- Port conflicts
- Volume permissions
- Resource availability
Cannot Access UI
Check:
- Nginx configuration
- Certificate paths
- DNS resolution
- Firewall rules
Database Connection Errors
Check:
- PostgreSQL container running
- Database password correct
- Network connectivity
- DATABASE_URL format
LLM Not Responding
Check:
- CHATTYAI_AI_API_KEY set
- CHATTYAI_AI_API_BASE_URL correct
- Outbound HTTPS access
- LLM endpoint reachable
RAG Not Working
Check:
- Qdrant container running
- QDRANT_URI correct
- Embedding model configured
- Documents uploaded successfully
Validation Complete
Once all checks pass:
Deployment is successful System is ready for use Can proceed to user onboarding
Next Steps
- Configure users and permissions
- Set up monitoring and alerting
- Schedule backups
- Document custom configuration
- Train administrators
- Onboard end users
Troubleshooting
If validation fails, see:
Support
For assistance:
- Email: support@chatty-ai.ai
- Documentation: https://docs.chatty-ai.ai
- GitHub: https://github.com/chattyai-org/chatty-app