2024-06-19 Database Optimisation and Performance Improvements
- Improved the performance of dashboard, reports, and log tables with Clickouse.
- Replicated data to ClickHouse to reduce load on the main database and enhance query speed.
Query Performance Testing:
- Compared performance of complex queries between standard PostgreSQL and TimescaleDB, demonstrating significant speed improvements with TimescaleDB.
Implementation Plan:
- Set up TimescaleDB instance on AWS for analytics.
- Configured TimescaleDB to sync data using PeerDB.
- Adjusted live SwitchTransact queries for stats and graphs to point to TimescaleDB.
Notes:
Monitoring tools have been set up to observe resource usage and query performance post-implementation.