Add Routing and Gateway

Manage complexity and costs with smarter routing:

• Router: Direct queries to the optimal model based on intent or type

• Gateway: Provide unified, secure access to multiple models

• Centralised security: Improve maintainability and logging

This layer optimises resource usage by directing different types of queries to the most appropriate models, while providing a single access point for security and monitoring.