I think the idea is that the RAG can act as a knowledge base and allow users to add additional documentation and sample queries as context.

Those would be fetched along with the table metadatas.

I'm building https://dataline.app but we don't even use RAG there YET and it's great!