Cost of Retraining Pretrained Large Language Models

It is very costly and time consuming to retrain large language models.
This poses a problem when we want a clear answer to a question that incorporates up to the minute knowledge. We discuss two models - one from Stanford and the other from MIT which try to "patch" new information on to the existing base. It produces inconsistencies in the models with billions of parameters.