This should update the config data, but leave the accumulated token/cost data for the llms that still remain untouched.