Going to the database repeatedly is slow and operations-heavy. Caching stores recent/frequent data in a faster layer (memory) ...
As for the AI bubble, it is coming up for conversation because it is now having a material effect on the economy at large.