Although AI bots have improved a lot, tests prove that they still cannot provide reliable answers on photonics questions. While semantic search works well, a photonics chatbot is currently not feasible.