What is robots.txt file?
The robots.txt file is a text file standard widely used in websites. Basically it tells search engine robots and other crawlers which pages and areas on your websites are allowed/disallowed for them to follow.
Continue reading Serving robots.txt in Spring Boot application