A robots.txt file is included in the SiteGenesis Storefront Core cartridge, in the cartridge/static/default directory.
robots.txt
© Copyright 2000-2019, salesforce.com inc. All rights reserved. Various trademarks held by their respective owners.