Is robots.txt needed if one uses the Meta Robots, and vice versa? Also, does the robot.txt reside in the root directory, or does each sub-directory for individual sites also need one…assuming the file contains the same permissions.
You just set your robots.txt once in the root folder, then you choose in the txt file what folders that located inside the root to be allow/disallow
Is robots.txt needed if one uses the Meta Robots, and vice versa? Also, does the robot.txt reside in the root directory, or does each sub-directory for individual sites also need one…assuming the file contains the same permissions.
You just set your robots.txt once in the root folder, then you choose in the txt file what folders that located inside the root to be allow/disallow