Skip to content
This repository was archived by the owner on May 22, 2021. It is now read-only.
This repository was archived by the owner on May 22, 2021. It is now read-only.

Add robots.txt? #141

Closed
Closed
Add robots.txt?#141
@pdehaan

Description

@pdehaan
pdehaan
opened on Jun 24, 2017

Currently https://fileshare.stage.mozaws.net/robots.txt 404s. Not sure if we want to add a /public/robots.txt to prevent anything from being indexed (like download pages, etc).

What about something like this?

User-agent: *
Disallow: /download/

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions