Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / ameygawade / streamlit-robots_txt_generator

This Streamlit app allows users to generate and customize a robots.txt file by selecting user-agents, specifying disallowed paths, enabling crawler delay, and providing a sitemap URL.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ameygawade%2Fstreamlit-robots_txt_generator

Stars: 1
Forks: 0
Open Issues: 0

License: None
Language: Python
Repo Size: 98.3 MB
Dependencies: 0

Created: about 1 month ago
Updated: 16 days ago
Last pushed: about 1 month ago
Last synced: 3 days ago

Topics: config, data-science, front, generative, generator, google, robots-txt, search-algorithm, search-engine, seo, seo-optimization, stream, streamlit, txt-files, web, webapp, webapplication

Files

Readme

No dependencies found