Generate Sitemap.xml and Robots.txt to improve SEO and Site Crawling

[amiya-cyber]

Adding sitemap.xml and robots.txt files helps optimize a website for search engines.

Sitemap.xml provides a list of important URLs, helping search engines discover, crawl, and index new and updated content faster, improving SEO.

Robots.txt controls which parts of the site search engines can access, preventing indexing of sensitive or unimportant pages, conserving crawl budget, and reducing server load.

Together, they enhance site visibility, performance, and search engine ranking.

ASSIGN WITH LEVEL 2 OR LEVEL 3

[github-actions]

Hello @amiya-cyber!
Thank you for raising this issue.
Please make sure to follow our Contributing Guidelines.
Don't forget to ⭐ our Grabtern-Frontend.

Our review team will carefully assess the issue and reach out to you soon!
We appreciate your patience!