OSINT Repos List (Limited Access Version)

This repository encapsulates a list of repositories from the GitHub, marked with an asterisk relating to the subject of OSINT, Cybersecurity, DevOps / System Administration and specific development.

The list of 100 random starred repositories is here: https://github.com/bormaxi8080/osint-repos-list/blob/main/starred_repos_random.md

---

The full version of the list includes more than 3,000 repositories generated on PDF and Markdown formats.

The list of repositories is updated weekly.

---

How to access full repositories list?

• Buy Me A Coffee:

or Subscribe Me on Substack: @OSINTech

• Connect Me on Substack: @OSINTech or Request Access in a Google Form by providing your email address and a link to GitHub account

• I will grant you access to the full version list repositories posted on GitHub or send it on email.

• All Paid Substack Subscribers have access to the full list of repositories, as well as a premium version of the list in the form of bookmarks/a board for the start.me service.

---

How to build your own repos List?

Python script for build all your starred GitHub repositories information in JSON and Markdown documents named as builder.py.

To build repos list run:

python3 builder.py

This Python script helps for generate Markdown description document contains GitHub starred repositories.

This is typically needed in a situation when you have many starred repositories to view, such as collection of various utilities.

This script does simple things:

Gets list of your starred GitHub repositories.

Generate JSON and Markdown documents with GitHub starred repos statistics

That's all.

*It works on GitHub only! (not in GitLab or BitBucket)

---

WARNING

All tools, programs and techniques published in this repository are used for informational, educational purposes or for information security purposes. The authors are not responsible for the activities that users of these tools and techniques may carry out, and urge them not to use them to carry out harmful or destructive activities directed against other users or groups on the Internet.

---

Important

If you have a lot of starred GitHub repositories, operations may take a long time to complete.

---

Usage

• Clone this repository
• Create environment variable GITHUB_API_TOKEN with GitHub API token
• Run 'python3 builder.py' and wait

Modes

• Full generation (default): JSON -> Topics -> Markdown -> PDF -> start.me HTML

python3 builder.py

If starred_repos.json already exists, -m full automatically enables the "new version" workflow:

• Current starred_repos.json is copied to starred_repos_previous.json before refresh.

• PDF includes Newly Added Repositories section.

• JSON only:

python3 builder.py -m json

• Markdown only (from existing JSON files):

python3 builder.py -m markdown

• PDF only (from existing JSON files):

python3 builder.py -m pdf

• Topics only (from existing JSON files):

python3 builder.py -m topics

• start.me bookmarks only (from existing JSON files):

python3 builder.py -m startme

New Version Flag

Use --new-version to explicitly enable the workflow in json and pdf modes (or to force it in any mode):

python3 builder.py -m full --new-version

The flag works with -m full, -m json, and -m pdf:

• Before writing a new starred_repos.json, the current file is copied to starred_repos_previous.json.
• During PDF generation, the second page contains Newly Added Repositories (difference between starred_repos.json and starred_repos_previous.json) in the same format as the main repositories list.
• Then the regular sections continue on a new page: full repositories list and contributors list.

Markdown generation (starred_repos.md) is unchanged.

• Bingo!!!

---

Results

NOTE: Simplification of the output: image badges have been removed, since with a large number of repositories, a document is generated that is too large and the page freezes

You can see full repos list in Markdown and JSON files.

---

SEARCH EXAMPLE

You can search repos by keyword. For example, search repos by "SMS" keyword. Type "Ctrl+F" ("Cmd+F") and search:

---

Related projects

I use github-starred-repos-loader and git-repos-updater shell scripts to pull and update my starred GitHub collected repos locally.

---

Notes

How to get GitHub personal API access token for API

https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token

---

More about GitHub stars

https://stars.github.com/

More about GitHub API

https://docs.github.com/en/rest

More about GitHub Starred API

https://docs.github.com/en/rest/activity/starring

More About GitHub API Pagination Requests

https://docs.github.com/en/rest/guides/traversing-with-pagination

---

Donates