This directory contains hands-on tutorials and practical examples for over 90 open-source AI/ML libraries. Each notebook provides step-by-step guidance, code examples, and real-world applications to help you master the most important tools in the AI ecosystem.

🎯 Categories

🤖 AI Agents & Frameworks

AutoGen - Building collaborative AI agents in Python
CrewAI - Multi-agent orchestration framework
LangGraph - Multi-agent swarm systems
Phidata - Production-ready AI agents
Swarm Agents - OpenAI's experimental multi-agent framework
Agency Swarm - Advanced AI agent framework
Agno - Lightweight multi-modal agents
Atomic Agents - Modular AI framework
Browser Use - Web automation agents
Composio - AI integration platform

🔍 RAG & Vector Databases

ChromaDB - Efficient vector database for embeddings
Pinecone - Scalable vector database for AI applications
Weaviate - AI-native vector database
Qdrant - Vector search and semantic matching
FAISS - Efficient document search and retrieval
Milvus - Large-scale vector database
AutoRAG - Automated RAG system optimization
RAGatouille - Advanced RAG retrieval
RAGLite - Efficient RAG framework

🧠 Language Models & NLP

LangChain - Building intelligent workflows
LlamaIndex - Data integration for language models
Hugging Face Transformers - Foundation for generative AI and NLP
OpenAI - GPT models and API integration
LiteLLM - Simplified LLM integration
vLLM - Fast LLM inference
Instructor - Structured outputs from LLMs
DSPy - Language model prompting with Python
Guidance - Structured LLM generation

📊 Data Processing & Analysis

PandasAI - AI-powered data analysis
Unstructured - Text processing for LLMs
TextBlob - Simplified NLP for everyone
SentenceTransformers - Semantic similarity and clustering
Gensim - Topic modeling and document similarity
PyTesseract - OCR tool for text extraction
Tiktoken - High-performance tokenizer
Chonkie AI - Advanced text chunking for RAG

🌐 Web Scraping & Data Extraction

FireCrawl - Advanced web scraping for AI applications
Crawl4AI - LLM-friendly web scraper
ScrapegraphAI - AI-powered web scraping
ExtractThinker - Intelligent document processing

🔧 Development & Deployment

Streamlit - Interactive web apps development
FastAPI - High-performance web framework for AI
Gradio - Build interactive AI applications
E2B - Execution environments with language models
MLflow - Streamlining the ML lifecycle

📈 Evaluation & Monitoring

DeepEval - LLM evaluation framework
Ragas - Evaluation framework for RAG systems
LangSmith - Building and optimizing LLM applications
Langfuse - Open-source LLM engineering platform
Giskard - Evaluation & testing framework for AI systems
OpenLLMetry - Observability for LLM apps
Opik - LLM evaluation and monitoring

🎵 Multimodal & Specialized

Suno AI - Advanced speech synthesis platform
WhisperASR - Multilingual speech recognition
NeMo SpeechAI - Speech AI workbench
Mem0 - Intelligent memory for personalized AI

☁️ Cloud & Infrastructure

Supabase - Backend for GenAI applications
MongoDB - AI-powered applications database
Redis - High-speed data management for GenAI
Neon DB - Serverless PGVector database

🚀 Getting Started

Choose a notebook based on your interest or project needs
Open in Jupyter or your preferred notebook environment
Install dependencies as specified in each notebook
Follow along with the step-by-step examples
Experiment with the provided code and adapt to your use case

📋 Prerequisites

Python 3.8+
Jupyter Notebook or JupyterLab
Basic understanding of Python programming
API keys for specific services (OpenAI, Anthropic, etc.) where required

🤝 Contributing

Found an issue or want to add a new library tutorial?

Create an issue describing the problem or suggestion
Fork the repository and create a new branch
Add your notebook following the existing format
Submit a pull request with a clear description

📄 License

This collection is part of the Gen-AI-Experiments repository. Please refer to the main repository license.

Happy Learning! 🎉
Master AI/ML libraries one notebook at a time

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

README.md

🚀 100+ Open Source Libraries

📚 Overview

🎯 Categories

🤖 AI Agents & Frameworks

🔍 RAG & Vector Databases

🧠 Language Models & NLP

📊 Data Processing & Analysis

🌐 Web Scraping & Data Extraction

🔧 Development & Deployment

📈 Evaluation & Monitoring

🎵 Multimodal & Specialized

☁️ Cloud & Infrastructure

🚀 Getting Started

📋 Prerequisites

🤝 Contributing

📄 License

Name		Name	Last commit message	Last commit date
parent directory ..
Agency_Swarm_AI_Framework.ipynb		Agency_Swarm_AI_Framework.ipynb
AgentOps_Evaluation.ipynb		AgentOps_Evaluation.ipynb
Agenta_Open_Source_LLMOps_Platform.ipynb		Agenta_Open_Source_LLMOps_Platform.ipynb
Agentarium_AI_Agent_Orchestration_Framework.ipynb		Agentarium_AI_Agent_Orchestration_Framework.ipynb
Agno_Lightweight_Multi_Modal_Agents.ipynb		Agno_Lightweight_Multi_Modal_Agents.ipynb
Atomic_Agents_Modular_AI_Framework.ipynb		Atomic_Agents_Modular_AI_Framework.ipynb
AutoGen_Building_Collaborative_AI_Agents_in_Python.ipynb		AutoGen_Building_Collaborative_AI_Agents_in_Python.ipynb
AutoRAG_–_Automates_and_optimizes_RAG_systems.ipynb		AutoRAG_–_Automates_and_optimizes_RAG_systems.ipynb
Beginner_Guide_of_AI_Suite.ipynb		Beginner_Guide_of_AI_Suite.ipynb
Browser_Use_Agent_Automation.ipynb		Browser_Use_Agent_Automation.ipynb
Building_AgentLite_AI_Agents.ipynb		Building_AgentLite_AI_Agents.ipynb
Camel_AI_Advanced_AI_Platform_for_Intelligent_Task_Automation.ipynb		Camel_AI_Advanced_AI_Platform_for_Intelligent_Task_Automation.ipynb
ChatArena_Multi_Agent_LLM_Environment.ipynb		ChatArena_Multi_Agent_LLM_Environment.ipynb
Chonkie_AI_Advanced_Text_Chunking_for_RAG_.ipynb		Chonkie_AI_Advanced_Text_Chunking_for_RAG_.ipynb
ChromaDB_Efficient_Vector_Database_for_Embeddings.ipynb		ChromaDB_Efficient_Vector_Database_for_Embeddings.ipynb
Composio_Supercharge_Your_Apps_with_AI_Integration.ipynb		Composio_Supercharge_Your_Apps_with_AI_Integration.ipynb
Crawl4AI_LLM_Friendly_Web_Scraper.ipynb		Crawl4AI_LLM_Friendly_Web_Scraper.ipynb
CrewAI_Essentials_Quick_Start_Guide.ipynb		CrewAI_Essentials_Quick_Start_Guide.ipynb
DSPy_Simplify_Language_Model_Prompting_with_Python.ipynb		DSPy_Simplify_Language_Model_Prompting_with_Python.ipynb
Data_Analysis_with_PandasAI.ipynb		Data_Analysis_with_PandasAI.ipynb
DeepPavlov_Advanced_Conversational_AI_Framework.ipynb		DeepPavlov_Advanced_Conversational_AI_Framework.ipynb
Docling_The_Ultimate_Document_Parsing_and_Exporting_Tool.ipynb		Docling_The_Ultimate_Document_Parsing_and_Exporting_Tool.ipynb
E2B_Integrating_Execution_Environments_with_Language_Models.ipynb		E2B_Integrating_Execution_Environments_with_Language_Models.ipynb
Efficient_Document_Search_and_Retrieval_with_FAISS.ipynb		Efficient_Document_Search_and_Retrieval_with_FAISS.ipynb
Ell_The_Language_Model_Programming_Library.ipynb		Ell_The_Language_Model_Programming_Library.ipynb
Embedchain_Build_AI_Powered_Document_Based_Chatbots.ipynb		Embedchain_Build_AI_Powered_Document_Based_Chatbots.ipynb
Exploring_TextBlob_Simplified_NLP_for_Everyone.ipynb		Exploring_TextBlob_Simplified_NLP_for_Everyone.ipynb
ExtractThinker_Intelligent_Document_Processing_for_LLM.ipynb		ExtractThinker_Intelligent_Document_Processing_for_LLM.ipynb
FLAML_Efficient_AutoML_and_Agent_Framework.ipynb		FLAML_Efficient_AutoML_and_Agent_Framework.ipynb
FastAPI_High_Performance_Web_Framework_for_AI_Integration_.ipynb		FastAPI_High_Performance_Web_Framework_for_AI_Integration_.ipynb
FireCrawl_Advanced_Web_Scraping_and_Data_Extraction_for_AI_Applications.ipynb		FireCrawl_Advanced_Web_Scraping_and_Data_Extraction_for_AI_Applications.ipynb
Fireworks_AI_Building_Advanced_Generative_Applications.ipynb		Fireworks_AI_Building_Advanced_Generative_Applications.ipynb
FlagEmbedding_Retrieval.ipynb		FlagEmbedding_Retrieval.ipynb
GPTCache_High_Speed_Caching_for_Generative_AI.ipynb		GPTCache_High_Speed_Caching_for_Generative_AI.ipynb
Gensim_Powerful_Library_for_Topic_Modeling_and_Document_Similarity.ipynb		Gensim_Powerful_Library_for_Topic_Modeling_and_Document_Similarity.ipynb
Getting_Started_with_LangExtract_Unlocking_Text_Analysis_with_AI.ipynb		Getting_Started_with_LangExtract_Unlocking_Text_Analysis_with_AI.ipynb
Getting_Started_with_Pydantic_AI.ipynb		Getting_Started_with_Pydantic_AI.ipynb
Getting_started_with_Langgraph.ipynb		Getting_started_with_Langgraph.ipynb
Giskard_Evaluation_&_Testing_Framework_for_AI_Systems.ipynb		Giskard_Evaluation_&_Testing_Framework_for_AI_Systems.ipynb
Gradio_Build_Interactive_AI_Applications_with_Ease.ipynb		Gradio_Build_Interactive_AI_Applications_with_Ease.ipynb
Griptape_AI_Workflow_Automation_Framework.ipynb		Griptape_AI_Workflow_Automation_Framework.ipynb
Guardrails_Using_LangChain.ipynb		Guardrails_Using_LangChain.ipynb
Haystack_Open_Source_Framework_for_LLMs_&_Vector_Search.ipynb		Haystack_Open_Source_Framework_for_LLMs_&_Vector_Search.ipynb
Hugging_Face_Transformers_A_Powerful_Foundation_for_Generative_AI_and_NLP.ipynb		Hugging_Face_Transformers_A_Powerful_Foundation_for_Generative_AI_and_NLP.ipynb
Instructor_The_Most_Popular_Library_for_Simple_Structured_Outputs.ipynb		Instructor_The_Most_Popular_Library_for_Simple_Structured_Outputs.ipynb
LLMWare_RAG_Agen.ipynb		LLMWare_RAG_Agen.ipynb
LLM_Evaluation_Using_DeepEval.ipynb		LLM_Evaluation_Using_DeepEval.ipynb
LLM_Evaluation_with_Judges.ipynb		LLM_Evaluation_with_Judges.ipynb
LLM_Reasoner_Playground.ipynb		LLM_Reasoner_Playground.ipynb
LMQL_Language_Model_Query_Language.ipynb		LMQL_Language_Model_Query_Language.ipynb
LangChain_Basics_Building_Intelligent_Workflows.ipynb		LangChain_Basics_Building_Intelligent_Workflows.ipynb
LangGraph_Multi_Agent_Swarm.ipynb		LangGraph_Multi_Agent_Swarm.ipynb
LangGraph_Supervisor.ipynb		LangGraph_Supervisor.ipynb
LangSmith_Building_and_Optimizing_LLM_Applications_.ipynb		LangSmith_Building_and_Optimizing_LLM_Applications_.ipynb
Langfuse_Open_Source_LLM_Engineering_Platform.ipynb		Langfuse_Open_Source_LLM_Engineering_Platform.ipynb
Langroid_Simplifies_LLM_Powered_Conversational_Agents_🦜.ipynb		Langroid_Simplifies_LLM_Powered_Conversational_Agents_🦜.ipynb
LiteLLM_Simplified_LLM_Integration.ipynb		LiteLLM_Simplified_LLM_Integration.ipynb
LlamaIndex_Enhancing_Language_Models_with_Intelligent_Data_Integration.ipynb		LlamaIndex_Enhancing_Language_Models_with_Intelligent_Data_Integration.ipynb
Llama_Parse_Transform_Unstructured_Data_with_Ease.ipynb		Llama_Parse_Transform_Unstructured_Data_with_Ease.ipynb
MLflow_Streamlining_the_ML_Lifecycle.ipynb		MLflow_Streamlining_the_ML_Lifecycle.ipynb
Marvin_Multi_Agent.ipynb		Marvin_Multi_Agent.ipynb
Milvus_Unlocking_the_Power_of_Vector_Databases.ipynb		Milvus_Unlocking_the_Power_of_Vector_Databases.ipynb
MongoDB_for_AI_Powered_Applications.ipynb		MongoDB_for_AI_Powered_Applications.ipynb
NeMo_SpeechAI_Workbench_🎙️.ipynb		NeMo_SpeechAI_Workbench_🎙️.ipynb
Neon_DB_Serverless_PGVector.ipynb		Neon_DB_Serverless_PGVector.ipynb
Nomic_Empowering_Large_Scale_Data_Insights.ipynb		Nomic_Empowering_Large_Scale_Data_Insights.ipynb
OpenAI_Agents_Quickstart.ipynb		OpenAI_Agents_Quickstart.ipynb
OpenLLMetry_Observability_for_Your_LLM_Apps.ipynb		OpenLLMetry_Observability_for_Your_LLM_Apps.ipynb
Open_Interpreter_Local_Code_Execution_with_LLMs.ipynb		Open_Interpreter_Local_Code_Execution_with_LLMs.ipynb
Opik_LLM_Evaluation_and_Monitoring.ipynb		Opik_LLM_Evaluation_and_Monitoring.ipynb
Phidata_Agents_in_Action_A_Hands_On_Guide.ipynb		Phidata_Agents_in_Action_A_Hands_On_Guide.ipynb
Portkey_AI_Unified_Generative_AI_Platform.ipynb		Portkey_AI_Unified_Generative_AI_Platform.ipynb
PromptBench_Test_Suite.ipynb		PromptBench_Test_Suite.ipynb
Prompt_Engineering_with_Promptify.ipynb		Prompt_Engineering_with_Promptify.ipynb
PyTesseract_Powerful_OCR_Tool_For_Text_Extraction.ipynb		PyTesseract_Powerful_OCR_Tool_For_Text_Extraction.ipynb
Qdrant_Vector_Search_and_Semantic_Matching.ipynb		Qdrant_Vector_Search_and_Semantic_Matching.ipynb
R2R_Advanced_Retrieval_and_Knowledge_Integration_Platform.ipynb		R2R_Advanced_Retrieval_and_Knowledge_Integration_Platform.ipynb
RAGLite_Efficient_Retrieval_Augmented_Generation_Framework.ipynb		RAGLite_Efficient_Retrieval_Augmented_Generation_Framework.ipynb
RAGatouille_Advanced_RAG_Retrieval.ipynb		RAGatouille_Advanced_RAG_Retrieval.ipynb
README.md		README.md
Ragas_Evaluation_Framework_for_RAG_Systems.ipynb		Ragas_Evaluation_Framework_for_RAG_Systems.ipynb
Redis_for_Generative_AI_High_Speed_Data_Management.ipynb		Redis_for_Generative_AI_High_Speed_Data_Management.ipynb
Semantic_Kernel_Versatile_AI_Orchestration_Framework.ipynb		Semantic_Kernel_Versatile_AI_Orchestration_Framework.ipynb
SentenceTransformers_Semantic_Similarity_and_Clustering.ipynb		SentenceTransformers_Semantic_Similarity_and_Clustering.ipynb
Structured_LLM_Generation_with_Guidance.ipynb		Structured_LLM_Generation_with_Guidance.ipynb
Suno_AI_Advanced_Speech_Synthesis_Platform.ipynb		Suno_AI_Advanced_Speech_Synthesis_Platform.ipynb
Supabase_for_GenAI.ipynb		Supabase_for_GenAI.ipynb
Swarm_Agents_A_Beginner's_Guide.ipynb		Swarm_Agents_A_Beginner's_Guide.ipynb
TaskGen_Task_Based_Agentic_Framework_with_StrictJSON.ipynb		TaskGen_Task_Based_Agentic_Framework_with_StrictJSON.ipynb
TextGrad_Differentiable_Text_Optimization_for_Generative_AI.ipynb		TextGrad_Differentiable_Text_Optimization_for_Generative_AI.ipynb
Tiktoken_High_Performance_Tokenizer_for_OpenAI_Models.ipynb		Tiktoken_High_Performance_Tokenizer_for_OpenAI_Models.ipynb
Unsloth_Fine_tune_Models_2_5x_Faster_with_80_Less_Memory.ipynb		Unsloth_Fine_tune_Models_2_5x_Faster_with_80_Less_Memory.ipynb
Unstructured_Text_Processing_for_LLMs.ipynb		Unstructured_Text_Processing_for_LLMs.ipynb
Vanna_AI_SQL_Generator.ipynb		Vanna_AI_SQL_Generator.ipynb
Weaviate_The_AI_Native_Vector_Database.ipynb		Weaviate_The_AI_Native_Vector_Database.ipynb
WebScraping_with_ScrapegraphAI .ipynb		WebScraping_with_ScrapegraphAI .ipynb
WhisperASR_Multilingual_Speech_Recognition.ipynb		WhisperASR_Multilingual_Speech_Recognition.ipynb
smolagents_a_smol_library_to_build_great_agents.ipynb		smolagents_a_smol_library_to_build_great_agents.ipynb
txtai_Semantic_Search_and_LLM_Workflows.ipynb		txtai_Semantic_Search_and_LLM_Workflows.ipynb
vLLM_Fast_LLM_Inference.ipynb		vLLM_Fast_LLM_Inference.ipynb

FilesExpand file tree

100-os-libraries

Directory actions

More options

Directory actions

More options

Latest commit

History

100-os-libraries

Folders and files

parent directory

README.md

🚀 100+ Open Source Libraries

📚 Overview

🎯 Categories

🤖 AI Agents & Frameworks

🔍 RAG & Vector Databases

🧠 Language Models & NLP

📊 Data Processing & Analysis

🌐 Web Scraping & Data Extraction

🔧 Development & Deployment

📈 Evaluation & Monitoring

🎵 Multimodal & Specialized

☁️ Cloud & Infrastructure

🚀 Getting Started

📋 Prerequisites

🤝 Contributing

📄 License