By category

Top Data & databases

The most-starred MIT projects in Data & databases.

How it's ranked: Sorted by GitHub stars. A project can appear in up to two categories. Data from GitHub as of 2026-11-02.

1. 1MarkItDownPython tool that converts files like PDF, Word, Excel and PowerPoint into Markdown.microsoft · Python★ 193k
2. 2awesome-public-datasetsA curated list of links to high-quality open datasets, organized by topic.awesomedata★ 79.9k
3. 3DoclingPython library that converts PDFs and office files into structured text for AI use.docling-project · Python★ 70k
4. 4daily_stock_analysisLLM-driven stock analysis tool that gathers market data and news, then pushes daily reports to chat apps.ZhuLinsen · Python★ 67.4k
5. 5rcloneCommand-line tool that copies, syncs and manages files across many cloud storage providers.rclone · Go★ 60.7k
6. 6chinese-poetryA free, open JSON database of classical Chinese poetry, prose and song lyrics.chinese-poetry · JavaScript★ 54k
7. 7LlamaIndexPython framework for building LLM apps that query your own documents and data.run-llama · Python★ 52.8k
8. 8Python Data Science HandbookThe full text of a Python data science book, delivered as runnable Jupyter notebooks.jakevdp · Jupyter Notebook★ 50.3k
9. 9QlibOpen-source Python platform for quant investment research using machine learning.microsoft · Python★ 49.9k
10. 10JuliaA programming language for technical and scientific computing, with source code in this repo.JuliaLang · Julia★ 49.2k
11. 11Day.jsA small JavaScript library for working with dates and times, with an API similar to Moment.js.iamkun · JavaScript★ 48.7k
12. 12Umi-OCRFree, open-source OCR app that reads text from screenshots, images, and PDFs, offline.hiroi-sora · Python★ 48.4k
13. 13Moment.jsA JavaScript library for parsing, validating, manipulating and formatting dates; now in maintenance mode.moment · JavaScript★ 47.9k
14. 14VeighNaPython framework for building quant trading systems, with market gateways, backtesting and ML research tools.vnpy · Python★ 46.2k
15. 15KronosOpen-source pre-trained models that forecast financial candlestick (K-line) price data.shiyu-coder · Python★ 45.7k
16. 16CCXTA library for connecting code to 100+ crypto exchanges through one common interface.ccxt · Python★ 44.7k
17. 17DuckDBAn in-process analytical SQL database that runs inside your app with no server to manage.duckdb · C++★ 42.7k
18. 18FaissA C++ library with Python bindings for fast similarity search over large sets of vectors.facebookresearch · C++★ 41.2k
19. 19LightRAGA Python library that builds a knowledge graph from your documents to answer questions with an LLM.HKUDS · Python★ 40.5k
20. 20PolarsA fast library for working with tables of data (DataFrames), written in Rust with Python and other bindings.pola-rs · Rust★ 40.2k
21. 21GORMA Go library that maps database tables to Go structs so you can query data without writing raw SQL.go-gorm · Go★ 40k
22. 22PageIndexLets an AI find answers in long documents by reading a table-of-contents-style tree, not vector search.VectifyAI · Python★ 40k
23. 23UmamiPrivacy-first web analytics you can self-host or use in the cloud, without cookies.umami-software · TypeScript★ 39.9k
24. 24QuivrOpen-source engine that ingests content streams and makes them searchable and monitorable, in evaluation stageThe-Vibe-Company · Go★ 39.6k
25. 25Data Science for BeginnersA free 10-week, 20-lesson beginner data science curriculum from Microsoft, with quizzes and assignments.microsoft · Jupyter Notebook★ 37.9k