D4Vinci/Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
This period is measured from GitHub’s rebuilt star history — one point per week — because our own daily snapshots do not reach this far back yet. Period boundaries can be off by up to half a week; the repository page prints the real start date for each period. So far the history has been fetched for 12,569 of 63,108 tracked repositories, and only those can be ranked in this period.
Star counts measured between 07:56 and 10:04 (BKK).
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:
LlamaIndex is the document processing platform for AI
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
👾 nao is an open source analytics agent. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Pluggable data replication with checkpointing, batching, and integrity events
The agent platform built on sync.
Scalable data pre processing and curation toolkit for LLMs
Generate massive amounts of fake data in the browser and node.js
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
The official home of the Presto distributed SQL query engine for big data
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Easiest and laziest way for building multi-agent LLMs applications.
OpenDota: Open source Dota 2 data platform with automated replay parsing
OpenDota: React web UI for Dota 2 statistics using the OpenDota platform
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Backend that powers the dataset viewer on Hugging Face dataset pages through a public API.
Searchable, application-level encryption for building privacy-first apps
Showing 30 of 38 repositories
