Specialty Technologies
Special field specific technologies and tools
Elasticsearch - a distributed RESTful search engine
Union is a hyper-efficient zero-knowledge infrastructure layer designed for general message passing, asset transfers, NFTs, and DeFi. It operates without dependencies on trusted third parties, oracles, multi-signatures, or MPC, leveraging Consensus Verification for security. Union is compatible with Cosmos chains via IBC and connects to EVM chains like Ethereum, Berachain, and Arbitrum. Its decentralized governance controls contract upgrades, connections, token configurations, and protocol evolution. Key components include `uniond` (node implementation), `galoisd` (ZK prover), `voyager` (cross-ecosystem relayer), and `hubble` (chain indexer). Built with Go, Rust, and Solidity, Union supports reproducible builds via Nix and offers a TypeScript SDK for interaction. It aims to align priorities among users, validators, and operators through decentralized governance.
A cache database, it is the indispensable "dessert" in your application! This open source project provides a high-performance and flexible data storage solution, and supports various data structures and complex operations.
A Java algorithm list, which provides a detailed demonstration of the built-in algorithm implementations in Java. It offers Java developers a convenient reference, showcasing the application of Java's built-in algorithms in handling various tasks. This project helps developers better understand and use Java's algorithms through clear code examples and illustrations.
Prometheus - CNCF project, used to monitor other systems or services. It collects metrics from the target at a given time interval, evaluates them according to rules, displays the results, and can also trigger alarms if certain monitoring conditions are met
An open-source, free search engine known for its excellent performance, ease of use, and simple deployment. It offers instant search experiences, supports multiple languages, and is suitable for projects of various scales. Whether it's a small website or a large enterprise-level application, Meilisearch can provide fast and reliable search functionality.
An easy-to-use web crawler software that provides a graphical interface for users to easily design and execute crawling tasks without writing complex codes. EasySpider offers simple and user-friendly tools to help users quickly scrape the data they need, and supports customized data and exportation, suitable for various crawling applications and data collection needs.
A comprehensive Linux command search tool that provides detailed command manuals, explanations, and learning resources. Suitable for users of all levels, from beginners to advanced users, it offers useful commands and tips, making it an ideal choice for mastering the Linux command line.
InfluxData - a scalable data storage written in go, used for metrics, events and real-time analysis
A cross-platform video download command line tool written in Go, supporting almost all video platforms such as TikTok, Bilibili, YouTube, etc., and can control the format, clarity and subtitles of the downloaded videos.
A selection of papers, technical articles and well-known blogs related to data science and machine learning, covering 24 technical directions such as data engineering, natural language processing, computer vision, reinforcement learning, etc. Most of the articles come from world-renowned universities and enterprises.
A vector database for next-generation AI applications. It provides efficient vector indexing and retrieval functions, supporting fast similarity search and relevance calculation, suitable for various AI application fields.
A big data platform specifically designed and optimized for industries such as the Internet of Things (IoT) and application monitoring. Its database insertion and query operations are 10 times faster than other databases! It also consumes very low costs compared to other typical solutions in this category. TDengine only requires less than 1/5 of computing resources, and it provides interfaces for development in Java, C/C++, Python, Go, RESTful API, etc. Are you still worried about the performance of data writing, reading, and computing? With it, your hair survival rate will definitely increase significantly.
Perplexica is an open-source, AI-powered search engine designed to deliver precise, up-to-date answers by leveraging advanced machine learning techniques like similarity searching and embeddings. It integrates with SearxNG to ensure privacy and real-time information retrieval. Key features include support for local LLMs (e.g., Llama3, Mixtral via Ollama), two search modes (Normal and Copilot), and six focus modes tailored for specific needs like academic research, YouTube, Reddit, and Wolfram Alpha queries. Perplexica offers an API for seamless integration into applications and supports Docker for easy installation. It prioritizes user privacy and provides cited sources for transparency, making it a versatile tool for enhanced web searching.
The GPT Researcher is an autonomous agent designed to conduct comprehensive online research on a variety of tasks. The agent can generate detailed, factual, and unbiased research reports, offering customized options that focus on relevant resources, outlines, and curricula. Inspired by AutoGPT and recent Plan-and-Solve papers, the GPT Researcher addresses issues of speed and determinacy by employing parallel agent operations (as opposed to synchronous operations), thereby delivering more stable performance and increased speed.
An open-source organization that provides C language implementations of various fundamental algorithms and data structures. The project includes sample code for basic algorithms, covering multiple programming languages, offering valuable resources for learning and understanding algorithms.
A developer-centric information aggregation platform that provides more than 350+ developer information sources and aggregates more than 10,000 technical tags, making it a good channel to get the latest development information.
A new generation of crawler and spider framework designed to provide efficient and flexible web crawling and data extraction capabilities. Katana supports various crawling strategies and data processing methods, enabling it to adapt to complex web structures and dynamic content. It is suitable for data collection, information retrieval, cybersecurity, and other fields, providing users with powerful crawling and analysis tools.
An open-source vector database that stores objects and vectors, allowing the combination of vector search with structured filtering, with the fault tolerance and scalability of cloud-native databases, all accessible via GraphQL, REST, and various language clients.
Through this tutorial, you will learn about the principles and applications of various technology stacks such as blockchain, web development, smart contracts, cryptography, NFTs, etc.
An educational program that is updated every week, mainly explaining the basic development skills of Web3, contract security, digital signature, time lock, etc. It aims to provide developers with practical knowledge about Solidity smart contract development.
Qbot is an AI-oriented quantitative investment platform designed to harness the potential of quantitative investing through AI technology. The platform offers a suite of tools and features that enable investors to utilize AI for data analysis, model construction, and trade execution, bringing greater intelligence and efficiency to the field of quantitative investment.
An open-source platform that integrates an embedded database, supports semantic search, LLM (large language model) orchestration, and language model workflows. By using embedding technology, txtai provides powerful text search and analysis capabilities, enabling developers to easily automate and optimize natural language processing tasks.
An integrated observability platform that combines the strengths of Prometheus and Grafana. The platform provides a comprehensive solution for alert management, metric visualization, logs, and tracing. Its powerful web UI design makes monitoring and data analysis more intuitive and efficient.
An open source meta search engine that provides users with a clean, ad-free Google meta search engine, focusing on privacy security and supporting hosting on private servers.
A highly flexible and configurable crawler platform that allows users to implement crawlers without writing code, using a flowchart.
Falcon - Xiaomi's enterprise-level, highly available and scalable open source monitoring solution
The Modern Web Application Development Kit is designed to help developers build modern web applications faster. It provides a complete set of component libraries, build tools, and best practices that enable developers to build user-friendly web applications in an efficient and maintainable manner. SUI offers rich features and flexible design options to help developers quickly start projects and provide excellent user experiences.
A smart web crawler script, its main function is to quickly and intelligently obtain data from a specified website. These data can be web page text, URL addresses or other HTML elements.
A platform for applications that need low-latency computation on large data sets. It stores and indexes your structured, text, and vector data so that queries, selections, and processing as well as machine learning model inference can be executed quickly at any scale within service time. Functionality can be customized and extended using application components hosted in Vespa.
Graphite - Graphite is a highly scalable real-time graphics system that runs well on inexpensive hardware
A full-text search engine based on Redis. It provides high-performance full-text search capabilities, supports complex queries and filters, and can seamlessly integrate into the existing Redis environment.
Screenshot offline OCR search translation picture search paste picture on screen screen recorder
A high-performance Java sensitive word filtering tool framework based on DFA algorithm, with 60,000+ sensitive word library, supporting sensitive word judgment, return, desensitization and other operations, with excellent performance, rich functions, simple use and other characteristics.
A tool for visualizing time series, which allows you to perform data analysis more intuitively by visualizing the data in the editor.
To protect personal data security, GitHub user ffffffff0x has compiled a set of solutions that integrate digital privacy collection, protection, and cleaning, as well as open source intelligence (OSINT) countermeasures.
A collection of some information about blockchain and cryptocurrency
Solidity Security: A Comprehensive List of Known Attack Methods and Common Defense Patterns, translated by the SlowMist Security Team
CrateDB - CrateDB is a distributed SQL database that makes it easy to store and analyze large amounts of machine data in real time
BigchainDB - BigchainDB is a blockchain database
A simple and powerful Python crawling framework. The usage is similar to Scrapy, with 3 built-in crawlers, supporting distributed, batch collection, data loss prevention, breakpoint resume, monitoring alarm, browser rendering download, etc.
An environment monitoring and regulation system that can run on a Raspberry Pi, supporting applications such as planting plants, cultivating microorganisms, maintaining the homeostasis of honey bee hives, incubating animals and eggs, and maintaining aquatic systems. The collected data can be monitored and visualized in a web interface.
lianjia-beike-spider - Real estate price crawler in major cities
"Getting Things Done with Pytorch" will teach you the basics of PyTorch, neural networks, image classification, face detection, sentiment analysis, and more.
An open-source personal search engine and web crawler that automatically crawls website text content, video subtitles and stores them after indexing website URLs. Then, users can quickly view the crawled content or access the source page of the website through search.
An open-source Python crawler script that can automatically extract data from HTML pages based on machine learning. After providing the crawler with output results as examples, it will automatically extract rules and crawl page data without specifying CSS selectors.
Infinispan - An open source data grid platform and highly scalable NoSQL cloud data store
A comprehensive collection of learning materials about Web3, covering the basics of Web3, applications and projects, related sharing bloggers, video tutorials, related books, development resources and tools, and also some job opportunities related to Web3.
A meaningful Dapp ethlance.com a blockchain-based freelancing platform
An open source, multi-functional GUI network security crawler tool designed for cybersecurity professionals. Currently supports Windows and Linux operating systems.
Time series related learning resources organization. It covers multiple common developer tools, visualization open source libraries, technical papers, open source tutorials and other contents.
A simple and powerful website analysis tool that can complete website analysis, performance testing, SEO optimization suggestions with one click, and export complete offline HTML analysis results for website analysis optimization.
Centreon - One of the most flexible and powerful monitoring software on the market