Gaoding Technology Saves 60% Of Storage Cost Used By Elasticsearch

We use Elasticsearch (ES) as the log query component. With the growth of business volume, there are about 2T of new data every day, which needs to be stored for 15-30 days, which puts a lot of pressure on the disk and the system. In order to ensure the performance of log writing and query in ES, we use high-performance cloud disks with higher unit storage costs. However, in actual business scenarios, data older than 7 days is only used for low frequency, and all data stored in high-performance cloud disks will inevitably lead to excessive costs and waste of space.......

Shopee x JuiceFS: ClickHouse Cold and Hot Data Separation Storage Architecture and Practice

Shopee ClickHouse is a highly available distributed analytical database based on the open source database ClickHouse for secondary development and architectural evolution. This article will focus on Shopee ClickHouse’s hot and cold storage architecture and the practices that support the company’s business.......

JuiceFS v0.17 is released, passed 1270 LTP tests!

Hello everyone, JuiceFS v0.17 was released as scheduled. This is the second version we launched in the fall of 2021. Let’s go straight to see what new changes are there. There are 9 users from JuiceFS community contributed 80+ commits for this update on GitHub. Here, we sincerely thank them for their contributions. At the same time, welcome you to join our open source community to contribute code, documents or discuss ideas. Passed LTP 1270 tests, the compatibility under Linux system is more perfect The new version of JuiceFS has been further optimized for the Linux system, supporting more flags of rename and setxattr syscalls, and successfully passed 1270 tests of LTP.......

JuiceFS v0.16 is released, supporting TiKV metadata engine!

After a month of development, JuiceFS brings the first new version v0.16 in the fall of 2021. This update involves 11 changes, fixes 16 bugs, and adds 6 new features. With the eager anticipation of community users, JucieFS officially opened TiKV database as a metadata engine support. It is worth mentioning that the implementation of TiKV as a metadata engine is derived from the PingCAP 2rd Hacking Camp activity. In more than a month, the JuiceFS team worked closely with community users to successfully implement support for the TiKV database. TiKV Metadata Engine TiKV is a key-value database that supports distributed transactions.......

JuiceFS x TiKV: PingCAP 2rd Hacking Camp is waiting for you!

TiDB Hacking Camp is a long-term incubation event organized by PingCAP in cooperation with Jingwei China and co-organized with many partners. It is held 1-3 sessions every year. The event, in conjunction with TiDB’s ecological partners and cooperative enterprises, aims to help the TiDB ecological project obtain more resources and help from the community, so that it can quickly grow to a mature stage with practical application scenarios. This session of Hacking Camp is starting from 2021.07 to 2021.10. With the topic of ecology, PingCAP and senior R&D experts are invited to assist the project team in formulating a reasonable R&D plan and business direction, and jointly promote the implementation of the project.......