Whether as developers or architects, we all deal with software systems all the time, and architecture is one of the most frequently used terms at work. So, what exactly is architecture? You may or may not have your own answer. The understanding of “architecture” requires us to constantly think, summarize, and deduce in practice to […]
I believe that many people are not clear about the process of https, but only know that https is securely encrypted, and the principle and process behind it are not clear. The author used to be not clear about the process of https, and I had a little understanding, and the most annoying thing is
This article collects some cases that are very easy to step on the pit in the process of using Go. All cases have specific code examples and targeted code repair methods to avoid stepping on the pit again. Usually, the characteristics of these pits are that the code can be compiled normally, but the running
Daily blog | Summary of Go language hiding experience Read More »
With the continuous development of technology, more and more technical frameworks have emerged in the field of big data. In order to reduce the learning cost and difficulty of big data, more and more big data technologies and applications begin to support SQL for data query. SQL is a language with low learning cost, and
The kernel programmability brought by eBPF technology can create some “wormholes” in the original long forwarding path, so that packets can quickly reach their destinations. For the container network scenario, we can use eBPF to bypass subsystems such as bridge and netfilter to speed up packet forwarding. #Daily #Blog #eBPF #technology #practice #Accelerate #container #network
Introduction: StateBackend is the cornerstone of Flink’s ability to provide state upwards, and its performance will seriously affect the throughput of tasks. This sharing mainly introduces the related optimizations that improve performance by providing a general cache layer for StateBackend inside ByteDance. #Daily #Blog #ByteDance #Flink #StateBackend #Performance #Improvement #Road
Daily Blog | ByteDance Flink StateBackend Performance Improvement Road Read More »
The front-end has achieved an engineering system upgrade through the development of Babel and other compilation technologies. How to further enable front-end development through compilation technology? Perhaps our wepy to uniapp compilation conversion practice can give you inspiration. #Daily #blog #wepy #uniapp #Metamorphosis
The first is an overview of the feature platform. The entire feature platform is divided into four layers, namely data services, storage services, computing engines, and raw storage. The data service layer provides external services, mainly including four types: #Daily #blog #Construction #application #feature #platform #Shuhe
Daily blog | Construction and application of feature platform in Shuhe Read More »
With the further development of big data, both offline tasks and real-time tasks are becoming more and more, and the requirements for the scheduling system are getting higher and higher. #Daily #blog #Apache #Dolphinschedulers #landing #practice #field #fresh #food #ecommerce
Common distributed transaction solutions such as 2pc/3pc, tcc, saga, etc. are common on the market, but the actual implementation of the framework is relatively heavy, the design and development are relatively cumbersome, and it is not easy to develop quickly. This paper provides a simple and easy-to-use distributed transaction design scheme based on flexible transaction
Risk-driven delivery is a very important research direction in Baidu’s practical intelligence test – perception intelligence stage. This article first introduces the first part: Baidu search business delivery unattended practice and exploration. #Daily #Blog #Unattended #Practice #Exploration #Baidu #Search #Business #Delivery
Daily Blog | Unattended Practice and Exploration of Baidu Search Business Delivery Read More »
The storage of the previous generation log platform of Dewu mainly relied on ES. With the rapid development of the company’s business, log scenarios have gradually created some new requirements, mainly in the following: the number of applications is gradually increasing, more logs need to be printed for R&D to locate business problems, and logs
Daily Blog | ClickHouse Separation of Hot and Cold Storage in Dewu Practice Read More »
ID is used very frequently in our development work and in our daily life. Almost as long as it is in development, we will deal with it every day. Its application scenarios are very wide, such as: ID card number, order number generated by placing an order, and purchased joint member products. redemption code. #Daily
In big data scenarios, data shuffle represents the process of data exchange in different partitions, and the performance of shuffle often becomes the performance bottleneck of jobs or even the entire cluster. Especially in the scenario where ByteDance has hundreds of PB Shuffle data every day, the shuffle process exposes many problems. This article will
Daily Blog | Application Practice of Cloud Shuffle Service in ByteDance Spark Scenario Read More »
