2021-07-27 Node Experience Team Update

[janewang]

Brief Summary

This week, the Node Experience team released Nearcore 1.20.0 and made improvements on pytests, rust tests, Nightly builds, and is in progress with a number of improvements and optimization on Nayduck. The team continues working on fuzzing the entire runtime and will eventually add fuzzing to nightly. On product, the team is interviewing ecosystem stakeholders on RPC and is working on creating pipelines for Block Producers and Chunk-Only Producers.

---

Node Experience team project board: https://github.com/orgs/near/projects/18
Attended: @mina86 @nikurt @posvyatokum @bowenwang1996 @janewang

Done

• @mina86 added a commit hook from pytests which compares tests in Nightly and all non-ignored tests, and checks if all pytests are listed in the Nightly directory file. The hook is added to the CI. add a commit hook which compare tests in Nightly and all non-ignored tests nearcore#2736
• @mina86 fixed Nightly builds by not compiling the packages that cause the tests to fail. The packages not needed are excluded. Nayduck nightly build is broken Near-One/nayduck#3
• @nikurt moved standard_test_cases out of test_utils in integration testes to isolate dependencies. Move standard_test_cases out of test_utils nearcore#4470
• @bowenwang1996 released Nearcore 1.20.0 this Monday and the release went well
• @janewang and @bowenwang1996 presented NodeX and Protocol progress in a biweekly product call
• @janewang has completed RPC interviews with Trust Wallet and Flux

In Progress

• @mina86 continues working on the Nayduck transition, and is moving Nayduck from Azure to GCP to make monitoring and integration simpler. NayDuck maintanance handoff to NodeX team and related code changes Near-One/nayduck#1
• @mina86 is optimizing a number of SQL queries and has lowered CPU utilization for Nayduck. He has added more validation on the requests to our servers to enhance security, and made improvements to SQL schema Review and optimise SQL queries Near-One/nayduck#7
• @mina86 is changing on how Nayduck tests are scheduled. Previously, every commit causes Nayduck to run all tests and we should run all tests only Nightly. Switch NayDuck to run nightly tests Near-One/nayduck#8
• @nikurt is working on removing circular dependencies for rust tests. Consider removing circular dependencies during tests nearcore#4357
• @nikurt is working on load test for betanet. near/near-ops#556
• @posvyatokum continues working on fuzzing and has submitted a PR on fuzzing function calls. Eventually would like to move the fuzzing into Nightly. Fuzzing the entire runtime nearcore#4374
• @posvyatokum is separating genesis config from protocol config to avoid unintended changes to genesis hash GenesisConfig should be separated from protocol config nearcore#4447
• @posvyatokum is preparing to be on call during call rotation
• @janewang continues to interview with ecosystem stakeholders on RPC, and is coordinating with other teams on the RPC service which currently has product board: https://github.com/orgs/near/projects/24
• @janewang is working on Block Producer pipeline and Chunk-Only Producer pipeline with Open Shards Alliance community lead

Upcoming

• Zoom cross team get-together this Friday with the Node Interfaces 🎈