2022-03-14 - KDB Project Call Meeting Minutes

[alvin-c-shih]

Date

Monday, March 14th, 2022 - 9:30am ET / 1:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
Aaron Davies	Morgan Stanley	@adavies42
Jo Shinonome	Squarepoint Capital	@jshinonome
Peter Gyorok	Morgan Stanley	@gyorokpeter
James McLeod	FINOS	@mcleo-d

Meeting notices

• FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.

• All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.

• FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.

• FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

• (5 min) Convene, roll call, welcome new people.

• Display FINOS Antitrust Policy summary slide

• Review Meeting Notices (see above)

• (5 min) Approve previous meeting minutes.

  • Approved by acclamation.

• (5 min) Kdb Boothroyd onboarding updates?

  • Found a SecArch person in Hungary who might be able to help move things forward.

• (5 min) Kdb Studio updates:

  • Large PRs to integrate features from the original FINOS fork onto the dzmipt branch is complete and ready to merge.
    • reapply changes: replace icons kdb-studio#74
    • Reapply kdb-studio#75
  • RSyntaxTextArea widget defaults to a tab width of 5?!?
    • Development underway for spaces instead of tabs with a default of 4.
    • add settings to change the tab size and usage of tab vs space characters kdb-studio#85
  • Some internal wrangling over chart legends happening.
  • Enthusiasm for the combined kdb Studio features when it was accidentally shown in a training class.

• (5 min) FINOS Updates:

  • Anyone interested in staying on top of security as it pertains to open source is welcome to join the Open Source Security Foundation (OpenSSF) hosted by the Linux Foundation.
    • https://linuxfoundation.org/press-release/industry-wide-initiative-to-support-open-source-security-gains-new-commitments/
    • Would be nice if SecArch reviewers at banks could contribute time to reviewing Open Source.
      • But they tend to be overscheduled in their day jobs as it is.
  • FINOS has discretionary funding to accelerate open source projects of high importance.

• (5 min) dep.q updates:

  • Updates to allow it to work on Windows.
    • further fixes for Windows #68
  • Support for qproject.json file.
    • https://github.com/finos/kdb/tree/main/q/dep/README.md
  • kdb 4.0 makes dep.q easier to work with.
    • Can see \l commands on the call stack.
  • Getting a q license for automated testing would be nice.
  • Could start releasing C plugins for q if we see uptake of dep.q.
    • Collaboration on HDB maintenance tools built atop dep.q is another possibility.

• (5 min) Any Perspective-related use cases that people would put time into?

  • vscode-q already integrates Perspective!
    • https://github.com/jshinonome/vscode-q/blob/master/assets/query-view/index.html
    • https://github.com/jshinonome/vscode-q/tree/master/assets/query-view/js
    • Would be nice to demo this to the Perspective and Boothroyd maintainers.
  • Kx Dashboards tries to minimize translation until data goes to video memory.
    • That said, can still take a few seconds to render two billion dots.
  • Would be interesting to see how much faster a WebAssembly implementation of c.js might be.

• (10 min) Anomaly detection package for data quality checks:

  • ML utilities that might be put towards that: https://code.kx.com/q/ml/
  • Lower frequency checks could be:
    • hourly down to 5 minutes
    • post-load hook
  • Higher frequency plants have alerting systems based on:
    • periodic queries to gateway
    • symbol must have specific number of rows
    • minimum row counts for tables

• (5 min) AOB, Q&A, Adjourn.

  • Client API for Go: https://github.com/jshinonome/geek
    • Implemented with load balancing in mind.
  • Morgan Stanley has load older balancers in Erlang and C++.

WebEx info

Webex

• https://finos.webex.com/finos/j.php?MTID=me61719ca3c3295a7cc76762d78392bc3

Dial-in and Project Materials

• US: +1-415-655-0003 US Toll
• UK: +44-20319-88141 UK Toll
• Access code: 2704 417 0390
• GitHub Repos:
  • https://github.com/finos/kdb
  • https://github.com/finos/kdb-studio
• Wiki Page:
  • https://finosfoundation.atlassian.net/wiki/spaces/DT/pages/329383945/kdb+Project
• KDB Metrics on FINOS
  • https://metrics.finos.org/goto/033b15c80f0d08cab70f40f4358932f6

[adavies42]

hi

[gyorokpeter]

hi

[mcleo-d]

Hi 😹

[jshinonome]

hi 🦊

[alvin-c-shih]

Yo!

[mcleo-d]

@jshinonome referenced Perspective being integrated into vscode-q.

https://github.com/jshinonome/vscode-q

[jshinonome]

https://github.com/jshinonome/vscode-q/blob/master/assets/query-view/index.html
https://github.com/jshinonome/vscode-q/tree/master/assets/query-view/js

[mcleo-d]

Hi @alvin-c-shih - Can we add @jshinonome and Perspective integration into https://github.com/jshinonome/vscode-q to the next agenda? I'll send ideas over Symphony.