2021-10-11 - KDB Project Call Meeting Minutes

[alvin-c-shih]

Date

Monday, October 11th, 2021 - 9:30am EST / 2:30pm BST

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
James McLeod	FINOS	@mcleo-d
Peter Gyorok	Morgan Stanley	@gyorokpeter
Jonathon McMurray	AquaQ Analytics	@jonathonmcmurray
Alvin Shih	Morgan Stanley	@alvin-c-shih
Gary Davies	AquaQ Analytics	@drgdavies
Colin Eberhardt	Scott Logic	@ColinEberhardt
Dmitry Zakharov	Deutsche Bank	@dzmipt
Aaron Davies	Morgan Stanley	@adavies42
Jonny Press	AquaQ Analytics	@jonnypress

Meeting notices

• FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.

• All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.

• FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.

• FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

• (5 min) Convene, roll call, welcome new people.
• Display FINOS Antitrust Policy summary slide
• Review Meeting Notices (see above)
• (5 min) Approve previous meeting minutes.
  • Approved by acclamation.
• (10 min) Kdb Boothroyd updates?
  • A few bug fixes.
  • Main things to prioritize for adoption by enterprise users:
    • pluggable authentication
    • disabling auto update (all open source code has to to through scanning for vulnerabilities / open source licensing)
    • have a default server rather than opening server selection box
  • Boothroyd team will provide a way to make it easy to disable auto-update.
  • Some differing requirements for pluggable authentication.
    • For enterprise users, would be best to configure at build / packaging time (using webpack).
    • For casual users, more flexible if one can drop plugins into a directory.
    • One possibility is a build-specific project with Boothroyd as a submodule.
  • Auto-updates / telemetry becoming a bigger sore point in some environments.
    • For example VSCodium is a repackaging of the core of VSCode, but without telemetry.
  • Still some discussions taking place with Morgan Stanley build tooling team to make it easier to release Boothroyd internally.
• (10 min) Findings on trying to get dzmipt fork of kdbStudio to build under FINOS tooling and within Morgan Stanley.
  • https://github.com/dzmipt/kdbStudio
  • FINOS fork was refactored and files got moved around.
    • Will reach out to the developer who worked on that part and see about getting in touch with dzmipt fork maintainer.
    • dzmipt fork built using Gradle / Maven / POM which can't be used in some enterprise environments.
    • Try to get time to investigate alternative build that works with Arifactory (the lattering being for libraries and not apps).
• (10 min) Anaconda for q packages
  • AquaQ experience with releasing q libraries on Anaconda.
  • Sounded like it was relatively straightforward : YAML config + shell script.
  • Based on qutil loader by Dan Nugent.
  • Needs a wrapper script for q to set up environment variables pointing to the library root and QINIT.
  • Anaconda not officially supported in some enterprise environments.
    • Integration with code scanning would be required.
    • Since Anaconda is well-established, will investigate further.
  • Alternative package repositories by abusing npm / PyPi?
    • Anaconda installer is very heavy and modifies the prompt.
    • Most q users not using Anaconda?
  • See what tweaks required to dep.q to work with packages downloaded from Anaconda.
    • Hoping we can stay with dep.q as FINOS module loader as it's written in a way that makes it easier to contribute more modules out of Morgan Stanley.
    • Example of dep.q usage in unzip.q:
      • https://github.com/adavies42/kdb/blob/feature/unzip/q/unzip/unzip.q
• (5 min) cla-present tag.
  • https://github.com/finos/kdb-studio/pulls?q=is%3Apr+is%3Aclosed
  • Not very useful on PRs when every PR has that tag.
    • Can it be gotten rid of / moved to the end?
  • FINOS migrating off their CLA-bot to Linux Foundation EZ CLA.
    • Revisit after that's taken place.
• (5 min) Participation
  • Any other kdb developers who might be looped in?
  • Participants of FINOS kdb Project encouraged to go to upcoming FINOS OSSF events and spread the word.
    • Colin and Peter did that at London OSSF.
    • Though attendance isn't what it was pre-COVID.
    • https://events.linuxfoundation.org/open-source-strategy-forum-new-york/
• (5 min) AOB, Q&A, Adjourn.
• Experimental library that parses a DSL for specifying binary protocols:
  • https://github.com/gyorokpeter/qbinparse
  • Might be useful for messaging interop or writing PNG files.

Decisions Made

• Decision 1
• Decision 2
• ...

Action Items

• Action 1
• Action 2
• ...

WebEx info

Webex

• https://finos.webex.com/finos/j.php?MTID=me61719ca3c3295a7cc76762d78392bc3

Dial-in and Project Materials

• US: +1-415-655-0003 US Toll
• UK: +44-20319-88141 UK Toll
• Access code: 2704 417 0390
• GitHub Repos:
  • https://github.com/finos/kdb
  • https://github.com/finos/kdb-studio
• Wiki Page:
  • https://finosfoundation.atlassian.net/wiki/spaces/DT/pages/329383945/kdb+Project
• KDB Metrics on FINOS
  • https://metrics.finos.org/goto/033b15c80f0d08cab70f40f4358932f6

[gyorokpeter]

hi

[alvin-c-shih]

Howdy!

[jonathonmcmurray]

hi

[mcleo-d]

Hello 👋🏻

[adavies42]

hi

[ColinEberhardt]

hi

[dzmipt]

hi

[jonnypress]

Hi

[mcleo-d]

Linked shared in the KDB project meeting ...

• https://github.com/gyorokpeter/qbinparse
• https://github.com/adavies42/kdb/blob/feature/unzip/q/unzip/unzip.q
• https://github.com/gyorokpeter/qbinparse/blob/master/examples.q

[jonnypress]

Sorry I joined late and now I have to drop...

[mcleo-d]

@alvin-c-shih to explore KDB and KDB Studio at FINOS Member Meeting and OSSF in NYC ... https://events.linuxfoundation.org/open-source-strategy-forum-new-york/