v3.1

What's Changed

• k8s pipeline by @fjammes in #697
• Update pixel table by @JulienPeloton in #717
• [Hbase] Push data incrementally in science_archival by @JulienPeloton in #721
• 698 k8s create a noscience pipeline by @fjammes in #718
• Bump dependencies by @JulienPeloton in #725
• Use schema converter from fink_utils by @JulienPeloton in #726
• HBase table for TNS object by @JulienPeloton in #728
• Update arguments for rfscore_sigmoid_elasticc by @JulienPeloton in #732
• Add local alerts by @JulienPeloton in #735
• Shift integration tests in k8s by @JulienPeloton in #737
• Add filter for area-restricted anomalies by @JulienPeloton in #740
• Add support for self-hosted runner in CI by @fjammes in #738

Full Changelog: 3.0...v3.1

3.0

What's Changed

• Externalise schemas for the CI by @JulienPeloton in #677
• Add a new function to select only relevant columns when pushing to HBase by @JulienPeloton in #678
• Clean repo by @JulienPeloton in #680
• Build fink-broker image from fink-broker repository by @fjammes in #675
• New filter targeting the Gravitation category in SIMBAD by @JulienPeloton in #687
• Update README by @JulienPeloton in #690
• [WIP] Resolve Kafka failure by @JulienPeloton in #693
• Anomaly detection filter by @JulienPeloton in #696
• Install fink-science from URL by @JulienPeloton in #702
• New arg for the feature extraction module by @JulienPeloton in #706
• Revert feature extraction by @JulienPeloton in #709
• Push anomaly candidates to HBase by @JulienPeloton in #707
• Put fink-FAT operations at the end by @JulienPeloton in #711
• Update the constructor for feature extraction by @JulienPeloton in #714
• Elasticc round two! by @JulienPeloton in #705

New Contributors

• @fjammes made their first contribution in #675

Full Changelog: 2.9...3.0

2.9

What's Changed

• [Kafka] Attach the schema to the payload, in the key by @JulienPeloton in #670
• Update columns to push to HBase tables by @JulienPeloton in #673

Full Changelog: 2.8...2.9

2.8

What's Changed

• Update the path to the simulator by @JulienPeloton in #663
• SNAD processor and anomaly detection by @VoidDruid in #554
• Add crossmatch with 4LAC and 3HSP by @JulienPeloton in #666
• Add T2 layer by @JulienPeloton in #667
• Add mangrove xmatch (and fix t2 syntax) by @JulienPeloton in #668

New Contributors

• @VoidDruid made their first contribution in #554

Full Changelog: 2.7.1...2.8

2.7.1

What's Changed

• online & offline GRB module to join streams by @JulienPeloton in #656
• New connection to ZTF by @JulienPeloton in #658
• Update AGN path by @JulienPeloton in #660

Full Changelog: 2.7...2.7.1

2.7

What's Changed

• Rename fink-fat index column by @JulienPeloton in #648
• [Elasticc] various updates by @JulienPeloton in #651
• [stream2raw] Parametrise the producer by @JulienPeloton in #654

Full Changelog: 2.4...2.7

2.5

What's Changed

• Add new fields when ingesting to hBase by @JulienPeloton in #631
• [Elasticc] Fix the column name by @JulienPeloton in #633
• Bump pyarrow from 0.14.1 to 0.15.1 by @dependabot in #636
• Fix timezone, and date format for elasticc by @JulienPeloton in #637
• Add modules for elastic (fink-science 3.0.0) by @JulienPeloton in #640
• Deploy EarlySN and T2 for elasticc (dummy) by @JulienPeloton in #643
• [Elasticc] various updates by @JulienPeloton in #645
• Change the way binary classifiers are decoded in elasticc by @JulienPeloton in #646

New Contributors

• @dependabot made their first contribution in #636

Full Changelog: 2.2...2.5

2.2

What's Changed

• Bump to 2.1 by @JulienPeloton in #589
• Remove temp files at the end of the database operations by @JulienPeloton in #591
• Add the new filter on YSO by @JulienPeloton in #595
• Stop the broker at 5pm Paris Time (4pm UTC) by @JulienPeloton in #598
• Fix the index for the TNS table to avoid overwriting cells by @JulienPeloton in #599
• Process streams from ELAsTICC by @JulienPeloton in #597
• [Bug] Fix wrong slicing when correlating with TNS catalog by @JulienPeloton in #601
• [Bug] Fix the healpix tables generation by adding a reference to the objectId in the index by @JulienPeloton in #602
• Fink-FAT: scheduler extension by @FusRoman in #605
• Update the conf file for fink-fat by @JulienPeloton in #609
• [HBase] new index tables for SSO candidates by @JulienPeloton in #611
• Fix reader syntax for recent versions of fastavro by @JulienPeloton in #617
• [HBase] refactoring by @JulienPeloton in #614
• [Elasticc] smoother processing by @JulienPeloton in #628

New Contributors

• @FusRoman made their first contribution in #605

Full Changelog: 2.1...2.2

2.1

What's Changed

• Schedule the CI every day-of-week at 5 UTC by @JulienPeloton in #584
• Remove old reference to fink_filters and use fink_utils by @JulienPeloton in #586
• [Prod] Spark 2 to Spark 3 by @JulienPeloton in #588

Full Changelog: 2.0...2.1

2.0

What's Changed

• Fix broken dependencies to install package from source (git protocol on port 9418 is no longer supported) by @JulienPeloton in #525
• Data partitioning by @JulienPeloton in #528
• Remove unecessary re-computation of roid by @JulienPeloton in #534
• Remove mention of knscore by @JulienPeloton in #533
• Add tracklet computation when re-computing science data by @JulienPeloton in #535
• [Stats] Do not cache df_raw by @JulienPeloton in #538
• Use direct filtering for quality cuts instead of Pandas UDF by @JulienPeloton in #540
• Force partitioning when doing bulk processing by @JulienPeloton in #544
• Allow prefixing the Kafka substreams by @JulienPeloton in #550
• Deploy microlensing and slope-based KN substreams. by @JulienPeloton in #552
• Add installation for astronet (private dependency) by @JulienPeloton in #558
• Fix typos when pushing candidates to TNS by @JulienPeloton in #562
• Allow deps cache for the test suite by @JulienPeloton in #561
• Test tracklet ingestion in the database by @JulienPeloton in #563
• Clean unused code & files by @JulienPeloton in #566
• Upgrade to Spark 3 by @JulienPeloton in #564

Full Changelog: 1.4...2.0