Skip to content

Releases: iris-hep/func_adl_servicex

Fixing how the backend uses data types

15 Feb 06:54
e707eb7
Compare
Choose a tag to compare

Highlights

  • The new ServiceX background is better about paying attention to the results-format tag - which was not being properly handled by the front-end stack. This fixes that up.
  • Small fixes to metadata, package version limits, etc.

What's Changed

Full Changelog: 2.1...2.2

Using file types properly

14 Feb 22:18
5692498
Compare
Choose a tag to compare
Pre-release

Fixing up how we propagate file types through the various layers. Should have no impact for anyone using this.

Getting AsParquetFiles to work correctly with the uproot backend

30 Oct 00:03
5589366
Compare
Choose a tag to compare

The main goal of this release is to make sure that AsParquetFiles has the right semantics and is compatible with the uproot transformer.

As servicex moves towards having more backend file flexibility, this interface may change (and generate some depreciated warnings). Note that best practices (which allows for most flexibility) is to rewrite something like this:

import pandas as pd
from func_adl_servicex import ServiceXSourceUpROOT

dataset_name = "data15_13TeV:data15_13TeV.00282784.physics_Main.deriv.DAOD_PHYSLITE.r9264_p3083_p4165_tid21568807_00"
src = ServiceXSourceUpROOT(dataset_name, "CollectionTree")
data = src.Select("lambda e: e['AnalysisJetsAuxDyn.pt']") \
    .AsParquetFiles('junk.parquet', ['JetPT']) \
    .value()
df = pd.read_parquet(data[0])
print(df)

as this:

import pandas as pd
from func_adl_servicex import ServiceXSourceUpROOT

dataset_name = "data15_13TeV:data15_13TeV.00282784.physics_Main.deriv.DAOD_PHYSLITE.r9264_p3083_p4165_tid21568807_00"
src = ServiceXSourceUpROOT(dataset_name, "CollectionTree")
data = src.Select("lambda e: {'JetPT': e['AnalysisJetsAuxDyn.pt']}") \
    .AsParquetFiles('junk.parquet') \
    .value()
df = pd.read_parquet(data[0])
print(df)

In short - use dictionaries in your query to label the columns that come back.

What's Changed

New Contributors

Full Changelog: 2.0...2.1

Uproot and AsParquetFiles interoperability

29 Oct 23:32
30e498c
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: 2.0...2.1b1

Typed Datasets, Local Executor

19 Apr 02:35
8d61cd1
Compare
Choose a tag to compare

This is a new release! Major improvements:

  • Datasets can be typed, allowing type checkers like pylance and mypy to follow types through the system. This should aid in the editing experience.
  • A local executor for xAOD's has been added.

What's Changed

Full Changelog: 1.1.3...2.0

Better Single Column Access

24 Mar 22:45
8d61cd1
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: 2.0b1...2.0b2

Typed Datasets, Local Executor

14 Mar 01:44
6682319
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: 1.1.3...2.0b1

Support Python 3.10

09 Dec 19:29
c19ad68
Compare
Choose a tag to compare

Add Python 3.10 support

Typed Datasets and MetaData

16 Oct 22:28
Compare
Choose a tag to compare
Pre-release
  • Typed datasets
  • Metadata can be sent down to the backend

Bug Fix: dealing with uproot column names backend

02 Sep 15:49
d64815b
Compare
Choose a tag to compare
  • Uproot transformer can't deal with explicit column names - so this code was removed. User might still mis-use this, and cause a crash...