piping to verbs is not passing the dataframe argument

[ftobin]

Piping into verbs like mutate seems to be broken in 0.9.0. Passing in the dataframe directly works, but still generates a warning.

>>> import datar.all
>>> import datar.datasets
>>> datar.datasets.mtcars >> datar.all.mutate(x = 3)
/home/bizdev/.pyenv/versions/3.9.13/lib/python3.9/site-packages/pipda/utils.py:68: VerbCallingCheckWarning: Failed to detect AST node calling `mutate`, assuming a normal call.
  warnings.warn(
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/bizdev/.pyenv/versions/3.9.13/lib/python3.9/site-packages/pipda/verb.py", line 216, in __call__
    raise TypeError(f"{self.__name__}() missing at least one argument.")
TypeError: mutate() missing at least one argument.
>>> datar.__version__
'0.9.0'
>>> import pipda
>>> pipda.__version__
'0.7.6'

>>> datar.all.mutate(datar.datasets.mtcars, x = 3)
/home/bizdev/.pyenv/versions/3.9.13/lib/python3.9/site-packages/pipda/utils.py:68: VerbCallingCheckWarning: Failed to detect AST node calling `mutate`, assuming a normal call.
  warnings.warn(
                          mpg     cyl      disp      hp      drat        wt      qsec      vs      am    gear    carb       x
                    <float64> <int64> <float64> <int64> <float64> <float64> <float64> <int64> <int64> <int64> <int64> <int64>
Mazda RX4                21.0       6     160.0     110      3.90     2.620     16.46       0       1       4       4       3
Mazda RX4 Wag            21.0       6     160.0     110      3.90     2.875     17.02       0       1       4       4       3

[pwwang]

Are you running in plain python REPL, instead of ipython/bpython?

[ftobin]

That was a plain repl.

[pwwang]

See: https://pwwang.github.io/datar/caveats/blind/

[ftobin]

It fails in a jupyter notebook too.

[ftobin]

Downgrading to 0.8.6 allows it to succeed in both environments.

Correction -- downgrading allows it to work in Jupyter. I understand it doesn't work in the plain repl.

[pwwang]

What does this print with 0.9.0 in your jupyter notebook?

from datar import get_versions

get_versions()

Also attach your jupyter version:

$ jupyter --version 

[ftobin]

           [GCC 10.2.0]
datar    : 0.9.0
numpy    : 1.21.6
pipda    : 0.7.6
executing: 1.1.0
pandas   : 1.3.5

Selected Jupyter core packages...
IPython          : 7.34.0
ipykernel        : 6.15.1
ipywidgets       : not installed
jupyter_client   : 7.3.4
jupyter_core     : 4.11.1
jupyter_server   : 1.18.1
jupyterlab       : 3.4.5
nbclient         : 0.6.7
nbconvert        : 7.0.0
nbformat         : 5.4.0
notebook         : 6.4.12
qtconsole        : not installed
traitlets        : 5.3.0

[pwwang]

And also your code that fails?

[ftobin]

import datar.all
import datar.datasets

datar.datasets.mtcars >> datar.all.mutate(x=3)

/home/bizdev/.pyenv/versions/3.7.13/lib/python3.7/site-packages/pipda/utils.py:71: VerbCallingCheckWarning: Failed to detect AST node calling `mutate`, assuming a normal call.
  VerbCallingCheckWarning,

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
/tmp/ipykernel_29360/1589615853.py in <module>
      2 import datar.datasets
      3 
----> 4 datar.datasets.mtcars >> datar.all.mutate(x=3)

~/.pyenv/versions/3.7.13/lib/python3.7/site-packages/pipda/verb.py in __call__(self, *args, **kwargs)
    214 
    215         if len(args) == 0:
--> 216             raise TypeError(f"{self.__name__}() missing at least one argument.")
    217 
    218         data, *args = args

TypeError: mutate() missing at least one argument.

[pwwang]

It works with my environment. Looks like the major difference is the IPython version. Mind upgrading it and see if it works?

python   : 3.9.10 | packaged by conda-forge | (main, Feb  1 2022, 21:24:11) 
           [GCC 9.4.0]
datar    : 0.9.0
numpy    : 1.23.2
pipda    : 0.7.6
executing: 1.0.0
pandas   : 1.4.3

Selected Jupyter core packages...
IPython          : 8.3.0
ipykernel        : 6.13.0
ipywidgets       : 7.7.0
jupyter_client   : 7.3.1
jupyter_core     : 4.11.1
jupyter_server   : 1.17.0
jupyterlab       : 3.4.2
nbclient         : 0.6.3
nbconvert        : 6.5.0
nbformat         : 5.4.0
notebook         : 6.4.11
qtconsole        : 5.3.0
traitlets        : 5.3.0

[ftobin]

Unfortunately the more recent ipython requires Python 3.8, and I'm stuck on 3.8 there for now.
I'll note that datar 0.8.6 works fine in this respect in Jupyter.

But I do have an alternate, up-to-date environment where this still fails:

python   : 3.9.13 (main, Aug 24 2022, 20:14:16) 
           [GCC 10.2.0]
datar    : 0.9.0
numpy    : 1.23.2
pipda    : 0.7.6
executing: 1.1.0
pandas   : 1.4.3

IPython          : 8.5.0
ipykernel        : 6.15.1
ipywidgets       : not installed
jupyter_client   : 7.3.4
jupyter_core     : 4.11.1
jupyter_server   : 1.18.1
jupyterlab       : 3.4.5
nbclient         : 0.6.7
nbconvert        : 7.0.0
nbformat         : 5.4.0
notebook         : 6.4.12
qtconsole        : not installed
traitlets        : 5.3.0

In [1]: import datar.all

In [2]: import datar.datasets

In [3]: datar.datasets.mtcars >> datar.all.mutate(x=3)
/home/bizdev/.pyenv/versions/3.9.13/lib/python3.9/site-packages/pipda/utils.py:68: VerbCallingCheckWarning: Failed to detect AST node calling `mutate`, assuming a normal call.
  warnings.warn(
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In [3], line 1
----> 1 datar.datasets.mtcars >> datar.all.mutate(x=3)

File ~/.pyenv/versions/3.9.13/lib/python3.9/site-packages/pipda/verb.py:216, in Verb.__call__(self, *args, **kwargs)
    213     return VerbCall(self, *args, **kwargs)
    215 if len(args) == 0:
--> 216     raise TypeError(f"{self.__name__}() missing at least one argument.")
    218 data, *args = args
    219 if has_expr(data):

TypeError: mutate() missing at least one argument.

[pwwang]

How about switching executing to 1.0.0

$ pip install executing==1.0.0

[ftobin]

That works!

[pwwang]

Great!
I will submit an issue to executing.

[pwwang]

Fixed at v0.9.1