You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Whilst the same effect can be achieved via select, having the ability to drop is useful in certain cases.
Whilst looking into this I found out the Spark doe not support dropping multiple columns via col notation or similar and only allows dropping columns via string column names. It might be a nice addition to doric to have a function defined similar to the following:
defdrop(col: DoricColumn[_]*):DataFrame
Current behaviour
When trying to use the drop function with a doric column we get the following error:
Cannot resolve overloaded method 'drop`
The text was updated successfully, but these errors were encountered:
As mentioned, I'm not fully sure if this is functionality required in doric given we can achieve it with select. However if this is something you do feel will add value please let me know as I have the changes locally for both functions 😃
The idea is good, but the original logic of drop is that it never throws an error if the column doesn't exist. We can have an alternative version that checks if it exists and returns an error in case it doesn't.
Feature suggestion
The following functionality is not supported:
df.drop(colString("col1))
Whilst the same effect can be achieved via
select
, having the ability todrop
is useful in certain cases.Whilst looking into this I found out the Spark doe not support dropping multiple columns via
col
notation or similar and only allows dropping columns via string column names. It might be a nice addition to doric to have a function defined similar to the following:Current behaviour
When trying to use the
drop
function with a doric column we get the following error:The text was updated successfully, but these errors were encountered: