Skip to content

Comments

Remove deprecated APIs up to 0.12.#3331

Merged
rdblue merged 4 commits intoapache:masterfrom
flyrain:remove-deprecated-apis
Oct 21, 2021
Merged

Remove deprecated APIs up to 0.12.#3331
rdblue merged 4 commits intoapache:masterfrom
flyrain:remove-deprecated-apis

Conversation

@flyrain
Copy link
Contributor

@flyrain flyrain commented Oct 20, 2021

Remove all deprecated APIs which are supposed to removed up to release 0.12.

cc @aokolnychyi, @rdblue, @jackye1995, @RussellSpitzer, @karuppayya, @szehon-ho

this.nullValueCounts = nullValueCounts;
}

public Metrics(Long rowCount,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like this one wasn't deprecated.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's add more deprecations in a separate commit though.

.addFile(FILE_DAY_2_MODIFIED)
.validateNoConflictingAppends(baseSnapshot.snapshotId(), EXPRESSION_DAY_2)
.validateFromSnapshot(baseSnapshot.snapshotId())
.validateNoConflictingAppends(EXPRESSION_DAY_2)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think validateNoConflictingAppends has been deprecated as well.
We should use conflictDetectionFilter and validateNoConflictingData.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed it.

@aokolnychyi
Copy link
Contributor

This looks mostly good to me. The only question is the removed constructor in Metrics that wasn't deprecated.

Also, we missed a few methods in HadoopCatalog and HiveCatalog.

@aokolnychyi
Copy link
Contributor

We should also cover OutputFileFactory.

@flyrain
Copy link
Contributor Author

flyrain commented Oct 21, 2021

Thanks @aokolnychyi for the review. I will remove the deprecated methods in 0.13 in a follow-up PR.

@RussellSpitzer
Copy link
Member

@flyrain While we are at it you may want to remove TestNewRewriteAction for Spark 2 since it is currently dead code

@flyrain
Copy link
Contributor Author

flyrain commented Oct 21, 2021

@RussellSpitzer, we may remove TestNewRewriteAction in another PR since this one is for removing deprecated APIs.

* @deprecated this will be removed in 0.11.0; use {@link #visit(PartitionSpec, PartitionSpecVisitor)} instead.
*/
@Deprecated
static <R> List<R> visit(Schema schema, PartitionSpec spec, PartitionSpecVisitor<R> visitor) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. It is a little odd that we deprecated this method but still used it in the recommended alternative.

@rdblue rdblue merged commit 4ea8663 into apache:master Oct 21, 2021
@rdblue
Copy link
Contributor

rdblue commented Oct 21, 2021

Thanks, @flyrain!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants