diff --git a/features/package.feature b/features/package.feature
index 4f9363721..8cda511c0 100644
--- a/features/package.feature
+++ b/features/package.feature
@@ -56,17 +56,3 @@ Feature: Manage WP-CLI packages
 
     When I run `wp --require=bad-command.php package list`
     Then STDERR should be empty
-
-  Scenario: Run package commands without hitting Composer plugin errors in Phar files
-    Given an empty directory
-    And a new Phar with the same version
-
-    When I run `{PHAR_PATH} package list`
-    Then STDERR should not contain:
-      """
-      failed to open stream
-      """
-    And STDERR should not contain:
-      """
-      is not a file in phar
-      """