Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TAXSIM-35 Validation, "a" files #2698

Merged
merged 20 commits into from
Nov 6, 2023

Conversation

jdebacker
Copy link
Member

@jdebacker jdebacker commented Oct 3, 2023

This PR adds the "expected" files for differences between Tax-Calculator and TAXSIM-35 for the "a" validation sample. This is the sample with the simplest returns.

We are looking for the differences between each to diff economically insignificant or explain through some difference in the two models.

The following years' files will be added here (and checked off below when differences are explained/resolved):

  • 2017
  • 2018
  • 2019
    • 2 obs with diffs for iitax of $196 -- seems to come from eitc diff (note, the max diff in the eitc comes from same record as max offs in mtr)
  • 2020
    • 133 obs with differing rrc (this may be due to TAXSIM-35 not counting the Jan/March 2021 RRC amounts in 2020)
    • 9 obs with differing eitc, up to 75.82
    • 62 obs with differing mtr_inctax
  • 2021
    • c11070 diff for 502 records - up to 12500
    • non_refundable_child_odep_credit diff for 172 obs - up to 4000 (does this relate rrc for jan 2021??)
    • 40 recs with diffs in mtr_inctax up to 80
    • 104 recs with diff iitax, up to 2500

cc @bodiyang

@bodiyang
Copy link
Contributor

bodiyang commented Oct 5, 2023

the 2019 'a' set: Tax Calculator is correct
2 obs with diffs for iitax of $196 -- seems to come from eitc diff

  • record 348: $0.01 diff in iitax ~ can be ignored (diff might come from rounding rules)

  • record 905: $192 diff in iitax ~ $192 diff in eitc
    Tax filler's age is 19, not eligible for EITC (childless tax filler's age must be between 25~65 to be eligible for EITC)
    EITC amount: Tax-Calculator $0; Taxsim $196
    Tax-Calculator should be right; Taxsim does not consider the EITC age cap

@bodiyang
Copy link
Contributor

bodiyang commented Oct 5, 2023

the 2020 'a' set:

records iitax diff mainly come from:

  • recovery rebate credit
    I have manually calculated the records with differences and Tax-Calculator should be correct. The reasons Taxsim showing different results vary
    ~ examples including: not counting qualifying children (id 7); taxsim do not differentiate single/head of household filing status (id 31); taxsim not counting EIP2 (if 33); taxsim counts wrong number of child (id 59)

  • eitc
    The EITC_ps_MarriedJ for the year 2020 was incorrect in Tax-Calculator, which causing the eitc differences.
    This is fixed in the PR 2699

  • mtr_inctax

@bodiyang
Copy link
Contributor

bodiyang commented Oct 11, 2023

the 2021 'a' set:

  • For year 2021, Child tax credit is categorized as nonrefundable child tax credit. So c11070 as the refunded Child tax credit is count as zero in Tax-Calculator. Taxsim35 calculates the amount of Child tax credit (it does not differentiate refundable vs nonrefundable credit)

@jdebacker
Copy link
Member Author

@bodiyang Thanks for documenting these known diffs in this issue. To keep track of these long-term, I've added a Differences_Explained.md file to this PR.

@bodiyang
Copy link
Contributor

bodiyang commented Nov 1, 2023

the 2021 'a' set showing no difference after the work to include other dependent credit into iitax calculation

@jdebacker I think this will conclude the validation work of 'a' set.

@jdebacker jdebacker marked this pull request as ready for review November 3, 2023 22:16
@jdebacker
Copy link
Member Author

@bodiyang Thanks for your help. I believe this PR is ready for review and to merge following that.

Copy link

codecov bot commented Nov 4, 2023

Codecov Report

Merging #2698 (dd979a0) into master (b1eb957) will not change coverage.
Report is 1 commits behind head on master.
The diff coverage is n/a.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #2698   +/-   ##
=======================================
  Coverage   98.54%   98.54%           
=======================================
  Files          14       14           
  Lines        2609     2609           
=======================================
  Hits         2571     2571           
  Misses         38       38           
Flag Coverage Δ
unittests 98.54% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

@jdebacker jdebacker merged commit 6798fba into PSLmodels:master Nov 6, 2023
11 checks passed
@jdebacker jdebacker deleted the taxsim_validation branch November 6, 2023 17:36
@bodiyang bodiyang mentioned this pull request Nov 30, 2023
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants