Skip to content
This repository has been archived by the owner on Nov 10, 2020. It is now read-only.

Explore > Jobs: numbers are off #1092

Closed
meiqimichelle opened this issue Dec 11, 2015 · 24 comments
Closed

Explore > Jobs: numbers are off #1092

meiqimichelle opened this issue Dec 11, 2015 · 24 comments
Labels
data-mgmt Use this label for adding and/or updating data on the site. Also can be used for data management too

Comments

@meiqimichelle
Copy link
Contributor

Our numbers aren't matching up. @Isabelle1512 reviewed this page in the past and life was good, but it looks like we introduced a regression and our numbers aren't correct anymore. Isabelle, can you list what numbers we should expect to see on this viz? Thank you!

@meiqimichelle meiqimichelle added this to the Sprint-DapperYeti milestone Dec 11, 2015
@shawnbot shawnbot added the data-mgmt Use this label for adding and/or updating data on the site. Also can be used for data management too label Dec 11, 2015
@shawnbot
Copy link
Contributor

Boooooooo!

@meiqimichelle
Copy link
Contributor Author

I think Isabelle is out for a little bit. This is the latest info I have:

Me:
Question -- the summary says for wage and salary around 800k people, and thousands of self-employed. Our data page seems to say ~730k jobs, and 1.6m self-employed.

What do you think about the wage/salary numbers? And I'm thinking the self-employed problem is just a order-of-magitude problem.

Isabelle:
Yes on the order of magnitude looking at the other questions now...
Let me look at your data page...I did check Shawn's numbers and they were right...
ah - ok. For self-employed, I had closer to 800 K (similarly to wage and salary...)

@Isabelle1512
Copy link

Hi I'm here! I'm looking!

@Isabelle1512
Copy link

Ah 1.65 million is self-employed + wage and salary employment

@Isabelle1512
Copy link

You likely have SA25N which is good. Now you just need to subtract SA27N from it to get a "self-employed" total. I'm not looking at Shawn's data, just going on messages for now. I'll try and revisit the data and give you some sample numbers.

@Isabelle1512
Copy link

For the U.S., I'd expect 797,000 (in the exec sum, it's 799,000, but this is from a data release before they updated it in November, so don't worry about that discrepancy); for Alabama, I'd expect 5,672. For Alaska, I'd expect 4,271. This is just for self-employment, not total employment or wage and salary employment.

@Isabelle1512
Copy link

And yes, looked at site and numbers for "self-employment" seem to be for all employment.

Best,

Isabelle

@meiqimichelle
Copy link
Contributor Author

@Isabelle1512 do the numbers look accurate for wage and salary then?

@Isabelle1512
Copy link

They look ball park but slightly off. If I download data from BLS for NAICS 21 (you may or may not be also adding renewables, but those are just a few thousand) - I would expect 289,610 for texas (not including renewables). I gave Shawn a bunch of codes, but that was mostly because we said we'd break out jobs by commodity. If we aren't breaking out jobs by commodity, then to get totals you just need NAICS 21 plus the renewable codes which all start with 22. Off to a meeting, will log on later tonight.

@shawnbot
Copy link
Contributor

Ah ok, I forgot to include the NAICS 22 jobs in the BEA data. So that's first on my list.

@shawnbot
Copy link
Contributor

Okay so, based on the Texas figure at least, I think wage and salary numbers are right now. @Isabelle1512 can you check out this preview link and/or send me the spreadsheet that you're referencing so I can check them on my end?

shawnbot pushed a commit that referenced this issue Dec 14, 2015
@shawnbot
Copy link
Contributor

@Isabelle1512 I think I've got the self-employment figures fixed now too. The US total shows 797,000 and Alabama shows 5,672.

@shawnbot
Copy link
Contributor

I had to go back and look at #923 to be sure, but the deal is that the BEA data isn't organized by NAICS codes, and their "line codes" don't appear to align 1:1 with NAICS. We're getting 200 ("Mining") then getting 10 ("Total employment") so we can derive percentages for #955.

These are all of the codes, according to BEA's API. @Isabelle1512, do any of these stick out to you as relevant, or do the numbers in the preview links above look right now?

Key Desc
10 Total employment
20 Wage and salary employment
40 Proprietors employment
50 Farm proprietors employment
60 Nonfarm proprietors employment
70 Farm employment
80 Nonfarm employment
90 Private nonfarm employment
100 Forestry, fishing, and related activities
101 Forestry and logging
102 Fishing, hunting, and trapping
103 Agriculture and forestry support activities
200 Mining
201 Oil and gas extraction
202 Mining (except oil and gas)
203 Support activities for mining
300 Utilities
400 Construction
401 Construction of buildings
402 Heavy and civil engineering construction
403 Specialty trade contractors
500 Manufacturing
510 Durable goods manufacturing
511 Wood product manufacturing
512 Nonmetallic mineral product manufacturing
513 Primary metal manufacturing
514 Fabricated metal product manufacturing
515 Machinery manufacturing
516 Computer and electronic product manufacturing
517 Electrical equipment and appliance manufacturing
518 Motor vehicles, bodies and trailers, and parts manufacturing
519 Other transportation equipment manufacturing
521 Furniture and related product manufacturing
522 Miscellaneous manufacturing
530 Nondurable goods manufacturing
531 Food manufacturing
532 Beverage and tobacco product manufacturing
533 Textile mills
534 Textile product mills
535 Apparel manufacturing
536 Leather and allied product manufacturing
537 Paper manufacturing
538 Printing and related support activities
539 Petroleum and coal products manufacturing
541 Chemical manufacturing
542 Plastics and rubber products manufacturing
600 Wholesale trade
700 Retail trade
701 Motor vehicle and parts dealers
702 Furniture and home furnishings stores
703 Electronics and appliance stores
704 Building material and garden supply stores
705 Food and beverage stores
706 Health and personal care stores
707 Gasoline stations
708 Clothing and clothing accessories stores
709 Sporting goods, hobby, book and music stores
711 General merchandise stores
712 Miscellaneous store retailers
713 Nonstore retailers
800 Transportation and warehousing
801 Air transportation
802 Rail transportation
803 Water transportation
804 Truck transportation
805 Transit and ground passenger transportation
806 Pipeline transportation
807 Scenic and sightseeing transportation
808 Support activities for transportation
809 Couriers and messengers
811 Warehousing and storage
900 Information
901 Publishing industries, except Internet
902 Motion picture and sound recording industries
903 Broadcasting, except Internet
904 Internet publishing and broadcasting
905 Telecommunications
906 Data processing, hosting, and related services
907 Other information services
1000 Finance and insurance
1001 Monetary authorities - central bank
1002 Credit intermediation and related activities
1003 Securities, commodity contracts, investments
1004 Insurance carriers and related activities
1005 Funds, trusts, and other financial vehicles
1100 Real estate and rental and leasing
1101 Real estate
1102 Rental and leasing services
1103 Lessors of nonfinancial intangible assets
1200 Professional, scientific, and technical services
1300 Management of companies and enterprises
1400 Administrative and waste management services
1401 Administrative and support services
1402 Waste management and remediation services
1500 Educational services
1600 Health care and social assistance
1601 Ambulatory health care services
1602 Hospitals
1603 Nursing and residential care facilities
1604 Social assistance
1700 Arts, entertainment, and recreation
1701 Performing arts and spectator sports
1702 Museums, historical sites, zoos, and parks
1703 Amusement, gambling, and recreation
1800 Accommodation and food services
1801 Accommodation
1802 Food services and drinking places
1900 Other services, except public administration
1901 Repair and maintenance
1902 Personal and laundry services
1903 Membership associations and organizations
1904 Private households
2000 Government and government enterprises
2001 Federal, civilian
2002 Military
2010 State and local
2011 State government
2012 Local government

@shawnbot
Copy link
Contributor

FWIW, the self-employment issue was a double-counting problem. The data contains figures at the national, state, and county levels, and I was adding them all up.

@meiqimichelle
Copy link
Contributor Author

For reference, these are the tables in the executive summary for wage and salary:
screenshot 2015-12-14 19 47 28

...and these are the tables for self-employed:
screenshot 2015-12-14 19 48 45
screenshot 2015-12-14 19 48 58

@shawnbot
Copy link
Contributor

Okay, I think we're good here when #1103 merges. On that branch we list 813,040 wage and salary jobs, which matches up pretty closely with the report's 808,000 (page 81):

image

The self-employment figure in the report is confusing. It cites the BEA data listing 16,000 self-employed persons in the table:

image

But then it goes on to say:

Using the regional BEA data, the number of sole proprietors and partners receiving income from and working in the extractive industries was roughly 799,000 people in 2013.

On my branch we list the nationwide total for self-employed persons as 797,000.

I'm honestly not sure how to reconcile the slight differences, but my gut tells me that they're close enough.

@meiqimichelle
Copy link
Contributor Author

@shawnbot, Isabelle did say something about the numbers getting updated every month. That might be the discrepancy.

@meiqimichelle
Copy link
Contributor Author

This should be live on the site now. @Isabelle1512 if the numbers look good to you we will close this issue.

@Isabelle1512
Copy link

@shawnbot and @meiqimichelle : The self-employed 16 K in the report is what they call "self-employed." If you remember from the BEA data, their categories are self-employed (16K), "wage and salary" (800K) and "employment" (1600K). We backed in to a new "self-employed" total (800K) that includes sole proprietors and active partners. The agreement reached in the Executive Summary was to discuss all three: self employed, wage and salary, and self-employed inclusive of sole proprietors and active partners. The agreement we reached in the online report was to do both wage and salary and self-employed inclusive of sole proprietors and active partners. It's all really confusing, and the product of less than perfect data (the BEA had trouble explaining some of their methods to our stakeholders) and a grand bargain on how to discuss employment in extractives. Ideas for how to make it clearer in 2016 welcome!

@Isabelle1512
Copy link

"they call" meaning the BEA

@Isabelle1512
Copy link

The self employed inclusive of sole proprietors and partnerships in the Exec Sum uses the previous data release, so don't worry about small differences. I hadn't realized how frequently they updated historical data. We'll be more strategic and clearer about how to cite that in the Exec Sum next year - perhaps by rounding more so that their aren't these small differences with the online report which will be able to use the freshest data I'd imagine.

@Isabelle1512
Copy link

their --> there. No coffee yet.

@Isabelle1512
Copy link

Not sure if I'm looking at the right version of the site, but here are the values in yellow I'd expect to see.
image

@meiqimichelle
Copy link
Contributor Author

This was fixed before launch on Tuesday. Done!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
data-mgmt Use this label for adding and/or updating data on the site. Also can be used for data management too
Projects
None yet
Development

No branches or pull requests

3 participants