Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Creating, Submitting, and Handling IPUMS Data Extracts #16

Merged
merged 22 commits into from
May 2, 2024
Merged
Show file tree
Hide file tree
Changes from 21 commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
bc349a8
Ah, but you have heard of me
TheCedarPrince Apr 7, 2024
787df6f
Fully get all details of a given dataset
TheCedarPrince Apr 7, 2024
18d5077
An act of larceny
TheCedarPrince Apr 13, 2024
050b767
Cleaned up script and removed export
TheCedarPrince Apr 13, 2024
8b63e89
Merge branch 'main' into tcp-extracts
TheCedarPrince Apr 16, 2024
367bed7
Added exports, comments, and Downloads
TheCedarPrince Apr 16, 2024
6c32e81
Added Downloads dependency
TheCedarPrince Apr 16, 2024
2a971b7
Prototype download function
TheCedarPrince Apr 16, 2024
3eeb74e
Added test extract request file
TheCedarPrince Apr 16, 2024
5f6a886
Renamed some functions and updated references
TheCedarPrince Apr 16, 2024
9783005
Updated name of API object for future and created extract info method
TheCedarPrince Apr 18, 2024
99b6acc
Renamed documentation file
TheCedarPrince Apr 18, 2024
ec9b8de
Renamed some exports and files
TheCedarPrince Apr 18, 2024
73b63a1
Documentation added to download function
TheCedarPrince Apr 18, 2024
d6a84d4
Added convenience wrapper around IPUMS
TheCedarPrince Apr 19, 2024
694307f
Finished creation of extract download capacity
TheCedarPrince Apr 26, 2024
8ab7022
Updated documentation and warnings
TheCedarPrince Apr 26, 2024
6757404
Added example
TheCedarPrince Apr 26, 2024
5d7f114
Add description for pirated method
TheCedarPrince Apr 28, 2024
d267e80
Add naive implementation and documentation
TheCedarPrince Apr 28, 2024
94ccfc4
Added documentation and implementation for extract_submit
TheCedarPrince Apr 28, 2024
979163f
Added note on piracy method
TheCedarPrince May 2, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Project.toml
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ version = "0.0.1"
[deps]
DataFrames = "a93c6f00-e57d-5684-b7b6-d8193f3e46c0"
Dates = "ade2ca70-3891-5945-98fb-dc099432e06a"
Downloads = "f43a241f-c20a-4ad4-852c-f6b1247861c6"
EzXML = "8f5d6c58-4d21-5cfd-889c-e3ad7ee6a615"
HTTP = "cd3eb016-35fb-5094-929b-558a96fad6f3"
JSON3 = "0f8b85d8-7281-11e9-16c2-39a750bddbf1"
Expand Down
2 changes: 1 addition & 1 deletion docs/src/DataExtract.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
## Properties
Name | Type | Description | Notes
------------ | ------------- | ------------- | -------------
**extractDefinition** | [***DataExtractExtractDefinition**](DataExtractExtractDefinition.md) | | [optional] [default to nothing]
**extractDefinition** | [***DataExtractDefinition**](DataExtractDefinition.md) | | [optional] [default to nothing]
**number** | **Int64** | | [optional] [default to nothing]
**status** | **String** | | [optional] [default to nothing]
**downloadLinks** | [***DataExtractDownloadLinks**](DataExtractDownloadLinks.md) | | [optional] [default to nothing]
Expand Down
2 changes: 1 addition & 1 deletion docs/src/DataExtractExtractDefinition.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# DataExtractExtractDefinition
# DataExtractDefinition


## Properties
Expand Down
2 changes: 1 addition & 1 deletion docs/src/DataExtractPostResponse.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
## Properties
Name | Type | Description | Notes
------------ | ------------- | ------------- | -------------
**extractDefinition** | [***DataExtractExtractDefinition**](DataExtractExtractDefinition.md) | | [optional] [default to nothing]
**extractDefinition** | [***DataExtractDefinition**](DataExtractDefinition.md) | | [optional] [default to nothing]
**number** | **Int64** | | [optional] [default to nothing]
**status** | **String** | | [optional] [default to nothing]
**downloadLinks** | [***DataExtractDownloadLinks**](DataExtractDownloadLinks.md) | | [optional] [default to nothing]
Expand Down
92 changes: 46 additions & 46 deletions docs/src/DefaultApi.md → docs/src/IPUMSAPI.md

Large diffs are not rendered by default.

57 changes: 28 additions & 29 deletions src/IPUMS.jl
Original file line number Diff line number Diff line change
Expand Up @@ -2,62 +2,61 @@ module IPUMS

import Base:
@kwdef
import Downloads:
download as dl
import OpenAPI.Clients:
Client

using DataFrames
using Dates
using HTTP
using JSON3
using OpenAPI
using OpenAPI.Clients
import OpenAPI:
Client
using TimeZones
using URIs
using EzXML

#=

Scripts used across whole of package

=#

include("structs.jl")
include("constants.jl")
include("helpers.jl")

#=

This information was generated by the OpenAPI documentation and
This information was auto-generated by the OpenAPI spec and
subsequently better incorporated into the whole of the package

=#

const API_VERSION = "v2"

include("modelincludes.jl")
include("apis/api_DefaultApi.jl")
include("apis/api_IPUMSAPI.jl")
include("piracy.jl")


include("extracts.jl")

#=

Parsers

=#

include("parsers/ddi_parser.jl")

#=
export from_json
export DataExtract
export DataExtractDownloadLinks
export DataExtractExtractDefinition
export DataExtractPost
export DataExtractPostResponse
export DataTableFull
export DataTableFullVariablesInner
export DataTableSimple
export Dataset
export DatasetFull
export DatasetFullBreakdowns
export DatasetFullBreakdownsBreakdownValuesInner
export DatasetFullGeogLevelsInner
export DatasetSimple
export Error
export Shapefile
export TimeSeriesTable
export TimeSeriesTableFull
export TimeSeriesTableFullTimeSeriesInner
export TimeSeriesTableSimple
=#

Exports

=#

export Client
export DefaultApi
export IPUMSAPI
export parse_ddi
export extract_download
end
Loading
Loading