Skip to content
This repository has been archived by the owner on Oct 15, 2022. It is now read-only.

Commit

Permalink
New Meteor API Fathead (#802)
Browse files Browse the repository at this point in the history
* adding debugging with some class reading changes

* library update for php parsing

* updating code for enable/disable debugging

* fix for repeated functions ⛳

* updated parsers, also updated readme, easy debugging

some whitespace changes

some more and more and more whitespace changes

some more and more and more whitespace changes

some more and more and more whitespace changes

adding more coverage to the php functions

* adding debugging with some class reading changes , updated readme

new parser with improved coverage

removed some code that was not in use

whitepsace corrections in code

a small indentation fix

arrrhhhvi parse.js  a whitespace

* added colored console, disabled debugging

* more coverage for "function" keyword

* fixed the urls for more info

* adding classes as categories

* output.txt generated with results

* Merging (#2)

* Removed Django_built_ins (#677)

* adding more coverage to the php functions (#678)

* adding debugging with some class reading changes

* library update for php parsing

* updating code for enable/disable debugging

* fix for repeated functions ⛳

* updated parsers, also updated readme, easy debugging

some whitespace changes

some more and more and more whitespace changes

some more and more and more whitespace changes

some more and more and more whitespace changes

adding more coverage to the php functions

* adding debugging with some class reading changes , updated readme

new parser with improved coverage

removed some code that was not in use

whitepsace corrections in code

a small indentation fix

arrrhhhvi parse.js  a whitespace

* added colored console, disabled debugging

* more coverage for "function" keyword

* fixed the urls for more info

* adding classes as categories

* output.txt generated with results

* Update PULL_REQUEST_TEMPLATE.md

* Jquery: Add article aliases(redirects) for append,after,before (#610) (#679)

* Add append,after,before redirects (#610)

* Add append,after,before redirects (Fixed Pull request issues) (#610)

* Ending period on disambiguation should be optional

* jQuery Fathead: Add arguments type & description, Fixes #319 (#682)

* Add argument desc

* Completed arg descriptions

* Exclude xi:include argsDescription

* Remove whitespace

* Fix args desc parse issue

* Change argsdesc from code to unordered list

* Format arguments name & type

* Improove content formatting

* Update output.txt

* Final changes

* Fix sub-heading and remove ill formatted redirects

* Remove whitespace

* Perl 6 Documentation: Fix the parser so that it generates correct links (#680)

* Perl6: Use https instead of http

* Perl6: Fix broken links

* Perl6: Update output.txt

* New SQLAlchemy Fathead  Fixes #462 (#483)

* New fathead for SQLAlchemy  Fixes #462

* corrected unwanted redundancy in output.txt

* Corrected improperly escaped '\n's

* Added IAs for sqlalchemy events, internals and exceptions without disambiguation entries

* Added disambiguation entries and handled a few corner cases

* removed unnecessary '\t's, changed indentation and removed inline styles

* Adding examples to all the topics of numpy. (#688)

* Added Examples Template

* Added examples for all topics of numpy

* Typo fixed

* Removed Extra spans from examples

* using highlight-python to get examples

* Remove extra new line characters and correct docmentation

* Removed spaces

* JavaScript: New NPM CLI Fathead (#694)

* First commit

* Truncated fetch.sh

* Scraping Home Page and indentation fixed

* Bugs fixed

* Final changes

* First commit

* Removed unnecessary data

* Indentation fixed and redirects added

* Final changes

* Order of desc and code changed

* Changes made

* STY: Fix PEP8 issues

* Remove incorrect comment

* Fix escaping issues in numpy fathead examples.

* Perl 6 Documentation: Fix parse.pl so that it can handle the latest html structure. (#726)

* Perl 6 Documentation: Modify the way to parse so that it can handle the latest (i.e. 2017.01) html structure

* Perl 6 Documentation: Update output.txt corresponding with parse.pl's one

* Perl 6 Documentation: Fix code blocks so that they don't contain escaped characters

* Perl 6 Documentation: Update output.txt corresponding with parse.pl's one

* C++ Fathead: Add language keywords  (#626)

* Initial Commit: Keywords Added

* Fixed misspell

* File Name changed

* Removed Blanked lines

* add "boost" trigger word

* Java: New JMeter Fathead (#700)

* Fixing conflicts

* Code review and adding trigger file

* Formatting updates

* jmeter fathead inital commit

* test commit to trigger build

* Updating directory name for dax to pickup

* Code review updates

* Updating triggers

* Wrapping up details inside <p> tags

* JavaScript: New ESLint Fathead (#690)

* Push initial version.

* Test fetch + parse
- Add output.txt
- Tune download folder structure.

* Code
Add parse.sh

* >Code: Process all categories instead of one.
- Apply forEach on categories.
- Polish tests.

* Documentation: References, Intro, Testing.

* Doc: Move notes to readme.md.

* Test: Update current output.txt.

* Infrastructure: Rename 'javascript_eslint/' to 'eslint/'.

* Infrastructure: Adapt package.json
- Name.

* Add TXT for trigger words.

* Add TXT for trigger words.

* Code: Abstract layout
- Add markdown-js.
- Test inline code.

* Testing: Run fetch + parse.

* Infrastructure: 'parse.h'
- Add **npm install** before calling 'parse.js'.

* Update trigger_words.txt

Add common search quotes.

* +x permissions to fetch and parse sh

* Code: Format summary text:
- Start with uppercase letter.
- End with dot.

* Cosmetics: Code analysis.

* Run fetch + parse.

* JavaScript: New react native fathead (#713)

* Download docs for the current stable release.

* Parsing of docs
    * Module title and intro text.

    * Identifying prop sections and method sections.

    * Property signature, paragraph and url.

    * Methods section parsed.

* Output result to output file.

* Add parse.sh and output_statistics.awk.

* Add output.txt for testing on beta.

* Fix issues listed in review

    * Methods or Props with no information other than the
        signature should not add an empty <p></p> to output.

    * Method names should not be classified in classes. The
        module name is the class.

* Fix erroneous prop_name

    * Some of the documentations pages are not of expected format.

* Really sort on first field.

* Handle disambiguations.

    * Add redirect.py that generates disambiguations.

* Add requirements.txt that specifies requirements for this fathead.

* Javascript: New Webpack Fathead (#720)

* first steps of the fetching script

* getting all the hrefs

* cleaning up the file, and adding some comments

* a working fetch script

* placing it all under the same dir

* rename the package, and adding some info

* adding readme

* adding node version

* a very first beginning of parse.js

* fixing node version dependency

* adding a new line to the end of each entry

* adding parse.sh to parse all the files in the download dir

* bugfix: not trying to iterate when there are no more tags

* small cleanup

* adding counter

* escaping strings

* fixing a bug in the escaping

* loading the pages with the original urls (and not file://)

*  fixing counter zero-based bug

* refactoring: increasing readability

* bugfix: not escaping links inside paragraphs

* adding output.txt

* removing empty lines

* strip out a tags

* Python: New Arrow Fathead (#669) (#723)

* New Arrow Fathead (#669)

* Fixed wrong formatting of abstract in output.txt

The paragraph and code are supposed to be on the same level

* Python: New Scipy fathead (#731)

* scipy: Add fetcher scripts.

* scipy: parser for scipy fathead.

* scipy: Add parser runner

* scipy: Add parser python requirements

* scipy: Add a README file

* scipy: Add trigger words file

* scipy: Add fathead output

* adding redirector script, and making redirect for . seperated values (#743)

* JavaScript: New Lodash Fathead (#719)

* Initial Commit

* second commit

* nothing huge

* nothing major

* nothing major

* fixed fetch.sh

* Nothing major

* nothing much

* added some redirects

* fixed redirects

* added more redirects

* added methods.txt, some redirects, and formatted the code a bit

* one /t was missing

* updated txt with an extra tab

* added formatting for abstract

* removed extra /n in abstract formatting

* Changed summary from text to html to count it <br> in <p>

* stripped anchor tags

* Added <code> tags in anchor tags title

* fixed arguments and trigger words.txt

* Scala: New Scala Docs Fathead (#704)

* Initial Commit

Add a new Scala Documentation fathead. Resolves #692

* Remove Debug Statements

* Add requirements.txt

* Add output.txt File

* Fix minor issues

* ADd triggers.txt

* Add formatting to answers

* Add recursive parsing of lists

* Fix issue with inline code tag

* sqlalchemy: Added requirements.txt and changed headings in output.txt (#703)

* Added requirements.txt and changed header's <span> to <pre><code>

* Corrected paragraph,list and table displays

*  MDN CSS: Add missing documentation articles (#702)

* Rename --* to its proper name custom properties (--*).

* Sort tags.txt.

* Remove parameter from scale3d().

* Remove :full-screen. There is :fullscreen already.

* Add creating of more redirects.
Use a variant of title found in
<code> part of description paragraph
to create redirects.

* Handle more than one alternate titles.

* Make writing of redirects lazy.
Write redirects only after all the articles
have been written so that all redirects that
have the same title as an article are dropped.
The logic being that an article has a higher
precedence than a redirect and thus a redirect
should not prevent an article from being written.
Thus, redirects get to use a different hash from
the articles hash when keeping track of titles.

* Check for duplication in create_article function.
This ensures whenever create_article is called
outside the parse loop we do not end up with
duplicate titles in output.txt.

* Fix comment indentation.

* Add parsing of Values and Units.

* Create redirects for all versions of :not().

* Remove !important.
It is missing in  https://developer.mozilla.org/en-US/docs/Web/CSS/Reference

* tree-cell is not covered by Mozilla CSS reference.

* Fix custom-ident typo.

* Lowercase title in create_article.
In some cases the title is not lowercased
beforehand.

* Replace <indent> with ident which is covered.

* Add parsing of units for @font-feature-values.

* Use exact element name to create link if it is present.
This makes the article link scroll down to the exact
element in the page more accurately than using the parent
id.

* No need for redirects for titles with '

* Appearance does not appear on mdn css reference.

* Background-position-{x, y} are not on mdn css reference.

* Bleed is not no mdn css reference.

* border-start is not in mdn css reference.

* Fix contrast typo.

* fit is not covered in mdn css reference.

* font-height is not covered by mdn css reference.

* format is not covered by mdn css reference.

* fr is not covered by mdn css reference.

* grid-span is not covered by mdn css reference.

* mark is not covered by mdn css reference.

* Fix scroll-behavior typo.

* SkewZ() is not covered by mdn css reference.

* wrap-mode is not covered by mdn css reference.

* Stop Mojo::IOLoop gracefully.
See http://mojolicious.org/perldoc/Mojo/IOLoop#stop_gracefully

* Delete keywords requiring extra processing or with 404 pages.
See https://gist.github.com/hchienjo/c61adddbe63641a7b3c9de20a9995422

* Add output.txt.

* Remove parsing of values data.
This messes up with some of the
articles as the titles collide.

* Fetch only links in /docs/Web/CSS/ path.

* Limit accepted alternate titles.

* Parsing of #Feature_value_blocks is not harmful.

* Parse values for font-variant-alternate.
This is because it contains entries that are in tags.txt
like:
    1. swash()
    2. ornaments()
    3. annotation()

* Remove "using css" from titles.

* <counter> actually points to https://developer.mozilla.org/en-US/docs/Web/CSS/CSS_Lists_and_Counters/Using_CSS_counters

* <flex> is converedd by flex.

* mozilla.org/en-US/docs/Web/CSS/ident leads to a 404 error.

* Add output.txt.

* tighten rules on alternate titles.

* Drop incorrect *.warning redirect.

* Remove useless comment.

* Limit creation of alternate titles for redirects.

* Add output.txt.

* No css snippet should be a redirect entry title.

* Add output.txt.

* Ensure removing brackets from titles preserves meaning.
For instance :-moz-locale-dir(ltr) should be :-moz-locale-dir ltr
and not :-moz-locale-dirltr.

* Add output.txt.

* New Six Library Fathead #453 (#532)

* added Readme and fetch

* added parse file

* added class to store info about python_six lib

* added class to parse the python six library content and added output.txt file

* added new template and fixed issues

* updated output.txt

* added trigger words

* if code section is not present then skip that in the abstraction

* fixed issue of newline in abstarction

* fixed indention issue

* renamed the directory to match the id

* change the trigger words

* New Python Pip Fathead (#465)

* parser,fetch and requirements added

* Prelim pip fathead completed

* Made required changes

* SOme changes to parser

* Fixed import file error. Also reduced output size to display only relevant information

* Fixed some parsing errors

* Serving pages to command <pip command>

* Updated code to handle formatting error

* added trigger words file and updated code

* corrected few errors

* New Flask Fathead (#459)

* Added flask fathead

* Added flask fathead

* Parsed API documentation Flask

* Escaped html symbols and newlines

* Escaped html symbols and newlines

* Fixed HTML class for closing quote

* Fixed HTML class for closing quote

* Fixes #751 Improves Redirects

* Fixes #751 Changes done

* Javascript: New Electron Fathead (#721)

* First commit

* Truncated fetch.sh

* Scraping Home Page and indentation fixed

* Bugs fixed

* Final changes

* First commit - Electron branch

* Removed unnecessary data

* Modified code

* Indentation fixed

* Final  changes

* Fixes #757 Updates docs and directory structure

* Fixes #757: Some final clean ups

* Added trigger_words.txt

* added angular javascript trigger along with angular js :#755

* changes done as requested

* updated parse.sh and readme

* Fixed minor indentation issue.

* Sort and make sure entries are unique.

* Fix issue with parsing the newest docs.

    * Apparently, the docs could not be parsed anymore. This was solved by
        checking that the elements used were really bs4.element.Tag elements
        and actually had the .name etc properties.

* Java: New Java Fathead (Continue #642) (#774)

* Added method coverage data for the Java fathead

* Added methods to output.txt

* Removed classname from several functions

* Fixed formatting for output and coverage

* Added classesto methods in methods.txt and updated file

* Coverage data and output are sorted if they exist

* Added sorted methods.txt

* Stripped methods of brackets and parameters

* Added sorted version of methods.txt

* Added a space between method description and url

* Added formatted method parameters to methods.txt and output.txt

* Added method output and coverage without parameters

* Changed method_url find parameter from "href" to "a"

* Removed test_parse.py due to it being a redundant test

* Added tests for checking the output is correct in output.txt and method coverage

* Removed pipe to uniq -u and added sort -u instead

* Removed test cases for method parameter formatting

* Fixed spacing in method coverage so that sort -u recognizes duplicates

* Removed output.txt from .gitignore

* Added -f option to sort in parse.sh

* Excluded methods without parameters from being appended twice to output.txt

* Fixed method_url parsing and reverted method extraction function

* Fixed formatting issues on cover and output so that sort -u recognizes duplicates

* Added <section> to method descriptions and an additional tab

* Remove output.txt after beta upload

* Python: New PEP Fathead (#627)

* Added PEP Fathead.

* Removed data.url file.

* Tab replacement now 4 spaces.

* Updated trigger words.

* Adding output file.

* Updated title.

* Updated with redirects.

* Removed meta.txt file.

* Removed 'PEP' trigger word.

* Updated parser from review.

* Update Parser and redirects.

* Updating output.txt file for beta server.

* Updated output.txt

* Updated Parser for new lines.

* Updated parser.

* Patched Parser flush bug.

* Fixes spacing issue.

* Refactored parser.

* Updated parser to include newlines in code blocks.

* Updated parser.

* Updated parser to handle <p>

* JavaScript: New Vuejs Fathead (#776)

* Initial commit

* added trigger words.txt

* added more redirects

* fixed redirect function

* fixed abstract title

* fixed formatting of code in abstract

* fixed trigger words, changed order of abstraction

* Removed unnecessary redirects

* Python Coverage Fathead (#738)

* inital commit to repo

* fixes incorrect file write
* adds trigger words
* updates README to install requirements
* corrects inconsistency of method docstrings

* removes blank line in triggerwords, adds output.txt

* removes minor version spec from pip install doc line

* removes original site URL and text

* changes html cleanup to preserve some tags

* removes debugging print line, swaps <cite> tags with <code> tags

* Ocaml: New OPAM fathead. (#775)

* Updated stale OPAM fathead.

* Added trigger words.

* Updated parser to deal with version.

* Updated parser.

Updated output.txt

* npm CLI: Added Categories (#754)

* Added list of commands for npm cli

* Removed npm.txt

* Updated from npm-cli.txt

* Delete npm-cli.txt

* Revert "Swift Docs: Readme updated and url changed from 2.2 to 3.1" (#790)

* fetching the API from docs

* created fathead as required [meteor]

* Yo! (#3)

* Removed Django_built_ins (#677)

* adding more coverage to the php functions (#678)

* adding debugging with some class reading changes

* library update for php parsing

* updating code for enable/disable debugging

* fix for repeated functions ⛳

* updated parsers, also updated readme, easy debugging

some whitespace changes

some more and more and more whitespace changes

some more and more and more whitespace changes

some more and more and more whitespace changes

adding more coverage to the php functions

* adding debugging with some class reading changes , updated readme

new parser with improved coverage

removed some code that was not in use

whitepsace corrections in code

a small indentation fix

arrrhhhvi parse.js  a whitespace

* added colored console, disabled debugging

* more coverage for "function" keyword

* fixed the urls for more info

* adding classes as categories

* output.txt generated with results

* Update PULL_REQUEST_TEMPLATE.md

* Jquery: Add article aliases(redirects) for append,after,before (#610) (#679)

* Add append,after,before redirects (#610)

* Add append,after,before redirects (Fixed Pull request issues) (#610)

* Ending period on disambiguation should be optional

* jQuery Fathead: Add arguments type & description, Fixes #319 (#682)

* Add argument desc

* Completed arg descriptions

* Exclude xi:include argsDescription

* Remove whitespace

* Fix args desc parse issue

* Change argsdesc from code to unordered list

* Format arguments name & type

* Improove content formatting

* Update output.txt

* Final changes

* Fix sub-heading and remove ill formatted redirects

* Remove whitespace

* Perl 6 Documentation: Fix the parser so that it generates correct links (#680)

* Perl6: Use https instead of http

* Perl6: Fix broken links

* Perl6: Update output.txt

* New SQLAlchemy Fathead  Fixes #462 (#483)

* New fathead for SQLAlchemy  Fixes #462

* corrected unwanted redundancy in output.txt

* Corrected improperly escaped '\n's

* Added IAs for sqlalchemy events, internals and exceptions without disambiguation entries

* Added disambiguation entries and handled a few corner cases

* removed unnecessary '\t's, changed indentation and removed inline styles

* Adding examples to all the topics of numpy. (#688)

* Added Examples Template

* Added examples for all topics of numpy

* Typo fixed

* Removed Extra spans from examples

* using highlight-python to get examples

* Remove extra new line characters and correct docmentation

* Removed spaces

* JavaScript: New NPM CLI Fathead (#694)

* First commit

* Truncated fetch.sh

* Scraping Home Page and indentation fixed

* Bugs fixed

* Final changes

* First commit

* Removed unnecessary data

* Indentation fixed and redirects added

* Final changes

* Order of desc and code changed

* Changes made

* STY: Fix PEP8 issues

* Remove incorrect comment

* Fix escaping issues in numpy fathead examples.

* Perl 6 Documentation: Fix parse.pl so that it can handle the latest html structure. (#726)

* Perl 6 Documentation: Modify the way to parse so that it can handle the latest (i.e. 2017.01) html structure

* Perl 6 Documentation: Update output.txt corresponding with parse.pl's one

* Perl 6 Documentation: Fix code blocks so that they don't contain escaped characters

* Perl 6 Documentation: Update output.txt corresponding with parse.pl's one

* C++ Fathead: Add language keywords  (#626)

* Initial Commit: Keywords Added

* Fixed misspell

* File Name changed

* Removed Blanked lines

* add "boost" trigger word

* Java: New JMeter Fathead (#700)

* Fixing conflicts

* Code review and adding trigger file

* Formatting updates

* jmeter fathead inital commit

* test commit to trigger build

* Updating directory name for dax to pickup

* Code review updates

* Updating triggers

* Wrapping up details inside <p> tags

* JavaScript: New ESLint Fathead (#690)

* Push initial version.

* Test fetch + parse
- Add output.txt
- Tune download folder structure.

* Code
Add parse.sh

* >Code: Process all categories instead of one.
- Apply forEach on categories.
- Polish tests.

* Documentation: References, Intro, Testing.

* Doc: Move notes to readme.md.

* Test: Update current output.txt.

* Infrastructure: Rename 'javascript_eslint/' to 'eslint/'.

* Infrastructure: Adapt package.json
- Name.

* Add TXT for trigger words.

* Add TXT for trigger words.

* Code: Abstract layout
- Add markdown-js.
- Test inline code.

* Testing: Run fetch + parse.

* Infrastructure: 'parse.h'
- Add **npm install** before calling 'parse.js'.

* Update trigger_words.txt

Add common search quotes.

* +x permissions to fetch and parse sh

* Code: Format summary text:
- Start with uppercase letter.
- End with dot.

* Cosmetics: Code analysis.

* Run fetch + parse.

* JavaScript: New react native fathead (#713)

* Download docs for the current stable release.

* Parsing of docs
    * Module title and intro text.

    * Identifying prop sections and method sections.

    * Property signature, paragraph and url.

    * Methods section parsed.

* Output result to output file.

* Add parse.sh and output_statistics.awk.

* Add output.txt for testing on beta.

* Fix issues listed in review

    * Methods or Props with no information other than the
        signature should not add an empty <p></p> to output.

    * Method names should not be classified in classes. The
        module name is the class.

* Fix erroneous prop_name

    * Some of the documentations pages are not of expected format.

* Really sort on first field.

* Handle disambiguations.

    * Add redirect.py that generates disambiguations.

* Add requirements.txt that specifies requirements for this fathead.

* Javascript: New Webpack Fathead (#720)

* first steps of the fetching script

* getting all the hrefs

* cleaning up the file, and adding some comments

* a working fetch script

* placing it all under the same dir

* rename the package, and adding some info

* adding readme

* adding node version

* a very first beginning of parse.js

* fixing node version dependency

* adding a new line to the end of each entry

* adding parse.sh to parse all the files in the download dir

* bugfix: not trying to iterate when there are no more tags

* small cleanup

* adding counter

* escaping strings

* fixing a bug in the escaping

* loading the pages with the original urls (and not file://)

*  fixing counter zero-based bug

* refactoring: increasing readability

* bugfix: not escaping links inside paragraphs

* adding output.txt

* removing empty lines

* strip out a tags

* Python: New Arrow Fathead (#669) (#723)

* New Arrow Fathead (#669)

* Fixed wrong formatting of abstract in output.txt

The paragraph and code are supposed to be on the same level

* Python: New Scipy fathead (#731)

* scipy: Add fetcher scripts.

* scipy: parser for scipy fathead.

* scipy: Add parser runner

* scipy: Add parser python requirements

* scipy: Add a README file

* scipy: Add trigger words file

* scipy: Add fathead output

* adding redirector script, and making redirect for . seperated values (#743)

* JavaScript: New Lodash Fathead (#719)

* Initial Commit

* second commit

* nothing huge

* nothing major

* nothing major

* fixed fetch.sh

* Nothing major

* nothing much

* added some redirects

* fixed redirects

* added more redirects

* added methods.txt, some redirects, and formatted the code a bit

* one /t was missing

* updated txt with an extra tab

* added formatting for abstract

* removed extra /n in abstract formatting

* Changed summary from text to html to count it <br> in <p>

* stripped anchor tags

* Added <code> tags in anchor tags title

* fixed arguments and trigger words.txt

* Scala: New Scala Docs Fathead (#704)

* Initial Commit

Add a new Scala Documentation fathead. Resolves #692

* Remove Debug Statements

* Add requirements.txt

* Add output.txt File

* Fix minor issues

* ADd triggers.txt

* Add formatting to answers

* Add recursive parsing of lists

* Fix issue with inline code tag

* sqlalchemy: Added requirements.txt and changed headings in output.txt (#703)

* Added requirements.txt and changed header's <span> to <pre><code>

* Corrected paragraph,list and table displays

*  MDN CSS: Add missing documentation articles (#702)

* Rename --* to its proper name custom properties (--*).

* Sort tags.txt.

* Remove parameter from scale3d().

* Remove :full-screen. There is :fullscreen already.

* Add creating of more redirects.
Use a variant of title found in
<code> part of description paragraph
to create redirects.

* Handle more than one alternate titles.

* Make writing of redirects lazy.
Write redirects only after all the articles
have been written so that all redirects that
have the same title as an article are dropped.
The logic being that an article has a higher
precedence than a redirect and thus a redirect
should not prevent an article from being written.
Thus, redirects get to use a different hash from
the articles hash when keeping track of titles.

* Check for duplication in create_article function.
This ensures whenever create_article is called
outside the parse loop we do not end up with
duplicate titles in output.txt.

* Fix comment indentation.

* Add parsing of Values and Units.

* Create redirects for all versions of :not().

* Remove !important.
It is missing in  https://developer.mozilla.org/en-US/docs/Web/CSS/Reference

* tree-cell is not covered by Mozilla CSS reference.

* Fix custom-ident typo.

* Lowercase title in create_article.
In some cases the title is not lowercased
beforehand.

* Replace <indent> with ident which is covered.

* Add parsing of units for @font-feature-values.

* Use exact element name to create link if it is present.
This makes the article link scroll down to the exact
element in the page more accurately than using the parent
id.

* No need for redirects for titles with '

* Appearance does not appear on mdn css reference.

* Background-position-{x, y} are not on mdn css reference.

* Bleed is not no mdn css reference.

* border-start is not in mdn css reference.

* Fix contrast typo.

* fit is not covered in mdn css reference.

* font-height is not covered by mdn css reference.

* format is not covered by mdn css reference.

* fr is not covered by mdn css reference.

* grid-span is not covered by mdn css reference.

* mark is not covered by mdn css reference.

* Fix scroll-behavior typo.

* SkewZ() is not covered by mdn css reference.

* wrap-mode is not covered by mdn css reference.

* Stop Mojo::IOLoop gracefully.
See http://mojolicious.org/perldoc/Mojo/IOLoop#stop_gracefully

* Delete keywords requiring extra processing or with 404 pages.
See https://gist.github.com/hchienjo/c61adddbe63641a7b3c9de20a9995422

* Add output.txt.

* Remove parsing of values data.
This messes up with some of the
articles as the titles collide.

* Fetch only links in /docs/Web/CSS/ path.

* Limit accepted alternate titles.

* Parsing of #Feature_value_blocks is not harmful.

* Parse values for font-variant-alternate.
This is because it contains entries that are in tags.txt
like:
    1. swash()
    2. ornaments()
    3. annotation()

* Remove "using css" from titles.

* <counter> actually points to https://developer.mozilla.org/en-US/docs/Web/CSS/CSS_Lists_and_Counters/Using_CSS_counters

* <flex> is converedd by flex.

* mozilla.org/en-US/docs/Web/CSS/ident leads to a 404 error.

* Add output.txt.

* tighten rules on alternate titles.

* Drop incorrect *.warning redirect.

* Remove useless comment.

* Limit creation of alternate titles for redirects.

* Add output.txt.

* No css snippet should be a redirect entry title.

* Add output.txt.

* Ensure removing brackets from titles preserves meaning.
For instance :-moz-locale-dir(ltr) should be :-moz-locale-dir ltr
and not :-moz-locale-dirltr.

* Add output.txt.

* New Six Library Fathead #453 (#532)

* added Readme and fetch

* added parse file

* added class to store info about python_six lib

* added class to parse the python six library content and added output.txt file

* added new template and fixed issues

* updated output.txt

* added trigger words

* if code section is not present then skip that in the abstraction

* fixed issue of newline in abstarction

* fixed indention issue

* renamed the directory to match the id

* change the trigger words

* New Python Pip Fathead (#465)

* parser,fetch and requirements added

* Prelim pip fathead completed

* Made required changes

* SOme changes to parser

* Fixed import file error. Also reduced output size to display only relevant information

* Fixed some parsing errors

* Serving pages to command <pip command>

* Updated code to handle formatting error

* added trigger words file and updated code

* corrected few errors

* New Flask Fathead (#459)

* Added flask fathead

* Added flask fathead

* Parsed API documentation Flask

* Escaped html symbols and newlines

* Escaped html symbols and newlines

* Fixed HTML class for closing quote

* Fixed HTML class for closing quote

* Fixes #751 Improves Redirects

* Fixes #751 Changes done

* Javascript: New Electron Fathead (#721)

* First commit

* Truncated fetch.sh

* Scraping Home Page and indentation fixed

* Bugs fixed

* Final changes

* First commit - Electron branch

* Removed unnecessary data

* Modified code

* Indentation fixed

* Final  changes

* Fixes #757 Updates docs and directory structure

* Fixes #757: Some final clean ups

* Added trigger_words.txt

* added angular javascript trigger along with angular js :#755

* changes done as requested

* updated parse.sh and readme

* Fixed minor indentation issue.

* Sort and make sure entries are unique.

* Fix issue with parsing the newest docs.

    * Apparently, the docs could not be parsed anymore. This was solved by
        checking that the elements used were really bs4.element.Tag elements
        and actually had the .name etc properties.

* Java: New Java Fathead (Continue #642) (#774)

* Added method coverage data for the Java fathead

* Added methods to output.txt

* Removed classname from several functions

* Fixed formatting for output and coverage

* Added classesto methods in methods.txt and updated file

* Coverage data and output are sorted if they exist

* Added sorted methods.txt

* Stripped methods of brackets and parameters

* Added sorted version of methods.txt

* Added a space between method description and url

* Added formatted method parameters to methods.txt and output.txt

* Added method output and coverage without parameters

* Changed method_url find parameter from "href" to "a"

* Removed test_parse.py due to it being a redundant test

* Added tests for checking the output is correct in output.txt and method coverage

* Removed pipe to uniq -u and added sort -u instead

* Removed test cases for method parameter formatting

* Fixed spacing in method coverage so that sort -u recognizes duplicates

* Removed output.txt from .gitignore

* Added -f option to sort in parse.sh

* Excluded methods without parameters from being appended twice to output.txt

* Fixed method_url parsing and reverted method extraction function

* Fixed formatting issues on cover and output so that sort -u recognizes duplicates

* Added <section> to method descriptions and an additional tab

* Remove output.txt after beta upload

* Python: New PEP Fathead (#627)

* Added PEP Fathead.

* Removed data.url file.

* Tab replacement now 4 spaces.

* Updated trigger words.

* Adding output file.

* Updated title.

* Updated with redirects.

* Removed meta.txt file.

* Removed 'PEP' trigger word.

* Updated parser from review.

* Update Parser and redirects.

* Updating output.txt file for beta server.

* Updated output.txt

* Updated Parser for new lines.

* Updated parser.

* Patched Parser flush bug.

* Fixes spacing issue.

* Refactored parser.

* Updated parser to include newlines in code blocks.

* Updated parser.

* Updated parser to handle <p>

* JavaScript: New Vuejs Fathead (#776)

* Initial commit

* added trigger words.txt

* added more redirects

* fixed redirect function

* fixed abstract title

* fixed formatting of code in abstract

* fixed trigger words, changed order of abstraction

* Removed unnecessary redirects

* Python Coverage Fathead (#738)

* inital commit to repo

* fixes incorrect file write
* adds trigger words
* updates README to install requirements
* corrects inconsistency of method docstrings

* removes blank line in triggerwords, adds output.txt

* removes minor version spec from pip install doc line

* removes original site URL and text

* changes html cleanup to preserve some tags

* removes debugging print line, swaps <cite> tags with <code> tags

* Ocaml: New OPAM fathead. (#775)

* Updated stale OPAM fathead.

* Added trigger words.

* Updated parser to deal with version.

* Updated parser.

Updated output.txt

* npm CLI: Added Categories (#754)

* Added list of commands for npm cli

* Removed npm.txt

* Updated from npm-cli.txt

* Delete npm-cli.txt

* Revert "Swift Docs: Readme updated and url changed from 2.2 to 3.1" (#790)

* better code, fixed documentation link
  • Loading branch information
mayank authored and moollaza committed Mar 8, 2017
1 parent 079f25a commit ffdc4dc
Show file tree
Hide file tree
Showing 6 changed files with 436 additions and 0 deletions.
70 changes: 70 additions & 0 deletions lib/fathead/meteor_api/fetch.js
@@ -0,0 +1,70 @@
#!/usr/bin/env node
(function(){
'use strict';

const BASE_URL = 'http://docs.meteor.com/';
const DOWNLOAD_DIR = 'download/';

const debug = false;

const fs = require('graceful-fs');
const jsdom = require('jsdom');
const chalk = require('chalk');
const http = require('http');

function downloadByURL(url, cb){

var uri = url.replace(BASE_URL, "").split("/").join("_") || 'index.html';
if(debug) console.log(chalk.cyan('Fetching => ') + url);

http.get(url, function(res){
var chunk = '';

res.on('data', function(body){
fs.appendFileSync(DOWNLOAD_DIR + uri, body);
chunk += body;
});

res.on('end', function(){
if(debug) console.log(chalk.green('Written to File : ') + DOWNLOAD_DIR + uri);

if(typeof cb == 'function') {
var html = chunk.toString('utf-8');
cb(html);
}
});

});
};

function main(){

downloadByURL(BASE_URL, function(fileContent){
jsdom.env(fileContent, function(err, window){

if (err) {
console.error(err)
return;
}

var toc = window.document.querySelectorAll('.item-toc');

for(var i=0;i<toc.length; i++){
var selector = toc[i].firstElementChild;
var href = selector.href;
if(debug) console.log(chalk.red('Downloading ==> ') + href);

if(href.startsWith('api/')){
downloadByURL(BASE_URL + href);
}
}

window.close();
});
});

}

main();

})();
5 changes: 5 additions & 0 deletions lib/fathead/meteor_api/fetch.sh
@@ -0,0 +1,5 @@
#!/usr/bin/sh

mkdir -p download
rm -rf download/*
node fetch.js

0 comments on commit ffdc4dc

Please sign in to comment.