Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Ripper for lexical analyser #512

Merged
merged 151 commits into from
Sep 12, 2017
Merged

Use Ripper for lexical analyser #512

merged 151 commits into from
Sep 12, 2017

Commits on Sep 5, 2017

  1. Configuration menu
    Copy the full SHA
    9fe38ca View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ae8e8ce View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d4d684c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c39f7f0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    1e61ab1 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    9f59a91 View commit details
    Browse the repository at this point in the history
  7. Fix parse_module for Ripper

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    5dcc452 View commit details
    Browse the repository at this point in the history
  8. Fix test_get_class_or_module

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    9338eec View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    7cd8575 View commit details
    Browse the repository at this point in the history
  10. Comment out some old code

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    b5443f9 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    e914d68 View commit details
    Browse the repository at this point in the history
  12. Fix for test_parse_alias

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    9eab386 View commit details
    Browse the repository at this point in the history
  13. Fix for rdoc command running

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    32eec2a View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    5021a1b View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    abc30fd View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    352f5ed View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    829fdba View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    1a2b601 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    d94a38d View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    e2d63ff View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    83b5b78 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    f6111fd View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    d10dcc5 View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    b9d53b2 View commit details
    Browse the repository at this point in the history
  25. Configuration menu
    Copy the full SHA
    a104381 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    55a18bb View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    6fe9b92 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    e37e73e View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    9d677e8 View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    b7ec322 View commit details
    Browse the repository at this point in the history
  31. Configuration menu
    Copy the full SHA
    7039be0 View commit details
    Browse the repository at this point in the history
  32. Fix for test_parse_attr.*

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    789b3cf View commit details
    Browse the repository at this point in the history
  33. Configuration menu
    Copy the full SHA
    d967b49 View commit details
    Browse the repository at this point in the history
  34. Fix for test_sanity_integer

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    36f6e01 View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    11a67a4 View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    8b98cf7 View commit details
    Browse the repository at this point in the history
  37. Remove unnecessary condition

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    8cdad9d View commit details
    Browse the repository at this point in the history
  38. Configuration menu
    Copy the full SHA
    f8e44b6 View commit details
    Browse the repository at this point in the history
  39. Fix test_read_directive

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    2ff8110 View commit details
    Browse the repository at this point in the history
  40. Configuration menu
    Copy the full SHA
    d85909e View commit details
    Browse the repository at this point in the history
  41. Fix test_read_directive_.*

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    9bfac9d View commit details
    Browse the repository at this point in the history
  42. Configuration menu
    Copy the full SHA
    9710964 View commit details
    Browse the repository at this point in the history
  43. Configuration menu
    Copy the full SHA
    f299898 View commit details
    Browse the repository at this point in the history
  44. Configuration menu
    Copy the full SHA
    288e3b3 View commit details
    Browse the repository at this point in the history
  45. Configuration menu
    Copy the full SHA
    7acaf58 View commit details
    Browse the repository at this point in the history
  46. Configuration menu
    Copy the full SHA
    4971265 View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    e91c8b1 View commit details
    Browse the repository at this point in the history
  48. Configuration menu
    Copy the full SHA
    8af6e17 View commit details
    Browse the repository at this point in the history
  49. Configuration menu
    Copy the full SHA
    84ff7c6 View commit details
    Browse the repository at this point in the history
  50. Configuration menu
    Copy the full SHA
    8cd6e15 View commit details
    Browse the repository at this point in the history
  51. Squash embdoc

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    659a359 View commit details
    Browse the repository at this point in the history
  52. Configuration menu
    Copy the full SHA
    8d12a1d View commit details
    Browse the repository at this point in the history
  53. Configuration menu
    Copy the full SHA
    6569d87 View commit details
    Browse the repository at this point in the history
  54. Use RipperStateLex

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    692a25a View commit details
    Browse the repository at this point in the history
  55. Use :on_embdoc token

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    1bf4264 View commit details
    Browse the repository at this point in the history
  56. Configuration menu
    Copy the full SHA
    5eef8de View commit details
    Browse the repository at this point in the history
  57. Configuration menu
    Copy the full SHA
    bfcf3ac View commit details
    Browse the repository at this point in the history
  58. Configuration menu
    Copy the full SHA
    375b2f9 View commit details
    Browse the repository at this point in the history
  59. Fix test_rdoc_any_method.rb, test_rdoc_parser_ruby.rb and test_rdoc_t…

    …oken_stream.rb for RipperStateLex
    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    b71ce89 View commit details
    Browse the repository at this point in the history
  60. Configuration menu
    Copy the full SHA
    d6066f1 View commit details
    Browse the repository at this point in the history
  61. Configuration menu
    Copy the full SHA
    cb88303 View commit details
    Browse the repository at this point in the history
  62. Fix for variable warnings

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    fb6e70c View commit details
    Browse the repository at this point in the history
  63. Configuration menu
    Copy the full SHA
    1afc442 View commit details
    Browse the repository at this point in the history
  64. Configuration menu
    Copy the full SHA
    b5ee102 View commit details
    Browse the repository at this point in the history
  65. Configuration menu
    Copy the full SHA
    9bae9dc View commit details
    Browse the repository at this point in the history
  66. Fix for test_parse_for_in

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    9d54fa3 View commit details
    Browse the repository at this point in the history
  67. Fix postfix if/unless

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    298e698 View commit details
    Browse the repository at this point in the history
  68. Detect postfix if/unless

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    c658e09 View commit details
    Browse the repository at this point in the history
  69. Configuration menu
    Copy the full SHA
    4d8fc86 View commit details
    Browse the repository at this point in the history
  70. Configuration menu
    Copy the full SHA
    905b5cf View commit details
    Browse the repository at this point in the history
  71. Configuration menu
    Copy the full SHA
    d7dc989 View commit details
    Browse the repository at this point in the history
  72. Configuration menu
    Copy the full SHA
    e4e33fe View commit details
    Browse the repository at this point in the history
  73. Configuration menu
    Copy the full SHA
    d645082 View commit details
    Browse the repository at this point in the history
  74. Configuration menu
    Copy the full SHA
    262c595 View commit details
    Browse the repository at this point in the history
  75. Configuration menu
    Copy the full SHA
    07ee8b0 View commit details
    Browse the repository at this point in the history
  76. Configuration menu
    Copy the full SHA
    030d9cd View commit details
    Browse the repository at this point in the history
  77. Configuration menu
    Copy the full SHA
    3382e39 View commit details
    Browse the repository at this point in the history
  78. Collect up number with +/-

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    acc0486 View commit details
    Browse the repository at this point in the history
  79. Fix string treatment

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    f711f23 View commit details
    Browse the repository at this point in the history
  80. Configuration menu
    Copy the full SHA
    010a7f5 View commit details
    Browse the repository at this point in the history
  81. Configuration menu
    Copy the full SHA
    1633735 View commit details
    Browse the repository at this point in the history
  82. Configuration menu
    Copy the full SHA
    6959f72 View commit details
    Browse the repository at this point in the history
  83. Configuration menu
    Copy the full SHA
    4f62d1c View commit details
    Browse the repository at this point in the history
  84. Configuration menu
    Copy the full SHA
    bdd07e5 View commit details
    Browse the repository at this point in the history
  85. Fix for Ripper token access

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    9c03883 View commit details
    Browse the repository at this point in the history
  86. Skip all tests for RubyLex

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    4a3210a View commit details
    Browse the repository at this point in the history
  87. Squash dwrods with dstring

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    f2a0b08 View commit details
    Browse the repository at this point in the history
  88. Configuration menu
    Copy the full SHA
    012ccea View commit details
    Browse the repository at this point in the history
  89. Configuration menu
    Copy the full SHA
    7df38a8 View commit details
    Browse the repository at this point in the history
  90. Configuration menu
    Copy the full SHA
    80f6841 View commit details
    Browse the repository at this point in the history
  91. Configuration menu
    Copy the full SHA
    93e787d View commit details
    Browse the repository at this point in the history
  92. Configuration menu
    Copy the full SHA
    b318cf4 View commit details
    Browse the repository at this point in the history
  93. Fix %w[] treatment

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    7309e83 View commit details
    Browse the repository at this point in the history
  94. Configuration menu
    Copy the full SHA
    3e036cf View commit details
    Browse the repository at this point in the history
  95. Configuration menu
    Copy the full SHA
    54ee329 View commit details
    Browse the repository at this point in the history
  96. Split get_squashed_tk

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    bb4cf29 View commit details
    Browse the repository at this point in the history
  97. Configuration menu
    Copy the full SHA
    e27c741 View commit details
    Browse the repository at this point in the history
  98. Configuration menu
    Copy the full SHA
    6dc557b View commit details
    Browse the repository at this point in the history
  99. Configuration menu
    Copy the full SHA
    47b431b View commit details
    Browse the repository at this point in the history
  100. Support %i, %I and %W

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    21bb9ca View commit details
    Browse the repository at this point in the history
  101. Support symbol with const

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    099472c View commit details
    Browse the repository at this point in the history
  102. Configuration menu
    Copy the full SHA
    c1e3b83 View commit details
    Browse the repository at this point in the history
  103. Configuration menu
    Copy the full SHA
    5a94c0a View commit details
    Browse the repository at this point in the history
  104. Configuration menu
    Copy the full SHA
    b26c08d View commit details
    Browse the repository at this point in the history
  105. Squash heredoc as one token

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    e3525fd View commit details
    Browse the repository at this point in the history
  106. Configuration menu
    Copy the full SHA
    fe2ee65 View commit details
    Browse the repository at this point in the history
  107. Configuration menu
    Copy the full SHA
    0ec3a8e View commit details
    Browse the repository at this point in the history
  108. Configuration menu
    Copy the full SHA
    7c1fa22 View commit details
    Browse the repository at this point in the history
  109. Configuration menu
    Copy the full SHA
    e75ddc4 View commit details
    Browse the repository at this point in the history
  110. Configuration menu
    Copy the full SHA
    666bb0d View commit details
    Browse the repository at this point in the history
  111. Support lambda -> operator

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    55f2f6f View commit details
    Browse the repository at this point in the history
  112. Configuration menu
    Copy the full SHA
    e5195ee View commit details
    Browse the repository at this point in the history
  113. Configuration menu
    Copy the full SHA
    783c59e View commit details
    Browse the repository at this point in the history
  114. Configuration menu
    Copy the full SHA
    10949c8 View commit details
    Browse the repository at this point in the history
  115. Configuration menu
    Copy the full SHA
    6d0c7d0 View commit details
    Browse the repository at this point in the history
  116. Configuration menu
    Copy the full SHA
    5b65747 View commit details
    Browse the repository at this point in the history
  117. Configuration menu
    Copy the full SHA
    00e88d2 View commit details
    Browse the repository at this point in the history
  118. Fix typo

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    d2b01e0 View commit details
    Browse the repository at this point in the history
  119. Skip unnecessary :on_comment

    The read_directive method sets back tokens and
    the parse_statements method read comment token after newline token,
    but Ripper doesn't separate comment and newline unlike IRB scanner.
    So previous directive at end of line improperly connects to
    next comment tokens for documentation.
    This commit fixes it.
    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    3c55a39 View commit details
    Browse the repository at this point in the history
  120. Support symbol with keyword

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    34fb3ba View commit details
    Browse the repository at this point in the history
  121. Configuration menu
    Copy the full SHA
    d1cfa70 View commit details
    Browse the repository at this point in the history
  122. Configuration menu
    Copy the full SHA
    b7e39ce View commit details
    Browse the repository at this point in the history
  123. Configuration menu
    Copy the full SHA
    0c5ec7d View commit details
    Browse the repository at this point in the history
  124. Configuration menu
    Copy the full SHA
    1955b68 View commit details
    Browse the repository at this point in the history
  125. Fix % words syntax

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    bfda75e View commit details
    Browse the repository at this point in the history
  126. Configuration menu
    Copy the full SHA
    4fa207c View commit details
    Browse the repository at this point in the history
  127. Configuration menu
    Copy the full SHA
    cc208fe View commit details
    Browse the repository at this point in the history
  128. Configuration menu
    Copy the full SHA
    debdaee View commit details
    Browse the repository at this point in the history
  129. Check nil

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    b06882a View commit details
    Browse the repository at this point in the history
  130. Configuration menu
    Copy the full SHA
    1843528 View commit details
    Browse the repository at this point in the history
  131. Configuration menu
    Copy the full SHA
    8dbd3fb View commit details
    Browse the repository at this point in the history
  132. Configuration menu
    Copy the full SHA
    8193399 View commit details
    Browse the repository at this point in the history
  133. Fix postfix :nodoc: handling

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    a110189 View commit details
    Browse the repository at this point in the history
  134. Configuration menu
    Copy the full SHA
    6aec6b0 View commit details
    Browse the repository at this point in the history
  135. Configuration menu
    Copy the full SHA
    e7a504c View commit details
    Browse the repository at this point in the history
  136. Fix heredoc end checking

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    050de61 View commit details
    Browse the repository at this point in the history
  137. Configuration menu
    Copy the full SHA
    0422275 View commit details
    Browse the repository at this point in the history
  138. Fix condition with paren

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    7b47060 View commit details
    Browse the repository at this point in the history
  139. Configuration menu
    Copy the full SHA
    415a40d View commit details
    Browse the repository at this point in the history
  140. Configuration menu
    Copy the full SHA
    6d808d3 View commit details
    Browse the repository at this point in the history
  141. Configuration menu
    Copy the full SHA
    1ffde6c View commit details
    Browse the repository at this point in the history
  142. Configuration menu
    Copy the full SHA
    4eb4651 View commit details
    Browse the repository at this point in the history
  143. Configuration menu
    Copy the full SHA
    d881b6b View commit details
    Browse the repository at this point in the history
  144. Configuration menu
    Copy the full SHA
    e26fdfc View commit details
    Browse the repository at this point in the history
  145. Configuration menu
    Copy the full SHA
    a8ea955 View commit details
    Browse the repository at this point in the history
  146. Remove unnecessary variable

    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    a2b511c View commit details
    Browse the repository at this point in the history
  147. Configuration menu
    Copy the full SHA
    2725175 View commit details
    Browse the repository at this point in the history
  148. Configuration menu
    Copy the full SHA
    80b7445 View commit details
    Browse the repository at this point in the history
  149. Fix handling method parmeter

      def a, b, # comment
          c
      end
    
    This is valid definition of method with a comment inside args.
    This commit fixes behavior for it.
    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    f3807d7 View commit details
    Browse the repository at this point in the history
  150. Configuration menu
    Copy the full SHA
    6ff1766 View commit details
    Browse the repository at this point in the history
  151. Support earlier than Ruby 2.4

    Remove String#match? and heredoc with ">>~".
    aycabta committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    1946c08 View commit details
    Browse the repository at this point in the history