sqlfluff

Changed

• Big Rewrite - some loss in functionality might be apparent compared to pre-0.1.0. Please submit any major problems as issues on github
• Changed unicode handling for better escape codes in python 2. Thanks @mrshu
• BIG rewrite of the parser, completely new architecture. This introduces breaking changes and some loss of functionality while we catch up.
  • In particular, matches now return partial matches to speed up parsing.
  • The Delimited matcher has had a significant re-write with a major speedup and broken the dependency on Sequence.
  • Rewrite of StartsWith and Sequence to use partial matches properly.
  • Different treatment of numeric literals.
  • Both Bracketed and Delimited respect bracket counting.
  • MASSIVE rewrite of Bracketed.
• Grammars now have timers.
• Joins properly parsing,
• Rewrite of logging to selectively output commands at different levels of verbosity. This uses the verbosity_logger method.
• Added a command line sqlfluff parse option which runs just the parsing step of the process to better understand how a file is being parsed. This also has options to configure how deep we recurse.
• Complete Re-write of the rules section, implementing new crawlers which implement the linting rules. Now with inbuilt fixers in them.
• Old rules removed and re implemented so we now have parity with the old rule sets.
• Moved to using Ref mostly within the core grammar so that we can have recursion.
• Used recursion to do a first implementation of arithmetic parsing. Including a test for it.
• Moved the main grammar into a separate dialect and renamed source and test files accordingly.
• Moved to file-based tests for the ansi dialect to make it easier to test using the tool directly.
• As part of file tests - expected outcomes are now encoded in yaml to make it easier to write new tests.
• Vastly improved readability and debugging potential of the _match logging.
• Added support for windows line endings in the lexer.