AlphaGitHub
Source/Packages

Compiler.AST

packages/compiler/src/Compiler/AST.alpha

166 lines117 declarations5.7 KiBSHA-256 a0f24e9809ba
Download exact fileView at revisionf5034773ad4bb52133

def · lines 146–155

tokenizeSource

Full file
146def tokenizeSource =
147  (lambda unrestricted input : Bytes .
148    (bytes-eliminate
149      (lambda unrestricted remaining : Bytes . (family SourceBytes))
150      (constructor SourceBytes SourceEnd)
151      (lambda unrestricted head : Byte .
152        (lambda unrestricted tail : Bytes .
153          (lambda unrestricted tokenizedTail : (family SourceBytes) .
154            (constructor SourceBytes SourceByte head tokenizedTail))))
155      input))

The compiler supplied declaration spans and resolved links from this source snapshot. This page does not assert that this file belongs to a checked closure.