Pushdown automaton

In the theory of computation, a branch of theoretical computer science, a pushdown automaton (PDA) is a type of automaton that employs a stack.

Classes of automata

Pushdown automata are used in theories about what can be computed by machines. They are more capable than finite-state machines but less capable than Turing machines. Deterministic pushdown automata can recognize all deterministic context-free languages while nondeterministic ones can recognize all context-free languages, with the former often used in parser design.

The term "pushdown" refers to the fact that the stack can be regarded as being "pushed down" like a tray dispenser at a cafeteria, since the operations never work on elements other than the top element. A stack automaton, by contrast, does allow access to and operations on deeper elements. Stack automata can recognize a strictly larger set of languages than pushdown automata.[1] A nested stack automaton allows full access, and also allows stacked values to be entire sub-stacks rather than just single finite symbols.

Informal description

A diagram of a pushdown automaton

A finite-state machine just looks at the input signal and the current state: it has no stack to work with. It chooses a new state, the result of following the transition. A pushdown automaton (PDA) differs from a finite state machine in two ways:

1. It can use the top of the stack to decide which transition to take.
2. It can manipulate the stack as part of performing a transition.

A pushdown automaton reads a given input string from left to right. In each step, it chooses a transition by indexing a table by input symbol, current state, and the symbol at the top of the stack. A pushdown automaton can also manipulate the stack, as part of performing a transition. The manipulation can be to push a particular symbol to the top of the stack, or to pop off the top of the stack. The automaton can alternatively ignore the stack, and leave it as it is.

Put together: Given an input symbol, current state, and stack symbol, the automaton can follow a transition to another state, and optionally manipulate (push or pop) the stack.

If, in every situation, at most one such transition action is possible, then the automaton is called a deterministic pushdown automaton (DPDA). In general, if several actions are possible, then the automaton is called a general, or nondeterministic, PDA. A given input string may drive a nondeterministic pushdown automaton to one of several configuration sequences; if one of them leads to an accepting configuration after reading the complete input string, the latter is said to belong to the language accepted by the automaton.

Formal definition

We use standard formal language notation: ${\displaystyle \Gamma ^{*}}$ denotes the set of finite-length strings over alphabet ${\displaystyle \Gamma }$ and ${\displaystyle \varepsilon }$ denotes the empty string.

A PDA is formally defined as a 7-tuple:

${\displaystyle M=(Q,\Sigma ,\Gamma ,\delta ,q_{0},Z,F)}$ where

• ${\displaystyle Q}$ is a finite set of states
• ${\displaystyle \Sigma }$ is a finite set which is called the input alphabet
• ${\displaystyle \Gamma }$ is a finite set which is called the stack alphabet
• ${\displaystyle \delta }$ is a finite subset of ${\displaystyle Q\times (\Sigma \cup \{\varepsilon \})\times \Gamma \times Q\times \Gamma ^{*}}$, the transition relation
• ${\displaystyle q_{0}\in Q}$ is the start state
• ${\displaystyle Z\in \Gamma }$ is the initial stack symbol
• ${\displaystyle F\subseteq Q}$ is the set of accepting states

An element ${\displaystyle (p,a,A,q,\alpha )\in \delta }$ is a transition of ${\displaystyle M}$. It has the intended meaning that ${\displaystyle M}$, in state ${\displaystyle p\in Q}$, on the input ${\displaystyle a\in \Sigma \cup \{\varepsilon \}}$ and with ${\displaystyle A\in \Gamma }$ as topmost stack symbol, may read ${\displaystyle a}$, change the state to ${\displaystyle q}$, pop ${\displaystyle A}$, replacing it by pushing ${\displaystyle \alpha \in \Gamma ^{*}}$. The ${\displaystyle (\Sigma \cup \{\varepsilon \})}$ component of the transition relation is used to formalize that the PDA can either read a letter from the input, or proceed leaving the input untouched.

In many texts[2]^:110 the transition relation is replaced by an (equivalent) formalization, where

• ${\displaystyle \delta }$ is the transition function, mapping ${\displaystyle Q\times (\Sigma \cup \{\varepsilon \})\times \Gamma }$ into finite subsets of ${\displaystyle Q\times \Gamma ^{*}}$

Here ${\displaystyle \delta (p,a,A)}$ contains all possible actions in state ${\displaystyle p}$ with ${\displaystyle A}$ on the stack, while reading ${\displaystyle a}$ on the input. One writes for example ${\displaystyle \delta (p,a,A)=\{(q,BA)\}}$ precisely when ${\displaystyle (q,BA)\in \{(q,BA)\},(q,BA)\in \delta (p,a,A),}$ because ${\displaystyle ((p,a,A),\{(q,BA)\})\in \delta }$. Note that finite in this definition is essential.

Computations

a step of the pushdown automaton

In order to formalize the semantics of the pushdown automaton a description of the current situation is introduced. Any 3-tuple ${\displaystyle (p,w,\beta )\in Q\times \Sigma ^{*}\times \Gamma ^{*}}$ is called an instantaneous description (ID) of ${\displaystyle M}$, which includes the current state, the part of the input tape that has not been read, and the contents of the stack (topmost symbol written first). The transition relation ${\displaystyle \delta }$ defines the step-relation ${\displaystyle \vdash _{M}}$ of ${\displaystyle M}$ on instantaneous descriptions. For instruction ${\displaystyle (p,a,A,q,\alpha )\in \delta }$ there exists a step ${\displaystyle (p,ax,A\gamma )\vdash _{M}(q,x,\alpha \gamma )}$, for every ${\displaystyle x\in \Sigma ^{*}}$ and every ${\displaystyle \gamma \in \Gamma ^{*}}$.

In general pushdown automata are nondeterministic meaning that in a given instantaneous description ${\displaystyle (p,w,\beta )}$ there may be several possible steps. Any of these steps can be chosen in a computation. With the above definition in each step always a single symbol (top of the stack) is popped, replacing it with as many symbols as necessary. As a consequence no step is defined when the stack is empty.

Computations of the pushdown automaton are sequences of steps. The computation starts in the initial state ${\displaystyle q_{0}}$ with the initial stack symbol ${\displaystyle Z}$ on the stack, and a string ${\displaystyle w}$ on the input tape, thus with initial description ${\displaystyle (q_{0},w,Z)}$. There are two modes of accepting. The pushdown automaton either accepts by final state, which means after reading its input the automaton reaches an accepting state (in ${\displaystyle F}$), or it accepts by empty stack (${\displaystyle \varepsilon }$), which means after reading its input the automaton empties its stack. The first acceptance mode uses the internal memory (state), the second the external memory (stack).

Formally one defines

1. ${\displaystyle L(M)=\{w\in \Sigma ^{*}|(q_{0},w,Z)\vdash _{M}^{*}(f,\varepsilon ,\gamma )}$ with ${\displaystyle f\in F}$ and ${\displaystyle \gamma \in \Gamma ^{*}\}}$ (final state)
2. ${\displaystyle N(M)=\{w\in \Sigma ^{*}|(q_{0},w,Z)\vdash _{M}^{*}(q,\varepsilon ,\varepsilon )}$ with ${\displaystyle q\in Q\}}$ (empty stack)

Here ${\displaystyle \vdash _{M}^{*}}$ represents the reflexive and transitive closure of the step relation ${\displaystyle \vdash _{M}}$ meaning any number of consecutive steps (zero, one or more).

For each single pushdown automaton these two languages need to have no relation: they may be equal but usually this is not the case. A specification of the automaton should also include the intended mode of acceptance. Taken over all pushdown automata both acceptance conditions define the same family of languages.

Theorem. For each pushdown automaton ${\displaystyle M}$ one may construct a pushdown automaton ${\displaystyle M'}$ such that ${\displaystyle L(M)=N(M')}$, and vice versa, for each pushdown automaton ${\displaystyle M}$ one may construct a pushdown automaton ${\displaystyle M'}$ such that ${\displaystyle N(M)=L(M')}$

Example

The following is the formal description of the PDA which recognizes the language ${\displaystyle \{0^{n}1^{n}\mid n\geq 0\}}$ by final state:

PDA for ${\displaystyle \{0^{n}1^{n}\mid n\geq 0\}}$
(by final state)

${\displaystyle M=(Q,\ \Sigma ,\ \Gamma ,\ \delta ,\ q_{0},\ Z,\ F)}$, where

• states: ${\displaystyle Q=\{p,q,r\}}$
• input alphabet: ${\displaystyle \Sigma =\{0,1\}}$
• stack alphabet: ${\displaystyle \Gamma =\{A,Z\}}$
• start state: ${\displaystyle q_{0}=p}$
• start stack symbol: Z
• accepting states: ${\displaystyle F=\{r\}}$

The transition relation ${\displaystyle \delta }$ consists of the following six instructions:

${\displaystyle (p,0,Z,p,AZ)}$,

${\displaystyle (p,0,A,p,AA)}$,

${\displaystyle (p,\epsilon ,Z,q,Z)}$,

${\displaystyle (p,\epsilon ,A,q,A)}$,

${\displaystyle (q,1,A,q,\epsilon )}$, and

${\displaystyle (q,\epsilon ,Z,r,Z)}$.

In words, the first two instructions say that in state p any time the symbol 0 is read, one A is pushed onto the stack. Pushing symbol A on top of another A is formalized as replacing top A by AA (and similarly for pushing symbol A on top of a Z).

The third and fourth instructions say that, at any moment the automaton may move from state p to state q.

The fifth instruction says that in state q, for each symbol 1 read, one A is popped.

Finally, the sixth instruction says that the machine may move from state q to accepting state r only when the stack consists of a single Z.

There seems to be no generally used representation for PDA. Here we have depicted the instruction ${\displaystyle (p,a,A,q,\alpha )}$ by an edge from state p to state q labelled by ${\displaystyle a;A/\alpha }$ (read a; replace A by ${\displaystyle \alpha }$).

Understanding the computation process

accepting computation for 0011

The following illustrates how the above PDA computes on different input strings. The subscript M from the step symbol ${\displaystyle \vdash }$ is here omitted.

1. Input string = 0011. There are various computations, depending on the moment the move from state p to state q is made. Only one of these is accepting.
   1. ${\displaystyle (p,0011,Z)\vdash (q,0011,Z)\vdash (r,0011,Z)}$
      The final state is accepting, but the input is not accepted this way as it has not been read.
   2. ${\displaystyle (p,0011,Z)\vdash (p,011,AZ)\vdash (q,011,AZ)}$
      No further steps possible.
   3. ${\displaystyle (p,0011,Z)\vdash (p,011,AZ)\vdash (p,11,AAZ)\vdash (q,11,AAZ)\vdash (q,1,AZ)\vdash (q,\epsilon ,Z)\vdash (r,\epsilon ,Z)}$
      Accepting computation: ends in accepting state, while complete input has been read.
2. Input string = 00111. Again there are various computations. None of these is accepting.
   1. ${\displaystyle (p,00111,Z)\vdash (q,00111,Z)\vdash (r,00111,Z)}$
      The final state is accepting, but the input is not accepted this way as it has not been read.
   2. ${\displaystyle (p,00111,Z)\vdash (p,0111,AZ)\vdash (q,0111,AZ)}$
      No further steps possible.
   3. ${\displaystyle (p,00111,Z)\vdash (p,0111,AZ)\vdash (p,111,AAZ)\vdash (q,111,AAZ)\vdash (q,11,AZ)\vdash (q,1,Z)\vdash (r,1,Z)}$
      The final state is accepting, but the input is not accepted this way as it has not been (completely) read.

PDA and context-free languages

Every context-free grammar can be transformed into an equivalent nondeterministic pushdown automaton. The derivation process of the grammar is simulated in a leftmost way. Where the grammar rewrites a nonterminal, the PDA takes the topmost nonterminal from its stack and replaces it by the right-hand part of a grammatical rule (expand). Where the grammar generates a terminal symbol, the PDA reads a symbol from input when it is the topmost symbol on the stack (match). In a sense the stack of the PDA contains the unprocessed data of the grammar, corresponding to a pre-order traversal of a derivation tree.

Technically, given a context-free grammar, the PDA has a single state, 1, and its transition relation is constructed as follows.

1. ${\displaystyle (1,\varepsilon ,A,1,\alpha )}$ for each rule ${\displaystyle A\to \alpha }$ (expand)
2. ${\displaystyle (1,a,a,1,\varepsilon )}$ for each terminal symbol ${\displaystyle a}$ (match)

The PDA accepts by empty stack. Its initial stack symbol is the grammar's start symbol.

For a context-free grammar in Greibach normal form, defining (1,γ) ∈ δ(1,a,A) for each grammar rule A → aγ also yields an equivalent nondeterministic pushdown automaton.[2]^:115

The converse, finding a grammar for a given PDA, is not that easy. The trick is to code two states of the PDA into the nonterminals of the grammar.

Theorem. For each pushdown automaton ${\displaystyle M}$ one may construct a context-free grammar ${\displaystyle G}$ such that ${\displaystyle N(M)=L(G)}$.[2]^:116

The language of strings accepted by a deterministic pushdown automaton is called a deterministic context-free language. Not all context-free languages are deterministic.[note 1] As a consequence, the DPDA is a strictly weaker variant of the PDA and there exists no algorithm for converting a PDA to an equivalent DPDA, if such a DPDA exists.

A finite automaton with access to two stacks is a more powerful device, equivalent in power to a Turing machine.[2]^:171 A linear bounded automaton is a device which is more powerful than a pushdown automaton but less so than a Turing machine.[note 2]

Generalized pushdown automaton (GPDA)

A GPDA is a PDA which writes an entire string of some known length to the stack or removes an entire string from the stack in one step.

A GPDA is formally defined as a 6-tuple:

${\displaystyle M=(Q,\ \Sigma ,\ \Gamma ,\ \delta ,\ q_{0},\ F)}$

where ${\displaystyle Q,\Sigma \,,\Gamma \,,q_{0}}$, and ${\displaystyle F}$ are defined the same way as a PDA.

${\displaystyle \,\delta }$: ${\displaystyle Q\times \Sigma _{\epsilon }\times \Gamma ^{*}\longrightarrow P(Q\times \Gamma ^{*})}$

is the transition function.

Computation rules for a GPDA are the same as a PDA except that the ${\displaystyle a_{i+1}}$'s and ${\displaystyle b_{i+1}}$'s are now strings instead of symbols.

GPDA's and PDA's are equivalent in that if a language is recognized by a PDA, it is also recognized by a GPDA and vice versa.

One can formulate an analytic proof for the equivalence of GPDA's and PDA's using the following simulation:

Let ${\displaystyle \delta (q_{1},w,x_{1}x_{2}\cdot x_{m})\longrightarrow (q_{2},y_{1}y_{2}...y_{n})}$ be a transition of the GPDA

where ${\displaystyle q_{1},q_{2}\in Q,w\in \Sigma _{\epsilon },x_{1},x_{2},\ldots ,x_{m}\in \Gamma ^{*},m\geq 0,y_{1},y_{2},\ldots ,y_{n}\in \Gamma ^{*},n\geq 0}$.

Construct the following transitions for the PDA:

${\displaystyle {\begin{array}{lcl}\delta ^{'}(q_{1},w,x_{1})&\longrightarrow &(p_{1},\epsilon )\\\delta ^{'}(p_{1},\epsilon ,x_{2})&\longrightarrow &(p_{2},\epsilon )\\&\vdots &\\\delta ^{'}(p_{m-1},\epsilon ,x_{m})&\longrightarrow &(p_{m},\epsilon )\\\delta ^{'}(p_{m},\epsilon ,\epsilon )&\longrightarrow &(p_{m+1},y_{n})\\\delta ^{'}(p_{m+1},\epsilon ,\epsilon )&\longrightarrow &(p_{m+2},y_{n-1})\\&\vdots &\\\delta ^{'}(p_{m+n-1},\epsilon ,\epsilon )&\longrightarrow &(q_{2},y_{1})\end{array}}}$

Stack automaton

As a generalization of pushdown automata, Ginsburg, Greibach, and Harrison (1967) investigated stack automata, which may additionally step left or right in the input string (surrounded by special endmarker symbols to prevent slipping out), and step up or down in the stack in read-only mode.[4][5] A stack automaton is called nonerasing if it never pops from the stack. The class of languages accepted by nondeterministic, nonerasing stack automata is NSPACE(n²), which is a superset of the context-sensitive languages.[1] The class of languages accepted by deterministic, nonerasing stack automata is DSPACE(n⋅log(n)).[1]

Alternating pushdown automata

An alternating pushdown automaton (APDA) is a pushdown automaton with a state set

• ${\displaystyle Q=Q_{\exists }\cup Q_{\forall }}$ where ${\displaystyle Q_{\exists }\cap Q_{\forall }=\emptyset }$.

States in ${\displaystyle Q_{\exists }}$ and ${\displaystyle Q_{\forall }}$ are called existential resp. universal. In an existential state an APDA nondeterministically chooses the next state and accepts if at least one of the resulting computations accepts. In a universal state APDA moves to all next states and accepts if all the resulting computations accept.

The model was introduced by Chandra, Kozen and Stockmeyer.[6] Ladner, Lipton and Stockmeyer[7] proved that this model is equivalent to EXPTIME i.e. a language is accepted by some APDA if, and only if, it can be decided by an exponential-time algorithm.

Aizikowitz and Kaminski[8] introduced synchronized alternating pushdown automata (SAPDA) that are equivalent to conjunctive grammars in the same way as nondeterministic PDA are equivalent to context-free grammars.

See also

• Stack machine
• Context-free grammar
• Finite automaton
• Counter automaton
• Queue automaton

Notes

1. The set of even-length palindromes of bits can't be recognized by a deterministic PDA, but is a context-free language, with the grammar S → ε | 0S0 | 1S1.[3]
2. Linear bounded automata are acceptors for the class of context-sensitive languages,[2]^:225 which is a proper superclass of the context-free languages, and a proper subclass of Turing-recognizable (i.e. recursively enumerable) languages.[2]^:228

References

1. John E. Hopcroft; Jeffrey D. Ullman (1967). "Nonerasing Stack Automata". Journal of Computer and System Sciences. 1 (2): 166–186. doi:10.1016/s0022-0000(67)80013-8.
2. John E. Hopcroft and Jeffrey D. Ullman (1979). Introduction to Automata Theory, Languages, and Computation. Reading/MA: Addison-Wesley. ISBN 0-201-02988-X.
3. John E. Hopcroft; Rajeev Motwani; Jeffrey D. Ullman (2003). Introduction to Automata Theory, Languages, and Computation. Addison Wesley. Here: Sect.6.4.3, p.249
4. Seymour Ginsburg, Sheila A. Greibach and Michael A. Harrison (1967). "Stack Automata and Compiling". J. ACM. 14 (1): 172–201. doi:10.1145/321371.321385.
5. Seymour Ginsburg, Sheila A. Greibach and Michael A. Harrison (1967). "One-Way Stack Automata". J. ACM. 14 (2): 389–418. doi:10.1145/321386.321403.
6. Chandra, Ashok K.; Kozen, Dexter C.; Stockmeyer, Larry J. (1981). "Alternation". Journal of the ACM. 28 (1): 114–133. doi:10.1145/322234.322243. ISSN 0004-5411.
7. Ladner, Richard E.; Lipton, Richard J.; Stockmeyer, Larry J. (1984). "Alternating Pushdown and Stack Automata". SIAM Journal on Computing. 13 (1): 135–155. doi:10.1137/0213010. ISSN 0097-5397.
8. Aizikowitz, Tamar; Kaminski, Michael (2011). "LR(0) Conjunctive Grammars and Deterministic Synchronized Alternating Pushdown Automata". Computer Science – Theory and Applications. Lecture Notes in Computer Science. 6651. pp. 345–358. doi:10.1007/978-3-642-20712-9_27. ISBN 978-3-642-20711-2. ISSN 0302-9743.

• Michael Sipser (1997). Introduction to the Theory of Computation. PWS Publishing. ISBN 0-534-94728-X. Section 2.2: Pushdown Automata, pp. 101–114.
• Jean-Michel Autebert, Jean Berstel, Luc Boasson, Context-Free Languages and Push-Down Automata, in: G. Rozenberg, A. Salomaa (eds.), Handbook of Formal Languages, Vol. 1, Springer-Verlag, 1997, 111-174.

External links

• JFLAP, simulator for several types of automata including nondeterministic pushdown automata
• CoAn, another simulator for several machine types including nondeterministic pushdown automata (C++, Windows, Linux, MacOS)