Time complexity for deterministic string machines

alcatal

This was a project conducted during MATS 5.0 under the mentorship of Vanessa Kosoy and supported by a grant from BERI. It builds off the String Machines framework (and depends on the linked post for certain definitions), which models category-theoretic generalizations of finite-state transducers. [EDIT: The results here can also be found presented in self-contained form, in this paper.]

The framework as it previously existed did not have representation-independent ways of bounding (analogues of) time complexity, or natural guarantees that output size would not grow exponentially in input size. We introduce "filtered" transducers, which operate on categories enriched over filtered sets (sets equipped with a function to a partially ordered monoid, where morphisms are functions respecting order), and then, restricting our attention to transducers with a finite state space, prove constraints on the time complexity growth and expressivity of string machines.

Parameterizing complexity in string machines

Filtered transducers

Definition 1. The category of filtered sets is the category such that
an object is a tuple $(S, {deg}_{S})$ , where $S$ is a set and ${deg}_{S} : S \to N$ is a function,
a morphism $f : (S, {deg}_{S}) \to (T, {deg}_{T})$ is a function $S \to T$ such that ${deg}_{T} (f (s)) \leq {deg}_{S} (s)$ for all $s \in S$ .

We will generally refer to objects in $F i l t S e t$ solely by the symbol corresponding to the underlying set going forward. One can observe that the identity function on a set $S$ by definition satisfies ${deg}_{S} ({i d}_{S} (s)) = {deg}_{S} (s)$ for all $s \in S$ and is thus a morphism in $F i l t S e t$ . One can also observe that given $f : S \to T$ and $g : T \to V$ , ${deg}_{V} (g (f (s))) \leq {deg}_{T} (f (s)) \leq {deg}_{S} (s)$ for all $s \in S$ , and therefore $g \circ f$ is also a morphism in $F i l t S e t$ . Therefore, $F i l t S e t$ is indeed a category.

Definition 2. Given two objects $S, T \in O b (F i l t S e t)$ , we define their filtered product $S \otimes T$ to be the set $S \times T$ equipped with the function ${deg}_{S \otimes T} : S \times T \to N$ satisfying ${deg}_{S \otimes T} (s, t) = {deg}_{S} (s) + {deg}_{T} (t)$ for all $(s, t) \in S \times T$ . Given a morphism $f : S \to U$ and a morphism $g : T \to V$ , we define the morphism $f \otimes g : S \otimes T \to U \otimes V$ to be the function $f \times g$ . Indeed, we have that ${deg}_{U \otimes V} (f (s), g (t)) = {deg}_{U} (f (s)) + {deg}_{V} (g (t)) \leq {deg}_{S} (s) + {deg}_{T} (t) = {deg}_{S \otimes T} (s, t)$ , so $f \otimes g$ is a morphism in $F i l t S e t$ .

Due to the associativity and commutativity of addition, as well as the natural associativity and commutativity (up to isomorphisms which are still isomorphisms in $F i l t S e t$ ) of the cartesian product, $- \otimes -$ is naturally associative and commutative up to isomorphism. Additionally, the one-element set $1$ equipped with ${deg}_{1} (\cdot) = 0$ and unitor maps which are the same as in $S e t$ (which are, by their definition, filtered morphisms) provides a left and right unit for $- \otimes -$ , making $F i l t S e t$ a symmetric monoidal category.

Remark. Suppose filtered sets $S, T, U$ and filtered morphisms $f : S \to T$ and $g : S \to U$ . Then, the unique factoring function $S \to T \times U$ defined by $s \mapsto (f (s), g (s))$ is only a filtered morphism $S \to T \otimes U$ if ${deg}_{T} (f (s)) + {deg}_{U} (g (s)) \leq {deg}_{S} (s)$ , which does not hold in general. Therefore, $- \otimes -$ does not provide a product except for when at least one of the sets has degree uniformly zero. However, $F i l t S e t$ does have finite products $S \times T$ where ${deg}_{S \times T} (s, t) := max ({deg}_{S} (s), {deg}_{T} (t))$ . We will not be using this construction.

Remark. The set-theoretic disjoint union, with its degree function being the canonical factoring map to $N$ of its components' degree functions, provides all finite coproducts in $F i l t S e t$ .

Definition 3. A filtered-morphism category $C$ is a locally small symmetric monoidal category enriched over $F i l t S e t$ , using $F i l t S e t$ 's filtered product $- \otimes -$ as its monoidal structure.

This expresses the notion of morphisms having degrees which are subadditive under composition in a way that naturally extends to a complexity constraint on transducers. As the monoidal identity of $F i l t S e t$ is the single-element set with degree zero, the arrows $I_{F i l t S e t} \to {H o m}_{C} (A, A)$ providing the identity morphism ${i d}_{A}$ in the enrichment construction will ensure that identity morphisms are degree zero.

One can generalize the construction of $F i l t s e t$ by replacing $N$ with any partially-ordered symmetric monoid (where the partial order is, obviously, translation-invariant as it is with the usual definition of a partially-ordered group). We will make use of categories filtered over $N^{2}$ (with the partial order given by $(a, b) \leq (c, d)$ if and only if $a \leq c$ and $b \leq d$ ) in our construction of the filtered state category, as follows:

Definition 4. Given a filtered-morphism category $C$ and a list ${(X_{i} \to Y_{i}, a_{i} x + b_{i})}_{i}$ of $C$ -signatures (generators) and linear polynomials with coefficients in $N$ , the freely-generated $N^{2}$ -filtered category over $C$ with this list of signatures, or $C [X_{1} \to Y_{1}, \dots, X_{n} \to Y_{n}]$ , is the symmetric monoidal category where:
objects are exactly the objects of $C$ .
A morphism $f : X \to Y$ is either a morphism of $C$ , or obtained by composing morphisms of $C$ with free generators added to ${H o m}_{C} (X_{i}, Y_{i})$ for each $C$ -signature $X_{i} \to Y_{i}$ in the list.
The $N^{2}$ -degree of a morphism $f$ is a linear polynomial with coefficients in $N$ , which is either its degree in $C$ (expressed as a constant) if it is a $C$ -morphism, the polynomial $a_{i} x + b_{i}$ if it is one of the generators $X_{i} \to Y_{i}$ added when creating the category, or the sum of the degrees of all morphisms involved in its composition, with the degree contributions of composition-chains of $C$ -morphisms being the degrees in $C$ of the morphism they compose to, and these being strictly additive with each other and the degrees of any generator morphisms once all simplifications have been performed.

The monoidal product of a morphism with generators in its composition-chain and a $C$ -morphism is taken to have the sum of their $N^{2}$ -degrees.

We can now introduce filtered state categories.

Definition 5. Given a filtered-morphism category $C$ , its corresponding filtered state category $C^{S}$ is the category where
an object $A$ is a tuple $(S (A), V_{A}, {deg}_{A})$ , where:
The state space of $A$ is a set $S (A)$ .
The variables of $A$ are a functor $V_{A}$ from the discrete category corresponding to $S (A)$ to the discrete category formed by all finite ordered tuples of pairs of objects $X, Y$ in $C$ . We call the tuple associated with a given $x \in S (A)$ the variables at $x$ , or $V_{A} (x)$ . Since variables implicitly denote morphism signatures, we will refer to a given variable $(X, Y) \in V_{A} (x)$ as $X \to Y$ .
The degree of a variable $X \to Y \in V_{A} (x)$ for some $x \in S (A)$ , denoted ${deg}_{A, x} (X \to Y)$ (or simply ${deg}_{A} (X \to Y)$ if $x$ can be inferred from context) is a tuple $(a, b) \in N^{2}$ . We impose the same partial ordering $\leq$ on these tuples as we do with degrees in the freely-generated $N^{2}$ -filtered categories.
a morphism $f : A \to B$ of degree $ℓ$ , where $ℓ \in N$ , is a tuple $(S (f), V_{f})$ , where:
The state transition $S (f)$ is a function $S (A) \to S (B)$ .
The output function at $x \in S (A)$ , denoted $V_{f} (x)$ , is a collection of morphisms in a freely-generated $N^{2}$ -filtered category over $C$ , defined as follows:

For each variable $X_{j}^{'} \to Y_{j}^{'}$ of degree $a_{j}^{'} x + b_{j}^{'}$ , at $S (f) (x)$ , $V_{f} (x)$ defines a morphism $X_{j}^{'} \to Y_{j}^{'}$ of degree at most $a_{j}^{'} (x + ℓ) + b_{j}^{'} = a_{j}^{'} x + (a_{j}^{'} ℓ + b_{j}^{'})$ (that is, the degree of the morphism cannot exceed this polynomial in either of its terms) in the freely-generated $N^{2}$ -filtered category over $C$ with generators and the degrees of those generators provided by the variables $X_{i} \to Y_{i}$ of degrees $a_{i} x + b_{i}$ in $V_{A} (x)$ . The function between hom-sets in $C$ can then be expressed by substituting each generator with a $C$ -morphism of the appropriate signature.

This induces a function (but not a filtered one!) between the product of the hom-sets ${H o m}_{C} (X_{i}, Y_{i})$ for all variables $X_{i} \to Y_{i}$ at $x$ and the product of the hom-sets ${H o m}_{C} (X_{j}^{'}, Y_{j}^{'})$ for all variables $X_{j}^{'} \to Y_{j}^{'}$ at $S (f) (x)$ , which can be obtained by replacing each generator corresponding to a variable at $x$ with a morphism of $C$ of the appropriate signature.
Given two morphisms $f : A \to B$ of degree $ℓ$ and $g : B \to C$ of degree $ℓ^{'}$ , their composition $g \circ f : A \to C$ is a tuple $(S (g \circ f), V_{g \circ f})$ where:
The composite state transition $S (g \circ f)$ is defined as $S (g) \circ S (f)$ .
The composite output function $V_{g \circ f} (x)$ is defined as follows: For each variable $X_{k}^{''} \to Y_{k}^{''}$ defined at $S (g \circ f) (x)$ , of degree $a_{k}^{''} x + b_{k}^{''}$ , $V_{g} (S (f) (x))$ defines a morphism of degree at most $a_{k}^{''} (x + ℓ^{'}) + b_{k}^{''} = a_{k}^{''} x + (a_{k}^{''} ℓ^{'} + b_{k}^{'})$ in the category freely generated over $C$ with generators corresponding to the variables ${X_{j}^{'} \to Y_{j}^{'}}_{j}$ at $S (f) (x)$ and their degrees. Now, $V_{f} (x)$ induces a functor from $C [X_{1}^{'} \to Y_{1}^{'}, \dots]$ to $C [X_{1} \to Y_{1}, \dots]$ (where ${X_{i} \to Y_{i}}_{i}$ denote the variables at $x$ ), which fixes $C$ but replaces every free generator of the category freely generated over the variables at $S (f) (x)$ with the morphism associated with it by $V_{f} (x)$ , in the category freely generated over the variables at $x$ . Therefore, the output function $V_{g \circ f} (x)$ at $x$ is simply the image of each of the morphisms generated by $V_{g} (x)$ under this functor defined by $V_{f} (x)$ . The function between products of hom-sets induced by the composite output function is therefore just the composition of the functions induced by the individual morphisms' output functions.

Now, for a given variable $X_{k}^{''} \to Y_{k}^{''}$ at $S (f \circ g) (x)$ of degree $a_{k}^{''} x + b_{k}^{''}$ , every generator of some degree $a_{j}^{'} x + b_{j}^{'}$ involved in the morphism of (initial) degree $a_{k}^{''} x + a_{k}^{''} ℓ^{'} + b_{k}^{''}$ defined by $V_{g} (x)$ has been replaced with one of degree $a_{j}^{'} x + a_{j}^{'} ℓ + b_{j}^{'}$ . Suppose each generator $X_{j}^{'} \to Y_{j}^{'}$ appears with multiplicity $m_{j}^{'}$ in the morphism corresponding to $X_{k}^{''} \to Y_{k}^{''}$ . Then, we have it that $\sum_{j} m_{j} a_{j}^{'} \leq a_{k}^{''}$ , and since $a_{j}^{'} ℓ$ worth of degree has been added to the morphism for every generator appearing in it, we have that the degree of the morphism generated by $V_{g \circ f} (x)$ must be $a_{k}^{''} + a_{k}^{''} ℓ^{'} + b_{k}^{''} + \sum_{j} m_{j} a_{j}^{'} ℓ \leq a_{k}^{''} + a_{k}^{''} (ℓ + ℓ^{'}) + b_{k}^{''}$ . So, the degree of $g \circ f$ is $ℓ + ℓ^{'}$ .

Remark. $C^{S}$ is a filtered-morphism category with the degrees of morphisms being defined as in the definition of the category, as the identity morphism of each object $A$ has an output function that outputs a variable of degree $a x + b$ (the generator corresponding to the variable itself) for any variable of degree $a x + b$ and is thus of degree zero. Additionally, as also demonstrated in the definition, degree is subadditive with composition, meaning that the composition arrow is indeed a morphism in $F i l t S e t$ .

Definition 6. A filtered functor $F : C \to D$ is an enriched functor between filtered-morphism categories.

Given a filtered functor $F : C \to D$ , since the definition of an enriched functor requires the functor's action on morphisms to be provided by a morphism between hom-objects within the category, it automatically holds that ${deg}_{D} F (α) \leq {deg}_{C} (α)$ for all morphisms $α$ in $C$ .

Definition 7. A filtered deterministic transducer is a deterministic transducer where the input and output categories, $C$ and $D$ , are filtered-morphism categories, and the functor $F : C \to D^{S}$ affording the transducer structure is a filtered functor to the filtered state category of the output category.

Finite-state string machines

For the following section, we assume a filtered deterministic transducer $T$ with input category $C$ , output category $D$ , structure functor $F$ , input state space $S (A)$ , output state space $S (B)$ , primary input $C$ -signature $X \to Y$ , auxiliary input $D$ -signatures $(X_{i} \to Y_{i})_{1 \leq i \leq n}$ , and output $D$ -signatures $(X_{j}^{'} \to Y_{j}^{'})_{1 \leq j \leq m}$ . We will now demonstrate that requiring a finite output state space on a transducer provides us with certain output size and time complexity guarantees.

Proposition 1. If $S (B)$ is finite, and, for every $x \in S (A)$ , the linear term of the degree of every variable in $V_{A} (x)$ is nonzero, then, for every $x \in S (A)$ and every primary input $C$ -morphism $α$ , the number of copies of the generator corresponding to each auxiliary input $X_{i} \to Y_{i}$ appearing in each morphism corresponding to each output signature $X_{j}^{'} \to Y_{j}^{'}$ in $V_{F (α)} (S (F (α)) (x))$ is bounded by a fixed integer $k$ , which does not depend on $deg (α)$ .

Proof. Since $S (B)$ is finite, and the number of variables which exist at any state is finite, there exists a variable with maximal linear degree $a_{max}^{'}$ across all variables in all states in $S (B)$ , in some state in $S (B)$ . No morphism in $D^{S}$ can generate a morphism in the appropriate $N^{2}$ -graded free category over $D$ with linear degree greater than that of its corresponding variable. Therefore, given any starting state $x \in S (A)$ , no morphism $f : A \to B$ in $D^{S}$ exists where any component of the output function has more than $a_{max}^{'}$ copies of any of the generators corresponding to the variables at $x$ , since each of these will have sizes with linear term at least $1$ . ◻

Proposition 2. Suppose $S (B)$ is finite, and every variable in every state in $S (A)$ has a linear term of $1$ or greater in its degree. Denote the primary input morphism of $T$ as $α$ and its tuple of auxiliary input morphisms as $β_{1}, \dots, β_{n}$ , and define ${deg}_{m} (β) := {max}_{1 \leq i \leq n} (deg (β_{i}))$ . Then, for every output signature $X_{j}^{'} \to Y_{j}^{'}$ , there exist fixed integers $a_{j}^{T}, b_{k}^{T}, c_{j}^{T}$ such that, for the morphism $γ_{j}$ outputted for this signature given these inputs, $deg (γ_{j}) \leq a_{j}^{T} deg (α) + b_{j}^{T} {deg}_{m} (β) + c_{j}^{T}$ .
Proof. For every output signature $X_{j}^{'} \to Y_{j}^{'}$ , there exists a state $y \in S (B)$ such that ${deg}_{B, y} (X_{j}^{'} \to Y_{j}^{'})$ attains some maximal linear coefficient $a_{max}^{'}$ , the generators corresponding to auxiliary inputs of $T$ can appear in $X_{j}^{'} \to Y_{j}^{'}$ at most some fixed $a_{max}^{'}$ number of times. Additionally, a similar maximum $b_{max}^{'}$ can be found for the constant term of ${deg}_{B, y} (X_{j}^{'} \to Y_{j}^{'})$ . Since, by the definition of a filtered functor, $deg (F (α)) \leq deg (α)$ , and by the definition of the state category, the $N^{2}$ -degree of the output at $X_{j}^{'} \to Y_{j}^{'}$ can be at most $a_{j}^{'} x + a_{j}^{'} deg (F (α)) + b_{j}^{'}$ , then $deg (γ_{j}) \leq a_{max}^{'} {deg}_{m} (β) + a_{max}^{'} deg (α) + b_{max}^{'}$ . ◻

Corollary 2.1. Suppose a string machine composed only of a finite set of filtered transducers ${T_{k}}_{1 \leq k \leq N}$ , where each transducer $T_{k}$ has input state space $S (A_{k})$ and output state space $S (B_{k})$ such that every variable at every state in $S (A_{k})$ has a degree with $1$ or greater linear term, and $S (B_{k})$ is finite. Denote by $α_{k}^{'}$ the morphism that $T_{k}$ will receive as its primary input morphism, given overall input morphisms $α_{1}, \dots, α_{n}$ and input states $x_{1}, \dots, x_{m}$ to the string machine. Then, $\sum_{k = 1}^{N} deg (α_{k}^{'}) = O (\sum_{i = 1}^{n} deg (α_{i}))$ .
Proof. Suppose two transducers $T_{1}, T_{2}$ , where $T_{1}$ receives a primary input morphism $α$ and auxiliary input morphisms $β_{1}, \dots, β_{m}$ . Therefore, by Proposition 2, there exist integers $a_{1}, b_{1}, c_{1}$ such that, for a given output $γ$ produced by $T_{1}$ , the degree of $γ$ satisfies $deg (γ) \leq a_{1} deg (α) + b_{1} {deg}_{m} (β) + c_{1}$ . Now, if the primary input of $T_{2}$ is not connected to an output of $T_{1}$ , then the string machine composed of these transducers satisfies the proposition, as the inputs of $T_{2}$ are now included in the overall inputs of the string machine. If $γ$ is composed into the primary input of $T_{2}$ , however, then $deg (α_{2}^{'}) \leq a_{1} deg (α) + b_{1} {deg}_{m} (β) + c_{1}$ . Given similar coefficients $a_{2}, b_{2}, c_{2}$ for a given output $γ_{2}$ of $T_{2}$ , we can see that $deg (γ_{2}) \leq a_{2} (deg (α_{2}^{'})) + b_{2} {deg}_{m} (β_{2}) + c_{2}$ , where ${deg}_{m} (β_{2})$ is bounded from above by either the same kind of linear sum as the one for $γ$ (if the greatest degree among the auxiliary inputs comes from an output of $T_{1}$ ), or the degree of yet another additional input to the overall string machine. Therefore, any further composition of transducers $T_{3}, \dots$ will result in $α_{3}^{'}, \dots$ also being bounded by a linear sum of the degrees of the overall inputs of the string machine, meaning that the sum $\sum_{k = 1}^{N} deg (α_{k}^{'})$ is also bounded by a linear sum of these degrees. ◻

Corollary 2.1 can be used to bound the time complexity of string machines, if, fixing some model of computation, we have a bound on the time it takes to run a single transducer as a function of its inputs. We note that the coefficients bounding output size are multiplied together upon composition into either an auxiliary input or a primary input, but only composition into a primary input ties the degree of the state transition that will occur in the second transducer to the primary input degree of the first transducer. We define the sum bounded in the corollary as follows:

Definition 8. Take a string machine $K$ with input signatures $X_{1} \to Y_{1}, \dots X_{n} \to Y_{n}$ and input state spaces $S (A_{1}), \dots, S (A_{m})$ , where the transducers forming $K$ form the set ${T_{k}}_{1 \leq k \leq N}$ . Denote by $α_{k}^{'}$ the morphism that the transducer $T_{k}$ will receive as its primary input morphism, given inputs $α_{1}, \dots, α_{n}$ ( $¯ ¯¯ ¯ α$ for short) and $x_{1}, \dots, x_{m}$ ( $¯ ¯ ¯ x$ for short) to $K$ . We define the internal total primary input degree of $K$ to be ${I P D}_{K} (¯ ¯¯ ¯ α, ¯ ¯ ¯ x) := \sum_{k = 1}^{N} deg (α_{k}^{'})$ .

While we have established that, lacking a meta-vertex, ${I P D}_{K}$ will be linearly bounded by the total degree of its inputs, its scaling properties as a function of the number of transducers composed has no such guarantees. One can observe that composing more and more transducers that double their input size together causes exponential growth in ${I P D}_{K}$ . As we are interested in the time complexity of both string machines that incorporate a meta-vertex and of parameterized families of string machines, we must obtain some sufficient conditions for ${I P D}_{K}$ to grow polynomially in the number of transducers in our string machine. To help determine these conditions, we will define the output-degree-bounding parameters referenced in Proposition 2.

Definition 9. Take a filtered deterministic transducer $T$ with a finite output state space $S (B)$ and an output signature $X \to Y$ of $T$ . Given an input state $x$ , primary input morphism $α$ , and auxiliary input morphisms $β_{1}, \dots, β_{m}$ to $T$ , denote by $γ$ the output morphism produced for $X \to Y$ . We define the output degree ${deg}_{o}^{T} (X \to Y)$ of the output $X \to Y$ of $T$ to be the integer triple $(a, b, c)$ such that the relation described in Proposition 2, $deg (γ) \leq a deg (α) + b {deg}_{m} (β) + c$ , holds for all possible $α$ and $β_{1}, \dots, β_{m}$ (and the $γ$ produced by these inputs). Given the minimal linear term $a_{min}$ (at least $1$ ) that the degree of any variable in any state in the input state space of $T$ , and the maximal linear term $a_{max}^{'}$ and constant term $b_{max}^{'}$ for the degree of the variable in the output state space corresponding to $X \to Y$ , we can unambiguously define ${deg}_{o}^{T} (X \to Y) = (a_{max}^{'}, ⌊ a_{max}^{'} / a_{min} ⌋, b_{max}^{'})$ .

We can now prove some elementary sufficient conditions for ${I P D}_{K_{N}}$ for a family ${K_{N}}_{N \leq 1}$ of string machines to grow polynomially in $N$ .

Proposition 3. Suppose a family of string machines ${K_{N}}_{N \geq 1}$ , where $K_{1}$ is composed of a single filtered deterministic transducer with a finite output state space, and for $N > 1$ , $K_{N}$ is created by composing some of the outputs of $K_{N - 1}$ into the inputs of a new filtered deterministic transducer with a finite output state space, such that the remaining uncomposed input legs of each $K_{N}$ are the same for all $N$ . Given the output $X_{N} \to Y_{N}$ of $K_{N - 1}$ composed into the primary input of the new transducer added to obtain $K_{N}$ , we designate the transducer that that output is produced from as $T_{N}^{'}$ , and write ${deg}_{o}^{T_{N}^{'}} (X_{N} \to Y_{N}) = (a_{N}, b_{N}, c_{N})$ . Now, fixing any input states and morphisms, ${I P D}_{K_{N}} = O (N^{h})$ for some $h$ , regardless of the value of the inputs fixed, if the following conditions are met:
We have that $c_{N} = O (N^{k})$ , for some fixed $k$ .
We have that $a_{N} + b_{N} = O (1)$ .
The number of times that $a_{N} + b_{N} > 1$ is $O (log N)$ .
Proof. Omitting our input morphisms and states, we have that ${I P D}_{K_{N}} = {I P D}_{K_{N - 1}} + γ_{N}$ , where $γ_{N}$ is the output of $K_{N - 1}$ composed into the new transducer's primary input. ${I P D}_{K_{1}}$ is obviously simply the degree of our initial primary input. $T_{N}^{'}$ either adds $O (N^{k})$ degrees' worth of material to the new transducer's primary input compared to ${I P D}_{K_{N - 1}}$ , or at most multiplies ${I P D}_{K_{N - 1}}$ by some fixed amount and then adds this extra degree. Since subsequent multiplications of this sum can be bounded from above by doing all the additions first first and then multiplying the result by the cumulative multiplication thus far, the function bounding ${I P D}_{K_{N}}$ can be expressed as a sum

N \sum i = 1 O (1)^{O (log i)} (n + i O (i^{k})) \leq N (N^{O (1)} (n + O (N^{k + 1}))) = N^{ℓ + 1} n + O (N^{ℓ + k + 2})

where $ℓ$ is the constant coefficient affording the $O (log i)$ bound, and $n$ is the total degree of the input morphisms to $K_{N}$ . ◻

Assuming the time complexity of a state-category morphism is proportional to its degree, we must impose either a constant or logarithmic bound on the number of primary-input compositions where the output is multiplied to preserve time complexity that is polynomial in the total number of transducers. In the figure, vertical arrows go to a transducer’s primary input, while horizontal ones go to its auxiliary input.

Remark. We have thus far only considered filtered transducers where the linear term of every variable in the input state space is non-vanishing. If we change this condition to only require that the constant term of the variable be non-vanishing, then the total number of generators in the $N^{2}$ -filtered category over the output category produced in the output is still bounded by a linear function of the primary input signature. So, the degree of the output function is now linear in the product of the degrees of the primary and auxiliary inputs. One can observe, however, that any composition of transducers will only cause outputs to be multiplied with each other a fixed number of times, so $I P D$ will now be bounded by a polynomial in the total inputs of the string machine.

String machine description length

As string machines can themselves be thought of as morphisms in a category, and we are interested in extending our complexity constraints to the case where the meta-vertex is involved, we must imbue the category that string machines are morphisms in with a filtered category structure itself. While this could be accomplished by setting the degree of a string machine to just be the number of transducers involved (where a no-transducer string machine is just the identity and has degree zero), this obviously fails to capture the internal complexity of a transducer.

If we require that the input category of every non-meta-vertex transducer be finitely-generated, then we could make reference to the size of some fixed graph representation of a transducer's transition table and output functions corresponding to generators, and then have this size be additive when transducers are composed. However, as discussed in the previous section, this description size does not constrain time complexity for transducers which build other transducers and then run them. We discuss possible approaches in our conclusion.

The expressivity of finite-state string machines

Now that we have obtained guarantees for the scaling of $I P D$ , which can be thought of as an analogue to the time complexity of running a string machine, in both the number of transducers in a string machine and in input size, we focus on characterizing the expressivity of string machines consisting of finite-state deterministic transducers, that is, filtered deterministic transducers where the state space corresponding to every element of the input category (not only the output state space) is finite.

In the following section, we will assume that all transducers have an input category that is of a form described as follows:

Definition 10. A tape category is a filtered-morphism copy-discard category $X$ freely generated over a single object $X$ and a finite number of morphisms of the form $X^{m} \to X^{n}$ (where superscripts denote monoidal self-products), where every generator morphism has positive degree. If all our generator morphisms are of signature $X^{m} \to X$ , then a tape category is the copy-discard category freely generated over the symmetric monoidal category freely generated from the multicategory with one object freely generated from those generators, by way of the functor from multicategories to monoidal categories proven by Hermida to be an adjoint to the forgetful functor in the other direction.

We can treat tapes as a special case of tape category, where all generators are endomorphisms of the generating object.

Without a meta-vertex

Finite-state string machines, even without a meta-vertex, can prepend to their output, which is not something the traditional definition of finite-state transducer can do. It is natural to investigate if this makes the framework more expressive than a deterministic finite automaton, e.g., having it recognize palindromes by reversing a string and then feeding the product of these two (their overlaying) into a transducer that then checks if each character matches up.

Unfortunately, given morphisms $f : A \to B$ and $g : C \to D$ in an input category (not necessarily a tape category) $C$ , and their product $f \otimes g$ , we can see that, since $F (f \otimes g) = F (f \otimes {i d}_{D}) \circ F ({i d}_{A} \otimes g) = F ({i d}_{B} \otimes g) \circ F (f \otimes {i d}_{C})$ , a state transition on a collection of finite state spaces induced by the product of two morphisms can only capture the same sort of information that could be captured by independently running two finite-state transducers on both morphisms and comparing their states at the very end.

Thus, "per-character" comparisons of the sort that would require conditions analogous to aligning characters on tape would require infinite state spaces to represent the equivalent memory operations being performed. However, due to the nature of the auxiliary input, as well as the aforementioned prepending capabilities, we are clearly able to model functions that finite state transducers cannot, even without a meta-vertex.

To characterize the class of decision problems computable by non-meta-vertex finite-state string machines, we first prove the following lemma:

Lemma 4. Suppose some finite-state transducer $T$ with primary input signature $X \to X$ in a tape category $X$ , structure functor $F$ , and output state space $S (A)$ , such that these are its only inputs and outputs. Fix a finite set of morphisms ${g_{1}, \dots, g_{n} : X \to X}$ in the freely-generated $N^{2}$ -filtered category over $X$ with a single generating signature $X \to X$ of degree $x$ , such that the linear coefficient of the degree of each $g_{i}$ is at most $1$ (that is, the generator corresponding to $X \to X$ appears at most once). Suppose we are able to construct a primary input morphism $g : X \to X$ for this transducer in the following way:
Our starting value for $g$ is ${i d}_{X}$ .
We can replace $g$ with with one of the previously-given $g_{i}$ , with $g$ substituted for the generator morphism. We can perform this step a finite of times.
Then, given some state transition reached as a result of some such $g$ , the space complexity of computing the output state of the transducer is $O (1)$ in the degree of $g$ .
Proof. We will assume that one "computational step" involves performing one of the operations involved in constructing $g$ described above. We will demonstrate that computing the next state after any of the operations performed requires storing an amount of information that is $O (1)$ in the degree of $g$ .
If one of the $g_{i}$ does not have the generator morphism appear at all, then $S (A)$ after this $g_{i}$ has replaced $g$ depends solely on the $g_{i}$ used, and since the set of such $g_{i}$ is finite, it takes a finite amount of space to store the state reached from the starting state when one of these $g_{i}$ are evaluated.
If one of the $g_{i}$ only involves post-composing an endomorphism of $X$ into the generator, then storing the state reached from a given state after any of these endomorphisms is post-composed takes a fixed amount of memory, since the set of $g_{i}$ is finite.
If one of the $g_{i}$ involves only pre-composing and post-composing endomorphisms of $T$ into $g$ , then computing the resultant state after the action of one of these $g_{i}$ only requires us to store $| S (A) |$ extra "possible current states." That is, if we know what state we would be in after the evaluation of $g$ had we started at any other one of the $| S (A) |$ states of the transducer, then after computing which new starting state we would have started at (which, since the set of endomorphisms we pre-compose is finite, is equivalent to storing a fixed-size transition table), we can then pick the state that the copy of the transducer that started at that state would be at after the action of $g$ . This is therefore equivalent to running $| S (A) |$ copies of a finite state automaton, where each copy starts at a different state.
Suppose one of the $g_{i}$ is obtained by taking a morphism $α : X \to X^{n}$ , post-composing morphisms into each branch (such that one branch includes the generator), and then finally post-composing a morphism $β : X^{n} \to X$ . Even if multiple "branchings" occur, since the generator where $g$ will be substituted appears only once, we can still decompose this into a morphism obtained by first taking the monoidal product of $g$ with a number of fixed morphisms such that the overall signature of their product is $X^{n} \to X^{n}$ , and then composing in $α$ and $β$ . Now, we only need $O (1)$ space to store the functions $S (F (X)) \to S (F (X^{n}))$ and $S (F (X^{n})) \to S (F (X))$ induced by $α$ and $β$ , since these are functions between finite sets. Additionally, for the function $S (F (X^{n})) \to S (F (X^{n}))$ induced by the monoid product of $g$ with with a fixed morphism $γ$ of signature $X^{n - 1} \to X^{n - 1}$ , by the property discussed at the start of this section, we only need to be keeping track of the action of $F (g \otimes {i d}_{X^{n - 1}})$ on $S (F (X^{n}))$ (which, since there are a finite number of $g_{i}$ , only requires keeping an absolutely bounded number of automata running), and then compute the action of $F ({i d}_{X} \otimes γ)$ on the result, which, as a function with a finite domain and codomain, takes finite space to store.

Therefore, to compute the state transition induced by $g$ , we only need to keep $| S (A) |$ copies of the finite state automaton running, as well as some fixed number of finite-state automata with input and output state spaces corresponding to $S (F (X^{n}))$ for some fixed $n$ . ◻

With this lemma, it now remains to show, roughly speaking, that for any string machine made out of finite-state deterministic transducers which decides some language (represented by morphisms in a tape category), the computation performed at every input morphism can be broken into a constant-bounded number of transitions of the type described in the lemma. We present a conjecture that finite-state string machines without a meta-vertex can only recognize regular languages, followed by a sketch for a proof of this conjecture.

Conjecture. Suppose a string machine composed only of finite-state transducers, where the input and output categories of each transducer are tape categories. Suppose this string machine has only one free input $X \to X$ in some tape category $X$ where all generating morphisms (which form a set $Σ$ ) are endomorphisms of the generating object $X$ , and has as its sole output a state space $S (A)$ , with some subset of $S (A)$ designated as accepting. Then, taking an endomorphism $X \to X$ in $X$ which does not include any instances of the copy morphism to be a string over the alphabet $Σ$ , any language over $Σ$ accepted by this string machine is regular.

Proof sketch. It suffices to prove that the computation involved in deciding this language takes constant space as a function of input size, as $D S P A C E (O (1)) = R E G$ . More precisely, given any input morphism $g : X \to X$ and a finite set of possible character strings that we can post-compose into $g$ , we desire to show that there is a constant-bounded amount of information (independent of the size of $g$ ) that we need to store, which will allow us to calculate the output state after any of these character strings are added to $g$ . By Proposition 1, each transducer involved in the string machine can create a constant-bounded number of duplicates of its auxiliary inputs within each of its outputs. This means that to predict the state of a given transducer after one of the operations described in Lemma 4 done to an auxiliary input, we need to store a constant amount of information. Moreover, due to the limitation caused by the size of a variable on the number of transitions one can make before we run out of variable space and must either limit ourselves to Lemma 4-like operations or reset, the number of "shapes" auxiliary inputs can exist in is absolutely bounded. The hope is that if we back-propagate until reaching the primary input of the first transducer, we will still have a constant-bounded amount of information to keep track of to predict the output state after the next character is reached.

Remark. This conjecture is already suggested by the combination of Corollary 2.1 and classical results by Kobayashi and Hennie which together imply that any one-tape Turing machine that runs in $o (n log n)$ time decides a regular language. The reason the proposition is not trivially implied by these results is that a naive simulation of the string machine in question on a single-tape Turing machine will cross the last cell of its initial input a guaranteed $O (n)$ times (when going back and forth to read the next cell to write the inputs to feed to the next automaton in line). The conjecture would also automatically be implied if we prove that the composition of two finite-state transducers can be equivalently modeled by a single finite-state transducer.

With a meta-vertex

The meta-vertex, even at meta-level one, can clearly be seen to increase the expressivity of finite-state string machines. We construct a string machine which can be recognize palindromes as follows:

Given a tape category $X$ where all generating morphisms are endomorphisms of the generating object $X$ , mark a special generating endomorphism $r$ . Given a generating endomorphism $α \neq r$ of $X$ , we define $T_{α}$ to be the filtered deterministic transducer with input and output category $X$ , with input and output signatures $X \to X$ and three states, a fixed one of which is the starting state. When in the starting state, $T_{α}$ will transition to the "accepting state" and store ${i d}_{X}$ in the sole variable at that state if it encounters $α$ , and transition to the "rejecting state" and store $r$ if any other generating morphism is encountered. When in the rejecting state, all morphisms are mapped to the identity on the rejecting state. When in the accepting state, all morphisms transition back to the accepting state, but this time append the current primary input generator morphism to the output. The end result is that when given an endomorphism $s : X \to X$ , the transducer $T_{α}$ will output $s$ with its first "character" removed if and only if it starts with $α$ , and output $r$ otherwise. As a morphism, it is of signature $(X \to X)_{X} \to (X \to X)_{X}$ .

Now, we define a filtered deterministic transducer $T$ with input category $X$ , which outputs a filtered deterministic transducer without meta vertices. This transducer has input signature $X \to X$ and only one state, with one variable of signature $(X \to X) \to (X \to X)$ , and it is assumed that no morphism $X \to X$ fed to $T$ will include $r$ . Given a generator morphism $α$ of $X$ , the transducer $T$ will prepend $T_{α}$ to the current variable's stored string machine. If we compose a meta vertex that takes the output of $T$ and takes the same input morphism as $T$ and passes it on to the string machine formed by $T$ , then we obtain a string machine that outputs ${i d}_{X}$ if it is given a palindrome, and $r$ if it is fed anything else.

Conclusions

Thus far, we have proven results about the time complexity and expressivity of finite-state deterministic transducers in the string machines framework. This framework allows us to model the compositionality of transducers in a way that allows for more compression of description length. For example, we are able to implement the trivial time-space tradeoff of recognizing a regular language that is the intersection of several regular languages by running several automata in sequence instead of the product automaton, or the cascade product in Krohn-Rhodes theory by having a transducer "shuffle" its primary input using its ability to prepend.

Additionally, our time complexity scaling guarantees in the number of transducers in a string machine translate to sufficient conditions for transducers which build and run other transducers in runtime to run in polynomial time. This will allow us to take advantage of the additional compression opportunities the meta-vertex presents. These results are valuable for developing string machines into a framework that can be used to model hypothesis spaces representable by automata.

Further work

Description complexity that encapsulates time complexity

As exemplified by Definition 4, the construction of filtered sets can be extended to a partially-ordered monoid that is not $N$ . Since a string machine without a meta-vertex will have the degrees of its outputs be bounded by a linear function of the degrees of its inputs, we can assign a degree $a x + b$ to finite-state filtered transducers, where $a$ and $b$ are the maximal values for some sum of the coefficients appearing in the output degree in Definition 9, where the partial order is the same as in Definition 4. However, in this case, the monoid operation imposed on the polynomials is composition, due to how the linear relations bounding output size get composed when transducers are composed, and the filtered-set category is no longer symmetric monoidal since this operation is not commutative.

Now, the variables in our state categories would have their degrees be of the form $a y + b x + c$ , where a morphism of degree $d x + e$ can compose in a transducer of at most that degree, meaning the output variable is of degree $a (y + (d x + e)) + b x + c = a y + (d x + e)^{a} \circ b x + c$ by abuse of notation. where the superscript indicates $a$ -fold self-composition. At further meta-levels, we keep adding terms, though it is unclear how we would disambiguate which variable to compose into for the monoid operation.

Characterizing the expressivity of transducers with a meta-vertex and monadic transducers

We have not yet established bounds on the expressivity of finite-state deterministic transducers which incorporate the meta-vertex, but, due to the bounding on levels of meta, it is likely that the languages they decide are some subset of context-free languages. The time complexity guarantees also need to be translated to the monadic case. Work on bounding the expressivity of monadic string machines may involve defining equivalents for string machines of various properties (see work by Mohri, Allauzen et al., Kostolanyi, and Bell et al.) which characterize determinizable weighted transducers, which may in turn allow us to bound the computational complexity of computing the distribution on output morphisms given by a monadic transducer.

LESSWRONG
LW

21