PhD thesis · ch 3 · method

A simulated auditory nerve as a virtual listener for ANC headphones

Computational models of the auditory brainstem are built to study the brain. This project inverts them: it points a validated inner-hair-cell → auditory-nerve → cochlear-nucleus → inferior-colliculus cascade at four consumer headphones and uses simulated neurons as a measuring instrument for hardware. 40,000 simulated responses per metric later, the ANC effect appears at the auditory nerve, strengthens at the cochlear nucleus, and is largely thrown away by the midbrain.

Role
Doctoral researcher (IIT Gandhinagar, supervised by Prof. Nithin V. George)
Methods
Computational auditory modelling, characteristic-frequency and best-modulation-frequency tuning, rate-MTF, coefficient of variation of inter-spike interval, vector strength / synchrony-MTF, stochastic spike-train averaging, two-way ANOVA with partial eta-squared
Stack
MATLAB, custom Python wrapper scripts, AMToolbox 1.0.0 (Zilany 2014 auditory-nerve model), UR EAR toolbox 2020b (SFIE band-enhanced/band-suppressed IC cells), KU 100 dummy-head recordings of four commercial ANC headphones
Output
PhD thesis chapter 3 (IIT Gandhinagar, October 2022)

The inversion

There is a mature literature of computational models of the auditory pathway — decades of work by Carney, Zilany, Nelson, Meddis and colleagues, cascades of stages anchored to the route information actually takes: cochlear non-linearities, basilar membrane, hair-cell electrical properties, synaptic chemistry, nerve potentials. Each stage is validated against physiological recordings from cats and rodents. These models are still in active use — 2024 to 2026 papers apply the same Zilany-plus-SFIE stack to chirp-velocity sensitivity, forward masking, tone-in-noise encoding, timbre encoding in the inferior colliculus.

Every one of those studies uses the model to learn about the brain. The stimulus is a means; the neural response is the object of interest.

This chapter runs the arrow backwards. The brain model is the instrument, and a consumer electronics product is the object of study. The question is not "how does the inferior colliculus encode modulation" — that is assumed, because it is what the model was validated on. The question is "what does this Sony headphone do to a signal, as registered by a system that responds the way an auditory system responds." The thesis states the gap directly: to the best of the author's knowledge, no model of auditory nerve or brainstem neurons had been used to characterise or evaluate ANC headphones. Four years of subsequent literature has not, as far as I can find, changed that.

This matters beyond bookkeeping about who was first. The electroacoustic chapter established that the physical envelope is cleaner with ANC on. That is an external view of the signal, and it does not license any claim about perception — a change can be physically present and perceptually invisible. The honest way to ask "would a listener notice?" is to ask listeners, and the thesis does that elsewhere. But human experiments are slow, expensive, and bounded by recruitment. A model listener costs compute instead of subjects, and can be run on every new device without booking a room.

The cascade

Four stages, mirroring the biology: inner hair cell → auditory nerve → cochlear nucleus → inferior colliculus.

The front end is the Zilany 2014 auditory-nerve model from AMToolbox 1.0.0, developed over two decades by Carney and colleagues. It simulates the auditory periphery including basilar-membrane and cochlear filtering with non-linearities, and internally splits into an inner-hair-cell stage and an auditory-nerve synapse stage, both exposed to the caller. It implements multiple scales of power-law adaptation and is tuned to reproduce simultaneous and forward masking, compression, suppression, level-dependent shifts in characteristic frequency, and AM encoding trends observed in real fibres.

The brainstem and midbrain stages come from UR EAR 2020b, using the "same-frequency inhibition and excitation" (SFIE) model of band-enhanced and band-suppressed inferior-colliculus cells. The cochlear nucleus is the first synapse for auditory information and is known to enhance modulation-frequency encoding relative to the auditory nerve. The inferior colliculus is an obligatory synapse — essentially all ascending auditory information passes through it.

Both toolboxes are used as-is. No attempt was made to improve or extend them, which is the right call when the model is an instrument rather than the object of study. All models are phenomenological: they replicate input-output characteristics without simulating the underlying biochemistry, trading interpretability for simplicity and speed.

Two tuning decisions align the neurons to the signal. For auditory-nerve fibres, the characteristic frequency is set to the carrier frequency of the test signal, so the fibre listens where the energy is. For inferior-colliculus neurons, the best modulation frequency is set to the modulation frequency of the signal, so the midbrain cell is tuned to the envelope rate under test. Other neurons with other characteristic frequencies would also respond — that is how a "neurogram" is built — but the goal here is characterising the device through the best-placed neuron, not mapping a population.

The neurons are stochastic: identical input yields a different spike train each time. So every condition runs ten times and averages. The full grid is 10 carrier frequencies × 50 modulation frequencies × 10 repetitions × 2 ANC conditions × 4 headphones = 40,000 values per metric, which is the kind of coverage a simulated listener makes affordable and a human listener makes unthinkable.

The connective tissue is a set of custom Python wrapper scripts that read the dummy-head recordings off disk, feed them to the models, and write the responses back as CSV. That glue is the actual engineering: turning a pile of .wav files and two academic MATLAB toolboxes into a pipeline you can point at a new headphone and turn the crank.

Three measures, because rate and timing are different claims

A neuron encodes amplitude modulation two ways: by adjusting mean firing rate, and by firing at specific phases of the envelope. Rate-coding and synchronisation are separable, and a neuron can preserve one while losing the other. So three measures run at each stage:

  • Mean rate, giving the rate-MTF (rMTF) when plotted against modulation frequency. The analogue of the loudness metric from chapter 2, but for a single simulated cell. Averaged over a long stimulus it is a blunt instrument — small fluctuations in instantaneous rate get swamped.
  • Coefficient of variation (Cv) of the inter-spike interval — the standard deviation of the intervals over their mean. A measure of firing irregularity, used to classify cochlear-nucleus cells into transient and sustained choppers. Crucially, Cv is not defined with reference to the stimulus, so it can be computed on any spike train.
  • Vector strength (VS) — the length of the average spike phase projected onto the unit circle, 0 for random firing and 1 for perfect phase-locking. Because it is defined relative to the stimulus envelope, a change in VS is attributable to the represented envelope rather than to internal noise.

What the model listener reported

This is where the result stops being a tidy confirmation of chapter 2 and becomes interesting.

The inner hair cell shows nothing. Not a small effect — nothing. Headphone type p = 0.689, ANC condition p = 0.346, interaction p = 0.627, all effect sizes rounding to 0.0000. The first transduction process in the cochlea does not register the ANC difference at all. Part of this is likely a known limitation: the model's authors state they assumed no adaptation in IHC voltage responses, while later evidence suggests there is some. But taken with what follows, it locates where in the cascade the effect enters.

At the auditory nerve, mean rate is silent and synchrony speaks. Mean rate shows no ANC effect (p = 0.119). Vector strength shows a clear one — higher with ANC on, p < 0.001, significant across headphones and in the interaction. The neuron is not firing more; it is firing more accurately at the right moments. The physical envelope improvement translates into better temporal representation, not louder representation.

Cv is the most sensitive metric in the whole study, and it goes "the wrong way". At the auditory nerve, Cv has an ANC-condition effect size of 0.13 and a headphone-type effect size of 0.21 — the largest effect anywhere in the chapter, larger than any vector-strength effect by more than an order of magnitude. And Cv increases with ANC on (2.25 versus 1.83 for the QC25). Naively, more irregular firing sounds worse. Read alongside vector strength, it is the opposite: as the neuron locks more tightly to envelope peaks, it fires in tighter bursts separated by longer gaps, so the inter-spike intervals become more dispersed. Higher Cv here is a signature of better synchronisation, not a defect. Anyone reading Cv in isolation would draw exactly the wrong conclusion — which is the chapter's argument for reading rate and timing together.

The cochlear nucleus confirms and amplifies. Same pattern — mean rate flat (p = 0.165), Cv large (0.17 across headphones), VS significant but smaller. Meanwhile absolute vector strength jumps from roughly 0.70 at the auditory nerve to roughly 0.92 at the cochlear nucleus, consistent with the known enhancement of modulation coding at this stage.

The inferior colliculus throws most of it away. All ANC effect sizes collapse toward zero: IC mean rate 0.0001, IC Cv 0.02, and IC vector strength shows no significant ANC effect at all (p = 0.118). The midbrain has partially or fully discarded the difference the periphery registered.

That last finding is the one I would not have predicted and would not have chosen. It is also the most useful, because it makes the inferior colliculus a falsification stage — a limit against which more optimistic peripheral findings can be tested to see whether they survive the journey toward cortex. A physical improvement that dies at the obligatory synapse is a physical improvement with a perceptual ceiling. Chapter 4's null on self-reported listening effort is exactly what that prediction looks like when you put real people in the chair.

The null defence

The IHC null and the IC null are claims, and cost the same evidence as the positives. Three ways they could be implementation errors rather than findings:

The models could be mis-driven. If the signals were reaching the models corrupted or at the wrong level, everything would be null. They are not: the identical recordings, through the identical wrapper scripts, produce large, orderly, highly significant effects at the auditory nerve and cochlear nucleus. A pipeline that can resolve η²ₚ = 0.21 at one stage is not failing to deliver signal at another.

The neurons could be mistuned. A neuron tuned away from the signal would report noise. Characteristic frequency is set per-carrier and best modulation frequency per-modulation-rate, so each cell is deliberately placed where the energy is; and the rMTF shapes that come out reproduce the expected non-linear low-frequency structure documented for stellate and bushy cells, which is what a correctly-tuned model should produce.

Stochastic variance could be swamping a real effect. Each condition is averaged over ten runs, and the surviving n is 39,992 residual degrees of freedom — enough that the significant effects at IC mean rate (p = 0.003 for headphone type) come through with effect sizes of 0.0003. The design detects trivially small effects when they exist. The IC vector-strength null is a null at high power, not a null at low power.

Symmetrically, the positive findings need their own defence, and the main risk is that 40,000 samples make everything significant. That is precisely why effect size is reported for every row and why the chapter's conclusions are stated in effect-size terms.

Honest limits

The pipeline is only as good as the model behind it, and the Zilany/UR EAR family is one defensible choice among several — Meddis and colleagues offer a different stance on internal detail. Re-running on an alternative model is a real robustness check, not a formality.

More fundamentally, the premise is contested. Viemeister — after thirty years on modulation and temporal integration — wrote that physiologically measured AM responses "have provided little insight into the processes underlying the psychophysics, specifically whether there is tuning for AM rate as postulated by the modulation filterbank models." EEG work has produced contradictory evidence on how much envelope representation matters for comprehension, with some concluding envelope information alone predicts neither intelligibility nor phase-locking quality. Envelope representation can therefore account for only part of the ANC effect.

Narrower caveats: all signals were presented at a single fixed intensity, though auditory-nerve synchronisation to AM is known to vary with level; all neurons ran at default "medium" spontaneous rate, leaving high- and low-SR fibres unexamined; only fully-modulated (0 dB depth) stimuli were used, where the interesting neural coding questions live near threshold; and every model here is monaural, so nothing is said about whether the two ears receive different treatment.

And the deepest one: a model that "could in principle register" a difference is not a person noticing it. Which is why the thesis does not stop here.

Where it sits

This is the perceptual-model half of the modulation-frequency axis; the electroacoustic metrics are the physical half, computed on the same recordings. The modulation-depth axis is covered by the chimera listener experiment and the instrumental metric panel. All rest on the problem framing.

Full thesis

The full PhD thesis, with all figures, statistical tables, and references, is available as a PDF: PhDThesis_Sohhom_15510011_final.pdf.