Balanced Model Truncation (BMT) and its Applications in DSP System Modelling and Computational Complexity Reduction
Submitting Institution
University of WestminsterUnit of Assessment
Computer Science and InformaticsSummary Impact Type
TechnologicalResearch Subject Area(s)
Mathematical Sciences: Applied Mathematics
Information and Computing Sciences: Computation Theory and Mathematics
Economics: Applied Economics
Summary of the impact
Work undertaken at the Applied DSP and VLSI Research Group since the
early/mid nineties, has led to a number of significant contributions
underpinning the development and commercial exploitation by industry of
power efficient and complexity reduced integrated Digital Signal
Processing (DSP) systems and products. These developments
have paved the way for a new paradigm in the design of complexity reduced
electronic systems aiding the emergence of numerous new commercial
application areas and products in a diversity of fields. Indeed, these
developments continue their currency and applicability in today's
electronic products sector and thus shall be at the core of this case
study.
Underpinning research
- Designing DSP systems that comprise digital filters to meet a given
specification is always possible at the expense of high dimensionality
and computational complexity (which is often impractical for real-life
implementation). Coming up with an equivalent solution that meets the
initial specification at a fraction of the computational complexity is
now a reality through the novel deployment of the Balanced Model
Truncation (BMT) approach. The end result is a lean and
mean, low computational complexity, low-power, and implementation
friendly equivalent.
At the heart of the findings relating to the impact claimed in this case
study is the BMT approach. The BMT approach we used to generate the much
simpler implementation friendly equivalent systems drew on the success of
the control theory community in developing the technique of balanced model
reduction during the 1980s. One of our earliest major papers in this area
[1] pushed the dimensionality focus from the very low-order, primarily
continuous-time systems, to high-order, high computational complexity,
Digital Signal Processing systems. However, we have since taken the
applicability, realisation efficiency, and ease of use of this approach to
a different dimension with the support of an EPSRC project award.
Moreover, a number of industrial- applied research contracts have directly
deployed, extended and expanded the applicability and effectiveness of
this approach for cutting edge product development.
The applied research results made possible through the detailed work and
discoveries made during the EPSRC-funded investigations and work that
followed, has truly proven to be a watershed. This is due to the fact that
our works in this area have become prominent standard practices in the
field, and they continue in this way today. The simple and humble baseline
that was set in [1] mushroomed out to a much enlarged scope of system
modelling beyond its roots in simple fixed linear time-invariant
filtering. Many major extensions and novel applications and
implementations have resulted from our work, and new ones continue to be
discovered.
- The design of arbitrarily specified digital filters and systems having
real or complex responses was primarily done in the high computational
and implementation-complexity Finite Impulse Response (FIR)
domain. This was due to the ease of design, abundance of design tool and
algorithm availability, and their guaranteed stability. On the other
hand, the scene for low computational and implementation-complexity
Infinite Impulse Response (IIR) filters and their design
algorithms was, and still continues to be, less attractive. Their main
downfall was the unavailability of appropriate design tools/algorithms,
lack of ease designing for arbitrary specifications, and most
importantly, their inherent stability issues.
- The problem of designing arbitrarily specified IIR filters with ease
and guaranteed stability, as well as low computational and
implementation-complexity, was tackled and solved with many practical
and commercially exploitable applications. Such applications were
derived from the work that was undertaken as a result of the EPSRC,
Research Grant No GR/J91777, in 1994.
- Work in the commercial exploitation and use of this approach continues
today with the most recent being an applied research contract from the
European Space Agency in partnership with Astrium UK Ltd. This started
in September 2011 ending in September 2013 to deploy BMT derived
complexity reduced IIR filters for their DSP engines onboard their
commercial communication satellites in order to reduce computational and
implementation complexity, and hence power consumption by multiple
orders.
- The approach was generalised from merely a humble filter design
strategy, to one that could take a signal or system that was defined by
a large time series to a representative, accurate model. This allowed
for a recreation of the original time series from a much reduced
complexity model which encapsulated all of the characteristics of the
original time series, and as a result paved the way for many novel,
practical applications for commercial products.
- The initial paper on the subject was published in March 1992, but the
bulk of the new and most impacting work was carried out during the
lifetime of the EPSRC project, 01 September 1994 through to 28 February
1998, and continues today.
- The key researchers at the time were Izzet Kale (Reader), Gerry Cain
(Professor, Head of School), who has left Westminster in the Academic
year 2001-2002, Jonathan Mackenzie (EPSRC project post doctoral research
fellow (1994-1998) ), Richard C. S. Morling (Head of Department) who has
retired January 2013, Bartek Beliczynski (Principal Lecturer), who has
left Westminster in the Academic year 1993-1994 and J. Huopaniemi and V.
Valimaki who were visiting researchers at Westminster and left for
Helsinki University of Technology (HUT) in 1995.
- This work started as a purely theoretical algorithmic exercise in
deriving an equivalent IIR model for an FIR filter and ended up being a
very powerful approach that is capable of solving a plethora of problems
in real-life practical systems, holding its currency and popularity
to-date.
References to the research
[1]* Kale I., B. Beliczynski, J. Gryka and G. D. Cain, "FIR filter
order reduction: balanced model truncation and Hankel-norm optimal
approximation", IEE Proc. of- Vis. Image Signal Process., vol.
141, no. 3, pp. 168-174, June 1994
[2] Kale, I. and R. C. S. Morling, "An integrated ΣΔ codec for
mobile telephone applications", Proc. 38th Midwest Symposium on Circuits
and Systems, (MWSCAS), vol. 2, pp. 945-948, Rio de Janeiro, 13-16 August
1995.
[3] Mackenzie, J., I. Kale, G.D. Cain, "Applying balanced model
truncation to sound analysis/synthesis models", Proc. International
Computer Music Conference, ICMC '95, pp. 400-403, Banff, Canada, 3-7
September 1995.
[4]* Mackenzie, J., J. Huopaniemi, V. Valimaki and I. Kale,
"Low-order modelling of head-related transfer functions using balanced
model truncation", IEEE Signal Processing Letters, vol. 4, no. 2, pp.
39-41, February 1997.
[5]* Ahfir, M., I. Kale, and D. Berkani, "An Alternative Approach
to the Balanced Model Truncation Algorithm for Acoustic Minimum-Phase
Inverse Filters Order Reduction", ISRN Signal Processing Journal, Volume
2011 (2011), Article ID 971051, 6 pages, doi:10.5402/2011/971051, web
link: http://www.isrn.com/journals/sp/2011/971051/ref/
[.]* Indicator of best quality
GRANT 1:
• Awarded to.: Gerry Cain and Izzet Kale
• Title: "Extension of Balanced Model Reduction Techniques for
Flexible Digital Filter Design"
• Sponsor: EPSRC, Research Grant No GR/J91777
• Period: 01 September 1994 - 28 February 1998
• Value: £121,567
GRANT 2:
• Awarded to: Izzet Kale and Richard C. S. Morling
• Title: "Efficient Techniques for Onboard Processing"
• Sponsor: European Space Agency/Astrium UK Ltd.
• Period: 01 November 2011 - 31 October 2012
• Value: £92,000
GRANT 3:
• Awarded to: Izzet Kale
• Title: "Extensions of Efficient Techniques for Onboard
Processing"
• Sponsor: European Space Agency/Astrium UK Ltd.
• Period: 01 April 2013 - 31 September 2013
• Value: £42,000
Details of the impact
- Applied industry-based research for industry's next generation
products has been one of the mainstream activities of the Applied DSP
and VLSI Research Group at Westminster. Often many of the projects and
tasks therein had a large proportion of integrated DSP systems that
heavily relied on and were limited by high computational and
implementation-complexity digital filters. These had to occupy the least
amount of silicon real-estate, operate as fast as possible, and consume
the minimum amount of power. This is unfortunately extremely impractical
and unfeasible to sustain in real life.
The research underpinned in this case study has, on most of these
products, resolved this requirement-conflict issue. Through orientating
these applied research projects, guiding, and furnishing the design and
implementation cycles with BMT to maximise the output efficiency (as per
the requirements from the distinct specifications), this result was
achieved.
- The impact resulted in new reduced computational and
implementation-complexity approaches to integrated DSP systems that
found and continue to find use in a diversity of products and spheres.
These range from mobile phones, to hearing aids, to onboard satellite
processing systems, satellite positioning systems to binaural 3D sound
systems, and beyond. This impact is strongly evidenced by the fact that
the real-life applications of the theoretical work that was done and
published back in the mid to late nineties is still keeping its currency
and finding used in real-world practical systems and products.
- The results of the underpinning research were disseminated to the
wider technical and industrial communities in a number of ways finding
uses in their products. These were primarily through the use of the open
literature publication channels, industrial company based short courses
delivered to industry which, in many cases, resulted in applied research
and development project contracts for their next generation products.
The results and findings of the research was furnished and supported to
potential beneficiaries through invited talks, seminars, and word of
mouth, which eventually resulted in more funded projects, the most
recent of which started in April 2013. The main influential aspect
of the output that attracted commercial as well as academic interest
has been the approach's ability to reduce computational and
implementation-complexity, and hence, implementation cost without loss
of performance.
- The research and its results detailed in this case study were almost
exclusively undertaken at the University of Westminster, and the
beneficiaries have mostly come from industry. Exceptions to the
contributions were from J. Huopaniemi and V. Valimaki who were at
Westminster at the time of the research when they contributed to one
strand of the work in the area of Head Related Transfer Functions (HRTFs)
with their a-prior knowledge of FIR HRTFs and their associated problems.
We subsequently solved this problem for them through BMT derived IIRs
and published papers with them, one of which is [5]. Consequently, they
returned to Helsinki University of Technology and continued in this
strand of work and have undertaken applied research consultancy projects
for NOKIA. The products resulting from this work are known to have
produced superior fidelity and reduced complexity Head Sets which
generated multi-million revenues in the binaural sound and headset
industry.
- Dialog Semiconductor, and Ericsson Mobile Phones. IIR filters derived
using the BMT techniques have found use in the Ericsson 688 and 768
handsets (announced in 1997 and were in use till the early to mid 2000s)
delivering low computational and implementation complexity and low power
and therefore, extending the battery-life. We can only speculate as to
the sheer multi-million/billion revenues that resulted from these sales
judging by their popularity at the time.
- Mitel Semiconductor/Zarlink Semiconductor/Starkey Labs, BMT derived
IIR filters for their digital hearing aid codec and processors. Their
digital hearing aids containing our technology were launched in 2003.
This opened up new avenues of opportunity for those hard of hearing,
improving their quality of life through extended battery life as well as
allowing them to individually customise their digital hearing
instruments. As these hearing aids have been in full production since
2003 we can once again, only speculate as to the multi-million revenues
that it generated, as well as the quality of life improvements achieved
for those who use them.
- Nokia, through HUT, on BMT derived low complexity IIR HRTFs. This work
has found itself in the heart of many of today's 3D binaural headsets
used in many gaming and immersive/virtual reality systems. Once again
the revenues and improvement of quality of life and superior user
experience resulting from the use of this technology can only be
speculated on.
- European Space Agency/Astrium, reduced computational and
implementation-complexity, low power onboard satellite processing
algorithms for communication satellites. Work in this area is now at its
maturity and has resulted in a very impressive output that Astrium and
the European Space Agency are very impressed with. Indeed, they will be
deploying it in their next generation satellites, as well as launching
into a new contract with us to look into further application areas. In
the space, namely satellite positioning filed the activity also found
use in a recent large collaborative EPSRC funded research project with
partners from Imperial Collage, UCL and Nottingham University where we
were responsible for the software and hardware design implementation and
prototyping for the next generation of Global Navigation Satellite
Systems.
- The industrial manufacturers/beneficiaries listed above have all
benefitted in the same way, namely in being able to integrate
computational and implementation-complexity reduced low power devices
into their systems on chip.
- The consumers have enjoyed cheaper and lower power, and hence, longer
lasting battery life and wider functionality offering products.
- Evidence to support the claims made in this case study can be provided
in the form of letters and testimonies form the industrial clients the
work was done for.
- The impact occurred 2 to 3 years after the work was carried out and
published continuing to date.
Sources to corroborate the impact
- EPSRC, Research Grant No GR/J91777, progress reports
- Designs and design documentation from applied research contracts for:
(a) Dialog Semiconductor on the Ericsson 688 and 768 mobile handsets
(b) Nokia for the car impulse responses complexity reduction
(c) Nokia through Helsinki University of Technology, Finland for the
HRTFs and related sound and musical instrument synthesis work
(d) Zarlink Semiconductor for the Starkey Silicon Integrated Hearing Aid
filters
(e) European Space Agency project for ASTRIUM on complexity reduction in
onboard satellite digital signal processing engines.
- The following key beneficiaries have provided the University with
factual corroborating statements that could be made available to the REF
team:
(a) Zarlink Semiconductor, San Diego, USA
(b) Dialog Semiconductor, Swindon, UK — Director of Engineering, PMIC
development
(c) Astrium Ltd, Stevenage, UK — Engineering, Payload Equipment (APP4),
Processor Product Group, Processing and Timing Product Line Group (APP3)
- The following users / beneficiaries can be contacted by the REF team
to corroborate claims:
(d) Helsinki University of Technology and Aalto University, Finland
(e) European Space Agency, ESA ESTEC, Noordwijk,