With the challenges of the global pandemic, the team mostly working from home, travel restrictions, and component shortages delaying installations, the Hiperwall development team had a banner year producing three important product releases! Our team’s ability to remain productive while working remotely is a testament to the team’s creativity and drive and the commitment of everyone in the company. Since we make video wall software, we need access to specialized equipment, including well-configured networks and video walls for testing, neither of which tend to be in most people’s homes. Remote access, cameras, and some trips to the office allowed the team to perform excellent work under austere conditions.
We started the year with our benchmark Hiperwall 7.0 release. This release added fundamental improvements, including the groundbreaking Quantum viewer software to synchronize content playback across many computers driving many LED controllers. Because of this capability, Hiperwall has been deployed to drive enormous LED video walls in control rooms around the world. We also added new capabilities for source management and many other features and additions.
Mid-year, we announced a feature release version, Hiperwall 7.1, which included new fault-tolerance content (called HiperFailSafe Content), in addition to VMS plug-in support, so popular video management systems can directly interact with Hiperwall systems and add their content to the video wall. Many other features and performance improvements were also included.
As the third quarter ended, we released Hiperwall 7.2, which added new audio volume and muting controls. This is much more interesting and capable than it sounds because of the complexity of managing many audio devices and even more audio sources (movies, streams, etc.). We also added significant new capabilities to make our sources even more robust and compatible with industry standards.
As the new year begins, we have new features and releases under development and testing – I can’t wait to show you the great capabilities that are coming. I’m proud of our team and their accomplishments in 2021, and I expect 2022 will be even more amazing!
Hiperwall video walls have supported playing content with audio since the beginning, but we had avoided adding audio controls to the system because of the complexities described in this article. That changed with a product version we released several months ago. This article describes the journey the development team took to make the robust and powerful audio controls in the current product. Customers with maintenance contracts can upgrade to the current version and get these new audio management capabilities for no additional cost.
Why Audio?
Hiperwall makes video wall software, so why is there a need for audio in such a visual medium? Many of our customers use their Hiperwall video wall in a control room environment, where audio might be a distraction. Therefore, whatever audio features we add must allow operators to easily mute the system to avoid disturbing the people monitoring and using the control room video wall. Many other customers, however, use their Hiperwall video wall in some sort of public (or employee) facing application where audio is commonly used. In the past, we advised such customers to use a multi-input audio mixer to manage their audio with fine-grain control.
Why is Audio Management a Challenge?
The Hiperwall video wall software is a distributed and parallel computing system that uses multiple display computers to draw content on video wall displays, including LCD, projector, and LED walls, which allows it to scale from very small systems to enormous systems with hundreds of displays or thousands of square feet of LED tiles. Each of those display computers can have audio output and perhaps even speakers attached. Beyond that, a Hiperwall video wall can have tens or hundreds of sources and content items, many of which can have audio channels. Therefore, video wall audio control not only has to manage display computer output volume, but also volume levels for perhaps hundreds of content items, all in an easy-to-use and scalable manner.
Project Beginnings
One of our significant partners expressed the need for volume control for the display computers, because some of their customer projects could use those capabilities. Having looked into volume controls in the past, I thought, “I know how to do that. I’ll do it.”
In the early days of Hiperwall software development, I made the Hiperwall Daemon, a small program that runs on each of the display computers to manage them, transfer content and issue commands, and make sure the display software is running. Having the Daemon control the output volume of its display computer is easy but communicating to make it do so was the challenge. I enhanced the state transfer protocol to allow individual volume control for each of the possibly many displays in the system. The protocol needed to be concise, yet scalable, so the mechanism I added extended an existing control scheme to add volume values when needed. I also added a volume control slider and status reporting to the “Walls” tab in the controller software so volume levels can be quickly and easily changed for one display or an entire wall at a time. The volume values also had to be consistent between fault-tolerant controllers, so I made sure the controllers coordinated.
Wall/Display Audio Status and Controls
Content Audio Control Development
After discussing this new capability with the team, we decided that we couldn’t just stop at device volume control, but needed to address content volume as well. Managing volume of individual content items is more technically challenging than just changing device output volume. Because each display computer can have many contents playing audio simultaneously, each object needs separate audio controls both on the controller and built into the display software. Managing audio levels for multiple items is a lot like using an audio mixer like the Windows mixer (right-click on the speaker in your system tray and choose “Open Volume Mixer” to see what I mean). Each object can have a volume setting, but the display computer volume limits that volume to its maximum.
The development team members who make the display software developed mechanisms to adjust the volume level for each object open on their display(s), and that worked very well. We added object volume to the extensive list of properties we manage for each object (like size, position, rotation, transparency, etc.). We added a volume slider to the controller so the operator could change the volume of a selected content object. We the made mechanisms to propagate the volume properties throughout the system and between fault-tolerant controllers. We also extended the existing Environment mechanism so volume levels are saved with each Environment and restored when the Environment is loaded. We even added volume control to our XML-based web services style interface so third-party programs can control content volume. But we weren’t done yet…
Audio Muting Policies
Being able to quickly and easily mute audio content is critical – we do it all the time with our TVs and radios and phones, but when you have many outputs and potentially hundreds of audio sources, it becomes a lot more complicated. We first had to decide which operations made sense. Of course, we needed the ability to mute all content, but we had to decide what it meant to mute audio. Was it just setting the volume of all the content items to 0? That’s easy, but it doesn’t remember the old value in case we want to unmute some or all of the content. Your TV remembers the volume it was before it was muted, so we decided customers would expect that kind of behavior, even though a TV is only playing one thing at a time, while we can show many items at once. Therefore, we had to make muting reversible rather than just setting an object’s volume to 0. This meant maintaining a bit more state and a lot more logic to mute and unmute properly. Of course, muted objects can be unmuted as a group or individually.
Beyond muting everything, we also devised a “mute all but this” mechanism, which allows the operator to define an object that should be the focus of attention by eliminating any potentially distracting audio from other source. While this is not something TVs would have, it is very beneficial in a video wall environment with many sources that include audio.
Content Object Audio Controls
Convenient and Simple Controls
Because audio has the potential to be disruptive and distracting, we had to make sure the controls to mute everything were easy to find and always available. In addition to the “Mute All” capability as part of the audio controls, we added very obvious system Mute button to the controller so it can be used quickly and easily. Like its “Mute All” counterpart, this Mute button can mute or unmute all the content at once. It has intuitive icons to show its state rather than words like the button in the audio controls.
Always-available Mute Button
In addition to the fault tolerance controller software, we have another way of controlling the video walls called HiperOperator. This is a very easy-to-use graphical application that several possibly remote operators to manipulate content on the video wall simultaneously. In keeping with the simplicity of HiperOperator, we had to add very simple audio controls to it. HiperOperator makes it very easy to manipulate properties of individual objects, including applying filters, rotating, and even making the transparent using a simple menu. We added audio volume and muting to the menu, making it extremely convenient to set audio properties of content items. We also added the object’s volume level to the descriptive label shown with each object in HiperOperator.
HiperOperator Object Properties
As with the controllers, HiperOperator needed a very simple way to mute and unmute all audio in the system, so we added a button/icon in the corner of the display that toggles the muted state when clicked. All of these volume and mute states need to be coordinated across all controllers and HiperOperators, too, so if one user performs a volume control operation, it is reflected everywhere. As anyone who builds distributed systems knows, such coordination is easier said than done, but because we were building on already robust protocols and communications links, it turned out very nicely.
HiperOperator with Mute/Unmute Control
Development of audio control capabilities was a very interesting and challenging activity, but more for policy reasons than technical ones. The underlying technology to change display computer output volume or individual object volume is not particularly difficult. Rather, defining behaviors and capabilities was by far more challenging. Since multi-input, multi-output audio is rare except in audio mixers, we had to do lots of prototyping and debating of how things should work. We worked with our partners to get feedback on our designs and made some changes based on their suggestions. The new audio features are the result of a great collaborative effort among the dev team and with our technical services group and our partners.
After not upgrading my mobile phone for a couple years, I splurged and got the new iPhone 12 Pro Max (because I wanted the new camera features). The phone is enormous, as you would expect, but you may not believe exactly how enormous it is. If anyone needs to land an aircraft, this thing is about the size of an aircraft carrier deck. Maybe I’m exaggerating a little, but it is big, though my hands are big too, so it feels natural and is a beautiful phone. By the way, the camera does seem to be spectacular, and the low light mode with the “normal” camera blew me away!
But that’s not why I’m writing this. We’ve come to rely on our phones for so many things that upgrading to a new phone is more complicated than it was in the past. Previously when switching to a new iPhone, I would restore the backup of the old phone and most things would work right away. A couple apps would detect they’re on new hardware and require that I log in again, but otherwise there was not transition other than newer, fancier hardware.
These days, however, our phones are not just our lifelines and our entertainment – they identify and authenticate us, and therein lies the problem when upgrading to a new phone. We are all using 2-factor authentication apps (if you’re not, do so. Now. I’ll wait) that are tied to the hardware identity of our phone. Some of us also use our phones for car keys or house keys, again tied to specific IDs in the phone that don’t transfer to a new one automatically.
With this new phone, most things transferred perfectly, as expected, so I could easily log into my iCloud stuff or Dropbox or Instagram, either automatically or just by entering my credentials. The problems were with the “authenticator” apps and with my Tesla Model 3. Rightfully so, they didn’t transfer over.
The Microsoft Authenticator is pretty excellent in that it has a recovery mode that allows restoring its functionality via information stored on iCloud. Luckily my old phone was still working so I could authenticate via the old one to allow the new one to restore the settings. If the old phone were lost or broken, things would have been a lot uglier, requiring the use of backup codes or other methods of proving identity.
The Google Authenticator was much worse. It had no recovery mode, so the answer is just disable the old one in your Google Security settings and enable the new one. Fine for Google, but other services, like Hubspot, also use the Google Authenticator, so for those I had to log in, disable the Google Authenticator, then re-enable it on the new phone. Again, because I had the old phone there, I could log in easily, but if I hadn’t had it accessible, things would have been tough.
The process for switching phones for the Tesla should have been easy, but didn’t work well. Adding the new phone via Bluetooth was trivial and worked well, as did logging into the Tesla app (using Microsoft Authenticator for 2FA), but adding the phone as a key for the car didn’t work. I put the keycard on the console and told the app to make the phone a key, but it claimed it couldn’t connect to the car. Playing with WiFi and Bluetooth didn’t work. In the end, I rebooted the car computer (yes, I know that sounds crazy) and that fixed it.
So now my new phone has replaced the old one in all capacities and I’m happy. But this should serve as a warning to us all that switching phones is more challenging than ever, and if we lose or break a phone, the trouble will be huge! Since many of the backup 2FA mechanisms use a text message to your phone if the authenticator app doesn’t work, that doesn’t help if you can’t receive the text message. My advice is to get the backup codes for your essential services and securely store them somewhere you can get to if your phone is gone. Easier said than done…
Last week I bought the Logitech MX Vertical mouse to see if it will be better at preventing repetitive strain injury to my wrist and hand. Somehow working from home because of the pandemic means fewer breaks and more intense work, so I could feel it in my hand and wrist (particularly my thumb has been bothering me).
The MX Vertical is a vertical mouse with a “handshake” grip. This means your hold on the mouse is almost like when you’re giving a handshake. (Remember handshakes? Those aren’t going to be a thing anymore.) This means your wrist is in a more natural position than the twisted angle needed for a regular mouse.
I really wanted to like the MX Vertical because I thought it could help me and because it is crazy expensive, so I wanted to be able to rationalize my decision to buy it. But when it arrived, I hated it. There were stupidly terrible software problems with it that I’ll cover later, but more importantly, it didn’t feel good.
The biggest problem I had with the MX Vertical is because of my big hands. The side of my hand rests on the desk when I grip the mouse in its handshake position. This makes movement terrible. My normal Logitech MX Master mouse is large enough that my hand stays clear of the desk so movement is very smooth. Not so with the MX Vertical. I think if it had an attachable extension to support the hand, it could be improved.
So I gave up on the MX Vertical. I tried to convince my wife to try it, but after my experience with it, she had little interest. But then I had the thought that a wrist rest might keep my wrist high enough that my hand wasn’t dragging on the desk, so I ordered a foam wrist rest (yes, I’m buying accessories for my accessories).
The wrist rest helped, so I used the MX Vertical all day yesterday and found it to be pretty good. I quickly got used to the vertical hand position, and I think it plus the wrist rest will help with my hand and wrist issues.
So does that mean I’m happy with it and it is the perfect mouse? No. Not at all.
It is a fairly light mouse, particularly for its size, so clicking a button requires that I hold the opposite side with my thumb to prevent the mouse from moving off where I wanted to click. I never had to do that with a normal mouse. The button positions are OK, but not great, though again my big hands have an influence on that. The biggest ergonomic mistake is the position of the scroll wheel. It is between the buttons pretty much where it would be on a normal mouse, but that makes it fairly far behind my fingertips, so to use the mouse wheel requires significant finger movement and isn’t as natural as on a normal mouse.
The MX Vertical has lots of fancy features, but that means it requires software to use them. The problem is that because I had an older Logitech mouse, I already had the Logitech Options software loaded. Well, the older software completely fails when this mouse is plugged it and it even disables the scroll wheel. Of course, installing the new version of the software over the old one means things are still broken (I installed on 2 different PCs, so it wasn’t a fluke). The only was I could get it to work is to uninstall the Logitech software, uninstall the device, then install the latest Logitech Options software, then it worked OK.
Because clicking requires holding the mouse firmly, I wouldn’t think the MX Vertical would be good for gaming, but it seems ok for normal usage. For the moment, I will use it on my main work PC. With a wrist rest, it seems comfortable, so if you feel like your old mouse is causing trouble, the MX Vertical could be a good option.
Yesterday, NASA and JPL released a magnificent panoramic image of Mars taken by the Curiosity Rover. This 1.8 billion pixel image is made up of over 1000 images stitched together. More info can be found here.
I imported the image to the Hiperwall system in our Customer Experience Center, because I love enormous images. It took a couple minutes to import and store such an enormous file, but once imported, Hiperwall software allowed me to move and zoom the image in real-time.
In order to take a video of it, I used Hiperwall’s animation feature to start with the fully zoomed-out image (so we can see all of it), then had it slowly zoom in to an area with lots of detail until one pixel in the image was one pixel on the screen. It then held that position for a bit, then zoomed back out and repeated. All of this took just a few seconds to set up, then I shot the video on my iPhone. The video was taken at 4K/60 FPS, but I’m not sure YouTube will offer it with that quality.
This video shows our unprecedented ability to handle enormous imagery, but it also shows how easy it is to animate content on a Hiperwall. While Hiperwall is commonly known for Command and Control video walls, many of our customers use Hiperwall systems for corporate communications, live presentations, and collaboration, often in addition to their control room Hiperwalls!
If you’re planning to order a Tesla, each Tesla owner (or orderer, in my case) is given a referral link that others can use to get some goodies. At the moment, when someone uses a referral link, both parties get 1000 supercharger miles, so win-win!
My link is below in case anyone would like to use it when you order a Tesla:
I recently wrote a blog post for the Hiperwall website on the value and quality of video wall controller solutions. I wrote the post because one of our potential customers was comparing Hiperwall to a very cheap bundled “solution” and they were being told the bundled product was comparable and good enough for what they needed. In almost no scenario was that true, so I made a list of questions at the end of the blog post that any video wall customer should ask as they are evaluating solutions.
I wrote a white paper about why resolution matters in control rooms and other environments where information density and content are important. I wrote it in response to the increasing popularity of Direct View LED (dvLED) in digital signage. Because dvLED is bright and beautiful and almost seamless, there is temptation to use it for control room video walls rather than the tiled LCD panels normally used. dvLED is quite costly, so some integrators may push it to increase their profit, but for the moment, control room customers will likely be unhappy with the result.
The problem with today’s dvLED tiles is that their pixel pitch is quite coarse. For digital signage and concert venues, this is fine, but if detailed information is to be displayed or for close viewing, it is not ideal. The pixel pitch (the distance between pixels) for some of the best currently available dvLED systems is more than 4 times worse than ordinary commercial LCD monitors. That means for the same size display, every 4 pixels on an LCD display are equivalent to 1 pixel on the dvLED tile. So essentially, buying a top-quality dvLED system costs a lot more and gives a quarter the resolution. (For this example, the assumptions are 1.3mm pitch for the dvLED and 0.6mm pitch for the LCD panel – I know 0.9mm LED is coming, but it’ll be expensive).
If we revisit this in 2 years, costs for dvLED will be down and the pixel pitch will be much closer to the 0.6mm that a common commercial LCD panel can do. Until then, for detailed information display, avoid paying a lot more for much coarser resolution.
I wrote a blog post for the Hiperwall web site about how we can put content anywhere and at pretty much any size. This was prompted by one of our competitors claiming they could do Picture-In-Picture, while we couldn’t. Well that’s absurd, because we can put anything anywhere, so if you want a video stream in front of another video stream, just move it there. Heck, put 2 or 3 in front – that’s OK. I even made the video shown in the blog post of an animated video stream becoming partially transparent as it flies over another video stream that is in front of a very high-resolution live data feed of the air traffic map around LAX.
This capability has been part of Hiperwall for years, so we don’t really think about how powerful and different it is until we’re reminded of exactly how limited our competitors are. Picture-in-Picture is an amusing thing for a competitor to think is great, because it has fallen out of favor – the TVs I bought in the first decade of this century all had it as a feature, but modern TVs don’t bother, because it is a hassle and most people don’t use it. Now I’m not saying it isn’t a useful concept for a video wall, but I think flexible object positioning is far more capable and powerful than very limiting Picture-in-Picture features.
Comments are closed 
