• Uncategorised
  • 0

Heads up: Augmented reality prepares for the battlefield

reader comments 4[1]Share this story

At last week’s Pentagon Lab Day in Washington, DC, the Army’s Communications-Electronics Research, Development and Engineering Center (CERDEC) and Army Research Lab demonstrated a prototype of technology straight out of first-person shooter games–an “augmented reality” heads-up display that could help soldiers tap into sensors and other data. Called Tactical Augmented Reality (TAR)[2], the technology is the latest evolution of the Army’s effort to network soldiers together and give them “situational awareness” on the battlefield–where they are, where their friends are, where the adversary is, and everything else they need to know for their mission, tied into tactical communications. Over the past few years, CERDEC, ARL, and the Defense Advanced Research Projects Agency have been working on the core technologies to make augmented reality work on the battlefield, including the development of a platform called the Heads Up Navigation, Tracking and Reporting (HUNTR) system[3].

While HUNTR is relatively recent, it is built on nearly three decades of efforts by the Army to digitally enhance the foot soldier. Up until recently, those efforts ran up hard against the limitations of wearable computing. Even as the technology finally matures, it’s probably years away from seeing service in the field.

An Army video demonstrating what the service hopes tactical augmented reality can do for soldiers.

Back to the future

The Army has been trying to put things in front of soldiers’ eyes since the late 1980s.

First was Land Warrior[4] (or, as it was more formally called, the Land Warrior Integrated Fighting System). Land Warrior sprung out of a technology demonstration program in 1989 called Soldier Integrated Protective Ensemble (SIPE), which showed that enhanced sensors and communications could significantly boost the combat capabilities of small infantry units. The concepts behind Land Warrior would get tried out and refined repeatedly over the next decade, but they didn’t take shape as an actual procurement program until 2000.

That’s when they became part of the Army’s massive Future Combat Systems program. When Land Warrior was officially awarded as a full-blown development program to Raytheon, its planned kit included an integrated computer system as part of a soldier’s kit, as well as a helmet-mounted display. That device served as a data display for communications and navigation, as well as a viewer for a thermal imaging sight on the soldier’s “weapons sub-system” (the M16 rifle or M4 carbine).

  • The SIPE technology demonstrator, which led to Land Warrior.

    Note the monstrous thermal site and helmet-mounted display. circa 1989.

  • The Land Warrior system in initial development trials in 2000. Note the still-bulky sensors.
  • Another iteration of Land Warrior, worn by a soldier at Fort McPherson, Georgia, in June 2001. The weight of the full kit tipped 45 pounds at its peak–and that was without a full combat suit-out.
  • Land Warrior in its 2007 version (on the soldier on the left), being tested by the Future Combat Systems Evaluation Brigade Combat Team at Oro Grande Range, Fort Bliss, Texas.
  • Land Warrior-Stryker Interoperable, a modified version of Land Warrior gear, deployed to Iraq in 2007 with the 4th Battalion, 9th Infantry Regiment.
  • The Land Warrior system continued to be used by Stryker units.

    Here, Staff Sgt. Mark Gravsky shows his Land Warrior display during a training session involving the 4-23 Infantry Regiment of the 5th Stryker Brigade in Regensberg, a mock village at Fort Lewis, Washington, June 18, 2009.Peter Haley/Tacoma News Tribune/MCT via Getty Images

  • Nett Warrior, the current reboot of Land Warrior, uses an Android smart phone as a data display.
  • The Nett Warrior device display shows a map. Nett Warrior is heads-down, not heads-up.
  • The HUNTR prototype (Heads Up Navigation, Tracking, and Reporting), built under a CERDEC/DARPA joint-funded program.

    It uses a tethered display along with a helmet-mounted camera (on the side rail). Here, 1st Lieutenant Obinna Opara of the 1st Battalion, 29th Infantry Regiment wears HUNTR during the Advanced Expeditionary Warfighting Experiment 2017 Collective Practice at Fort Benning, Georgia, in March.

  • This slide from RDECOM explains why commercial “see-through” displays like Google Glass were insufficient for the needs of a tactical system.
  • The see-through color display of the TAR being demonstrated in May 2017 has enough brightness and contrast for use in bright environments.

The computer, integrated GPS, and radio allowed (in theory) commanders to track, in real time, where troops were. But Land Warrior didn’t exactly have a “heads-up” display, per se–it could show positions on a two-dimensional map, and it allowed soldiers to aim weapons around corners.

But Land Warrior didn’t overlay information on the world around the soldier. And it also had some significant problems–the most obvious of which was the added weight required for batteries, computing power, radios, and a TV screen mounted on a soldier’s head. Full combat gear for an infantryman is already approximately 80 pounds by itself.

Land Warrior in its full implementation added 40 pounds more gear (computer plus helmet with video display, plus digital gun sights, plus radio, plus batteries) to a soldier’s load. Carrying 120 pounds of gear under combat conditions, for those who’ve never had the experience themselves, is the equivalent of lugging Hillary Clinton’s retired e-mail servers on your back while jogging down the Vegas Strip in July. Based on some of the reviews from soldiers who used the gear[5], the servers might have been equally combat-effective.

Only one version of Land Warrior ever saw combat: the “Stryker Interoperable” variant was designed to work with the systems aboard the Stryker Infantry Fighting Vehicle. It deployed to Iraq with the 4th Battalion, 9th Infantry Regiment. The Stryker configuration of Land Warrior lowers the weight of the gear primarily by allowing soldiers to leave spare batteries in their vehicles.

The gear is still deployed with Stryker mechanized infantry units. Ironically, the entire Land Warrior program was cancelled in 2007, as its cost mounted. Then there was Ground Soldier System (GSS), which originally was supposed to include a color helmet-mounted heads-up display.

But GSS morphed into “Nett Warrior,” named in honor of World War II Medal of Honor winner Colonel Robert B. Nett[6]. To meet needs quicker (and cheaper), the Army dispensed with the helmet-mounted monocle and went to a chest-mounted Android device, using off-the-shelf hardware components to achieve mostly the same thing–except now soldiers had to look down to check their smartphones.

Nett improvement

But Nett Warrior gave the Army a common platform to build from, just as commercial augmented-reality gear like Google Glass and Microsoft’s Halo were about to arrive.

The Android-based system used for the Nett Warrior “end-user device” (EUD) gives the army both an existing common networking interface and a development platform ideal for building wearable computing applications. Like Land Warrior before it, the Army’s vision for TAR is a combination of enhanced navigation, friendly force tracking, information sharing, and weapons targeting. But instead of having a monocle display “dashboard” to watch, the soldier would have data projected directly on their field of view in a way that meshes seamlessly with the terrain around them.

The HUNTR system developed over the past two years uses an Android port of a software package called ARC 4[7], according to a CERDEC presentation[8] given at an industry event in October 2015. ARC, developed by Applied Research Associates, was also used in an earlier DARPA augmented-reality program called Ultra-Vis[9]. The data from ARC can be displayed either within enhanced night-vision gear or on a variety of existing head-mounted see-through displays.

The software uses Global Positioning System data, helmet-camera data, and inertial sensors to “geo-register” the soldier’s field of view. That allows symbols designating waypoints, points of interest, and friendly forces to be projected on what the soldier sees, as well as a navigational “compass” showing the direction to tracked objects when they’re not in view. Additionally, a 3-D model of terrain can be superimposed on the real world to help in navigation.

This data can be pulled in from the Nett Warrior device and pushed out to soldiers from an operations center and other sources as needed.

[embedded content]
The ARC 4 software in action.

Display of determination

One of the major remaining problems for tactical augmented reality is that off-the-shelf display technology simply hasn’t been up to the demands of battlefield use. While it’s easy enough, relatively speaking, to project augmented-reality data on night-vision displays, daytime use of augmented reality has been made difficult by the relatively small field of view and low contrast of see-through displays. Even Microsoft Hololens’ relatively large field of view may not be enough for tactical applications.

And most displays don’t generate enough relative brightness to be visible over brightly lit desert or winter terrain (as shown by the CERDEC slide in the gallery above). So ARL and CERDEC had to work with suppliers to build their own. Previous prototypes of TAR displays used black-and-white or “greenscreen” projections to maintain enough contrast to be visible.

Color displays in the size range used (about one inch diagonally) could not provide enough resolution. But the prototype TAR display shown at Lab Days has significantly more contrast. The prototype allows color images to be superimposed on even the brightest backgrounds.

Meanwhile, Applied Research Associates is looking for commercial and consumer applications of its software–from logistics to augmented-reality gaming to social media.

So while the Army pushes augmented reality to the battlefield, we may all be seeing data swimming in front of our eyes.

References

  1. ^ 4 posters participating (arstechnica.com)
  2. ^ Tactical Augmented Reality (TAR) (www.army.mil)
  3. ^ Heads Up Navigation, Tracking and Reporting (HUNTR) system (soldiersystems.net)
  4. ^ Land Warrior (fas.org)
  5. ^ some of the reviews from soldiers who used the gear (www.popularmechanics.com)
  6. ^ Colonel Robert B.

    Nett (archive.is)

  7. ^ ARC 4 (www.ara.com)
  8. ^ CERDEC presentation (www.afcea.org)
  9. ^ Ultra-Vis (breakingdefense.com)

You may also like...

Leave a Reply

Your email address will not be published. Required fields are marked *

       
Apps & Games Clothing Electronics & Photo Large Appliances
Baby Womens Apparel Garden Lighting
Beauty Mens Apparel Outdoors Luggage
Books Girls Apparel Health & Personal Care Pet Supplies
Car Boys Apparel Home Shoes & Bags
Motorbike Computers & Accessories Kitchen Equipment Sports & Outdoors
Fashion DIY & Tools Jewellery Toys & Games