Intelligence Relational Database?

BY Herschel Smith
6 years, 12 months ago

Captain Tim Hsia, U.S. Army, has written a thoughtful and provocative article at the Small Wars Journal Blog entitled Intelligence Collection and Sharing. Captain Hsia begins by cataloging the sundy reasons for the paucity of good local and regional intelligence and other information.

When a unit assumes battle space within Iraq the first thing that a commander receives from his higher headquarters is a plethora of maps detailing major avenues of approach, religious divides, key figures, demographics, key infrastructure, etc. However, much of the intelligence is outdated or watered down, and the source of this data is often unattributed. The source of this intelligence is necessary in order to winnow the chaff from the wheat. The intelligence received from higher headquarters can come from multiple sources, which oftentimes can be suspect and unverifiable. For example, is this intelligence derived from an Iraqi Army soldier, Iraqi policeman, neighborhood councils, street vendor, coalition signal assets, or from the previous military units who have operated within the current Area of Operations? Additionally, this initial trove of intelligence oftentimes provides just the basics and does not delve into more important issues that commanders need to know, such as the amount of money U.S. forces have spent developing the local infrastructure, the number of discontinued projects and reasons for their discontinuance, the quality of local leaders, and the attitudes of those leaders toward the U.S. military.Counterinsurgencies are not won by more soldiers, cutting edge technology, or more lethal weapon systems. Rather insurgents are defeated when the pacifying force fully understands the local citizenry, when the people identify with the pacifying force, and when there is an abundance of timely information which allows the pacifying force to apply their intelligence to operations that result in overturning and disrupting insurgent activity. Despite the great advances in the U.S. military’s ability to leverage technology to gain intelligence, it has been less successful in storing and synchronizing the historical data compiled during the past several years in its campaigns in the Middle East.

When a unit redeploys to the states they usually dump all of their electronic files to their counterparts in no systematic or coherent manner. This is the ideal situation, though if they are on a more limited timeline they might just pass off the most essential information. With units being continually shifted around Iraq with little or no notice to respond to increased violence in different areas, it has been almost impossible for units to properly pass off their intelligence to the next battle space owner or more importantly to future units that will operate in their sector. At best the problem a commander faces is an abundance of information that is improperly cataloged. Oftentimes however it is the worse case scenario in which commanders and diplomats encounter, a difficult situation where they have little to no information regarding a region or locale

As a sidebar note, if Captain Hsia is arguing for a small footprint model of counterinsurgency, he has history with which to contend (the problems in Operation Iraqi Freedom II and III caused by inadequate force size and force projection, as well as the problems in Afghanistan from the same). But continuing with the point of his article, he advocates a rather remarkable solution to this problem.

A way to remedy the chaotic state of intelligence management is to create a central intelligence collection platform that will allow any unit to upload operation summaries, economic analysis, tribal networks, environmental analysis, and graphical overlays into a central site that future commanders can access when they assume an assigned battle space. Currently all military units in Iraq and Afghanistan have access to a worldwide SIPR (secure Internet protocol router) network which allows them to access, view, and transmit secret information. Expanding this network to encompass a more centralized program of data sharing would not require any additional hardware. A fusion of geography and intelligence within a centralized network can ensure that commanders arrive at any location with the necessary intelligence derived from years of work by previous agencies and military units that have already provided a framework for understanding the enemy and the people in his assigned area. Commanders could then be spared the countless man hours recollecting data that has already been captured thru blood, sweat, and tears. A solution to the current intelligence blackhole would be to collect, store, and sift this data into a intel site organized in a manner replicating stock market data.

The appeal for such a system is strong. I started the category The Anbar Narrative in order to begin to capture snippets of perspectives and information regarding the campaign in Anbar in its various manifestations. I have exchanged perspectives with Lt. Col. Gian Gentile at the Small Wars Journal in which I have taken the position that the campaign in Iraq can be at least partially categorized as a counterinsurgency, while he has clearly said multiple times that it is only a civil war. Gentile’s perspective doesn’t affect the Anbar narrative, but it does go to show that the region and locale within Iraq can deeply affect the way a participant sees the situation. In Anbar and to the East around Ramadi, the Anbar narrative became all about tribes “flipping.” In Fallujah, tribal sheikhs were irrelevant and kinetic operations, gated communities and biometrics were the order of the day, and the muktars were much more important than the sheikhs. To the West in Haditha, fighters from Syria were problematic and earthern berms were necessary to isolate the area from outside influences. In Basra, the story is one of competing Shi’a gangs and thugs in a struggle for power. In Kirkuk there is a mixed Sunni, Shi’a and Kurdish population, and like Baghdad, civil war might be a better description of the circumstances. No single narrative fully explains the complexity of the Iraq experience. Combined with personalities, monies spent successfully and wasted, and other exigencies of the battle space, one can easily be overwhelmed by the data and information. And if we cannot even get our history right while the campaign is ongoing, how can we expect to pass on more particular and detailed information with precision?But the solution Captain Hsia profers is overwhelming as well. Note well what is being advocated. Graphical overlays, potential enemy information, (probably) census information, operational summaries, and on the list goes. All of this would have to be in a database, searchable on name (enemy), operational details (e.g., what were the locations and patrol sizes when IEDs were encountered, were distributed operations successful against enemy snipers, etc.). This means that such a database would have to be a relational database. This means that those who enter the information and access the information would have to be trained in this relational database (search query criteria, required entry information and formatting, etc.). This means that in order to deploy such a system across the armed forces in a consistent manner, a defense contractor will be at work for years to develop such a system and training for its operation would be implemented only over subsequent years in order to put it to use.We have noted with lament that the U.S. armed forces is at war, and the public has not yet mobilized for this war. Defense Secretary Gates is having trouble deciding to wean the Army off of a fifty year old cold war by re-deploying from the European theater, and the Afghanistan campaign suffers from a lack of force projection. And yet we are discussing millions and years more to deploy an integrated relational database for battle space intelligence!We like the idea, but we are realistic about it. It pays to profer the idea when its need is seen, but it also pays to point out the scope of the project. This scope is likely to kill the project before it ever gets off the ground.


You are currently reading "Intelligence Relational Database?", entry #799 on The Captain's Journal.

This article is filed under the category(s) Department of Defense,Intelligence and was published November 27th, 2007 by Herschel Smith.

If you're interested in what else the The Captain's Journal has to say, you might try thumbing through the archives and visiting the main index, or; perhaps you would like to learn more about TCJ.

26th MEU (10)
Abu Muqawama (12)
ACOG (2)
ACOGs (1)
Afghan National Army (36)
Afghan National Police (17)
Afghanistan (675)
Afghanistan SOFA (4)
Agriculture in COIN (3)
AGW (1)
Air Force (28)
Air Power (9)
al Qaeda (83)
Ali al-Sistani (1)
America (6)
Ammunition (14)
Animals in War (4)
Ansar al Sunna (15)
Anthropology (3)
AR-15s (39)
Arghandab River Valley (1)
Arlington Cemetery (2)
Army (34)
Assassinations (2)
Assault Weapon Ban (26)
Australian Army (5)
Azerbaijan (4)
Backpacking (2)
Badr Organization (8)
Baitullah Mehsud (21)
Basra (17)
BATFE (44)
Battle of Bari Alai (2)
Battle of Wanat (15)
Battle Space Weight (3)
Bin Laden (7)
Blogroll (2)
Blogs (4)
Body Armor (16)
Books (2)
Border War (7)
Brady Campaign (1)
Britain (26)
British Army (35)
Camping (4)
Canada (1)
Castle Doctrine (1)
Caucasus (6)
CENTCOM (7)
Center For a New American Security (8)
Charity (3)
China (10)
Christmas (5)
CIA (12)
Civilian National Security Force (3)
Col. Gian Gentile (9)
Combat Outposts (3)
Combat Video (2)
Concerned Citizens (6)
Constabulary Actions (3)
Coolness Factor (2)
COP Keating (4)
Corruption in COIN (4)
Council on Foreign Relations (1)
Counterinsurgency (214)
DADT (2)
David Rohde (1)
Defense Contractors (2)
Department of Defense (114)
Department of Homeland Security (9)
Disaster Preparedness (2)
Distributed Operations (5)
Dogs (5)
Drone Campaign (3)
EFV (3)
Egypt (12)
Embassy Security (1)
Enemy Spotters (1)
Expeditionary Warfare (17)
F-22 (2)
F-35 (1)
Fallujah (17)
Far East (3)
Fathers and Sons (1)
Favorite (1)
Fazlullah (3)
FBI (1)
Featured (161)
Federal Firearms Laws (15)
Financing the Taliban (2)
Firearms (258)
Football (1)
Force Projection (35)
Force Protection (4)
Force Transformation (1)
Foreign Policy (27)
Fukushima Reactor Accident (6)
Ganjgal (1)
Garmsir (1)
general (14)
General Amos (1)
General James Mattis (1)
General McChrystal (38)
General McKiernan (6)
General Rodriguez (3)
General Suleimani (7)
Georgia (19)
GITMO (2)
Google (1)
Gulbuddin Hekmatyar (1)
Gun Control (217)
Guns (593)
Guns In National Parks (2)
Haditha Roundup (10)
Haiti (2)
HAMAS (7)
Haqqani Network (9)
Hate Mail (7)
Hekmatyar (1)
Heroism (4)
Hezbollah (12)
High Capacity Magazines (11)
High Value Targets (9)
Homecoming (1)
Homeland Security (1)
Horses (1)
Humor (13)
ICOS (1)
IEDs (7)
Immigration (34)
India (10)
Infantry (3)
Information Warfare (2)
Infrastructure (2)
Intelligence (22)
Intelligence Bulletin (6)
Iran (169)
Iraq (378)
Iraq SOFA (23)
Islamic Facism (33)
Islamists (37)
Israel (18)
Jaish al Mahdi (21)
Jalalabad (1)
Japan (2)
Jihadists (71)
John Nagl (5)
Joint Intelligence Centers (1)
JRTN (1)
Kabul (1)
Kajaki Dam (1)
Kamdesh (8)
Kandahar (12)
Karachi (7)
Kashmir (2)
Khost Province (1)
Khyber (11)
Knife Blogging (2)
Korea (4)
Korengal Valley (3)
Kunar Province (20)
Kurdistan (3)
Language in COIN (5)
Language in Statecraft (1)
Language Interpreters (2)
Lashkar-e-Taiba (2)
Law Enforcement (2)
Lawfare (6)
Leadership (5)
Lebanon (6)
Leon Panetta (1)
Let Them Fight (2)
Libya (11)
Lines of Effort (3)
Littoral Combat (7)
Logistics (47)
Long Guns (1)
Lt. Col. Allen West (2)
Marine Corps (229)
Marines in Bakwa (1)
Marines in Helmand (67)
Marjah (4)
MEDEVAC (2)
Media (22)
Memorial Day (2)
Mexican Cartels (20)
Mexico (24)
Michael Yon (5)
Micromanaging the Military (7)
Middle East (1)
Military Blogging (26)
Military Contractors (3)
Military Equipment (24)
Militia (3)
Mitt Romney (3)
Monetary Policy (1)
Moqtada al Sadr (2)
Mosul (4)
Mountains (10)
MRAPs (1)
Mullah Baradar (1)
Mullah Fazlullah (1)
Mullah Omar (3)
Musa Qala (4)
Music (16)
Muslim Brotherhood (6)
Nation Building (2)
National Internet IDs (1)
National Rifle Association (13)
NATO (15)
Navy (19)
Navy Corpsman (1)
NCOs (3)
News (1)
NGOs (2)
Nicholas Schmidle (2)
Now Zad (19)
NSA (1)
NSA James L. Jones (6)
Nuclear (53)
Nuristan (8)
Obama Administration (205)
Offshore Balancing (1)
Operation Alljah (7)
Operation Khanjar (14)
Ossetia (7)
Pakistan (165)
Paktya Province (1)
Palestine (5)
Patriotism (6)
Patrolling (1)
Pech River Valley (11)
Personal (17)
Petraeus (14)
Pictures (1)
Piracy (13)
Pistol (1)
Police (123)
Police in COIN (3)
Policy (15)
Politics (141)
Poppy (2)
PPEs (1)
Prisons in Counterinsurgency (12)
Project Gunrunner (20)
PRTs (1)
Qatar (1)
Quadrennial Defense Review (2)
Quds Force (13)
Quetta Shura (1)
RAND (3)
Recommended Reading (14)
Refueling Tanker (1)
Religion (77)
Religion and Insurgency (19)
Reuters (1)
Rick Perry (4)
Roads (4)
Rolling Stone (1)
Ron Paul (1)
ROTC (1)
Rules of Engagement (74)
Rumsfeld (1)
Russia (27)
Sabbatical (1)
Sangin (1)
Saqlawiyah (1)
Satellite Patrols (2)
Saudi Arabia (4)
Scenes from Iraq (1)
Second Amendment (140)
Second Amendment Quick Hits (2)
Secretary Gates (9)
Sharia Law (3)
Shura Ittehad-ul-Mujahiden (1)
SIIC (2)
Sirajuddin Haqqani (1)
Small Wars (72)
Snipers (9)
Sniveling Lackeys (2)
Soft Power (4)
Somalia (8)
Sons of Afghanistan (1)
Sons of Iraq (2)
Special Forces (22)
Squad Rushes (1)
State Department (17)
Statistics (1)
Sunni Insurgency (10)
Support to Infantry Ratio (1)
Survival (10)
SWAT Raids (51)
Syria (38)
Tactical Drills (1)
Tactical Gear (1)
Taliban (167)
Taliban Massing of Forces (4)
Tarmiyah (1)
TBI (1)
Technology (16)
Tehrik-i-Taliban (78)
Terrain in Combat (1)
Terrorism (87)
Thanksgiving (4)
The Anbar Narrative (23)
The Art of War (5)
The Fallen (1)
The Long War (20)
The Surge (3)
The Wounded (13)
Thomas Barnett (1)
Transnational Insurgencies (5)
Tribes (5)
TSA (10)
TSA Ineptitude (10)
TTPs (1)
U.S. Border Patrol (4)
U.S. Border Security (11)
U.S. Sovereignty (13)
UAVs (2)
UBL (4)
Ukraine (2)
Uncategorized (39)
Universal Background Check (2)
Unrestricted Warfare (4)
USS Iwo Jima (2)
USS San Antonio (1)
Uzbekistan (1)
V-22 Osprey (4)
Veterans (2)
Vietnam (1)
War & Warfare (210)
War & Warfare (40)
War Movies (2)
War Reporting (18)
Wardak Province (1)
Warriors (5)
Waziristan (1)
Weapons and Tactics (57)
West Point (1)
Winter Operations (1)
Women in Combat (11)
WTF? (1)
Yemen (1)

about · archives · contact · register

Copyright © 2006-2014 Captain's Journal. All rights reserved.