Correlation engine for security, safety, and business productivity

US 9,344,616 B2
Filed: 04/02/2014
Issued: 05/17/2016
Est. Priority Date: 10/04/2007
Status: Active Grant

- Alert
- Pin

Associated Cases

Associated Defendants

First Claim

Patent Images

1. A non-transitory, physical storage medium storing computer-readable program code, the program code executable by a hardware processor, the program code when executed by the hardware processor causing the hardware processor to execute steps comprising:

receiving sensory data about a physical environment from one or more sensors;

receiving IP data of the one or more sensors, wherein the IP data comprises at least an Internet Protocol (IP) address and a network status of at least one of the sensors;

processing the sensory data from the one or more sensors to detect one or more primitive sensory events;

communicating with one or more legacy systems external to the sensors via one or more communication links;

processing information from the one or more legacy systems to detect one or more primitive legacy system events;

normalizing the primitive sensory events and the primitive legacy system events into a standardized data format;

storing the normalized sensory events and the normalized legacy system events in an event database for later retrieval;

retrieving one or more historical normalized sensory events and one or more historical normalized legacy system events from the event database;

evaluating one or more historical correlations by automatically analyzing said primitive sensory events and said primitive legacy system events, across at least one of time and space, for one or more historical correlations between the historical normalized sensory events and the historical normalized legacy system events;

monitoring continuously and in real-time the primitive sensory events from the one or more sensors based on the one or more historical correlations to identify one or more critical events;

monitoring continuously and in real-time the network status of one or more of the sensors based on the IP data to identify one or more network failure events; and

sending one or more alerts based on at least one of said critical events and said network failure events.

View all claims

3 Assignments

Timeline View

Assignment View

Litigations

0 Petitions

Accused Products

Abstract

The present invention is a correlation engine for use in security, safety, and business monitoring applications. Sensory data from one or more sensors are captured and analyzed to detect one or more events in the sensory data. The events are correlated by the correlation engine by weighing the events based on attributes of the sensors that were used to detect the primitive events. The events are then monitored for an occurrence of one or more correlations of interest. Finally, one or more actions are triggered based on a detection of one or more anomalous events or events of interest. Events may come from sensory devices, legacy systems, third-party systems, anonymous tips, and other data sources. The present invention may be used to increase business productivity by improving security, safety, and increasing profitability of business processes.

149 Citations

57 Claims

1. A non-transitory, physical storage medium storing computer-readable program code, the program code executable by a hardware processor, the program code when executed by the hardware processor causing the hardware processor to execute steps comprising:
- receiving sensory data about a physical environment from one or more sensors;
  
  receiving IP data of the one or more sensors, wherein the IP data comprises at least an Internet Protocol (IP) address and a network status of at least one of the sensors;
  
  processing the sensory data from the one or more sensors to detect one or more primitive sensory events;
  
  communicating with one or more legacy systems external to the sensors via one or more communication links;
  
  processing information from the one or more legacy systems to detect one or more primitive legacy system events;
  
  normalizing the primitive sensory events and the primitive legacy system events into a standardized data format;
  
  storing the normalized sensory events and the normalized legacy system events in an event database for later retrieval;
  
  retrieving one or more historical normalized sensory events and one or more historical normalized legacy system events from the event database;
  
  evaluating one or more historical correlations by automatically analyzing said primitive sensory events and said primitive legacy system events, across at least one of time and space, for one or more historical correlations between the historical normalized sensory events and the historical normalized legacy system events;
  
  monitoring continuously and in real-time the primitive sensory events from the one or more sensors based on the one or more historical correlations to identify one or more critical events;
  
  monitoring continuously and in real-time the network status of one or more of the sensors based on the IP data to identify one or more network failure events; and
  
  sending one or more alerts based on at least one of said critical events and said network failure events.
- View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
- - 2. The non-transitory, physical storage medium of claim 1, wherein the historical correlations are calculated by applying a weighting of relative importance of the sensory data based on a quality of data produced by the sensors, wherein the primitive sensory events are weighted based at least on the quality of data produced by the sensors used to capture the sensory data.
  - 3. The non-transitory, physical storage medium of claim 1, wherein the critical events are determined from one or more safety procedures, and wherein the one or more alerts are sent when one or more of the safety procedures are violated.
  - 4. The non-transitory, physical storage medium of claim 1, wherein the one or more sensors are selected from the group consisting of a temperature probe, a pressure probe, an altitude meter, a speedometer, a revolutions per minute (RPM) meter, a blood pressure meter, a heart rate meter, a chlorine meter, a radon meter, a dust particle meter, a pollution meter, a CO₂meter, a bacteria meter, a water meter, an electrical meter, and combinations thereof.
  - 5. The non-transitory, physical storage medium of claim 1, wherein the one or more legacy systems are selected from the group consisting of an access control system, a personnel system, an inventory system, a financial system, a police dispatch system, a currency system, a law enforcement database, a light control system, and combinations thereof.
  - 6. The non-transitory, physical storage medium of claim 1, wherein the one or more legacy systems comprise at least a personnel system, and wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - retrieving experience levels of personnel from the personnel system;
      
      correlating the experience levels of personnel with the primitive sensory events; and
      
      generating one or more alerts based on the correlation between the experience levels of personnel and the primitive sensory events.
  - 7. The non-transitory, physical storage medium of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - performing one or more actions based on a correlation level exceeding a predetermined threshold.
  - 8. The non-transitory, physical storage medium of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - generating one or more new rules based on primitive events correlated and alerts generated.
  - 9. The non-transitory, physical storage medium of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - receiving tip data from one or more external sources;
      
      generating tip events based on the tip data;
      
      correlating one or more tip events with the primitive sensory events; and
      
      generating one or more alerts based on the correlation between the tip events and the primitive sensory events.
  - 10. The non-transitory, physical storage medium of claim 1, wherein the primitive sensory events are weighted based at least on one or more attribute data of the one or more sensors used to capture the sensory data.
  - 11. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises a quality of sensory data produced by the sensors.
  - 12. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises an age of the sensors used to capture the sensory data.
  - 13. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises a time since the sensors were last maintained.
  - 14. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises an integrity of the sensors used to capture the sensory data.
  - 15. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises a reliability of the sensors used to capture the sensory data.
  - 16. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises a reliability of power that is powering the sensors.
  - 17. The non-transitory, physical storage medium of claim 10, wherein the attribute data comprises a reliability of a transmission and a bandwidth of a communication link to the sensors.
  - 18. The non-transitory, physical storage medium of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - providing a graphical user interface (GUI) for a human operator to receive the one or more alerts.
  - 19. The non-transitory, physical storage medium of claim 1, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - storing the sensory data from the one or more sensors in one or more data storage devices.

20. A monitoring system, comprising:
- a hardware processor; and
  
  a non-transitory, physical storage medium storing computer-readable program code, the program code executable by the hardware processor, the program code when executed by the hardware processor causing the hardware processor to execute steps comprising;
  
  receiving sensory data about a physical environment from one or more sensors;
  
  receiving IP data of the one or more sensors, wherein the IP data comprises at least an Internet Protocol (IP) address and a network status of at least one of the sensors;
  
  processing the sensory data from the one or more sensors to detect one or more primitive sensory events;
  
  communicating with one or more legacy systems external to the sensors via one or more communication links;
  
  processing information from the one or more legacy systems to detect one or more primitive legacy system events;
  
  normalizing the primitive sensory events and the primitive legacy system events into a standardized data format;
  
  storing the normalized sensory events and the normalized legacy system events in an event database for later retrieval;
  
  retrieving one or more historical normalized sensory events and one or more historical normalized legacy system events from the event database;
  
  evaluating one or more historical correlations by automatically analyzing said primitive sensory events and said primitive legacy system events, across at least one of time and space, for one or more historical correlations between (i) the primitive sensory events and the primitive legacy system events that are detected in real time, and (ii) the historical primitive sensory events and the historical legacy system events;
  
  monitoring continuously and in real-time the primitive sensory events from the one or more sensors based on the one or more historical correlations to identify one or more critical events;
  
  monitoring continuously and in real-time the network status of one or more of the sensors based on the IP data to identify one or more network failure events; and
  
  sending one or more alerts based on at least one of said critical events and said network failure events.
- View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38)
- - 21. The monitoring system of claim 20, wherein the historical correlations are calculated by applying a weighting of relative importance of the sensory data based on a quality of data produced by the sensors.
  - 22. The monitoring system of claim 20, wherein the critical events are determined from one or more safety procedures, and wherein the one or more alerts are sent when one or more of the safety procedures are violated.
  - 23. The monitoring system of claim 20, wherein the one or more sensors are selected from the group consisting of a temperature probe, a pressure probe, an altitude meter, a speedometer, a revolutions per minute (RPM) meter, a blood pressure meter, a heart rate meter, a chlorine meter, a radon meter, a dust particle meter, a pollution meter, a CO₂meter, a bacteria meter, a water meter, and an electrical meter.
  - 24. The monitoring system of claim 20, wherein the one or more legacy systems are selected from the group consisting of an access control system, a personnel system, an inventory system, a financial system, a police dispatch system, a currency system, a law enforcement database, and a light control system.
  - 25. The monitoring system of claim 20, wherein the one or more legacy systems comprise at least a personnel system, and wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - retrieving experience levels of personnel from the personnel system;
      
      correlating the experience levels of personnel with the primitive sensory events; and
      
      generating one or more alerts based on the correlation between the experience levels of personnel and the primitive sensory events.
  - 26. The monitoring system of claim 20, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - performing one or more actions based on a correlation level exceeding a predetermined threshold.
  - 27. The monitoring system of claim 20, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - generating one or more new rules based on primitive events correlated and alerts generated.
  - 28. The monitoring system of claim 20, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - receiving tip data from one or more external sources;
      
      generating tip events based on the tip data;
      
      correlating one or more tip events with the primitive sensory events; and
      
      generating one or more alerts based on the correlation between the tip events and the primitive sensory events.
  - 29. The monitoring system of claim 20, wherein the primitive sensory events are weighted based at least on one or more attribute data of the one or more sensors used to capture the sensory data.
  - 30. The monitoring system of claim 29, wherein the attribute data comprises a quality of sensory data produced by the one or more sensors.
  - 31. The monitoring system of claim 29, wherein the attribute data comprises an age of the one or more sensors used to capture the sensory data.
  - 32. The monitoring system of claim 29, wherein the attribute data comprises a time since the one or more sensors were last maintained.
  - 33. The monitoring system of claim 29, wherein the attribute data comprises an integrity of the one or more sensors used to capture the sensory data.
  - 34. The monitoring system of claim 29, wherein the attribute data comprises a reliability of the one or more sensors used to capture the sensory data.
  - 35. The monitoring system of claim 29, wherein the attribute data comprises a reliability of power that is powering the one or more sensors.
  - 36. The monitoring system of claim 29, wherein the attribute data comprises a reliability of a transmission and a bandwidth of a communication link to the one or more sensors.
  - 37. The monitoring system of claim 29, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - providing a graphical user interface (GUI) for a human operator to receive the one or more alerts.
  - 38. The monitoring system of claim 29, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - storing the sensory data from the one or more sensors in one or more data storage devices.

39. A non-transitory, physical storage medium storing computer-readable program code, the program code executable by a hardware processor, the program code when executed by the hardware processor causing the hardware processor to execute steps comprising:
- receiving sensory data about a physical environment from one or more sensors;
  
  receiving IP data of the one or more sensors, wherein the IP data comprises at least an Internet Protocol (IP) address and a network status of at least one of the sensors;
  
  processing the sensory data from the one or more sensors to detect one or more primitive sensory events;
  
  normalizing the primitive sensory events into a standardized data format;
  
  storing the normalized sensory events in an event database for later retrieval;
  
  retrieving one or more historical normalized sensory events from the event database;
  
  evaluating one or more historical correlations by automatically analyzing said primitive sensory events, across at least one of time and space, for one or more historical correlations among the historical normalized sensory events;
  
  monitoring continuously and in real-time the primitive sensory events from the one or more sensors based on the one or more historical correlations to identify one or more critical events;
  
  monitoring continuously and in real-time the network status of one or more of the sensors based on the IP data to identify one or more network failure events; and
  
  sending one or more alerts based on at least one of said critical events and said network failure events.
- View Dependent Claims (40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57)
- - 40. The non-transitory, physical storage medium of claim 39, wherein the historical correlations are calculated by applying a weighting of relative importance of the sensory data based on a quality of data produced by the sensors.
  - 41. The non-transitory, physical storage medium of claim 39, wherein the critical events are determined from one or more safety procedures, and wherein the one or more alerts are sent when one or more of the safety procedures are violated.
  - 42. The non-transitory, physical storage medium of claim 39, wherein the one or more sensors are selected from the group consisting of a temperature probe, a pressure probe, an altitude meter, a speedometer, a revolutions per minute (RPM) meter, a blood pressure meter, a heart rate meter, a chlorine meter, a radon meter, a dust particle meter, a pollution meter, a CO₂meter, a bacteria meter, a water meter, and an electrical meter.
  - 43. The non-transitory, physical storage medium of claim 39, further comprising one or more legacy systems selected from the group consisting of an access control system, a personnel system, an inventory system, a financial system, a police dispatch system, a currency system, a law enforcement database, and a light control system.
  - 44. The non-transitory, physical storage medium of claim 39, further comprising one or more legacy systems comprising at least a personnel system, and wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - retrieving experience levels of personnel from the personnel system;
      
      correlating the experience levels of personnel with the primitive sensory events; and
      
      generating one or more alerts based on the correlation between the experience levels of personnel and the primitive sensory events.
  - 45. The non-transitory, physical storage medium of claim 39, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - performing one or more actions based on a correlation level exceeding a predetermined threshold.
  - 46. The non-transitory, physical storage medium of claim 39, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - generating one or more new rules based on primitive events correlated and alerts generated.
  - 47. The non-transitory, physical storage medium of claim 39, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - receiving tip data from one or more external sources;
      
      generating tip events based on the tip data;
      
      correlating one or more tip events with the primitive sensory events; and
      
      generating one or more alerts based on the correlation between the tip events and the primitive sensory events.
  - 48. The non-transitory, physical storage medium of claim 39, wherein the primitive sensory events are weighted based at least on one or more attribute data of the one or more sensors used to capture the sensory data.
  - 49. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises a quality of sensory data produced by the one or more sensors.
  - 50. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises an age of the one or more sensors used to capture the sensory data.
  - 51. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises a time since the one or more sensors were last maintained.
  - 52. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises an integrity of the one or more sensors used to capture the sensory data.
  - 53. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises a reliability of the one or more sensors used to capture the sensory data.
  - 54. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises a reliability of power that is powering the one or more sensors.
  - 55. The non-transitory, physical storage medium of claim 48, wherein the attribute data comprises a reliability of a transmission and a bandwidth of a communication link to the one or more sensors.
  - 56. The non-transitory, physical storage medium of claim 39, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - providing a graphical user interface (GUI) for a human operator to receive the one or more alerts.
  - 57. The non-transitory, physical storage medium of claim 39, wherein the storage medium further comprises program code, which when executed causes the hardware processor to execute steps comprising:
    - storing the sensory data from the one or more sensors in one or more data storage devices.

Specification

Resources

Litigation Campaign Assessment

Litigation Data

Current Assignee
SecureNet Solutions Group, LLC
Original Assignee
SecureNet Solutions Group, LLC
Inventors
Hussain, Daniar, Donovan, John J
Primary Examiner(s)
La, Anh V

Application Number

US14/243,182
Publication Number

US 20150319352A1
Time in Patent Office

776 Days
Field of Search

340/540, 340/506, 340/539.25, 340/521, 340/937, 340/143, 348/143, 348/159
US Class Current

1/1
CPC Class Codes

G06F 3/0481   based on specific propertie...

G06F 3/0605   by facilitating the interac...

G06F 3/0649   Lifecycle management

G06F 3/0685   Hybrid storage combining he...

G08B 13/19645   Multiple cameras, each havi...

G08B 13/19656   Network used to communicate...

G08B 13/19671   Addition of non-video data,...

G08B 13/19693   using multiple video source...

G08B 13/19697   Arrangements wherein non-vi...

H04L 41/0631   using root cause analysis; ...

H04L 41/0654   using network fault recover...

H04L 67/12   specially adapted for propr...

H04N 23/661   Transmitting camera control...

H04N 23/80   Camera processing pipelines...

H04N 23/90   Arrangement of cameras or c...

H04N 7/181   for receiving images from a...

H04N 7/183   for receiving images from a...

Correlation engine for security, safety, and business productivity

First Claim

3 Assignments

Litigations

0 Petitions

Accused Products

Abstract

149 Citations

57 Claims

Specification

Use Cases

Quick Links

Others

Correlation engine for security, safety, and business productivity

First Claim

3 Assignments

Subscription Required

Subscription Required

Litigations

0 Petitions

Subscription Required

Accused Products

Subscription Required

Abstract

149 Citations

57 Claims

Specification

Subscription Required

Use Cases

Quick Links

Others