NUMENTA, INC. Patent applications |
Patent application number | Title | Published |
20140207842 | Hierarchical Temporal Memory (HTM) System Deployed As Web Service - A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server. | 07-24-2014 |
20140129499 | VALUE ORIENTED ACTION RECOMMENDATION USING SPATIAL AND TEMPORAL MEMORY SYSTEM - Embodiments relate to recommending actions based on costs or benefits associated with predictions generated by a spatial and temporal memory system. The spatial and temporal memory system may generate a prediction indicating that more than one value or state may take place in the future where each value or state is associated with different costs and benefits. A configuration assistant facilitates a user to define costs and benefits associated with the more than one value or state. The spatial and temporal memory system uses the likelihood distribution in prediction, and its associated costs and benefits to recommend an action. | 05-08-2014 |
20140122394 | DIRECTED BEHAVIOR IN HIERARCHICAL TEMPORAL MEMORY BASED SYSTEM - A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy. | 05-01-2014 |
20140114896 | PERFORMING MULTISTEP PREDICTION USING SPATIAL AND TEMPORAL MEMORY SYSTEM - Embodiments relate to making predictions for values or states to follow multiple time steps after receiving a certain input data in a spatial and temporal memory system. During a training stage, relationships between states of the spatial and temporal memory system at certain times and spatial patterns of the input data detected a plurality of time steps later after the certain time steps are established. Using the established relationships, the spatial and temporal memory system can make predictions multiple time steps into the future based on the input data received at a current time. | 04-24-2014 |
20140067734 | ANOMALY DETECTION IN SPATIAL AND TEMPORAL MEMORY SYSTEM - Detecting patterns and sequences associated with an anomaly in predictions made a predictive system. The predictive system makes predictions by learning spatial patterns and temporal sequences in an input data that change over time. As the input data is received, the predictive system generates a series of predictions based on the input data. Each prediction is compared with corresponding actual value or state. If the prediction does not match or deviates significantly from the actual value or state, an anomaly is identified for further analysis. A corresponding state or a series of states of the predictive system before or at the time of prediction are associated with the anomaly and stored. The anomaly can be detected by monitoring whether the predictive system is placed in the state or states that is the same or similar to the stored state or states. | 03-06-2014 |
20130054552 | AUTOMATED SEARCH FOR DETECTING PATTERNS AND SEQUENCES IN DATA USING A SPATIAL AND TEMPORAL MEMORY SYSTEM - A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems. | 02-28-2013 |
20130054496 | ASSESSING PERFORMANCE IN A SPATIAL AND TEMPORAL MEMORY SYSTEM - A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems. | 02-28-2013 |
20130054495 | ENCODING OF DATA FOR PROCESSING IN A SPATIAL AND TEMPORAL MEMORY SYSTEM - A spatial and temporal memory system (STMS) processes input data to detect whether spatial patterns and/or temporal sequences of spatial patterns exist within the data, and to make predictions about future data. The data processed by the STMS may be retrieved from, for example, one or more database fields and is encoded into a distributed representation format using a coding scheme. The performance of the STMS in predicting future data is evaluated for the coding scheme used to process the data as performance data. The selection and prioritization of STMS experiments to perform may be based on the performance data for an experiment. The best fields, encodings, and time aggregations for generating predictions can be determined by an automated search and evaluation of multiple STMS systems. | 02-28-2013 |
20120330885 | SEQUENCE LEARNING IN A HIERARCHICAL TEMPORAL MEMORY BASED SYSTEM - A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy. | 12-27-2012 |
20120197823 | METHODS, ARCHITECTURE, AND APPARATUS FOR IMPLEMENTING MACHINE INTELLIGENCE AND HIERARCHICAL MEMORY SYSTEMS - Sophisticated memory systems and intelligent machines may be constructed by creating an active memory system with a hierarchical architecture. Specifically, a system may comprise a plurality of individual cortical processing units arranged into a hierarchical structure. Each individual cortical processing unit receives a sequence of patterns as input. Each cortical processing unit processes the received input sequence of patterns using a memory containing previously encountered sequences with structure and outputs another pattern. As several input sequences are processed by a cortical processing unit, it will therefore generate a sequence of patterns on its output. The sequence of patterns on its output may be passed as an input to one or more cortical processing units in next higher layer of the hierarchy. A lowest layer of cortical processing units may receive sensory input from the outside world. The sensory input also comprises a sequence of patterns. | 08-02-2012 |
20120166364 | Hierarchical Temporal Memory (HTM) System Deployed as Web Service - A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server. | 06-28-2012 |
20120109857 | Trainable hierarchical memory system and method - Memory networks and methods are provided. Machine intelligence is achieved by a plurality of linked processor units in which child modules receive input data. The input data are processed to identify patterns and/or sequences. Data regarding the observed patterns and/or sequences are passed to a patent module which may receive as inputs data from one or more child modules. the parent module examines its input data for patterns and/or sequences and then provides feedback to the child module or modules regarding the parent-level patterns that correlate with the child-level patterns. These systems and methods are extensible to large networks of interconnected processor modules. | 05-03-2012 |
20120005134 | SPATIO-TEMPORAL LEARNING ALGORITHMS IN HIERARCHICAL TEMPORAL NETWORKS - A spatio-temporal learning node is a type of HTM node which learns both spatial and temporal groups of sensed input patterns over time. Spatio-temporal learning nodes comprise spatial poolers which are used to determine spatial groups in a set of sensed input patterns. The spatio-temporal learning nodes further comprise temporal poolers which are used to determine groups of sensed input patterns that temporally co-occur. A spatio-temporal learning network is a hierarchical network including a plurality of spatio-temporal learning nodes. | 01-05-2012 |
20110231351 | Feedback in Group Based Hierarchical Temporal Memory System - A Hierarchical Temporal Memory (HTM) network has at least first nodes and a second node at a higher level than the first nodes. The second node provides an inter-node feedback signal to the first nodes for grouping patterns and sequences (or co-occurrences) in input data received at the first nodes at the first nodes. The second node collects forward signals from the first nodes; and thus, the second node has information about the grouping of the patterns and sequences (or co-occurrences) at the first nodes. The second node provides inter-node feedback signals to the first nodes based on which the first nodes may perform the grouping of the patterns and sequences (or co-occurrences) at the first nodes. | 09-22-2011 |
20110225108 | TEMPORAL MEMORY USING SPARSE DISTRIBUTED REPRESENTATION - A processing node in a temporal memory system includes a spatial pooler and a sequence processor. The spatial pooler generates a spatial pooler signal representing similarity between received spatial patterns in an input signal and stored co-occurrence patterns. The spatial pooler signal is represented by a combination of elements that are active or inactive. Each co-occurrence pattern is mapped to different subsets of elements of an input signal. The spatial pooler signal is fed to a sequence processor receiving and processed to learn, recognize and predict temporal sequences in the input signal. The sequence processor includes one or more columns, each column including one or more cells. A subset of columns may be selected by the spatial pooler signal, causing one or more cells in these columns to activate. | 09-15-2011 |
20100191684 | Trainable hierarchical memory system and method - Memory networks and methods are provided. Machine intelligence is achieved by a plurality of linked processor units in which child modules receive input data. The input data are processed to identify patterns and/or sequences. Data regarding the observed patterns and/or sequences are passed to a parent module which may receive as inputs data from one or more child modules. the parent module examines its input data for patterns and/or sequences and then provides feedback to the child module or modules regarding the parent-level patterns that correlate with the child-level patterns. These systems and methods are extensible to large networks of interconnected processor modules. | 07-29-2010 |
20100185567 | SUPERVISION BASED GROUPING OF PATTERNS IN HIERARCHICAL TEMPORAL MEMORY (HTM) - A HTM network that uses supervision signals such as indexes for correct categories of the input patterns to group the co-occurrences detected in the node. In the training mode, the supervised learning node receives the supervision signals in addition to the indexes or distributions from children nodes. The supervision signal is then used to assign the co-occurrences into groups. The groups include unique groups and nonunique groups. The co-occurrences in the unique group appear only when the input data represent certain category but not others. The nonunique groups include patterns that are shared by one or more categories. In an inference mode, the supervised learning node generates distributions over the groups created in the training mode. A top node of the HTM network generates an output based on the distributions generated by the supervised learning node. | 07-22-2010 |
20100049677 | SEQUENCE LEARNING IN A HIERARCHICAL TEMPORAL MEMORY BASED SYSTEM - A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy. | 02-25-2010 |
20090313193 | HIERARCHICAL TEMPORAL MEMORY SYSTEM WITH HIGHER-ORDER TEMPORAL POOLING CAPABILITY - A temporal pooler for a Hierarchical Temporal Memory network is provided. The temporal pooler is capable of storing information about sequences of co-occurrences in a higher-order Markov chain by splitting a co-occurrence into a plurality of sub-occurrences. Each split sub-occurrence may be part of a distinct sequence of co-occurrences. The temporal pooler receives the probability of spatial co-occurrences in training patterns and tallies counts or frequency of transitions from one sub-occurrence to another sub-occurrence in a connectivity matrix. The connectivity matrix is then processed to generate temporal statistics data. The temporal statistics data is provided to an inference engine to perform inference or prediction on input patterns. By storing information related to a higher-order Markov model, the temporal statistics data more accurately reflects long temporal sequences of co-occurrences in the training patterns. | 12-17-2009 |
20090240886 | PLUGIN INFRASTRUCTURE FOR HIERARCHICAL TEMPORAL MEMORY (HTM) SYSTEM - A system for implementing a hierarchical temporal memory (HTM) network using a plugin infrastructure. The plugin infrastructure registers the plugins to be used in instantiating the HTM network. The plugin may include one or more functions for creating one or more components of the HTM network in a runtime engine. The plugin is associated with a component specification describing the components of the HTM network created by invoking the functions of the plugin. After the plugin is registered, the plugin infrastructure allows functions of the plugin to be invoked to instantiate The HTM network on a runtime engine. After the HTM network is instantiated, the runtime engine may run the instance of the HTM network to learn and infer the causes of input data. The system may also include one or more external programs to provide various supporting operations associated with the runtime engine by referencing the component specification. The supporting operations that can be performed by the external programs include, among others, validating a netlist defining the structure of the HTM network, build help information for the component, and generating a graphical user interface associated with the HTM network. | 09-24-2009 |
20090240639 | Feedback in Group Based Hierarchical Temporal Memory System - A Hierarchical Temporal Memory (HTM) network has at least first nodes and a second node at a higher level than the first nodes. The second node provides an inter-node feedback signal to the first nodes for grouping patterns and sequences (or co-occurrences) in input data received at the first nodes at the first nodes. The second node collects forward signals from the first nodes; and thus, the second node has information about the grouping of the patterns and sequences (or co-occurrences) at the first nodes. The second node provides inter-node feedback signals to the first nodes based on which the first nodes may perform the grouping of the patterns and sequences (or co-occurrences) at the first nodes. Also, a node in a Hierarchical Temporal Memory (HTM) network comprising a co-occurrence detector and a group learner coupled to the co-occurrence detector. The group learner provides an intra-node feedback signal to the co-occurrence detector including information on the grouping of the co-occurrences. The co-occurrence detector may select co-occurrences to be split, merged, retained or discarded based on the intra-node feedback signals. | 09-24-2009 |
20090150311 | Action based learning - A set of sequences of sensed input patterns associated with a set of actions is generated by performing at least a first action on data derived from a real-world system. A subset of the sequences of sensed input patterns that form a group associated with the first action is determined. A new sequence of sensed input patterns is received. A first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action based on the subset of sequences of sensed input patterns is determined and stored in a memory associated with the computer system. | 06-11-2009 |
20090006289 | Hierarchical Temporal Memory System with Enhanced Inference Capability - A node, a computer program storage medium, and a method for a hierarchical temporal memory (HTM) network where at least one of its nodes generates a top-down message and sends the top-down message to one or more children nodes in the HTM network. The first top-down message represents information about the state of a node and functions as feedback information from a current node to its child node. The node may also maintain history of the input patterns or co-occurrences so that temporal relationships between input patterns or co-occurrences may be taken into account in an inference stage. By providing the top-town message and maintaining history of previous input patterns, the HTM network may, among others, (i) perform more accurate inference based on temporal history, (ii) make predictions, (iii) discriminate between spatial co-occurrences with different temporal histories, (iv) detect “surprising” temporal patterns, (v) generate examples from a category, and (vi) fill in missing or occluded data. | 01-01-2009 |
20080208966 | Hierarchical Temporal Memory (HTM) System Deployed as Web Service - A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server. | 08-28-2008 |
20080208915 | Episodic Memory With A Hierarchical Temporal Memory Based System - A hierarchy of computing modules is configured to (i) learn a cause of input data sensed over space and time, and (ii) determine a cause of novel sensed input data dependent on the learned cause. When determining the cause of the novel sensed input data, the computing modules determine likely sequences based on observed inputs. Information identifying one or more of those likely sequences and indexes of observed elements in those sequences may then be stored in external memory to facilitate data compression and/or granularity-based searches. | 08-28-2008 |
20080208783 | Spatio-Temporal Learning Algorithms In Hierarchical Temporal Networks - A spatio-temporal learning node is a type of HTM node which learns both spatial and temporal groups of sensed input patterns over time. Spatio-temporal learning nodes comprise spatial poolers which are used to determine spatial groups in a set of sensed input patterns. The spatio-temporal learning nodes further comprise temporal poolers which are used to determine groups of sensed input patterns that temporally co-occur. A spatio-temporal learning network is a hierarchical network including a plurality of spatio-temporal learning nodes. | 08-28-2008 |
20080201286 | Methods, Architecture, and Apparatus for Implementing Machine Intelligence and Hierarchical Memory Systems - Sophisticated memory systems and intelligent machines may be constructed by creating an active memory system with a hierarchical architecture. Specifically, a system may comprise a plurality of individual cortical processing units arranged into a hierarchical structure. Each individual cortical processing unit receives a sequence of patterns as input. Each cortical processing unit processes the received input sequence of patterns using a memory containing previously encountered sequences with structure and outputs another pattern. As several input sequences are processed by a cortical processing unit, it will therefore generate a sequence of patterns on its output. The sequence of patterns on its output may be passed as an input to one or more cortical processing units in next higher layer of the hierarchy. A lowest layer of cortical processing units may receive sensory input from the outside world. The sensory input also comprises a sequence of patterns. | 08-21-2008 |