Patent application number | Description | Published |
20080216081 | System and Method For Enforcing Future Policies in a Compute Environment - The invention relates to a system, method and computer-reliable medium, as well as grids and clusters managed according to the method described herein. An example embodiment relates to a method of processing a request for resources within a compute environment. The method is practiced by a system that contains modules configured or programmed to carry out the steps of the invention. The system receives a request for resources, generates a credential map for each credential associated with the request, the credential map comprising a first type of resource mapping and a second type of resource mapping. The system generates a resource availability map, generates a first composite intersecting map that intersects the resource availability map with a first type of resource mapping of all generated credential maps and generates a second composite intersecting map that intersects the resource availability map and a second type of resource mapping of all the generated credential maps. With the first and second composite intersecting maps, the system can allocate resources within the compute environment for the request based on at least one of the first composite intersecting map and the second composite intersecting map. The allocations or reservation for the request can then be made in an optimal way for parameters such as the earliest time possible based on available resources and also that maintains the constraints on the requestor. | 09-04-2008 |
20090012930 | System and method for a self-optimizing reservation in time of compute resources - A system and method of dynamically controlling a reservation of resources within a cluster environment to maximize a response time are disclosed. The method embodiment of the invention comprises receiving from a requester a request for a reservation of resources in the cluster environment, reserving a first group of resources, evaluating resources within the cluster environment to determine if the response time can be improved and if the response time can be improved, then canceling the reservation for the first group of resources and reserving a second group of resources to process the request at the improved response time. | 01-08-2009 |
20090144215 | SYSTEM AND METHOD FOR PROVIDING INTELLIGENT PRE-STAGING OF DATA IN A COMPUTE ENVIRONMENT - A system, computer-readable medium and method for performing intelligent data pre-staging for a job submitted to a cluster environment. The method aspect comprises determining availability of compute resources including availability timeframes to process the submitted job, determining data requirements for processing the job and determining a co-allocation in time reservation. | 06-04-2009 |
20090187536 | System and Method Providing Object Messages in a Compute Environment - The present invention provides a system, method and computer-readable media for creating object messages within a compute environment such as a cluster or grid. The method comprises upon an event affecting the availability or performance of an object within a cluster environment, retrieving messages related to the event from messages logs in different layers of a cluster environment. Next, the method comprises aggregating the retrieved messages into a single location, associating the aggregated messages with the object and, if a user submits a job and the performance of the job within the cluster environment is affected by the event, notifying the user of the event using the associated messages. Administrators may also create messages and associate the messages with objects such as nodes or reservations. | 07-23-2009 |
20090199193 | SYSTEM AND METHOD FOR MANAGING A HYBRID COMPUTE ENVIRONMENT - Disclosed are systems, hybrid compute environments, methods and computer-readable media for dynamically provisioning nodes for a workload. In the hybrid compute environment, each node communicates with a first resource manager associated with the first operating system and a second resource manager associated with a second operating system. The method includes receiving an instruction to provision at least one node in the hybrid compute environment from the first operating system to the second operating system, after provisioning the second operating system, pooling at least one signal from the resource manager associated with the at least one node, processing at least one signal from the second resource manager associated with the at least one node and consuming resources associated with the at least one node having the second operating system provisioned thereon. | 08-06-2009 |
20090265568 | SYSTEM AND METHOD FOR MANAGING ENERGY CONSUMPTION IN A COMPUTE ENVIRONMENT - A system, method and computer readable medium are disclosed for reducing power consumption in clusters, grids, on-demand centers, and so forth. The principles disclosed herein can reduce both direct and indirect power consumption while maintaining either full cluster performance or adequate SLA based cluster performance. The method includes receiving at least one state data point regarding power consumption or temperature of at least one resource within the compute environment. Using intelligent policies to control power consumption, the method implements and interfaces with power managements facilities within the cluster, grid or on-demand center to either implement policies, make dynamic changes, make predictions or actions, and so forth to reduce one or more of the direct or indirect power consumption associated with a compute environment. The method can analyze current workload, future workload or both in taking energy saving actions in the environment. An aspect can also involve reporting state information and updating algorithms based on historical experience or outside sources of information such as the news or weather. | 10-22-2009 |
20100023949 | SYSTEM AND METHOD FOR PROVIDING ADVANCED RESERVATIONS IN A COMPUTE ENVIRONMENT - A system and method are disclosed for dynamically reserving resources within a cluster environment. The method embodiment of the invention comprises receiving a request for resources in the cluster environment, monitoring events after receiving the request for resources and based on the monitored events, dynamically modifying at least one of the request for resources and the cluster environment. | 01-28-2010 |
20100088304 | SYSTEM AND METHOD FOR DYNAMICALLY MANAGING DATA CENTRIC SEARCHES - Disclosed herein are systems, methods, and computer readable-media for dynamically managing data-centric searches. The method includes receiving information associated with an event related to domain-specific searches to a database, identifying data at a first memory location in the database, the data being data identified in response to the domain-specific searches, duplicating the data at least once to at least one new memory location, and distributing processing more domain-specific searches amongst the at least one of the new memory location and the first memory location. The system can distribute the processing for more or additional domain-specific searches randomly, serially or using any other approach. The method optionally includes an expanded search space made up of the first memory location and at least one memory location and can identify a reduction event related to the domain-specific searches, and collapse the expanded search space by removing duplicate data from one or more memory location and adjusting the distribution of processing amongst at least one remaining memory location. The method can optionally include organizing multiple events by network segment, identifying a network segment associated with domain-specific searches, and duplicating the data to at least one new memory location in close proximity to the identified network segment. The method can measure proximity by one or more of geographic distance, network latency, number of intermediate network hops, temperature, and cost. | 04-08-2010 |
20100192157 | On-Demand Compute Environment - An on-demand compute environment comprises a plurality of nodes within an on-demand compute environment available for provisioning and a slave management module operating on a dedicated node within the on-demand compute environment, wherein upon instructions from a master management module at a local compute environment, the slave management module modifies at least one node of the plurality of nodes. | 07-29-2010 |
20100287283 | Optimized Multi-Component Co-Allocation Scheduling With Advanced Reservations for Data Transfers and Distributed Jobs - Disclosed are systems, methods, computer readable media, and compute environments for establishing a schedule for processing a job in a distributed compute environment. The method embodiment comprises converting a topology of a compute environment to a plurality of endpoint-to-endpoint paths, based on the plurality of endpoint-to-endpoint paths, mapping each replica resource of a plurality of resources to one or more endpoints where each respective resource is available, iteratively identifying schedule costs associated with a relationship between endpoints and resources, and committing a selected schedule cost from the identified schedule costs for processing a job in the compute environment. | 11-11-2010 |
20110016214 | SYSTEM AND METHOD OF BROKERING CLOUD COMPUTING RESOURCES - System, method, and tangible computer-readable storage media are disclosed for providing a brokering service for compute resources. The method includes, at a brokering service, polling a group of separately administered compute environments to identify resource capabilities and information, each compute resource environment including the group of managed nodes for processing workload, receiving a request for compute resources at the brokering service system, the request for compute resources being associated with a service level agreement (SLA) and based on the resource capabilities across the group of compute resource environments, selecting compute resources in one or more of the group of compute resource environments. The brokering service system receives workload associated with the request and communicates the workload to the selected resources for processing. The brokering services system can aggregate resources for multiple cloud service providers and act as an advocate for or a guarantor of the SLA associated with the workload. | 01-20-2011 |
20110035072 | SYSTEM AND METHOD FOR MANAGING ENERGY CONSUMPTION IN A COMPUTE ENVIRONMENT - A system, method and non-transitory computer-readable storage medium are disclosed for managing workload in data centers. The method includes receiving information associated with at least one of energy consumption and a temperature of nodes each data center of a group of distributed data centers to yield received information. The method further includes analyzing workload associated with at least one second data center of the group of distributed data centers to yield an analysis of the workload, and modifying use of resources of the group of distributed data centers based on the received information and the analysis of the workload. One application can include migration of workload from one data center to another data center based on a variety of factors. | 02-10-2011 |
20110035078 | SYSTEM AND METHOD FOR MANAGING ENERGY CONSUMPTION IN A COMPUTE ENVIRONMENT - A system, method and non-transitory computer readable storage medium are disclosed for managing workload in a data center. The method includes receiving data related to at least one of a current state of workload in the compute environment at a current time and future workload scheduled to consume resources in the compute environment at a future time relative to the current time, wherein the compute environment comprises a plurality of nodes in which compute resources are reserved by a workload manager for consumption, and controlling a cooling system to selectively modify a temperature of at least one node in the compute environment based on the data. | 02-10-2011 |
20110055604 | SYSTEM AND METHOD FOR MANAGING ENERGY CONSUMPTION IN A COMPUTE ENVIRONMENT - A system, method and non-transitory computer readable storage medium are disclosed for managing workload in a data center. The method includes receiving, at a workload manager, energy consumption information. The method further includes receiving workload information about a second data center that is remote from a first data center, and receiving, as controlled by the workload manager, at the first data center at least a portion of workload associated with the second data center based on at least one of the energy consumption information and the workload information. | 03-03-2011 |
20110055605 | SYSTEM AND METHOD FOR MANAGING ENERGY CONSUMPTION IN A COMPUTE ENVIRONMENT - A system, method and non-transitory computer readable storage medium are disclosed for managing workload in a data center. The method includes receiving, at a workload manager, energy consumption information associated with at least one of a first data center and a second data center that is geographically distanced from the first data center. The method further includes receiving workload information associated with at least one of the first data center and the second data center, and transmitting, as controlled by the workload manager, at least part of workload scheduled to be processed at the second data center to the first data center based on at least one of the energy consumption information and the workload information. | 03-03-2011 |
20110107343 | SYSTEM AND METHOD OF PROVIDING A FIXED TIME OFFSET BASED DEDICATED CO-ALLOCATION OF A COMMON RESOURCE SET - Disclosed are a system, method and computer-readable medium relating to managing resources within a compute environment having a group of nodes or computing devices. The method comprises, for each node in the compute environment: traversing a list jobs having a fixed time relationship, wherein for each job in the list, the following steps occur: obtaining a range list of available timeframes for each job, converting each availability timeframe to a start range, shifting the resulting start range in time by a job offset, for a first job, copying the resulting start range into a node range, and for all subsequent jobs, logically AND'ing the start range with the node range. Next, the method comprises logically OR'ing the node range with a global range, generating a list of acceptable resources on which to start and the timeframe at which to start and creating reservations according to the list of acceptable resources for the resources in the group of computing devices and associated job offsets. | 05-05-2011 |
20110119478 | System and method for providing object triggers - The present invention provides for systems and methods of dynamically controlling a cluster or grid environment. The method comprises attaching a trigger to an object and firing the trigger based on a trigger attribute. The cluster environment is modified by actions initiated when the trigger is fired. Each trigger has trigger attributes that govern when it is fired and actions it will take. The use of triggers enables a cluster environment to dynamically be modified with arbitrary actions to accommodate needs of arbitrary objects. Example objects include a compute node, compute resources, a cluster, groups of users, user credentials, jobs, resources managers, peer services and the like. | 05-19-2011 |
20110138056 | SYSTEM AND METHOD OF PROVIDING RESERVATION MASKS WITHIN A COMPUTE ENVIRONMENT - A system, method and computer-readable media for providing a reservation mask for compute resources such as a cluster or a grid. The method aspect comprises identifying a need type and a group of available resources, creating a reservation mask over the identified group of resources and if a request from a consumer matches the need type, then constraining the creation of a reservation for the consumer to only use resources within the reservation mask. | 06-09-2011 |
20110258248 | Elastic Management of Compute Resources Between a Web Server and an On-Demand Compute Environment - Disclosed are systems, methods and non-transitory computer-readable storage media for managing resources between a web server and an on-demand compute environment. A system configured to practice the method receives, at the on-demand compute environment, an indication that web traffic directed to a web server should at least be partially served via the on-demand compute environment, provisions compute resources within the on-demand compute environment to respond to web traffic for the web server based on the indication to yield a provisioned on-demand compute environment. The system serves web traffic at the provisioned on-demand compute environment based on an established routing of the web traffic from the web server to the provisioned on-demand compute environment such that the use of the provisioned on-demand compute environment for the web traffic is transparent. After serving the web traffic via the provisioned resources, the system can release the provisioned compute resources for other uses. | 10-20-2011 |
20110258320 | ELASTIC MANAGEMENT OF COMPUTE RESOURCES BETWEEN A WEB SERVER AND AN ON-DEMAND COMPUTE ENVIRONMENT - Disclosed are systems, methods and non-transitory computer-readable storage media for managing resources between a web server and an on-demand compute environment. A system configured to practice the method receives, at the on-demand compute environment, an indication that web traffic directed to a web server should at least be partially served via the on-demand compute environment, provisions compute resources within the on-demand compute environment to respond to web traffic for the web server based on the indication to yield a provisioned on-demand compute environment. The system serves web traffic at the provisioned on-demand compute environment based on an established routing of the web traffic from the web server to the provisioned on-demand compute environment such that the use of the provisioned on-demand compute environment for the web traffic is transparent. After serving the web traffic via the provisioned resources, the system can release the provisioned compute resources for other uses. | 10-20-2011 |
20110258323 | SYSTEM AND METHOD OF CO-ALLOCATING A RESERVATION SPANNING DIFFERENT COMPUTE RESOURCES TYPES - A system and method of co-allocating resources within a compute environment are disclosed. The method embodiment of the invention comprises receiving a request for a reservation for a first type of resource, analyzing constraints and guarantees associated with the first type of resource, identifying a first group of resources that meet the request for the first type of resource and storing in a first list, receiving a request for a reservation for a second type of resource, analyzing constraints and guarantees associated with the second type of resource, identifying a second group of resources that meet the request for the second type of resource and storing in a second list, calculating a co-allocation parameter between the first group of resources and the second group of resources and reserving resources according to the calculated co-allocation parameter of the first group of resources and the second group of resources. The request may also request exclusivity of the reservation. | 10-20-2011 |
20110296029 | System and Method for Providing Dynamic Roll-Back - A systems, method and computer-readable media are disclosed for providing a dynamic roll-back reservation mask in a compute environment. The method of managing compute resources within a compute environment includes, based on an agreement between a compute resource provider and a customer, creating a roll-back reservation mask for compute resources which slides ahead of current time by a period of time. Within the roll-back reservation mask, the method specifies a subset of consumers and compute resource requests which can access compute resources associated with the roll-back reservation mask and, based on received data, the method dynamically modifies at least one of (1) the period of time the roll-back reservation mask slides ahead of current time and (2) the compute resources associated with the roll-back reservation mask. | 12-01-2011 |
20120030685 | SYSTEM AND METHOD FOR PROVIDING DYNAMIC PROVISIONING WITHIN A COMPUTE ENVIRONMENT - The disclosure relates to systems, methods and computer-readable media for dynamically provisioning resources within a compute environment. The method aspect of the disclosure comprises A method of dynamically provisioning resources within a compute environment, the method comprises analyzing a queue of jobs to determine an availability of compute resources for each job, determining an availability of a scheduler of the compute environment to satisfy all service level agreements (SLAs) and target service levels within a current configuration of the compute resources, determining possible resource provisioning changes to improve SLA fulfillment, determining a cost of provisioning; and if provisioning changes improve overall SLA delivery, then re-provisioning at least one compute resource. | 02-02-2012 |
20120198467 | System and Method for Enforcing Future Policies in a Compute Environment - A disclosed system receives a request for resources, generates a credential map for each credential associated with the request, the credential map including a first type of resource mapping and a second type of resource mapping. The system generates a resource availability map, generates a first composite intersecting map that intersects the resource availability map with a first type of resource mapping of all the generated credential maps and generates a second composite intersecting map that intersects the resource availability map and a second type of resource mapping of all the generated credential maps. With the first and second composite intersecting maps, the system can allocate resources within the compute environment for the request based on at least one of the first composite intersecting map and the second composite intersecting map. | 08-02-2012 |
20120227054 | SYSTEM AND METHOD OF INTERFACING A WORKLOAD MANAGER AND SCHEDULER WITH AN IDENTITY MANAGER - A system, method and computer-readable media for managing a compute environment are disclosed. The method includes importing identity information from an identity manager into a module performs workload management and scheduling for a compute environment and, unless a conflict exists, modifying the behavior of the workload management and scheduling module to incorporate the imported identity information such that access to and use of the compute environment occurs according to the imported identity information. The compute environment may be a cluster or a grid wherein multiple compute environments communicate with multiple identity managers. | 09-06-2012 |
20120246660 | OPTIMIZED MULTI-COMPONENT CO-ALLOCATION SCHEDULING WITH ADVANCED RESERVATIONS FOR DATA TRANSFERS AND DISTRIBUTED JOBS - Disclosed are systems, methods, computer readable media, and compute environments for establishing a schedule for processing a job in a distributed compute environment. The method embodiment comprises converting a topology of a compute environment to a plurality of endpoint-to-endpoint paths, based on the plurality of endpoint-to-endpoint paths, mapping each replica resource of a plurality of resources to one or more endpoints where each respective resource is available, iteratively identifying schedule costs associated with a relationship between endpoints and resources, and committing a selected schedule cost from the identified schedule costs for processing a job in the compute environment. | 09-27-2012 |
20130024710 | SYSTEM AND METHOD FOR MANAGING ENERGY CONSUMPTION IN A COMPUTE ENVIRONMENT - A system and method for reducing power consumption in clusters, grids, on-demand centers, etc. These principles can reduce both direct and indirect power consumption while maintaining either full cluster performance or adequate SLA based cluster performance. The method includes receiving at least one state data point regarding power consumption or temperature of at least one resource within the compute environment. Using intelligent policies to control power consumption, the method implements and interfaces with power managements facilities within the cluster, grid or on-demand center to implement policies, make dynamic changes, make predictions or actions, etc., to reduce the direct or indirect power consumption associated with a compute environment. Methods can include analysis of current workload and/or future workload in taking energy saving actions, and also involve reporting state information and updating algorithms based on historical experience or outside sources of information. | 01-24-2013 |
20130139162 | SYSTEM AND METHOD OF PROVIDING SYSTEM JOBS WITHIN A COMPUTE ENVIRONMENT - The invention relates to systems, methods and computer-readable media for using system jobs for performing actions outside the constraints of batch compute jobs submitted to a compute environment such as a cluster or a grid. The method for modifying a compute environment from a system job comprises associating a system job to a queuable object, triggering the system job based on an event and performing arbitrary actions on resources outside of compute nodes in the compute environment. The queuable objects include objects such as batch compute jobs or job reservations. The events that trigger the system job may be time driven, such as ten minutes prior to completion of the batch compute job, or dependent on other actions associated with other system jobs. The system jobs may be utilized also to perform rolling maintenance on a node by node basis. | 05-30-2013 |
20130298134 | System and Method for a Self-Optimizing Reservation in Time of Compute Resources - A system and method of dynamically controlling a reservation of resources within a cluster environment to maximize a response time are disclosed. The method embodiment of the invention comprises receiving from a requestor a request for a reservation of resources in the cluster environment, reserving a first group of resources, evaluating resources within the cluster environment to determine if the response time can be improved and if the response time can be improved, then canceling the reservation for the first group of resources and reserving a second group of resources to process the request at the improved response time. | 11-07-2013 |
20140075222 | System and Method for Managing Energy Consumption in a Compute Environment - Disclosed are systems and methods of performing a power cap processing in a compute environment. The method includes determining of one of committed resources and dedicated resources in a compute environment exceed a threshold value for a job. If a determination is yes that the threshold value is exceeded, then the method includes preempting processing of the job in the compute environment by performing one of migrating the job to a new compute resources and performing a power reduction action associated with the job, such as slowing down a processor associated with a job or cancelling the job. When such a power state reduction action is taken, reservations associated with other jobs may also be adjusted. | 03-13-2014 |
20140101666 | SYSTEM AND METHOD OF PERFORMING A PRE-RESERVATION ANALYSIS TO YIELD AN IMPROVED FIT OF WORKLOAD WITH THE COMPUTE ENVIRONMENT - A system and method are disclosed for receiving a request for resources in a compute environment to process workload, the request including a specification of a quality of fit. The system generates a substantial maximum potential quality of fit based on compute environment with an assumption of no competing workload to yield an analysis. The system evaluates a first resource allocation and a second resource allocation against the analysis to yield the first fit in a respective second fit. The system selects one of the first resource allocation and the second resource allocation based on a comparison of the first fit to the second fit as well as a cost associated with any delays. | 04-10-2014 |
20140129721 | RESERVING RESOURCES IN AN ON-DEMAND COMPUTE ENVIRONMENT - Disclosed is an on-demand system and method for managing resources in an on-demand compute environment from a local compute environment. The method includes receiving information at a local resource broker that is associated with resources within an on-demand compute environment, based on the information, communicating instructions from the local resource broker to the on-demand compute environment and modifying resources associated with the on-demand compute environment based on the instructions. | 05-08-2014 |
20140298349 | System and Method for Managing Energy Consumption in a Compute Environment - Disclosed are systems and methods of performing a power cap processing in a compute environment. The method includes determining of one of committed resources and dedicated resources in a compute environment exceed a threshold value for a job. If a determination is yes that the threshold value is exceeded, then the method includes preempting processing of the job in the compute environment by performing one of migrating the job to a new compute resources and performing a power reduction action associated with the job, such as slowing down a processor associated with a job or cancelling the job. When such a power state reduction action is taken, reservations associated with other jobs may also be adjusted. | 10-02-2014 |
20140351824 | System and Method of Interfacing a Workload Manager and Scheduler with an Identity Manager - A system, method and computer-readable media for managing a compute environment are disclosed. The method includes importing identity information from an identity manager into a module performs workload management and scheduling for a compute environment and, unless a conflict exists, modifying the behavior of the workload management and scheduling module to incorporate the imported identity information such that access to and use of the compute environment occurs according to the imported identity information. The compute environment may be a cluster or a grid wherein multiple compute environments communicate with multiple identity managers. | 11-27-2014 |