Columbia Technology Ventures

CALIFORMS - Efficient memory access with improved cache structure

This technology is an improved cache line data structure that enables fast metadata processing with low storage costs.

Unmet Need: Faster, more memory-efficient data retrieval structures

A cache is used by the CPU of a computer for efficient data retrieval from the main memory. Current cache systems are partitioned into ‘lines’ that contain ‘tags’ indicating the address in the main system, and data is located by comparing the requested tag to the cache tag. However, tag comparison is slow, and tag storage overhead is high. Additionally, cache hit rate and latency are often maintained by adding an additional cache for metadata processing, further increasing storage and performance overhead.

The Technology: Improved cache structure for fast metadata processing with low storage costs

This technology is an in-place, compact cache line data structure and associated algorithms for fast metadata processing, as well as object and sub-object bounds checking. This approach minimizes metadata storage and compute costs and offers a 64x reduction in overhead (1 bit per 64 byte cache line) by storing pointers within the cache line that allow accessing metadata inline rather than in a separate cache. This technology is easy to integrate with existing memory security architectures and has the potential to reduce system performance latency and storage overhead costs, ultimately improving system efficiency.

Applications:

  • CPU cache design
  • Data retrieval and memory access
  • Object and sub-object bounds checking
  • Operating System design

Advantages:

  • Efficient memory access
  • Improved system efficiency
  • Minimizes metadata storage and compute costs
  • 64x reduction in overhead storage
  • Allows inline storage of metadata
  • Improved performance latency
  • Easy integration with existing memory security architectures

Lead Inventor:

Simha Sethumadhavan. Ph.D.

Patent Information:

Patent Pending

Related Publications:

Tech Ventures Reference: