Data.Horizon

What is Data.Horizon?

Data.Horizon is an application that implements simple HWM Store. Right now it includes:

• REST API
• Python client

Goals

• Allow users to save and fetch High Water Mark (HWM) items. These are name+type+value triples with few optional fields.
• Avoid confusion between different user's data by separating HWMs to different namespaces. Each HWM is bound to namespace.
• Allow users to get HWM change history, to determine who and when changed a specific HWM value and other fields.
• Provide RBAC model to ensure that interaction with HWMs and Namespaces are governed by role assigned to each user. Roles are assigned per namespace.

Non-goals

• This is not a data storage, it is not designed to store raw table rows. It is designed to store only HWM values.
• Attaching machine-readable metadata for HWMs (like process, origin) is not supported. This should be stored somewhere else.

Documentation

See https://data-horizon.readthedocs.io/