Home
Turium Algoreus
Turium Algoreus
  • Turium Algoreus Documentation
    • Turium Algoreus Overview
      • How to Guides
        • Axons (Pipeline) User Guide
          • Algoreus Genesis
          • Algoreus Node
          • Steps for a simple batch Axon in Algoreus
          • Configuring Axon in Algoreus
          • Deploying an Axon in Algoreus
          • Running an Axon in Algoreus
          • Viewing and downloading logs in the Genesis in Algoreus
          • Scheduling an Axon in Algoreus
          • Reusable Axons in Algoreus
          • Using Triggers in Algoreus
          • Working with multiple versions of the same node in Algoreus
          • Modifying a draft Axon in Algoreus
          • Editing a deployed Axon in Algoreus
          • Duplicating An Axon in Algoreus
          • Deleting an Axon in Algoreus
          • Deploying nodes from the Algoreus Hub
          • Using node templates in Algoreus
          • Exporting and importing Axons in Algoreus
          • Dynamic resource configuration in Algoreus
          • Working with namespaces in Algoreus
        • Soma (Transformation) User Guide
          • Algoreus Soma Overview
          • Algoreus Soma Concepts
          • Algoreus Soma UI components
          • Working with multiple datasets
          • Navigating between Soma and Algoreus Genesis
          • Editing a transformation created in the Soma
          • Soma data types
          • Working with connections in Soma
          • Parsing a CSV file
          • Strings Formatting
          • Sending records to error
          • Working with numbers in Soma
          • Working with Decimal types in Soma
          • Performing date transformations in Soma
          • Filtering records
          • Finding and replacing values in a column
          • Filling null or empty cells
          • Copying, deleting, and keeping columns
          • Renaming a column
          • Joining two columns
          • Swapping two column names
          • Extracting fields to retrieve values
          • Exploding fields
          • Masking data
          • Encoding records to store or transfer data
          • Decoding records to store or transfer data
          • Applying a Hashing algorithm to a column
          • Upgrading the Soma transformation node version
          • Viewing and downloading a schema in Soma
          • Viewing Soma Service logs
        • Cerebellum (Operations and Monitoring) User Guide
          • Logging and Monitoring
          • Metrics
          • Dashboard and Reports
          • Preferences and Runtime Arguments
          • Transaction Service Maintenance
        • Engram (Metadata) User Guide
          • System Metadata
          • Discovery and Lineage
          • Audit Logging
          • Metadata Management
          • Accessing Metadata Programmatically
          • Metadata Field-Level Lineage
        • Clone (Replication) User Guide
          • Cloning overview
          • Clone Concepts
          • Adding Transformations to a Cloning Job
          • Deleting a Cloning Job
          • Tutorial: Cloning data from Oracle Database to BigQuery
        • Algology (Visualisation) User Guide
          • Dashboards
            • Using Dashboards
            • Building Dashboards
            • Manage dashboards
            • Publishing Dashboard
            • Playlist
            • Create and manage reports
            • Share dashboards and panels
            • Access Dashboard Usage
            • Search Dashboards
          • Panel Editor
            • Configure Panel Options
            • Configure standard options
          • Visualisations
            • Alert List
            • Bar Chart
            • Bar Gauge
            • Candlestick Panel
            • Canvas
            • Dashboard List
            • Flame Graph
            • Gauge
            • Heatmap
            • Histogram
            • Logs
            • Node Graph
            • Traces Panel
            • Pie Chart
            • State Timeline
            • Stat Panel
            • Time series
            • Trend Panel
            • Text Panel
            • Table
            • GeoMap
            • Datagrid Panel
            • Status history
            • Annotations
          • Explore
            • Logs in Explore
            • Queries in Explore
            • Tracing in Explore
            • Inspector in Explore
    • Turium Algoreus Connectors
Powered by GitBook
On this page
  • Harvest, Index, Track, and Analyze Datasets
  • Search

Was this helpful?

  1. Turium Algoreus Documentation
  2. Turium Algoreus Overview
  3. How to Guides
  4. Engram (Metadata) User Guide

Metadata Management

PreviousAudit LoggingNextAccessing Metadata Programmatically

Last updated 1 year ago

Was this helpful?

The Algoreus Engram presents a clear picture of data flow in and out of datasets.

It allows for thorough impact and root-cause analysis, providing a traceable audit trail for compliance and auditability. Metadata management inside Engram grants access to structured data, describing, locating, and explaining data, which simplifies the retrieval, usage, and management of datasets.

Engram Metadata management also permits users to modify the metadata for datasets. Users can directly add, remove, and update tags and business properties in the UI. It enables users to establish a favored dictionary of tags to ensure team-wide uniformity when updating metadata.

Metadata management inside Engram exhibits a graphical representation of an entity's lineage. This lineage shows all data access of an entity for a specified time range, detailing the origin of that access.


Harvest, Index, Track, and Analyze Datasets

  • Prompt, current, and smooth capture of technical, operational, and business metadata, facilitating improved traceability of all datasets.

  • Through its lineage use, it enables the understanding of the impact of dataset changes on other datasets, processes, or queries.

  • Tracks data flow across enterprise systems and data lakes.

  • Provides viewing and updating of complete metadata on datasets, enabling traceability to resolve data issues and improve data quality.

  • Supports Standardization, Governance, and Compliance Needs

  • Provides IT with the traceability required in governing datasets and implementing compliance rules through seamless integration with other extensions.

  • Metadata management contains consistent definitions of metadata, reconciling differences in terminologies.

  • Assists in understanding the lineage of your crucial business data.

  • Blends Metadata Analytics and Integrations

  • Visualize how your datasets are created, accessed, and processed.


Search

Search functionality in Engram metadata management is provided by an interface similar to popular search engines:

In the text box, you enter your search terms:

Multiple search terms can be searched by separating them with a space character.

Search terms are case-insensitive.

Search the metadata of entities by using either a complete or partial name followed by an asterisk *

Engram Metadata management searches tags, properties, and schema of Algoreus datasets.

For example, if you have just started Algoreus and enabled metadata management, you could enter a search term such as a* k*, which will find all entities that begin with the letter a or k.

Entity Details

Clicking on a name in the search results list will take you to details for a particular entity. Details are provided on the Engram Metadata and Lineage tabs.

Metadata

The Engram tab provides lists of the System Tags, Business Tags, Schema, Business Properties, and System Properties found for the entity. The values shown will vary depending on the type of entity and each individual entity.

You can add business tags to any entity by clicking the plus button in the UI. You can also remove tags by hovering over the tag and clicking the x. You can add and remove Business Properties for the dataset as well, a useful feature for storing additional dataset details for others to see.

Lineage

The Engram tab displays the relationship between an entity and the programs interacting with it. As different lineage diagrams can be created for the same entity, depending on the specific set of programs selected to construct the diagram, a blue arrow-shaped button is used to cycle through the different lineage diagrams that a particular entity participates in.

A date menu on the left side of the diagram allows you to control the time range that the diagram displays. By default, the last seven days are used, though a custom range can be specified, in addition to common time ranges (two weeks to one year).


Harvest, Index, Track, and Analyze Datasets
Search
Entity Details
Metadata
Lineage