Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Record Fields #22

Merged
merged 2 commits into from
Feb 7, 2025
Merged

Record Fields #22

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
90f3578
Record Fields
claytongentry Feb 7, 2025
e3af1cc
0.0.13
claytongentry Feb 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 26 additions & 7 deletions lib/manifold/services/vector_service.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,16 +32,35 @@ def load_vector_config(vector_name)
private

def transform_attributes_to_schema(attributes)
attributes.map do |name, type_str|
type, mode = parse_type_and_mode(type_str)
{
"name" => name,
"type" => type.upcase,
"mode" => mode
}
attributes.map { |name, type_def| transform_field(name, type_def) }
end

def transform_field(name, type_def)
if type_def.is_a?(Hash)
transform_record_field(name, type_def)
else
transform_scalar_field(name, type_def)
end
end

def transform_record_field(name, type_def)
{
"name" => name,
"type" => "RECORD",
"mode" => "NULLABLE",
"fields" => transform_attributes_to_schema(type_def)
}
end

def transform_scalar_field(name, type_def)
type, mode = parse_type_and_mode(type_def)
{
"name" => name,
"type" => type.upcase,
"mode" => mode
}
end

def parse_type_and_mode(type_str)
type, mode = type_str.split(":")
mode = mode&.upcase || "NULLABLE"
Expand Down
3 changes: 3 additions & 0 deletions lib/manifold/templates/vector_template.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,9 @@ attributes:
# created_at: TIMESTAMP
# status: STRING
# names: STRING:REPEATED
# key_values:
# first_key: STRING
# second_key: STRING:REQUIRED

# Optionally, reference a view specifying how to select vector dimensions
# merge:
Expand Down
2 changes: 1 addition & 1 deletion lib/manifold/version.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# frozen_string_literal: true

module Manifold
VERSION = "0.0.12"
VERSION = "0.0.13"
end
43 changes: 41 additions & 2 deletions spec/manifold/services/vector_service_spec.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,19 @@
"url" => "string",
"created_at" => "timestamp",
"tags" => "string:repeated",
"email" => "string:required"
"email" => "string:required",
"metadata" => {
"source" => "string",
"last_modified" => "timestamp",
"settings" => {
"enabled" => "boolean",
"flags" => "string:repeated"
}
},
"key_values" => {
"first_key" => "string",
"second_key" => "string:required"
}
}
}
end
Expand All @@ -29,7 +41,34 @@
{ "name" => "url", "type" => "STRING", "mode" => "NULLABLE" },
{ "name" => "created_at", "type" => "TIMESTAMP", "mode" => "NULLABLE" },
{ "name" => "tags", "type" => "STRING", "mode" => "REPEATED" },
{ "name" => "email", "type" => "STRING", "mode" => "REQUIRED" }
{ "name" => "email", "type" => "STRING", "mode" => "REQUIRED" },
{
"name" => "metadata",
"type" => "RECORD",
"mode" => "NULLABLE",
"fields" => [
{ "name" => "source", "type" => "STRING", "mode" => "NULLABLE" },
{ "name" => "last_modified", "type" => "TIMESTAMP", "mode" => "NULLABLE" },
{
"name" => "settings",
"type" => "RECORD",
"mode" => "NULLABLE",
"fields" => [
{ "name" => "enabled", "type" => "BOOLEAN", "mode" => "NULLABLE" },
{ "name" => "flags", "type" => "STRING", "mode" => "REPEATED" }
]
}
]
},
{
"name" => "key_values",
"type" => "RECORD",
"mode" => "NULLABLE",
"fields" => [
{ "name" => "first_key", "type" => "STRING", "mode" => "NULLABLE" },
{ "name" => "second_key", "type" => "STRING", "mode" => "REQUIRED" }
]
}
]
}
end
Expand Down