Knowledge graphs earn complexity when relationships carry operational meaning
I think knowledge graphs earn their complexity only when relationships carry operational meaning. “Our data is connected” is not enough. Tables join, documents link, and vector indexes return neighbors. A graph becomes the right model when the type, direction, provenance, or path of a relationship changes what the system is allowed to infer, retrieve, explain, or do.
This test separates a knowledge graph from a diagram with storage costs. In a property graph, nodes and edges can carry attributes and support efficient multi-hop traversal. In RDF, subject–predicate–object triples use global identifiers, named graphs can preserve provenance, and OWL axioms can express constraints or support inference. Those capabilities matter when “reports to,” “depends on,” “approved by,” “supersedes,” or “contraindicated with” are not decorative labels. They become inputs to a decision.
Operational meaning appears first in traversal. If an agent must find every service affected by a vulnerable dependency, every policy inherited through an organizational hierarchy, or every claim supported by a source chain, the path is part of the answer. Flattening it into text loses direction and intermediate evidence. A vector can say two passages are similar; it cannot by itself establish that one artifact approved another, that the approval was valid at the relevant time, or that a path crosses a forbidden boundary. This is why vector search remains an indexing decision, not a substitute for modeled relationships.
The second signal is inference. Ontologies distinguish classes, object properties, data properties, domains, ranges, and property characteristics such as transitivity or symmetry. That machinery is expensive, but it can make rules reusable across data rather than hidden in every application. The open-world assumption also forces a useful distinction: absent may mean unknown rather than false. In compliance, medicine, and enterprise knowledge, that difference can determine whether the system proceeds or escalates.
The third signal is provenance. Knowledge-graph construction is not just extracting nouns and verbs. It requires entity recognition, linking, disambiguation, relation extraction, coreference resolution, validation, and ongoing freshness. Each assertion should retain its source and confidence, preferably in a named graph or equivalent provenance model. Otherwise a graph amplifies extraction mistakes by making them traversable. AI-ready data still needs identity, semantics, ownership, and lineage; graph storage does not waive that work.
This changes how I think about GraphRAG. Community detection and hierarchical summaries can help answer corpus-wide questions; local entity neighborhoods can focus retrieval; path-constrained retrieval can expose why evidence was selected. But the graph earns that pipeline only if its communities, paths, and relations correspond to decisions users care about. If the only requirement is finding passages similar to a question, a disciplined RAG pipeline with hybrid retrieval is usually simpler and easier to operate.
The graph should also meet the semantic layer rather than compete with it. Metrics and governed business entities answer quantitative questions; a graph can express richer relationships among those entities, policies, documents, and events. The useful architecture is often layered: canonical identifiers and contracts underneath, governed semantics above them, graph traversal where relationships carry consequence, and language models translating human questions into bounded queries.
There is one precise concession: exploratory graph construction can be valuable before operational meaning is fully known. Visualizing a domain, discovering communities, or testing an ontology may reveal relationships worth governing. The boundary is production commitment — exploration can tolerate provisional edges, while an agent making decisions from the graph needs typed semantics, validation, provenance, freshness, and an owner for every consequential relation.
I would therefore ask one question before approving a knowledge graph: what decision changes because this path exists? If the answer names authorization, impact, provenance, causality, dependency, or a defensible inference, the graph may earn its cost. If the answer is merely “better context,” I would start with modeled data and a good index. Relationships become architecture when they constrain action.