Skip to content

database connectors

Database integrations — relational, document, key-value, graph, time-series, and analytics. All 22 connectors are wired to real Go drivers (mongo-driver/v2, go-redis/v9, clickhouse-go, influxdb-client-go, pgx/v5, arangodb/go-driver, go-kivik/v4, go-elasticsearch/v8, colinmarc/hdfs/v2, go-sql-driver/mysql, gocql, gocb/v2, neo4j-go-driver/v5, snowflakedb/gosnowflake, marcboeker/go-duckdb) for native protocol throughput — no more hand-rolled HTTP stubs. For high-volume OLTP traffic you'll usually want the dedicated postgres:// / mongodb:// / redis:// components instead.

Connectors in this category

Connector URI / type Auth Native SDK One-line description
arangodb connector://arango/send Basic auth Yes (arangodb/go-driver/v2) ArangoDB multi-model — version, AQL query, document CRUD.
cassandra connector://cass/send Plain / password authenticator No (HTTP) Apache Cassandra CQL query execution via REST proxy.
clickhouse connector://ch/send Basic Yes (ClickHouse/clickhouse-go/v2) ClickHouse OLAP query + insert over native TCP.
cockroachdb connector://crdb/send DSN Yes (jackc/pgx/v5) CockroachDB SQL — PostgreSQL-wire compatible via pgxpool.
couchbase connector://cb/send Basic / RBAC No (HTTP) Couchbase REST + N1QL query.
couchdb connector://couch/send URL with embedded auth Yes (go-kivik/kivik/v4) CouchDB document CRUD + Mango find + AllDocs.
duckdb connector://duck/send None (file / in-memory) No (HTTP) DuckDB embedded analytics over REST adapter.
elasticsearch_db connector://es-db/send Basic / API key Yes (elastic/go-elasticsearch/v8) Elasticsearch index / get / delete / search / bulk.
hdfs connector://hdfs/send Hadoop UGI user Yes (colinmarc/hdfs/v2) HDFS read / write / mkdir / remove / stat / list-dir.
influxdb connector://influx/send Token Yes (influxdata/influxdb-client-go/v2) InfluxDB 2.x line-protocol write + Flux query.
jdbc connector://jdbc/send JDBC URL (parsed) Yes (database/sql + per-driver via sql.go) JDBC-style URL parser → database/sql query / execute / batch.
mariadb connector://maria/send Password No (HTTP) MariaDB SQL over HTTP shim.
mongodb connector://mongo/send SCRAM / X.509 / IAM Yes (go.mongodb.org/mongo-driver/v2) MongoDB find / insert / update / delete / aggregate + change-stream.
neo4j connector://neo4j/send Basic No (HTTP) Neo4j Cypher query over HTTP.
pgevent connector://pgevent/send Password / IAM Yes (jackc/pgx/v5) PostgreSQL LISTEN / NOTIFY real-time event consumer.
questdb connector://questdb/send DSN (PG) + raw TCP (ILP) Yes (pgx/v5 + ILP TCP) QuestDB SQL query (PG-wire) + bulk InfluxDB Line Protocol ingest.
redis connector://redis/send None / password / ACL Yes (redis/go-redis/v9) Redis GET / SET / DEL / LIST / HASH / pub-sub.
redis_json connector://rj/send None / password / ACL Yes (redis/go-redis/v9) Redis JSON module document operations.
snowflake connector://sf/send OAuth2 / key-pair No (HTTP) Snowflake SQL via REST API.
sql connector://sql/send DB-specific No (HTTP) Generic SQL connector (passes statements through a REST shim).
sql_stored connector://sql-stored/send DSN Yes (database/sql — mysql/pgx/sqlserver/oracle) Stored-procedure call with driver-aware syntax + list-procedures.
timescaledb connector://tsdb/send DSN Yes (jackc/pgx/v5 — Tiger Data's recommended driver) TimescaleDB — query/insert + hypertable, retention, compression, continuous-aggregate ops.
vitess connector://vitess/send MySQL DSN Yes (go-sql-driver/mysql) Vitess vtgate SQL via MySQL-wire (query + execute).

Native-SDK deep section

mongodb

Source: pkg/connector/connectors/database/mongodb.go. Uses go.mongodb.org/mongo-driver/v2. Supports find / findOne / insertOne / insertMany / updateOne / updateMany / deleteOne / deleteMany / aggregate, plus change-stream subscribe.

connectors:
  users-db:
    type: mongodb
    config:
      uri: mongodb://user:pass@host:27017/mydb?retryWrites=true
      database: mydb
      collection: users

Set exchange header operation=find (or any of the operations above), and body is the query / update document.

redis and redis_json

Both share the go-redis/v9 UniversalClient — standalone / cluster / sentinel — for connection pooling. redis_json adds JSON.SET, JSON.GET, JSON.ARRAPPEND via the RedisJSON module commands.

clickhouse

Source: pkg/connector/connectors/database/clickhouse.go. Uses ClickHouse/clickhouse-go/v2 native-TCP protocol. Query batching and async inserts supported.

influxdb

Source: pkg/connector/connectors/database/influxdb.go. Uses influxdata/influxdb-client-go/v2. Writes use line-protocol; queries use Flux.

pgevent

Source: pkg/connector/connectors/database/pgevent.go. Uses jackc/pgx/v5 pgxpool with PostgreSQL LISTEN <channel> for real-time event-driven consume. Combine with database triggers calling NOTIFY for change-data-capture without Debezium.

See also

  • Connector SDK guide — adding a new connector
  • postgres://, mongodb://, redis://, elasticsearch:// components — for high-volume use
  • cdc — Debezium-based CDC for the same databases