feat(connectors): add 9 knowledge base connectors

[waleedlatif1]

What

Adds 9 knowledge base connectors, closing the highest-frequency gaps in our catalog. Every service already shipped a block, so OAuth providers, credentials, and icons were reused — no new auth plumbing.

Connector	Auth	Syncs
Box	OAuth box	Files, recursive from a folder or the whole account
Zoho Desk	OAuth zoho-desk	Help Center articles + tickets with conversations
PagerDuty	API key	Incidents, notes, timeline log entries
Trello	OAuth trello	Cards with descriptions, checklists, comments, attachments
Microsoft Excel	OAuth microsoft-excel	Worksheet data
Google Slides	OAuth google-drive	Slide text + speaker notes
Google Vault	OAuth google-vault	Matters, holds, saved queries
Mintlify	API key (optional)	Documentation pages via llms.txt
SFTP	API key	Remote file trees

Selected by surveying the published connector catalogs of Glean, Onyx, Dust, Vectara, Writer, Guru, Elastic, Microsoft 365 Copilot, Notion AI, Unstructured, and Airbyte, then intersecting the gaps with services that already have a Sim block. Box was the single biggest gap — 7-8 of ~10 catalogs, and the default content store in financial services, life sciences, and government.

Validation

Every connector was validated against live provider documentation twice, independently. The second pass was told to treat the first pass's conclusions as unproven — which mattered, because it found defects in the first pass's own fixes.

Data-loss class

The sync engine hard-deletes documents past a cap not flagged with listingCapped. Paths found and fixed across both passes:

• Mintlify — three independent listing-collapse paths. An empty discovery (both llms.txt and sitemap.xml 404, or an HTTP-200 HTML interstitial, which docs.cursor.com really serves) reconciled the whole KB away. A sitemap-index child that 404s was silently skipped despite a comment claiming failure was fatal. The origin-level index returned early with 13 of 306 pages for a sub-path site.
• Trello — cards in archived lists vanished from an unflagged listing; listingCapped latched permanently on any list of 1000+ cards; then the fix for that stopped flagging multi-page lists while resting on an ordering guarantee Trello does not document.
• Zoho Desk — the flag never fired at the default caps (500/50 and 500/100 are exact multiples); then the fix's probe walked into Zoho's hard from <= 4999 ceiling and 422'd the whole listing at the documented 5000 maximum.
• PagerDuty — more: true with zero incidents ended the listing unflagged.
• SFTP — depth-limit pruning set the flag on every sync of a deep tree, permanently suppressing legitimate deletions.

Because five of ten audited connectors had some path here, the engine also gained a backstop: an empty or collapsed listing now blocks deletion reconciliation until the same observation repeats on a consecutive sync. No migration — the previous run is reconstructed from existing sync-log counters. Corroboration is only trusted from a run that could not have been incremental, otherwise a bad listing confirms itself.

Correctness

• Zoho Desk — desk.zoho.ca does not resolve. Canada is desk.zohocloud.ca. All 11 data centers were then re-verified by DNS and an authenticated probe returning 401 UNAUTHORIZED, which proves the host serves the Desk v1 API. Singapore and UAE were missing entirely.
• Zoho Desk — modifiedTime is absent from GET /tickets, so the stub and hydrated hashes never matched and every ticket re-embedded on every sync, forever.
• Trello — Atlassian documents that some edits bump dateLastActivity without creating an action, and never published which. The hash now folds in badges counters, which arrive with the listing at no extra cost.
• Microsoft Excel — dates and currency indexed as raw serial numbers (42019, not 1/15/2015), unlike Google Sheets. Graph documents that Range.text is independent of cell width, so the ####### objection does not apply. A content-format token forces one re-index, since the metadata-only hash would otherwise keep stale content.
• PagerDuty — the 10,000-record ceiling bounds offset + limit, so the guard admitted a request that 400s after any short page. The incremental window was also only half pinned.
• Google Vault — one call per matter per kind truncated at ~249 matters, silently never indexed on any run. Now ~3,500.
• SFTP — the incremental cutoff compared against the remote clock, permanently skipping same-second writes.
• Box — extracted_text gave up before polling when a representation was not yet generated.
• Mintlify — a site whose .md route 404s hydrated every page to nothing while validateConfig passed. The HTML fallback then indexed <script> contents: 294KB of RSC payload per page, 98% noise.

Security

• SFTP — getDocument used stat, which follows symlinks. Filenames from readdir were composed into paths unchecked. Host-key verification was absent entirely; an optional fingerprint now verifies during key exchange, before any password is sent. It is opt-in and blank by default, so an unconfigured source retains the original MITM exposure — IP pinning does not mitigate this, since the pin derives from the same DNS answer an attacker would poison.
• Trello — user-supplied board ids were interpolated into URL paths raw.
• Google Vault — narrowed from read-write ediscovery (which grants delete on matters and holds) to ediscovery.readonly.
• Dataverse tools — getDataverseBaseUrl accepted any host while every request attaches a bearer token. Pinned to Microsoft's Dataverse domains. This is pre-existing shipped code, fixed here.

Removed: Microsoft Dataverse

Built, then cut. Its OAuth cannot complete consent, and never could. Dataverse requires a per-environment resource (<environment-url>/user_impersonation); the provider declares a static https://dynamics.microsoft.com/user_impersonation, which is not an Entra Application ID URI. The scope is fixed at Better Auth config time with no per-connection override, and the environment URL is only collected after the credential exists — so nothing can supply it at authorize time. Entra rejects at /authorize with AADSTS500011.

This predates the PR and affects the 12 shipped tools/microsoft_dataverse/* tools. Added in a bulk tool-authoring PR (#3257) with zero tests; the later "align with live API docs" PR (#5481) touched no OAuth file. A real fix needs a contract, route, and UI change plus an Entra app-registration permission, so it belongs in its own change. One-minute confirmation: open the authorize URL in a browser signed into any work tenant.

Also cut earlier: Google Groups (no public API returns conversations — the Migration API is insert-only) and Workday (native file APIs need OAuth we haven't wired; only custom-report rows were reachable).

Claims corrected during validation

Stated in an earlier revision of this description and since disproven:

• PagerDuty does have a postmortem API — GET /status_pages/{id}/posts/{post_id}/postmortem. But StatusPagePost.linked_resource.type is an untyped string with no documented incident join, so it belongs in a separate status-pages connector, not the incident walk.
• .well-known/llms.txt is not a real Mintlify location — 404s on every site checked.
• The Google Vault cursor bug was unreachable — the engine reads sourceConfig once before the pagination loop, so enabled kinds cannot change mid-sync. The defensive branch is gone.
• Trello's before pagination is not a reliable completeness guarantee, only a usable dedup bound.

Known gaps

• SFTP host verification is opt-in. Consider requiring it, or TOFU-pinning the first-seen key.
• PagerDuty created_at:asc plus the 10k ceiling leaves a permanent hole on large accounts. asc is correct for offset-pagination integrity, so the fix is time-window chunking, not flipping to desc.
• Excel indexes hidden sheets, and issues one request for up to 200,000 cells against Microsoft's explicit large-range guidance.
• Box [markdown] representation would preserve table structure that flat extracted_text destroys.
• Mintlify cannot configure a docs site that redirects cross-host (docs.anthropic.com → platform.claude.com); needs url on SecureFetchResponse.
• Google Slides / Docs — a fetch failure on an add is invisible in sync counters. Shared with google-docs; belongs in a follow-up covering both.
• No connector has tests.

Still missing from the catalog

A generic web crawler (6/10 catalogs, backstops every source not in the catalog), Bitbucket, Guru, Coda, and a database/warehouse source. None have blocks today.

Testing

• bun run type-check clean
• biome check clean across 229 files
• bun run check:api-validation passes
• 245 tests pass, including 13 new sync-engine guard tests verified to fail when the guard is reverted

Not exercised against live tenants. Validation was documentation-based, with live DNS and HTTP probes where a host or response shape could be checked without credentials.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated (UTC)
docs	Skipped		Aug 14, 2026 8:36pm

[cursor]

PR Summary

High Risk
Large expansion of external sync surface (user-supplied hosts, SFTP credentials, and doc-site crawling) with complex listing-cap logic; mis-flagging listingCapped or discovery failures could still affect KB document reconciliation despite guards.

Overview
Adds nine new knowledge base connectors (Box, Google Slides, Google Vault, Microsoft Excel, Mintlify, PagerDuty, SFTP, Trello, plus registry entries for Zoho Desk) and registers them in both client and server connector registries. Docs now list 61 built-in connectors and document new API-key sources (PagerDuty, SFTP, optional Mintlify).

Each connector implements listing, deferred content fetch, config validation, and tag mapping with provider-specific pagination, caps, and listingCapped signaling so partial listings do not trigger wrongful deletions. Mintlify discovers pages via llms.txt / sitemap with SSRF-safe fetching; SFTP walks remote trees with depth/file limits, optional SHA-256 host key pinning, symlink-safe reads, and session timeouts.

UI: the add-connector modal allows optional API keys when connector meta sets auth.optional (e.g. public Mintlify sites).

Security fixes: Microsoft Dataverse file upload outbound calls use stripAuthOnRedirect so OAuth tokens are not sent to signed storage redirects; SFTP connection helper adds fingerprint verification, idle timeout handling, and clearer host-key errors.

^{Reviewed by Cursor Bugbot for commit eb1e556. Configure here.}

[greptile-apps]

Greptile Summary

The PR adds nine knowledge-base connectors and strengthens connector synchronization safeguards, while also hardening the existing Microsoft Dataverse tools against credential disclosure.

• Registers Box, Zoho Desk, PagerDuty, Trello, Microsoft Excel, Google Slides, Google Vault, Mintlify, and SFTP connectors.
• Adds safer listing reconciliation and connector-specific pagination, hydration, and content-processing behavior.
• Restricts Dataverse environment hosts and strips bearer authorization across redirects, including the upload route’s outbound request.

Confidence Score: 5/5

The PR appears safe to merge because no blocking failure remains from the previous review threads.

The arbitrary-host and redirect-based Dataverse bearer-token disclosures are addressed in current HEAD, including the upload route’s separate outbound fetch.

Important Files Changed

Filename	Overview
apps/sim/tools/microsoft_dataverse/utils.ts	Normalizes environment URLs and restricts bearer-authenticated Dataverse requests to HTTPS origins under Microsoft’s supported Dataverse domains.
apps/sim/app/api/tools/microsoft-dataverse/upload-file/route.ts	Prevents the outbound upload PATCH from forwarding its OAuth bearer token to signed-storage redirect targets.
apps/sim/tools/microsoft_dataverse/upload_file.ts	Keeps the user-entered environment URL user-only and delegates the external upload to the independently hardened internal route.
apps/sim/lib/knowledge/connectors/sync-engine.ts	Adds reconciliation safeguards for suspiciously empty or collapsed connector listings.
apps/sim/connectors/registry.server.ts	Registers the new connector runtimes for server-side synchronization.

Sequence Diagram

sequenceDiagram
  participant Tool as Dataverse Tool
  participant Route as Internal Upload Route
  participant DV as Dataverse API
  participant Storage as Signed Storage Host
  Tool->>Route: Same-origin upload request
  Route->>DV: PATCH file with OAuth bearer token
  DV-->>Route: Redirect to signed storage URL
  Route->>Storage: PATCH file body without Authorization
  Storage-->>Route: Upload response
  Route-->>Tool: Upload result

Loading

_{Reviews (6): Last reviewed commit: "fix(dataverse): strip the bearer token o..." | Re-trigger Greptile}

[waleedlatif1]

@greptile

[waleedlatif1]

@cursor review

[waleedlatif1]

@greptile

[waleedlatif1]

@cursor review

[waleedlatif1]

@greptile

[waleedlatif1]

@cursor review

[waleedlatif1]

@greptile

[waleedlatif1]

@cursor review

[cursor]

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit 74cda71. Configure here.}

[waleedlatif1]

@greptile

[waleedlatif1]

@cursor review

[cursor]

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit eb1e556. Configure here.}