Test Environments

Prove your data agent returns the right answer.

Pre-built synthetic environments for Salesforce, Jira, Stripe, and 35+ more. We generate the dataset, 200 adversarial queries, and the correct answer to every one.

Talk to Us

From your schema to a scored agent.

Describe your structure, we generate the environment and the ground truth, your agent gets graded on what is actually correct.

Step 1
Describe your schema
Connect a staging database or just describe your structure. Your real data never leaves your systems, only the shape of it.
companiesid · name · tier · arr
contactsid · company_id · role
dealsid · company_id · stage · amount
activitiesid · deal_id · type · date
Step 2
We generate the test environment
A synthetic dataset that matches your structure, adversarial questions across 7 categories, and the correct answer for every one. Because we generate the data, we know the truth.
Synthetic dataset2,000 rows
Adversarial questions200
Ground truthcomputed
CleanAmbiguousMulti-stepScope boundaryContradictoryInvalid assumptionsContext-dependent
Step 3
Your agent gets scored
Answer correctness, conversation quality, and the exact questions your agent got wrong, graded against computed ground truth. This is a real run.
87Overall score
174/200Answer correctness
88Conversation quality
Critical failureQ7 · How many bugs are in the backlog?
Agent said14 open bugs
Correct23 open bugs

The agent filtered by status and missed tickets past their due date with no status update. Fluent, specific, and wrong.

CleanAmbiguousMulti-stepScope boundaryContradictoryInvalid assumptionsContext-dependent

Plus per-question transcripts, failure-type distribution, and conversation-quality scoring in the full report.

Pre-built environments

40 environments, ready to test against.

Each ships with a synthetic dataset, 200 adversarial queries, and computed ground truth.

CRM

5

Ticketing

5

Communication

4

Knowledge

3

DevOps

5

Finance

4

Support

3
ServiceNow
Help Scout

E-commerce

3
Shopify
BigCommerce

HR

3
BambooHR
Lever

Analytics

3
Mixpanel
Amplitude
PostHog

Security

2
Snyk

Need a custom environment?

Describe your schema and we generate the dataset, queries, and ground truth automatically.

Talk to Us

Not affiliated with, endorsed by, or sponsored by any of the companies listed. All trademarks and logos belong to their respective owners. Environments contain synthetic test data only.

D

Datadog Environment

Monitoring platform · 5 tables · 2,500 rows · 200 queries

Schema
monitorsid, name, type, query, message, status, priority, tags, created_at
alertsid, monitor_id, status, triggered_at, resolved_at, value, message
logsid, message, level, service, host, source, tags, timestamp
metricsid, metric_name, host, value, tags, timestamp
slosid, name, type, target_threshold, timeframe, status, error_budget_remaining
Sample queries 5 of 200
Clean"How many monitors are in Alert status?"
Ambiguous"Show me the critical issues"
Multi-step"Which services had the most error logs last month and are those services covered by an SLO?"
Contradictory"Show me all resolved alerts that are still active"
Scope boundary"What is the company's revenue?"
Business rules
  • Resolved alerts must have resolved_at
  • Error logs should be less than 5% of total logs
  • SLO error_budget_remaining must be between 0 and 100
Talk to Us
A

Asana Environment

Project management platform · 4 tables · 2,000 rows · 200 queries

Schema
projectsid, name, notes, color, archived boolean, team_id, owner_id, due_date, created_at
tasksid, name, notes, completed boolean, assignee_id, project_id FK->projects.id, section_id FK->sections.id, due_on, start_on, tags, created_at, completed_at
sectionsid, name, project_id FK->projects.id, created_at
commentsid, text, author_id, task_id FK->tasks.id, type, created_at
Sample queries 5 of 200
Clean lookup"What is the name of the project with ID 1?"
Clean lookup"How many tasks are currently in the database?"
Clean lookup"What color is the Website Redesign project?"
Clean lookup"What is the name of section with ID 1?"
Clean lookup"What is the text of comment with ID 1?"
Business rules
  • Completed tasks must have completed_at.
  • Tasks must belong to valid projects and sections.
Talk to Us
B

Bill.com Environment

Accounts payable platform · 4 tables · 1,998 rows · 200 queries

Schema
vendorsid, name, email, address, account_number, payment_terms, active boolean, created_at
billsid, vendor_id FK->vendors.id, invoice_number, amount, due_date, status IN open/partially_paid/paid/overdue/void, approval_status IN pending/approved/denied, gl_account, created_at, paid_at
paymentsid, bill_id FK->bills.id, vendor_id FK->vendors.id, amount, payment_method, status, sent_at, created_at
approvalsid, bill_id FK->bills.id, approver_id, status, comments, created_at
Sample queries 5 of 200
Clean lookup"How many vendors are currently active?"
Clean lookup"What is the email address for Apex Office Supplies LLC?"
Clean lookup"What is the status of bill ID 1?"
Clean lookup"What is the amount on bill ID 1?"
Clean lookup"When was bill ID 1 paid?"
Business rules
  • Paid bills must have paid_at.
  • Approved bills must have at least one approval with status=approved.
  • Payment amounts should not exceed bill amounts.
Talk to Us
C

ClickUp Environment

Project management platform · 5 tables · 2,000 rows · 200 queries

Schema
spacesid, name, private boolean, status, created_at
listsid, name, space_id FK->spaces.id, folder_id, status, priority, due_date, created_at
tasksid, name, description, status IN to do/in progress/review/complete, priority IN urgent/high/normal/low, assignees, list_id FK->lists.id, due_date, time_estimate, tags, created_at, date_closed
commentsid, comment_text, user_id, task_id FK->tasks.id, created_at
time_entriesid, task_id FK->tasks.id, user_id, duration, start, end, description
Sample queries 5 of 200
Clean lookup"How many spaces are currently active?"
Clean lookup"What is the name of the space with ID 'a1b2c3d4-e5f6-7890-abcd-ef1234567890'?"
Clean lookup"Which lists are marked as active?"
Clean lookup"How many tasks are currently in the 'in progress' status?"
Clean lookup"List all private spaces."
Business rules
  • Complete tasks must have date_closed.
Talk to Us
C

Close CRM Environment

Sales CRM · 4 tables · 1,999 rows · 200 queries

Schema
leadsid, display_name, status_label, url, created_by, date_created, date_updated
contactsid, name, title, lead_id FK->leads.id, emails, phones, created_at
opportunitiesid, lead_id FK->leads.id, contact_id FK->contacts.id, value, status_type IN active/won/lost, confidence 0-100, expected_close_date, note, created_at
activitiesid, type IN call/email/sms/meeting/note, lead_id FK->leads.id, user_id, date_created, direction, status, duration, note
Sample queries 5 of 200
Clean lookup"How many leads are currently in the database?"
Clean lookup"What is the status label of the lead with the URL https://www.acmecorp.com?"
Clean lookup"Who created the lead for Acme Corp?"
Clean lookup"What is James Whitfield's job title?"
Clean lookup"What email address is on file for James Whitfield?"
Business rules
  • Won opportunities should have high confidence.
Talk to Us
C

Confluence Environment

Knowledge base · 4 tables · 1,500 rows · 200 queries

Schema
spacesid, key, name, type, status, created_at
pagesid, title, body text content, space_id FK->spaces.id, parent_id self-reference, creator_id, status, version integer, created_at, updated_at
commentsid, body, page_id FK->pages.id, author_id, created_at
labelsid, name, page_id FK->pages.id
Sample queries 5 of 200
Clean lookup"What is the name of the space with the key 'ENGINEERING'?"
Clean lookup"How many spaces exist in the database?"
Clean lookup"What is the body of comment with id 1?"
Clean lookup"Which page does label id 1 belong to?"
Clean lookup"What is the name of label id 1?"
Business rules
  • Pages must belong to valid spaces.
Talk to Us
D

Discord Environment

Communication platform · 4 tables · 2,000 rows · 200 queries

Schema
guildsid, name, owner_id, member_count, created_at
channelsid, name, type IN text/voice/category/announcement/forum, guild_id FK->guilds.id, category_id, topic, position, created_at
messagesid, content, author_id FK->users.id, channel_id FK->channels.id, timestamp, edited_timestamp, pinned boolean, type
usersid, username, discriminator, bot boolean, avatar, created_at
Sample queries 5 of 200
Clean lookup"What is the name of the guild with id 1?"
Clean lookup"Who owns the guild named 'Gaming Legends'?"
Clean lookup"What is the username of user with id 1?"
Clean lookup"What type is the channel with id 1?"
Clean lookup"What is the name of the channel with id 1?"
Business rules
  • Messages must reference valid channels.
  • Category channels should not contain messages directly.
Talk to Us
F

Freshdesk Environment

Customer support platform · 4 tables · 2,000 rows · 200 queries

Schema
conversationsid, number, subject, status IN active/pending/closed/spam, state, type IN email/chat/phone, mailbox_id FK->mailboxes.id, assignee_id, customer_id FK->customers.id, tags, created_at, closed_at
customersid, first_name, last_name, email, phone, company, job_title, created_at
threadsid, conversation_id FK->conversations.id, type IN customer/agent/note, body, source, created_by, assigned_to, created_at
mailboxesid, name, email, created_at
Sample queries 5 of 200
Clean lookup"What is the email address of the customer with ID 1?"
Clean lookup"What is the name of the mailbox with ID 1?"
Clean lookup"What is the status of conversation number 1?"
Clean lookup"What company does the customer with email james.whitfield@techorbit.com work for?"
Clean lookup"What is the subject of conversation with ID 1?"
Business rules
  • Closed conversations must have closed_at.
  • Each conversation should have at least one thread.
Talk to Us
G

GitHub Environment

Code hosting platform · 5 tables · 1,500 rows · 200 queries

Schema
repositoriesid, name, full_name, description, language, stars_count, forks_count, open_issues_count, private boolean, default_branch, created_at, updated_at
issuesid, number, title, body, state IN open/closed, labels, assignee_id, repo_id FK->repositories.id, author_id, comments_count, created_at, closed_at
pull_requestsid, number, title, body, state IN open/closed/merged, base_branch, head_branch, repo_id FK->repositories.id, author_id, additions, deletions, changed_files, merged boolean, created_at, merged_at
commitsid, sha, message, author_id, repo_id FK->repositories.id, additions, deletions, files_changed, created_at
commentsid, body, author_id, issue_id FK->issues.id, pr_id, created_at
Sample queries 5 of 200
Clean lookup"What is the name of the repository with id 1?"
Clean lookup"How many repositories are in the database?"
Clean lookup"What programming language is used in the react-dashboard repository?"
Clean lookup"Is the repository with id 1 private?"
Clean lookup"What is the SHA of the first commit in the database?"
Business rules
  • Closed issues must have closed_at.
  • Merged PRs must have merged=true.
Talk to Us
G

GitLab Environment

DevOps platform · 4 tables · 1,500 rows · 200 queries

Schema
projectsid, name, path, description, visibility, star_count, forks_count, default_branch, created_at
issuesid, iid, title, description, state, labels, assignee_id, project_id FK->projects.id, weight, created_at, closed_at
merge_requestsid, iid, title, description, state, source_branch, target_branch, project_id FK->projects.id, author_id, merged_by_id, created_at, merged_at
pipelinesid, status IN created/pending/running/success/failed/canceled/skipped, ref, sha, project_id FK->projects.id, source, duration, created_at, finished_at
Sample queries 5 of 200
Clean lookup"What is the name of the project with id 1?"
Clean lookup"What is the default branch of the AuthService project?"
Clean lookup"What is the path of the project named AuthService?"
Clean lookup"What is the state of merge request with id 1?"
Clean lookup"What is the title of merge request iid 1 in project 1?"
Business rules
  • Merged MRs must have merged_at.
Talk to Us
G

Google Drive Environment

File storage platform · 3 tables · 1,500 rows · 200 queries

Schema
filesid, name, mime_type IN document/spreadsheet/presentation/pdf/png/folder, size, parent_folder_id self-reference, owner_email, shared boolean, starred boolean, trashed boolean, created_time, modified_time
permissionsid, file_id FK->files.id, type IN user/group/domain/anyone, role IN owner/organizer/fileOrganizer/writer/commenter/reader, email_address, domain
commentsid, file_id FK->files.id, content, author_email, resolved boolean, created_time
Sample queries 5 of 200
Clean lookup"What is the name of the file with id '1'?"
Clean lookup"Is the file named 'Company Root' shared?"
Clean lookup"What is the mime_type of the file with id '1'?"
Clean lookup"Who is the owner of the file with id '3'?"
Clean lookup"What is the content of comment with id '1'?"
Business rules
  • Every file must have at least one permission with role=owner.
  • Folders should have mime_type=folder.
Talk to Us
G

Greenhouse Environment

Recruiting platform · 5 tables · 2,500 rows · 200 queries

Schema
jobsid, name, status IN open/closed/draft, department_id, office_id, requisition_id, opened_at, closed_at, created_at
candidatesid, first_name, last_name, email, phone, company, title, source, created_at
applicationsid, candidate_id FK->candidates.id, job_id FK->jobs.id, status IN active/rejected/hired, stage, source, rejection_reason, applied_at, rejected_at
interviewsid, application_id FK->applications.id, interviewer_id, scheduled_at, status, scorecard_id, feedback
scorecardsid, application_id FK->applications.id, interviewer_id, overall_recommendation IN definitely_not/no/yes/strong_yes, attributes, submitted_at
Sample queries 5 of 200
Clean lookup"How many jobs currently have an 'open' status?"
Clean lookup"What is the email address of the candidate with id 1?"
Clean lookup"What stage is application id 1 currently in?"
Clean lookup"What is the status of the interview with id 1?"
Clean lookup"What is the overall recommendation on scorecard id 1?"
Business rules
  • Hired applications must have at least one scorecard.
  • Rejected applications should have rejection_reason.
  • Closed jobs should have closed_at.
Talk to Us
H

HubSpot Environment

CRM system · 5 tables · 2,546 rows · 200 queries

Schema
companiesid, name, domain, industry, annual_revenue, num_employees, city, state, country, lifecycle_stage, created_at
contactsid, first_name, last_name, email, phone, job_title, company_id FK->companies.id, lifecycle_stage, lead_status, created_at
dealsid, deal_name, amount, pipeline, deal_stage IN Appointment Scheduled/Qualified to Buy/Presentation Scheduled/Decision Maker Bought-In/Contract Sent/Closed Won/Closed Lost, close_date, company_id FK->companies.id, contact_id FK->contacts.id, owner_id, created_at
ticketsid, subject, status, priority, category, contact_id FK->contacts.id, pipeline, created_at, closed_at
engagementsid, type IN EMAIL/CALL/MEETING/NOTE/TASK, timestamp, contact_id FK->contacts.id, deal_id FK->deals.id, body, duration_ms
Sample queries 5 of 200
Clean lookup"What is the email address of the contact with id 1?"
Clean lookup"What city is the company with id 1 located in?"
Clean lookup"What is the deal stage of deal id 1?"
Clean lookup"What is the subject of ticket id 1?"
Clean lookup"What type is engagement id 1?"
Business rules
  • Pipeline value must equal sum of open deal amounts.
  • Engagements must reference valid contacts and deals.
Talk to Us
I

Intercom Environment

Customer messaging platform · 4 tables · 2,000 rows · 200 queries

Schema
conversationsid, state IN open/closed/snoozed, priority IN priority/not_priority, contact_id FK->contacts.id, assignee_id, team_id, source_type, rating, first_response_time, created_at, updated_at
contactsid, name, email, phone, role, company_id FK->companies.id, location_city, signed_up_at, last_seen_at
companiesid, name, plan, monthly_spend, size, industry, website, created_at
conversation_partsid, conversation_id FK->conversations.id, author_type IN admin/user/bot, author_id, body, part_type IN comment/note/assignment/close/open, created_at
Sample queries 5 of 200
Clean lookup"How many conversations are currently open?"
Clean lookup"What is the email address of Sarah Mitchell?"
Clean lookup"What plan is Brightwave Solutions on?"
Clean lookup"How many conversations have a priority flag?"
Clean lookup"What is the total number of contacts in the database?"
Business rules
  • Closed conversations must have a close part.
  • Contacts must reference valid companies.
Talk to Us
J

Jira Environment

Project management system · 5 tables · 1,999 rows · 200 queries

Schema
projectsid, key, name, project_type, lead_id, category, created_at
issuesid, key, summary, description, issue_type IN Bug/Story/Task/Epic/Subtask, status IN To Do/In Progress/In Review/Done/Blocked, priority IN Highest/High/Medium/Low/Lowest, assignee_id, reporter_id, project_id FK->projects.id, sprint_id FK->sprints.id, story_points, labels, created_at, updated_at, resolved_at
sprintsid, name, state IN active/closed/future, start_date, end_date, project_id FK->projects.id, goal
commentsid, body, author_id, issue_id FK->issues.id, created_at
worklogsid, issue_id FK->issues.id, author_id, time_spent_seconds, started_at, comment
Sample queries 5 of 200
Clean lookup"What is the name of the project with key 'ALPHA'?"
Clean lookup"How many projects are currently in the database?"
Clean lookup"What is the state of Sprint 1?"
Clean lookup"What is the goal of Sprint 1?"
Clean lookup"How many comments are in the database?"
Business rules
  • Done issues must have resolved_at set.
Talk to Us
L

Linear Environment

Project management system · 5 tables · 1,998 rows · 200 queries

Schema
teamsid, name, key, description, created_at
projectsid, name, description, state, team_id FK->teams.id, lead_id, start_date, target_date, created_at
issuesid, identifier, title, description, state IN Backlog/Todo/In Progress/In Review/Done/Canceled, priority 0-4, assignee_id, project_id FK->projects.id, team_id FK->teams.id, estimate, labels, created_at, completed_at
cyclesid, name, number, team_id FK->teams.id, starts_at, ends_at, completed_at
commentsid, body, user_id, issue_id FK->issues.id, created_at
Sample queries 5 of 200
Clean lookup"How many teams are in the system?"
Clean lookup"What is the name of the team with key 'FE'?"
Clean lookup"What is the state of the project named 'Website Redesign'?"
Clean lookup"What are the valid states an issue can have?"
Clean lookup"What is the valid range for issue priority?"
Business rules
  • Done issues must have completed_at.
Talk to Us
M

Microsoft Teams Environment

Communication platform · 4 tables · 2,000 rows · 200 queries

Schema
teamsid, display_name, description, visibility, created_at
channelsid, display_name, description, team_id FK->teams.id, membership_type, created_at
messagesid, body, from_user_id FK->users.id, channel_id FK->channels.id, created_at, importance, reply_to_id
usersid, display_name, email, job_title, department, office_location
Sample queries 5 of 200
Clean lookup"What is the display name of the team with the earliest creation date?"
Clean lookup"How many teams are marked as public visibility?"
Clean lookup"What is the email address of the user named Olivia Bennett?"
Clean lookup"What is the description of the channel with the display name 'General'?"
Clean lookup"What is the job title of Olivia Bennett?"
Business rules
  • Messages must reference valid channels.
  • Reply messages must reference valid parent messages.
Talk to Us
N

Notion Environment

Knowledge platform · 4 tables · 1,997 rows · 200 queries

Schema
databasesid, title, description, parent_id, created_time, last_edited_time
pagesid, title, database_id FK->databases.id, parent_id, created_by, archived boolean, created_time, last_edited_time
blocksid, type IN paragraph/heading_1/heading_2/bulleted_list_item/code/table, page_id FK->pages.id, content, has_children boolean, created_time
commentsid, page_id FK->pages.id, body, created_by, created_time
Sample queries 5 of 200
Clean lookup"What is the title of the page with ID 'a1b2c3d4-e5f6-7890-abcd-ef1234567890'?"
Clean lookup"How many pages are currently archived?"
Clean lookup"What is the title of the database with ID 'a1b2c3d4-e5f6-7890-abcd-ef1234567890'?"
Clean lookup"Who created the comment with ID 'a1b2c3d4-e5f6-7890-abcd-ef1234567801'?"
Clean lookup"What type is the block with ID 'a1b2c3d4-e5f6-7890-abcd-ef1234567890'?"
Business rules
  • Pages must belong to valid databases.
Talk to Us
P

PagerDuty Environment

Incident management platform · 4 tables · 1,499 rows · 200 queries

Schema
servicesid, name, description, status, escalation_policy_id, team_id, created_at
incidentsid, incident_number, title, description, status IN triggered/acknowledged/resolved, urgency IN high/low, priority, service_id FK->services.id, assigned_to, created_at, resolved_at
alertsid, incident_id FK->incidents.id, status, severity, summary, source, created_at, resolved_at
schedulesid, name, time_zone, description, users, created_at
Sample queries 5 of 200
Clean lookup"How many incidents are currently in a triggered status?"
Clean lookup"What is the name of the service with the most incidents?"
Clean lookup"List all active services."
Clean lookup"What time zone does the Primary On-Call schedule use?"
Clean lookup"How many alerts have a severity of critical?"
Business rules
  • Resolved incidents must have resolved_at.
Talk to Us
P

Pipedrive Environment

CRM system · 4 tables · 1,999 rows · 200 queries

Schema
organizationsid, name, address, people_count, open_deals_count, won_deals_count, lost_deals_count, owner_id, created_at
personsid, name, email, phone, org_id FK->organizations.id, owner_id, open_deals_count, label, created_at
dealsid, title, value, currency, stage_id, pipeline_id, person_id FK->persons.id, org_id FK->organizations.id, status IN open/won/lost/deleted, expected_close_date, won_time, lost_time, created_at
activitiesid, type, subject, due_date, done, deal_id FK->deals.id, person_id FK->persons.id, org_id FK->organizations.id, note, duration
Sample queries 5 of 200
Clean lookup"What is the name of the organization with id 1?"
Clean lookup"What is the email address of James Harrington?"
Clean lookup"What is the value of deal id 1?"
Clean lookup"What type is activity id 1?"
Clean lookup"What is the address of Apex Dynamics LLC?"
Business rules
  • Deal counts on organizations and persons must match actual deal counts.
Talk to Us
Q

QuickBooks Environment

Accounting platform · 5 tables · 2,498 rows · 200 queries

Schema
customersid, display_name, company_name, email, phone, balance, currency, active boolean, created_at
invoicesid, customer_id FK->customers.id, doc_number, total_amount, balance, due_date, status, created_at
paymentsid, customer_id FK->customers.id, total_amount, payment_method, created_at
accountsid, name, account_type IN Asset/Liability/Equity/Revenue/Expense, current_balance, currency, active boolean
vendorsid, display_name, company_name, email, balance, active boolean, created_at
Sample queries 5 of 200
Clean lookup"What is the email address of the customer with the highest balance?"
Clean lookup"How many active customers are in the database?"
Clean lookup"What is the phone number of James Harrington?"
Clean lookup"List all account types that exist in the accounts table."
Clean lookup"What is the balance of the vendor with email accounts@acmesupplies.com?"
Business rules
  • Customer balance must equal sum of unpaid invoice balances.
Talk to Us
S

Salesforce Environment

CRM system · 5 tables · 2,496 rows · 200 queries

Schema
accountsid, name, industry, annual_revenue, num_employees, billing_city, billing_state, type, created_date, owner_id
contactsid, first_name, last_name, email, phone, title, department, account_id FK->accounts.id, lead_source, created_date
opportunitiesid, name, amount range 1000-5000000, stage IN Prospecting/Qualification/Proposal/Negotiation/Closed Won/Closed Lost, close_date, probability 0-100, account_id FK->accounts.id, owner_id, type, lead_source, created_date
leadsid, first_name, last_name, email, company, status IN New/Working/Qualified/Unqualified/Converted, lead_source, rating, industry, created_date
tasksid, subject, status, priority, due_date, contact_id FK->contacts.id, owner_id, description, created_date
Sample queries 5 of 200
Clean lookup"What is the name of the account with id 'a1b2c3d4-0001-4e5f-8a9b-c0d1e2f30001'?"
Clean lookup"What is the email address of the contact with id 'a1b2c3d4-e5f6-7890-abcd-ef1234567801'?"
Clean lookup"What is the status of the task with id 'a1b2c3d4-e5f6-7890-abcd-ef1234567801'?"
Clean lookup"What is the stage of the opportunity named 'Enterprise Cloud Migration Suite'?"
Clean lookup"What is the status of the lead with email 'james.harrington@techdynamics.com'?"
Business rules
  • Revenue must equal sum of Closed Won opportunities.
  • Contacts must belong to valid accounts.
  • Tasks must reference valid contacts.
Talk to Us
S

Sentry Environment

Error tracking platform · 4 tables · 2,000 rows · 200 queries

Schema
projectsid, name, slug, platform, status, created_at
issuesid, title, culprit, status IN unresolved/resolved/ignored/archived, level IN debug/info/warning/error/fatal, platform, project_id FK->projects.id, first_seen, last_seen, count, user_count, assigned_to
eventsid, issue_id FK->issues.id, message, level, platform, timestamp, user_id, tags, sdk_name, release
releasesid, version, project_id FK->projects.id, date_released, new_groups, commit_count
Sample queries 5 of 200
Clean lookup"How many projects are currently active?"
Clean lookup"What is the name of the project with id 1?"
Clean lookup"What platform does project with slug 'frontend-dashboard' use?"
Clean lookup"What is the version of release with id 1?"
Clean lookup"What is the level of issue with id 1?"
Business rules
  • Issue count must match actual event count.
Talk to Us
S

Slack Environment

Messaging platform · 4 tables · 2,000 rows · 200 queries

Schema
channelsid, name, purpose, topic, is_private boolean, num_members, creator_id, created_at
messagesid, text, user_id FK->users.id, channel_id FK->channels.id, thread_ts, ts, reply_count, reactions_count, created_at
usersid, name, real_name, display_name, email, title, status_text, is_admin boolean, is_bot boolean, timezone
reactionsid, name, user_id FK->users.id, message_id FK->messages.id, created_at
Sample queries 5 of 200
Clean lookup"What is the name of the channel with id '1'?"
Clean lookup"What is the email address of the user with username 'jsmith'?"
Clean lookup"What is the purpose of the general channel?"
Clean lookup"Who sent the first message in the database?"
Clean lookup"Is the user 'jsmith' an admin?"
Business rules
  • Messages must reference valid channels and users.
  • Thread messages must have thread_ts pointing to a parent message.
Talk to Us
S

Stripe Environment

Payment platform · 5 tables · 2,503 rows · 200 queries

Schema
customersid, name, email, phone, address_city, address_country, balance, currency, default_source, created
subscriptionsid, customer_id FK->customers.id, status IN active/past_due/canceled/unpaid/trialing/incomplete, plan_id, current_period_start, current_period_end, cancel_at_period_end boolean, trial_end, created
invoicesid, customer_id FK->customers.id, subscription_id FK->subscriptions.id, status IN draft/open/paid/void/uncollectible, amount_due, amount_paid, currency, due_date, created, paid_at
chargesid, customer_id FK->customers.id, amount, currency, status IN succeeded/pending/failed, payment_method_type, description, created
productsid, name, description, active boolean, type IN service/good, created
Sample queries 5 of 200
Clean lookup"What is the email address of customer James Whitfield?"
Clean lookup"How many customers are in the database?"
Clean lookup"How many products are currently active?"
Clean lookup"What is the status of invoice with ID 1?"
Clean lookup"How many charges have a status of succeeded?"
Business rules
  • Paid invoices must have amount_paid equal to amount_due.
  • Active subscriptions must have current_period_end in the future.
  • Charge amounts must be positive.
Talk to Us
V

Vanta Environment

Compliance platform · 4 tables · 2,000 rows · 200 queries

Schema
controlsid, name, description, framework IN SOC2/ISO27001/HIPAA/GDPR/PCI-DSS, status IN passing/failing/disabled/needs_attention, owner_id, last_tested_at, evidence_count
testsid, control_id FK->controls.id, name, status, last_run_at, remediation_instructions, resource_count
vulnerabilitiesid, title, severity IN critical/high/medium/low/info, status IN open/resolved/accepted/false_positive, asset_name, asset_type, detected_at, resolved_at
employeesid, name, email, department, role, security_training_completed boolean, background_check_status, device_encrypted boolean
Sample queries 5 of 200
Clean lookup"How many controls are currently in a failing status?"
Clean lookup"What is the name of the control with ID 1?"
Clean lookup"List all employees who have not completed security training."
Clean lookup"How many vulnerabilities have a severity of critical?"
Clean lookup"What frameworks are represented in the controls table?"
Business rules
  • Failing controls should have at least one failing test.
Talk to Us
W

WooCommerce Environment

E-commerce platform · 4 tables · 1,998 rows · 200 queries

Schema
productsid, name, slug, type IN simple/variable/grouped/external, status, regular_price, sale_price, stock_quantity, stock_status IN instock/outofstock/onbackorder, categories, tags, created_at
ordersid, status IN pending/processing/on-hold/completed/cancelled/refunded/failed, currency, total, discount_total, shipping_total, customer_id FK->customers.id, billing_email, payment_method, created_at
customersid, email, first_name, last_name, orders_count, total_spent, city, country, created_at
order_itemsid, order_id FK->orders.id, product_id FK->products.id, name, quantity, subtotal, total
Sample queries 5 of 200
Clean lookup"What is the name of the product with id 1?"
Clean lookup"What is the total amount of order id 1?"
Clean lookup"What is the email address of customer id 1?"
Clean lookup"What city does customer id 1 live in?"
Clean lookup"What is the status of order id 1?"
Business rules
  • Order total must equal sum of order items minus discounts plus shipping.
  • Customer orders_count must match actual orders.
Talk to Us
X

Xero Environment

Accounting platform · 4 tables · 2,000 rows · 200 queries

Schema
contactsid, name, email, is_customer boolean, is_supplier boolean, account_number, balance_owed, created_at
invoicesid, type IN ACCREC/ACCPAY, contact_id FK->contacts.id, status IN DRAFT/SUBMITTED/AUTHORISED/PAID/VOIDED, total, amount_due, amount_paid, currency_code, date, due_date
bank_transactionsid, type, contact_id FK->contacts.id, total, status, bank_account_id, date, reference
accountsid, name, code, type, class IN ASSET/EQUITY/EXPENSE/LIABILITY/REVENUE, status
Sample queries 5 of 200
Clean lookup"What is the email address of Greenfield Construction Ltd?"
Clean lookup"How many contacts are marked as both customers and suppliers?"
Clean lookup"What is the status of invoice with id a1b2c3d4-e5f6-7890-abcd-ef1234567801?"
Clean lookup"List all bank accounts in the chart of accounts."
Clean lookup"What currency is used on the sample invoice for Greenfield Construction Ltd?"
Business rules
  • Paid invoices must have amount_due=0.
Talk to Us
Z

Zendesk Environment

Customer support system · 4 tables · 1,500 rows · 200 queries

Schema
ticketsid, subject, description, status IN new/open/pending/hold/solved/closed, priority IN low/normal/high/urgent, type IN question/incident/problem/task, requester_id, assignee_id, group_id, tags, channel, satisfaction_rating, created_at, updated_at, solved_at
usersid, name, email, role, organization_id, phone, created_at
organizationsid, name, domain_names, group_id, tags, created_at
commentsid, body, author_id, ticket_id FK->tickets.id, public boolean, created_at
Sample queries 5 of 200
Clean lookup"What is the subject of ticket with ID 1?"
Clean lookup"What is the current status of ticket 42?"
Clean lookup"What is the email address of user Sarah Mitchell?"
Clean lookup"What role does user with ID 1 have?"
Clean lookup"What organization does Acme Corporation have listed as their group_id?"
Business rules
  • Solved tickets must have solved_at.
Talk to Us
Z

Zoho CRM Environment

CRM platform · 4 tables · 2,000 rows · 200 queries

Schema
accountsid, account_name, industry, annual_revenue, rating, phone, billing_city, billing_country, owner_id, created_time
contactsid, first_name, last_name, email, phone, title, department, account_id FK->accounts.id, lead_source, created_time
dealsid, deal_name, amount, stage IN Qualification/Needs Analysis/Value Proposition/Decision Makers/Proposal/Negotiation/Closed Won/Closed Lost, closing_date, probability 0-100, account_id FK->accounts.id, contact_id FK->contacts.id, created_time
tasksid, subject, status, priority, due_date, contact_id FK->contacts.id, deal_id FK->deals.id, description, created_time
Sample queries 5 of 200
Clean lookup"What is the name of the account with the highest annual revenue?"
Clean lookup"How many contacts are in the database?"
Clean lookup"What is the email address of James Hartley?"
Clean lookup"What stage is the deal named 'Enterprise Cloud Migration - Acme Corp' in?"
Clean lookup"What is the phone number for the account with phone (415) 832-9100?"
Business rules
  • Closed Won deals should have high probability.
Talk to Us