Skip to content

Conversation

superphil0
Copy link

@superphil0 superphil0 commented Sep 2, 2025

This allows users to generate schemas for subcollections that appear across multiple parent documents by using collection group queries instead of regular collection queries.

This loosely follows the pattern of the import script by adding the same flag --query-collection-group

I did test this on my own production DB, so works for my purposes

  • Add --query-collection-group flag to gen-schema-view script
  • Support both regular collection and collection group queries in Gemini schema generation
  • Update sampleFirestoreDocuments function with isCollectionGroupQuery parameter
  • Add interactive prompt for collection group query selection
  • Update documentation with examples and explanations
  • Add comprehensive test coverage for new functionality
  • Maintain backward compatibility with existing functionality

Feature request here: #2516

pr-Mais and others added 30 commits January 24, 2024 20:13
…gcp-option

feat(firestore-bigquery-export): support cross-project import with the import script
…ase#1934)

* chore(firestore-bigquery-export): update firebase dependencies

* fix: jest config
… CloudTask payload size (firebase#1908)

* feat(firestore-bigquery-export): new param EXCLUDE_OLD_DATA to reduce CloudTask payload size

* style: fix formatting

* chore(firestore-bigquery-export): update docs and tests

* chore: update formatting
…LECTION` (firebase#1922)

* docs(firestore-send-email): update the doc for handlebar

* templates collection description text is updated

* chore: fix formatting

---------

Co-authored-by: Pavel Ryabov <[email protected]>
Co-authored-by: Pavel <[email protected]>
…param (firebase#1905)

Co-authored-by: Mais Alheraki <[email protected]>
Co-authored-by: Pavel Ryabov <[email protected]>
Co-authored-by: Pavel <[email protected]>
…on import (firebase#1945)

* docs(firestore-bigquery-export): remove mention of bigquery updating on import

* docs: update readme
…e#2005)

* fix(firestore-bigquery-export): disable onInstall backfill

* chore(firestore-bigquery-export): increment CHANGELOG and version
cabljac and others added 19 commits July 18, 2025 11:16
…ize-images-genkit.dev-reference

docs(storage-resize-images): add genkit.dev reference to docs
…se#2478)

* feat(storage-resize-image): add param for backfill batch size

* chore(storage-resize-images): format

* fix(storage-resize-image): tests

* feat: add validation of batch size param
firebase#2479)

* chore(firestore-bigquery-export/gen-schema-view): update gemini to 2.5

* chore: small changes to guide

* chore: enable skipped test
Bumps [form-data](https://github.com/form-data/form-data) from 2.5.1 to 2.5.5.
- [Release notes](https://github.com/form-data/form-data/releases)
- [Changelog](https://github.com/form-data/form-data/blob/v2.5.5/CHANGELOG.md)
- [Commits](form-data/form-data@v2.5.1...v2.5.5)

---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 2.5.5
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps  and [brace-expansion](https://github.com/juliangruber/brace-expansion). These dependencies needed to be updated together.

Updates `brace-expansion` from 2.0.1 to 2.0.2
- [Release notes](https://github.com/juliangruber/brace-expansion/releases)
- [Commits](juliangruber/brace-expansion@v2.0.1...v2.0.2)

Updates `brace-expansion` from 1.1.11 to 2.0.2
- [Release notes](https://github.com/juliangruber/brace-expansion/releases)
- [Commits](juliangruber/brace-expansion@v2.0.1...v2.0.2)

---
updated-dependencies:
- dependency-name: brace-expansion
  dependency-version: 2.0.2
  dependency-type: indirect
- dependency-name: brace-expansion
  dependency-version: 2.0.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
* feat(firestore-translate-text): add models and provider

* chore(firestore-translate-text): format

* chore(firestore-translate-text): update version

* chore(firestore-translate-text): update genkit deps

* chore(firestore-translate-text): adjust for feedback

* chore(firestore-translate-text): adjust for feedback

* chore: adjust for feedback

* chore: generate readme

* fix: build issue

* fix: model exists check removed, as invalid
Bumps  and [form-data](https://github.com/form-data/form-data). These dependencies needed to be updated together.

Updates `form-data` from 4.0.3 to 4.0.4
- [Release notes](https://github.com/form-data/form-data/releases)
- [Changelog](https://github.com/form-data/form-data/blob/master/CHANGELOG.md)
- [Commits](form-data/form-data@v4.0.3...v4.0.4)

Updates `form-data` from 2.5.3 to 4.0.4
- [Release notes](https://github.com/form-data/form-data/releases)
- [Changelog](https://github.com/form-data/form-data/blob/master/CHANGELOG.md)
- [Commits](form-data/form-data@v4.0.3...v4.0.4)

---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Release: 22nd July 2025

gen-schema-view
firestore-translate-text
storage-resize-images
…d from config (firebase#2481)

* fix(firestore-bigquery-export/import): transform function url exported from config

* chore: format
* chore: increment version, npm audit fix, add CHANGELOG

* fix: amend date in CHANGELOG
)

* feat(firestore-translate-text): add Gemini 2.5 Flash Lite

* chore: update changelog and extension.yaml

* chore: format
* fix(bq-import-script): fix multimodal collectionGroup queries

* test: fix broken tests

* chore: format

* chore: remove temporary test

* chore(import-script): bump version
- Add --is-collection-group-query flag to gen-schema-view script
- Support both regular collection and collection group queries in Gemini schema generation
- Update sampleFirestoreDocuments function with isCollectionGroupQuery parameter
- Add interactive prompt for collection group query selection
- Update documentation with examples and explanations
- Add comprehensive test coverage for new functionality
- Maintain backward compatibility with existing functionality

This allows users to generate schemas for subcollections that appear across
multiple parent documents by using collection group queries instead of
regular collection queries.
- Update command line flag from --is-collection-group-query to --query-collection-group
- Update all documentation and examples with new flag name
- Update tests to use new flag name
- Maintain same functionality with cleaner flag naming

This provides a more concise and intuitive flag name for collection group queries.
Copy link

google-cla bot commented Sep 2, 2025

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@HassanBahati
Copy link
Member

HassanBahati commented Sep 2, 2025

Hi @superphil0, thank you for opening this Pull Request. We will review and provide feedback. Thanks!

@HassanBahati HassanBahati added extension: firestore-bigquery-export Related to firestore-bigquery-export extension type: feature request New feature or request labels Sep 2, 2025
@superphil0 superphil0 closed this Sep 2, 2025
@superphil0 superphil0 force-pushed the feature/collection-group-query-support branch from aad19e2 to 5abfa07 Compare September 2, 2025 18:59
@superphil0 superphil0 deleted the feature/collection-group-query-support branch September 2, 2025 19:04
@superphil0
Copy link
Author

Hi @superphil0, thank you for opening this Pull Request. We will review and provide feedback. Thanks!

sorry, had to remove a file, recreated here: #2518

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
extension: firestore-bigquery-export Related to firestore-bigquery-export extension type: feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.