Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add rag enrichment and ingestion. #33413

Open
wants to merge 15 commits into
base: master
Choose a base branch
from

Fix bigquery ingestion default schema to work with Avro file loads.

be0792f
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Add rag enrichment and ingestion. #33413

Fix bigquery ingestion default schema to work with Avro file loads.
be0792f
Select commit
Loading
Failed to load commit list.
GitHub Actions / Test Results succeeded Dec 31, 2024 in 0s

All 19 tests pass, 22 skipped in 2h 10m 26s

41 tests  ±0   19 ✅ +1   2h 10m 26s ⏱️ + 1m 28s
 1 suites ±0   22 💤 ±0 
 1 files   ±0    0 ❌  - 1 

Results for commit be0792f. ± Comparison against earlier commit af1d8ac.

Annotations

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Test Results

22 skipped tests found

There are 22 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
apache_beam.examples.ml_transform.ml_transform_it_test
apache_beam.examples.snippets.snippets_test.SnippetsTest ‑ test_model_bigqueryio_xlang
apache_beam.examples.snippets.transforms.elementwise.mltransform_test
apache_beam.examples.snippets.transforms.elementwise.runinference_test
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_streaming_with_auto_sharding
apache_beam.ml.inference.huggingface_inference_it_test
apache_beam.ml.inference.huggingface_inference_test
apache_beam.ml.inference.onnx_inference_test
apache_beam.ml.inference.pytorch_inference_test
apache_beam.ml.inference.tensorflow_inference_test
apache_beam.ml.inference.tensorrt_inference_test
apache_beam.ml.inference.vertex_ai_inference_it_test
apache_beam.ml.inference.xgboost_inference_test
apache_beam.ml.transforms.handlers_test
apache_beam.ml.transforms.tft_test
apache_beam.runners.dask.dask_runner_test
apache_beam.testing.analyzers.perf_analysis_test
apache_beam.testing.benchmarks.cloudml.cloudml_benchmark_test
apache_beam.transforms.enrichment_handlers.feast_feature_store_it_test
apache_beam.transforms.enrichment_handlers.feast_feature_store_test
apache_beam.typehints.pytorch_type_compatibility_test
apache_beam.yaml.yaml_ml_test

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Test Results

41 tests found

There are 41 tests, see "Raw output" for the full list of tests.
Raw output
apache_beam.examples.ml_transform.ml_transform_it_test
apache_beam.examples.snippets.snippets_test.SnippetsTest ‑ test_model_bigqueryio_xlang
apache_beam.examples.snippets.transforms.elementwise.mltransform_test
apache_beam.examples.snippets.transforms.elementwise.runinference_test
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_all_types
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_nested_records_and_lists
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_streaming_with_at_least_once
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_streaming_with_auto_sharding
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_streaming_with_fixed_num_streams
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_with_at_least_once_semantics
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_write_to_dynamic_destinations
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_write_to_dynamic_destinations_with_beam_rows
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_write_with_beam_rows
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_write_with_beam_rows_cdc
apache_beam.io.external.xlang_bigqueryio_it_test.BigQueryXlangStorageWriteIT ‑ test_write_with_dicts_cdc
apache_beam.io.gcp.bigtableio_it_test.TestReadFromBigTableIT ‑ test_read_xlang
apache_beam.io.gcp.bigtableio_it_test.TestWriteToBigtableXlangIT ‑ test_delete_cells_mutation
apache_beam.io.gcp.bigtableio_it_test.TestWriteToBigtableXlangIT ‑ test_delete_cells_with_timerange_mutation
apache_beam.io.gcp.bigtableio_it_test.TestWriteToBigtableXlangIT ‑ test_delete_column_family_mutation
apache_beam.io.gcp.bigtableio_it_test.TestWriteToBigtableXlangIT ‑ test_delete_row_mutation
apache_beam.io.gcp.bigtableio_it_test.TestWriteToBigtableXlangIT ‑ test_set_mutation
apache_beam.ml.inference.huggingface_inference_it_test
apache_beam.ml.inference.huggingface_inference_test
apache_beam.ml.inference.onnx_inference_test
apache_beam.ml.inference.pytorch_inference_test
apache_beam.ml.inference.tensorflow_inference_test
apache_beam.ml.inference.tensorrt_inference_test
apache_beam.ml.inference.vertex_ai_inference_it_test
apache_beam.ml.inference.xgboost_inference_test
apache_beam.ml.rag.ingestion.bigquery_it_test.BigQueryVectorWriterConfigTest ‑ test_custom_schema
apache_beam.ml.rag.ingestion.bigquery_it_test.BigQueryVectorWriterConfigTest ‑ test_default_schema
apache_beam.ml.rag.ingestion.bigquery_it_test.BigQueryVectorWriterConfigTest ‑ test_streaming_default_schema
apache_beam.ml.transforms.handlers_test
apache_beam.ml.transforms.tft_test
apache_beam.runners.dask.dask_runner_test
apache_beam.testing.analyzers.perf_analysis_test
apache_beam.testing.benchmarks.cloudml.cloudml_benchmark_test
apache_beam.transforms.enrichment_handlers.feast_feature_store_it_test
apache_beam.transforms.enrichment_handlers.feast_feature_store_test
apache_beam.typehints.pytorch_type_compatibility_test
apache_beam.yaml.yaml_ml_test