Code

Rebase Upstream#2

Code

Closed

chenzl25 wants to merge 236 commits intorisingwavelabs:mainrisingwavelabs/iceberg-rust:mainfrom apache:mainapache/iceberg-rust:mainCopy head branch name to clipboard

+43,658-3,006

Commits

Commits on Dec 26, 2023

• feat: Add website layout (#130)

  Show description for 6a401d4
  Xuanwo

  authored
  6a401d4

• feat: Expression system. (#132)

  Show description for 6375fb8
  liurenjie1024

  authored
  6375fb8

• website: Fix typo in book.toml (#136)

  Show description for 70b49e4
  Xuanwo

  authored
  70b49e4

Commits on Dec 27, 2023

• Set ghp_path and ghp_branch properties (#138)

  Fokko

  authored
  43697b9

Commits on Dec 29, 2023

• chore: Upgrade toolchain to 1.75.0 (#140)

  liurenjie1024

  authored
  38d1977

• feat: Add roadmap and features status in README.md (#134)

  Show description for 6fa2768
  

  liurenjie1024

  and

  Fokko

  authored
  6fa2768

• Infra: Remove publish: section from .asf.yaml (#141)

  Fokko

  authored
  7dfb0f2

Commits on Jan 1, 2024

• chore(deps): Bump peaceiris/actions-gh-pages from 3.9.2 to 3.9.3 (#143)

  Show description for 87777d4
  dependabot[bot]

  authored
  87777d4

• chore(deps): Update opendal requirement from 0.43 to 0.44 (#142)

  Show description for 47e3ae7
  dependabot[bot]

  authored
  47e3ae7

Commits on Jan 4, 2024

• docs: Change homepage to rust.i.a.o (#146)

  Xuanwo

  authored
  b703146

Commits on Jan 9, 2024

• feat: Introduce basic file scan planning. (#129)

  Show description for c91aeae
  liurenjie1024

  authored
  c91aeae

Commits on Jan 12, 2024

• chore: Update contributing guide. (#163)

  liurenjie1024

  authored
  18f63fe

• chore: Update reader api status (#162)

  Show description for 5d1a02d
  liurenjie1024

  authored
  5d1a02d

Commits on Jan 13, 2024

• #154 : Add homepage to Cargo.toml (#160)

  hiirrxnn

  authored
  35f3481

Commits on Jan 19, 2024

• Add formatting for toml files (#167)

  Show description for bcf2c5c
  Tyler-Sch

  authored
  bcf2c5c

Commits on Jan 25, 2024

• chore(deps): Update env_logger requirement from 0.10.0 to 0.11.0 (#170)

  Show description for 1775c90
  dependabot[bot]

  authored
  1775c90

• feat: init file writer interface (#168)

  Show description for a9104dc
  

  ZENOTME

  and

  ZENOTME

  authored
  a9104dc

• fix: Manifest parsing should consider schema evolution. (#171)

  Show description for e4f55d1
  liurenjie1024

  authored
  e4f55d1

Commits on Jan 26, 2024

• docs: Add release guide for iceberg-rust (#147)

  Xuanwo

  authored
  21c933a

• fix: Ignore negative statistics value (#173)

  liurenjie1024

  authored
  d9d6cfc

Commits on Jan 31, 2024

• feat: Add user guide for website. (#178)

  Show description for be65c89
  liurenjie1024

  authored
  be65c89

• chore(deps): Update derive_builder requirement from 0.12.0 to 0.13.0 (#175)

  Show description for 9768b0e
  dependabot[bot]

  authored
  9768b0e

Commits on Feb 2, 2024

• Replace unwrap (#183)

  odysa

  authored
  9ae9e13

Commits on Feb 5, 2024

• feat: add handwritten serialize (#185)

  Show description for 6929b79
  odysa

  authored
  6929b79

• Fix avro schema names for manifest and manifest_list (#182)

  Show description for 390cd51
  

  JanKaul

  and

  Fokko

  authored
  390cd51

• feat: Bump hive_metastore to use pure rust thrift impl volo (#174)

  Xuanwo

  authored
  09765db

Commits on Feb 6, 2024

• feat: Bump version 0.2.0 to prepare for release. (#181)

  Show description for e008105
  liurenjie1024

  authored
  e008105

• fix: default_partition_spec using the partion_spec_id set (#190)

  Show description for 149c7fa
  odysa

  authored
  149c7fa

Commits on Feb 7, 2024

• Docs: Add required Cargo version to install guide (#191)

  manuzhang

  authored
  645f9dd

Commits on Feb 12, 2024

• chore(deps): Update opendal requirement from 0.44 to 0.45 (#195)

  Show description for adef9bd
  dependabot[bot]

  authored
  adef9bd

Commits on Feb 16, 2024

• Smooth out release steps (#197)

  Show description for 03f77b5
  Fokko

  authored
  03f77b5

Commits on Feb 19, 2024

• refactor: remove support of manifest list format as a list of file path (#201)

  Show description for e2ba1a4
  Dysprosium0626

  authored
  e2ba1a4

• refactor: remove unwraps (#196)

  Show description for 69a5f14
  odysa

  authored
  69a5f14

• Fix: add required rust version in cargo.toml (#193)

  Show description for 5c23124
  dp-0

  authored
  5c23124

• Fix the REST spec version (#198)

  Show description for 07c9e0f
  Fokko

  authored
  07c9e0f

Commits on Feb 20, 2024

• feat: Add Sync + Send to Catalog trait (#202)

  zhenglin-charlie-li

  authored
  027f271

• feat: Make thrift transport configurable (#194)

  Show description for b6bbd1d
  DeaconDesperado

  authored
  b6bbd1d

• Add UnboundSortOrder (#115)

  Show description for d251904
  fqaiser94

  authored
  d251904

Commits on Feb 22, 2024

• ci: Add workflow for publish (#218)

  Show description for 8e3f950
  Xuanwo

  authored
  8e3f950

• ci: add workflow for cargo audit (#217)

  sdd

  authored
  fad60e1

• docs: Add basic README for all crates (#215)

  Show description for 86784ee
  Xuanwo

  authored
  86784ee

• Follow naming convention from Iceberg's Java and Python implementations (#204)

  s-akhtar-baig

  authored
  9f70c0d

Commits on Feb 23, 2024

• doc: Add download page (#219)

  Show description for 49a9d86
  liurenjie1024

  authored
  49a9d86

• chore(deps): Update derive_builder requirement from 0.13.0 to 0.20.0 (#203)

  Show description for 61e6444
  dependabot[bot]

  authored
  61e6444

Commits on Feb 27, 2024

• test: add FileIO s3 test (#220)

  Show description for 048eac8
  odysa

  authored
  048eac8

• ci: Ignore RUSTSEC-2023-0071 for no actions to take (#222)

  Show description for a20cda8
  Xuanwo

  authored
  a20cda8

Commits on Mar 1, 2024

• feat: Add expression builder and display. (#169)

  Show description for 811fd1d
  liurenjie1024

  authored
  811fd1d

Commits on Mar 5, 2024

• chord: Add IssueNavigationLink for RustRover (#230)

  Show description for cbf2873
  

  stream2000

  and

  fuqijun

  authored
  cbf2873

• minor: Fix double API doc typo (#226)

  viirya

  authored
  b248fd6

Commits on Mar 7, 2024

• feat: add UnboundPredicate::negate() (#228)

  Show description for 0fc0b0f
  sdd

  authored
  0fc0b0f

• fix: Remove deprecated methods to pass ci (#234)

  liurenjie1024

  authored
  f61d475

• Implement basic Parquet data file reading capability (#207)

  Show description for 8e4308d
  sdd

  authored
  8e4308d

Commits on Mar 9, 2024

• chore: doc-test as a target (#235)

  liurenjie1024

  authored
  c7727e3

• feat: add parquet writer (#176)

  ZENOTME

  authored
  0914f7a

Commits on Mar 10, 2024

• Add hive metastore catalog support (part 1/2) (#237)

  Show description for 3a947fa
  

  marvinlanhenke

  and

  mlanhenke

  authored
  3a947fa

Commits on Mar 11, 2024

• chore: Enable projects. (#247)

  liurenjie1024

  authored
  b8919cd

• Make plan_files as asynchronous stream (#243)

  viirya

  authored
  7a1cb12

Commits on Mar 12, 2024

• feat: Implement binding expression (#231)

  Show description for 83cdff4
  liurenjie1024

  authored
  83cdff4

Commits on Mar 13, 2024

• Implement Display instead of ToString (#256)

  lewiszlw

  authored
  78a416d

Commits on Mar 14, 2024

• add rewrite_not (#263)

  marvinlanhenke

  authored
  71cd44f

• feat: init TableMetadataBuilder (#262)

  ZENOTME

  authored
  39e7e9d

• Rename stat_table to table_exists in Catalog trait (#257)

  lewiszlw

  authored
  3d08f04

Commits on Mar 15, 2024

• feat (static table): implement a read-only table struct loaded from metadata (#259)

  Show description for 6e29ca7
  a-agmon

  authored
  6e29ca7

Commits on Mar 18, 2024

• feat: implement OAuth for catalog rest client (#254)

  TennyZhuang

  authored
  d6703df

Commits on Mar 19, 2024

• docs: annotate precision and length to primitive types (#270)

  Show description for 124a79b
  waynexia

  authored
  124a79b

• build: Restore CI by making parquet and arrow version consistent (#280)

  viirya

  authored
  76af889

• Metadata Serde + default partition_specs and sort_orders (#272)

  Show description for 6f85456
  marvinlanhenke

  authored
  6f85456

Commits on Mar 20, 2024

• feat: make optional oauth param configurable (#278)

  Show description for c3c1f5f
  

  himadripal

  and

  hpal

  authored
  c3c1f5f

Commits on Mar 21, 2024

• fix: enable public access to ManifestEntry properties (#284)

  Show description for f0effeb
  a-agmon

  authored
  f0effeb

• feat: Implement the conversion from Arrow Schema to Iceberg Schema (#258)

  Show description for 39aafdd
  viirya

  authored
  39aafdd

Commits on Mar 22, 2024

• Rename funtion name to add_manifests (#293)

  viirya

  authored
  ce09b1e

• feat: modify Bind calls so that they don't consume self and instead return a new struct, leaving the original unmoved" (#290)

  sdd

  authored
  757ef4c

• Add hive metastore catalog support (part 2/2) (#285)

  Show description for 0629ad5
  

  marvinlanhenke

  and

  mlanhenke

  authored
  0629ad5

Commits on Mar 24, 2024

• feat: implement prune column for schema (#261)

  Show description for 1c2a20b
  Dysprosium0626

  authored
  1c2a20b

• chore(deps): Update reqwest requirement from ^0.11 to ^0.12 (#296)

  dependabot[bot]

  authored
  a8f2939

Commits on Mar 25, 2024

• Glue Catalog: Basic Setup + Test Infra (1/3) (#294)

  Show description for fd9aa71
  marvinlanhenke

  authored
  fd9aa71

Commits on Mar 26, 2024

• feat: rest client respect prefix prop (#297)

  Show description for e196725
  TennyZhuang

  authored
  e196725

• fix: missing properties (#303)

  marvinlanhenke

  authored
  ffd76eb

• fix: renaming FileScanTask.data_file to data_manifest_entry (#300)

  Show description for ce71aeb
  a-agmon

  authored
  ce71aeb

• feat: Make OAuth token server configurable (#305)

  whynick1

  authored
  c67007a

Commits on Mar 27, 2024

• feat: Glue Catalog - namespace operations (2/3) (#304)

  Show description for 2018ffc
  marvinlanhenke

  authored
  2018ffc

• feat: add transform_literal (#287)

  Show description for bbc8578
  

  ZENOTME

  and

  ZENOTME

  authored
  bbc8578

• feat: Complete predicate builders for all operators. (#276)

  Show description for 94c9af0
  QuakeWang

  authored
  94c9af0

• feat: Support customized header in Rest catalog client (#306)

  Show description for 49117cb
  whynick1

  authored
  49117cb

Commits on Mar 29, 2024

• fix: chrono dep (#274)

  odysa

  authored
  162f16e

Commits on Apr 1, 2024

• feat: Read Parquet data file with projection (#245)

  Show description for 6e5a871
  viirya

  authored
  6e5a871

• Fix day timestamp micro (#312)

  Show description for d57d91b
  marvinlanhenke

  authored
  d57d91b

Commits on Apr 3, 2024

• feat: support uri redirect in rest client (#310)

  Show description for 3dcb3a9
  TennyZhuang

  authored
  3dcb3a9

• refine: seperate parquet reader and arrow convert (#313)

  ZENOTME

  authored
  865f774

• Upgrade to rust-version 1.77.1 (#316)

  marvinlanhenke

  authored
  301a0af

Commits on Apr 5, 2024

• Support identifier warehouses (#308)

  Show description for f7bffb1
  Fokko

  authored
  f7bffb1

• feat: Project transform (#309)

  Show description for 4e89ac7
  marvinlanhenke

  authored
  4e89ac7

Commits on Apr 6, 2024

• feat: add Struct Accessors to BoundReferences (#317)

  sdd

  authored
  ca9de89

Commits on Apr 15, 2024

• feat: use str args rather than String in transform (#325)

  sdd

  authored
  4170872

Commits on Apr 16, 2024

• chore(deps): Update pilota requirement from 0.10.0 to 0.11.0 (#327)

  Show description for ecde318
  dependabot[bot]

  authored
  ecde318

• chore(deps): Bump peaceiris/actions-mdbook from 1 to 2 (#332)

  Show description for 9dba0ce
  dependabot[bot]

  authored
  9dba0ce

• chore(deps): Bump peaceiris/actions-gh-pages from 3.9.3 to 4.0.0 (#333)

  Show description for 2bb6918
  dependabot[bot]

  authored
  2bb6918

• chore(deps): Bump apache/skywalking-eyes from 0.5.0 to 0.6.0 (#328)

  Show description for 8847f9c
  dependabot[bot]

  authored
  8847f9c

• feat: add BoundPredicateVisitor. Add AlwaysTrue and AlwaysFalse to Predicate (#334)

  sdd

  authored
  9160bba

Commits on Apr 19, 2024

• feat: add InclusiveProjection (#335)

  sdd

  authored
  de80a24

• feat: Implement the conversion from Iceberg Schema to Arrow Schema (#277)

  Show description for 5761fd2
  

  ZENOTME

  and

  ZENOTME

  authored
  5761fd2

• Simplify expression when doing {and,or} operations (#339)

  Show description for 7666bb6
  Fokko

  authored
  7666bb6

Commits on Apr 21, 2024

• feat: Glue Catalog - table operations (3/3) (#314)

  Show description for dcc380a
  marvinlanhenke

  authored
  dcc380a

• chore: update roadmap (#336)

  Show description for 0e683f2
  marvinlanhenke

  authored
  0e683f2

Commits on Apr 22, 2024

• feat: add ManifestEvaluator (#322)

  sdd

  authored
  0666b4b

• feat: init iceberg writer (#275)

  Show description for aba6209
  

  ZENOTME

  and

  ZENOTME

  authored
  aba6209

Commits on Apr 26, 2024

• feat: implement manifest filtering in TableScan (#323)

  sdd

  authored
  0154829

Commits on Apr 30, 2024

• Refactor: Extract partition_filters from ManifestEvaluator (#360)

  Show description for 7dfc548
  marvinlanhenke

  authored
  7dfc548

Commits on May 2, 2024

• Basic Integration with Datafusion (#324)

  Show description for bbd042d
  

  3 peopleauthored
  bbd042d

• refactor: cache partition_schema in fn plan_files() (#362)

  Show description for 1c66e5a
  marvinlanhenke

  authored
  1c66e5a

Commits on May 9, 2024

• fix (manifest-list): added serde aliases to support both forms conventions (#365)

  Show description for ffb691d
  a-agmon

  authored
  ffb691d

Commits on May 14, 2024

• feat: Extract FileRead and FileWrite trait (#364)

  Show description for 3b8121e
  Xuanwo

  authored
  3b8121e

Commits on May 15, 2024

• feat: Convert predicate to arrow filter and push down to parquet reader (#295)

  Show description for 81df940
  viirya

  authored
  81df940

Commits on May 18, 2024

• chore(deps): Update datafusion requirement from 37.0.0 to 38.0.0 (#369)

  dependabot[bot]

  authored
  40eb024

Commits on May 19, 2024

• chore(deps): Update itertools requirement from 0.12 to 0.13 (#376)

  dependabot[bot]

  authored
  6d95a5c

• Add InclusiveMetricsEvaluator (#347)

  Show description for e1c10b5
  sdd

  authored
  e1c10b5

Commits on May 25, 2024

• Rename V2 spec names. (#380)

  gupteaj

  authored
  43df392

Commits on May 27, 2024

• make file scan task serializable (#377)

  Show description for 1bf80e1
  

  ZENOTME

  and

  ZENOTME

  authored
  1bf80e1

Commits on May 28, 2024

• Feature: Schema into_builder method (#381)

  c-thiel

  authored
  e5b59a7

Commits on May 30, 2024

• replaced i32 in TableUpdate::SetDefaultSortOrder to i64 (#387)

  rwwwx

  authored
  4407634

Commits on Jun 1, 2024

• fix: make PrimitiveLiteral and Literal not be Ord (#386)

  Show description for 8068407
  

  ZENOTME

  and

  ZENOTME

  authored
  8068407

Commits on Jun 2, 2024

• docs(writer/docker): fix small typos and wording (#389)

  Show description for 1aa05e0
  jdockerty

  authored
  1aa05e0

Commits on Jun 7, 2024

• feat: StructAccessor.get returns Result<Option<Datum>> instead of Result<Datum> (#390)

  Show description for f1ea6e1
  sdd

  authored
  f1ea6e1

Commits on Jun 10, 2024

• feat: add ExpressionEvaluator (#363)

  Show description for 15e61f2
  marvinlanhenke

  authored
  15e61f2

Commits on Jun 12, 2024

• Derive Clone for TableUpdate (#402)

  c-thiel

  authored
  a888bd8

• Add accessor for Schema identifier_field_ids (#388)

  Show description for e41f17e
  

  c-thiel

  and

  liurenjie1024

  authored
  e41f17e

Commits on Jun 13, 2024

• deps: Bump arrow related crates to 52 (#403)

  Dysprosium0626

  authored
  ffafe15

• SnapshotRetention::Tag max_ref_age_ms should be optional (#391)

  c-thiel

  authored
  1912f0f

• feat: Add storage features for iceberg (#400)

  Show description for b20d7ac
  Xuanwo

  authored
  b20d7ac

• Implement BoundPredicateVisitor for ManifestFilterVisitor (#367)

  Show description for 070576b
  s-akhtar-baig

  authored
  070576b

Commits on Jun 15, 2024

• Add missing arrow predicate pushdown implementations for StartsWith, NotStartsWith, In, and NotIn (#404)

  Show description for adc5d20
  sdd

  authored
  adc5d20

Commits on Jun 19, 2024

• feat: make BoundPredicate,Datum serializable (#406)

  Show description for def6114
  

  ZENOTME

  and

  ZENOTME

  authored
  def6114

• refactor: Upgrade hive_metastore to 0.1 (#409)

  Show description for fa7fee9
  Xuanwo

  authored
  fa7fee9

Commits on Jun 20, 2024

• Remove duplicate filter (#414)

  liurenjie1024

  authored
  11d4221

Commits on Jun 21, 2024

• Enhancement: refine the reader interface (#401)

  ZENOTME

  authored
  854171d

Commits on Jun 28, 2024

• refactor(catalog/rest): Split http client logic to seperate mod (#423)

  Show description for 0d6fae0
  Xuanwo

  authored
  0d6fae0

• Remove #[allow(dead_code)] from the codebase (#421)

  Show description for 8955e7b
  vivek378521

  authored
  8955e7b

Commits on Jun 30, 2024

• ci: use official typos github action (#426)

  shoothzj

  authored
  7417a2a

Commits on Jul 2, 2024

• feat: support lower_bound&&upper_bound for parquet writer (#383)

  ZENOTME

  authored
  64922c6

• refactor: Implement ArrowAsyncFileWriter directly to remove tokio (#427)

  Show description for fc3d475
  Xuanwo

  authored
  fc3d475

Commits on Jul 3, 2024

• chore: Don't enable reqwest default features (#432)

  Xuanwo

  authored
  e6d6cd9

Commits on Jul 4, 2024

• refactor(catalogs/rest): Split user config and runtime config (#431)

  Show description for c3b5364
  Xuanwo

  authored
  c3b5364

Commits on Jul 5, 2024

• feat: runtime module (#233)

  Show description for b341910
  odysa

  authored
  b341910

• fix: Fix namespace identifier in url (#435)

  Show description for 0937f19
  liurenjie1024

  authored
  0937f19

• refactor(io): Split io into smaller mods (#438)

  Show description for 8562708
  Xuanwo

  authored
  8562708

Commits on Jul 6, 2024

• chore: Use once_cell to replace lazy_static (#443)

  Show description for dba6059
  Xuanwo

  authored
  dba6059

• fix: Fix build while no-default-features enabled (#442)

  Show description for 5bfb8bd
  Xuanwo

  authored
  5bfb8bd

Commits on Jul 8, 2024

• chore(deps): Bump crate-ci/typos from 1.22.9 to 1.23.1 (#447)

  Show description for 9603c8a
  dependabot[bot]

  authored
  9603c8a

• docs: Refactor the README to be more user-oriented (#444)

  Show description for 8782665
  

  Xuanwo

  and

  Fokko

  authored
  8782665

Commits on Jul 9, 2024

• feat: Add cargo machete (#448)

  Show description for 48f9e3e
  vaibhawvipul

  authored
  48f9e3e

• chore: Use nightly toolchain for check (#445)

  Show description for 9e1e8eb
  liurenjie1024

  authored
  9e1e8eb

• reuse docker container to save compute resources (#428)

  Show description for 9b8f791
  

  thexiay

  and

  thexiay

  authored
  9b8f791

Commits on Jul 10, 2024

• feat: Add macos runner for ci (#441)

  Show description for 484ef05
  QuakeWang

  authored
  484ef05

Commits on Jul 11, 2024

• chore: remove compose obsolete version (#452) (#454)

  Show description for 53c132c
  yinheli

  authored
  53c132c

Commits on Jul 15, 2024

• Refactor file_io_s3_test.rs (#455)

  fqaiser94

  authored
  8772968

• chore(deps): Bump crate-ci/typos from 1.23.1 to 1.23.2 (#457)

  Show description for b2c5873
  dependabot[bot]

  authored
  b2c5873

• remove binary serialize in literal (#456)

  Show description for 08c46fb
  

  ZENOTME

  and

  ZENOTME

  authored
  08c46fb

• fix: Hms test on macos should use correct arch (#461)

  liurenjie1024

  authored
  0942e3c

Commits on Jul 17, 2024

• Fix ManifestFile length calculation (#466)

  nooberfsh

  authored
  f30d872

Commits on Jul 21, 2024

• chore(deps): Update typed-builder requirement from ^0.18 to ^0.19 (#473)

  Show description for f5b406f
  dependabot[bot]

  authored
  f5b406f

Commits on Jul 23, 2024

• fix: use avro fixed to represent decimal (#472)

  Show description for 244a218
  xxchan

  authored
  244a218

Commits on Jul 25, 2024

• chore(catalog): Deprecate rest.authorization-url in favor of oauth2-server-uri (#480)

  ndrluis

  authored
  4b275a2

• fix: Transform::Day maps to Date rather than Int for consistency with reference implementation (#479)

  Show description for e4d8001
  sdd

  authored
  e4d8001

Commits on Jul 26, 2024

• feat(iceberg): Add memory file IO support (#481)

  Show description for c9ffbce
  Xuanwo

  authored
  c9ffbce

• Add in-memory catalog implementation (#475)

  Show description for 36e128c
  fqaiser94

  authored
  36e128c

• chore: Enable new rust code format settings (#483)

  Show description for 5b3d1d3
  Xuanwo

  authored
  5b3d1d3

• docs: Generate rust API docs (#486)

  Show description for 297a607
  Xuanwo

  authored
  297a607

Commits on Jul 27, 2024

• chore: Fix format of recent PRs (#487)

  Show description for 5056dbb
  Xuanwo

  authored
  5056dbb

• Rename folder to memory (#490)

  fqaiser94

  authored
  de450c8

Commits on Jul 28, 2024

• chore(deps): Bump crate-ci/typos from 1.23.2 to 1.23.5 (#493)

  Show description for aeeaa11
  dependabot[bot]

  authored
  aeeaa11

• View Spec implementation (#331)

  Show description for ab4f69a
  

  c-thiel

  and

  liurenjie1024

  authored
  ab4f69a

Commits on Jul 29, 2024

• fix: Return error on reader task (#498)

  ndrluis

  authored
  79b5650

• chore: Bump OpenDAL to 0.48 (#500)

  Show description for b3c2311
  Xuanwo

  authored
  b3c2311

• add check compatible func for primitive type (#492)

  Show description for c81dd71
  

  ZENOTME

  and

  ZENOTME

  authored
  c81dd71

• refactor(iceberg): Remove an extra config parse logic (#499)

  Show description for 8248c91
  Xuanwo

  authored
  8248c91

• feat: permit Datum Date<->Int type conversion (#496)

  Show description for 869eef1
  sdd

  authored
  869eef1

Commits on Jul 30, 2024

• Add additional S3 FileIO Attributes (#505)

  Show description for e8f8694
  c-thiel

  authored
  e8f8694

• docs: Add links to dev docs (#508)

  Show description for 4df188b
  Xuanwo

  authored
  4df188b

• chore: Remove typo in README (#509)

  Show description for c58e69d
  Xuanwo

  authored
  c58e69d

Commits on Jul 31, 2024

• feat: podman support (#489)

  Show description for 001dfa7
  

  alexyin1

  and

  Alex Yin

  authored
  001dfa7

• feat(table): Add debug and clone trait to static table struct (#510)

  ndrluis

  authored
  bd9eea1

Commits on Aug 3, 2024

• Use namespace location or warehouse location if table location is missing (#511)

  fqaiser94

  authored
  0f7fc20

Commits on Aug 4, 2024

• chore(deps): Bump crate-ci/typos from 1.23.5 to 1.23.6 (#521)

  dependabot[bot]

  authored
  4083f81

Commits on Aug 7, 2024

• Concurrent table scans (#373)

  Show description for abe3a64
  sdd

  authored
  abe3a64

• refactor: replace num_cpus with thread::available_parallelism (#526)

  SteveLauC

  authored
  ded5926

• Fix: MappedLocalTime should not be exposed (#529)

  c-thiel

  authored
  9b4ea11

• feat: Establish subproject pyiceberg_core (#518)

  Show description for 68069e3
  Xuanwo

  authored
  68069e3

Commits on Aug 8, 2024

• fix: complete miss attribute for map && list in avro schema (#411)

  Show description for 5bf9f3c
  

  ZENOTME

  and

  ZENOTME

  authored
  5bf9f3c

Commits on Aug 9, 2024

• arrow/schema.rs: refactor tests (#531)

  Show description for 2daa2c9
  AndreMouche

  authored
  2daa2c9

• feat: initialise SQL Catalog (#524)

  Show description for 80c1399
  callum-ryan

  authored
  80c1399

Commits on Aug 11, 2024

• chore(deps): Bump actions/setup-python from 4 to 5 (#536)

  Show description for 182b20d
  dependabot[bot]

  authored
  182b20d

Commits on Aug 12, 2024

• support session token (#530)

  twuebi

  authored
  bbbea97

Commits on Aug 13, 2024

• Simplify PrimitiveLiteral (#502)

  Show description for 07b7744
  

  ZENOTME

  and

  ZENOTME

  authored
  07b7744

• chore: bump opendal to 0.49 (#540)

  jdockerty

  authored
  596fc37

• feat: support timestamp columns in row filters (#533)

  Show description for c917a87
  sdd

  authored
  c917a87

• fix: don't silently drop errors encountered in table scan file planning (#535)

  sdd

  authored
  c426956

• chore(deps): Update sqlx requirement from 0.7.4 to 0.8.0 (#537)

  Show description for 42235b4
  dependabot[bot]

  authored
  42235b4

• Fix main branch building break (#541)

  liurenjie1024

  authored
  257cdbd

Commits on Aug 14, 2024

• feat: support for gcs storage (#520)

  Show description for cbd1844
  jdockerty

  authored
  cbd1844

• feat: Allow FileIO to reuse http client (#544)

  Show description for 2137f6b
  Xuanwo

  authored
  2137f6b

• docs: Add an example to scan an iceberg table (#545)

  Show description for a3f9aec
  Xuanwo

  authored
  a3f9aec

• Concurrent data file fetching and parallel RecordBatch processing (#515)

  Show description for 2758961
  sdd

  authored
  2758961

• doc: Add statement for contributors to avoid force push as much as possible (#546)

  liurenjie1024

  authored
  68ef766

• chore: Bump datafusion to 41 (#548)

  Show description for 4434909
  Xuanwo

  authored
  4434909

• feat: Partition Binding and safe PartitionSpecBuilder (#491)

  Show description for 9862026
  c-thiel

  authored
  9862026

• Bump to version 0.3.0 (#549)

  Show description for 79711ac
  Xuanwo

  authored
  79711ac

Commits on Aug 16, 2024

• io: add support for role arn and external id s3 props (#553)

  Show description for cb3c8be
  

  Matheus Alcantara

  authored
  cb3c8be

• fix: ensure S3 and GCS integ tests are conditionally compiled only when the storage-s3 and storage-gcs features are enabled (#552)

  sdd

  authored
  a796325

• docs: fix main iceberg example (#554)

  jdockerty

  authored
  1b32a33

• io: add support to set assume role session name (#555)

  Show description for 19af3d3
  mattheusv

  authored
  19af3d3

• test: refactor datafusion test with memory catalog (#557)

  Show description for fcf14ca
  FANNG1

  authored
  fcf14ca

Commits on Aug 17, 2024

• add clean job in Makefile (#561)

  ChinoUkaegbu

  authored
  1731766

Commits on Aug 19, 2024

• docs: Fix build website permission changed (#564)

  Xuanwo

  authored
  4440af6

• Object Cache: caches parsed Manifests and ManifestLists for performance (#512)

  Show description for a1ec0fa
  

  sdd

  and

  liurenjie1024

  authored
  a1ec0fa

• Update the paths (#569)

  Show description for 94adc42
  Fokko

  authored
  94adc42

• docs: Add links for released crates (#570)

  Show description for a4894f9
  Xuanwo

  authored
  a4894f9

• Python: Use hatch for dependency management (#572)

  sungwy

  authored
  9778fe6

Commits on Aug 20, 2024

• Ensure that RestCatalog passes user config to FileIO (#476)

  Show description for e387bdb
  sdd

  authored
  e387bdb

• Move zlib and unicode licenses to allow (#566)

  Show description for 70d5b0b
  Fokko

  authored
  70d5b0b

Commits on Aug 21, 2024

• website: Update links for 0.3.0 (#573)

  Show description for 4da12c5
  Xuanwo

  authored
  4da12c5

• feat(timestamp_ns): Implement timestamps with nanosecond precision (#542)

  Show description for b36d1c6
  Sl1mb0

  authored
  b36d1c6

Commits on Aug 24, 2024

• fix: correct partition-id to field-id in UnboundPartitionField (#576)

  Show description for ba66665
  FANNG1

  authored
  ba66665

Commits on Aug 25, 2024

• fix: Update sqlx from 0.8.0 to 0.8.1 (#584)

  FANNG1

  authored
  f9c92b7

Commits on Aug 26, 2024

• chore(deps): Update typed-builder requirement from 0.19 to 0.20 (#582)

  Show description for 905ebd2
  dependabot[bot]

  authored
  905ebd2

Commits on Aug 27, 2024

• Expose Transforms to Python Binding (#556)

  Show description for ecbb4c3
  sungwy

  authored
  ecbb4c3

Commits on Aug 28, 2024

• chore(deps): Bump crate-ci/typos from 1.23.6 to 1.24.1 (#583)

  dependabot[bot]

  authored
  da08e8d

Commits on Aug 29, 2024

• Table Scan: Add Row Group Skipping (#558)

  Show description for 7aa8bdd
  sdd

  authored
  7aa8bdd

Commits on Sep 3, 2024

• chore: bump crate-ci/typos to 1.24.3 (#598)

  sdlarsen

  authored
  ae75f96

Commits on Sep 5, 2024

• feat: SQL Catalog - namespaces (#534)

  Show description for 620d58e
  callum-ryan

  authored
  620d58e

Commits on Sep 8, 2024

• feat: Add more fields in FileScanTask (#609)

  Show description for cbbd086
  Xuanwo

  authored
  cbbd086

• chore(deps): Bump crate-ci/typos from 1.24.3 to 1.24.5 (#616)

  Show description for ced661f
  dependabot[bot]

  authored
  ced661f

• fix: Less Panics for Snapshot timestamps (#614)

  c-thiel

  authored
  ede4720

• feat: partition compatibility (#612)

  Show description for 5812399
  c-thiel

  authored
  5812399

• feat: SortOrder methods should take schema ref if possible (#613)

  Show description for a5aba9a
  c-thiel

  authored
  a5aba9a

Commits on Sep 9, 2024

• feat: add client.region (#623)

  jdockerty

  authored
  f78c59b

• fix: Correctly calculate highest_field_id in schema (#590)

  liurenjie1024

  authored
  e08c0e5