-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Read Multiplex Band Support #698
Read Multiplex Band Support #698
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is a major logic problem with the implementation that would yield incorrect results for non-trivial cases. The test does not reveal it because it uses only two files as input. This input is small enough that they will never be split by a partition.
Although a little outdated now here is an example of a required approach:
- Generate
RasterRegions
perSpatialKey
- perform shuffle by key to co-locate all spatially overlapping input
- "sort"
RasterRegions
by key to get the right band order.
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
geopyspark-backend/geotrellis/src/main/scala/geopyspark/geotrellis/vlm/RasterSource.scala
Outdated
Show resolved
Hide resolved
…g is done when reading in and formatting the data
…e when reading in and formatting the data
f8c2538
to
b4783bc
Compare
This PR adds multiplex band support to the
TiledRasterLayer.read
method. Now, it'll be possible to read in separate files as a single multiband. This is useful in cases where individual bands are split into separate files. In addition to combing multiple bands into a single tile, it's also possible to specify their order. In order to support band multiplexing, a new type:SourceInfo
has been created.Note: This PR depends on an unmerged PR: geotrellis/geotrellis-contrib#111 to work.