Package

astraea.spark.rasterframes.experimental.datasource

awspds

Permalink

package awspds

Module support.

Since

5/4/18

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. awspds
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class DownloadExpression(child: Expression, colPrefix: String) extends UnaryExpression with Generator with CodegenFallback with GeoTiffInfoSupport with DownloadSupport with LazyLogging with Product with Serializable

    Permalink

    Downloads data from URL and stores it in a column.

    Downloads data from URL and stores it in a column.

    Since

    5/4/18

  2. trait DownloadSupport extends AnyRef

    Permalink

    Common support for downloading data.

    Common support for downloading data.

    Since

    5/5/18

  3. case class DownloadTilesExpression(child: Expression, colPrefix: String) extends UnaryExpression with Generator with CodegenFallback with GeoTiffInfoSupport with StandardEncoders with DownloadSupport with LazyLogging with Product with Serializable

    Permalink

    Catalyst generator to convert a geotiff download URL into a series of rows containing the internal tiles and associated extents.

    Catalyst generator to convert a geotiff download URL into a series of rows containing the internal tiles and associated extents.

    Since

    5/4/18

  4. class L8CatalogDataSource extends DataSourceRegister with RelationProvider

    Permalink

    Data source for querying AWS PDS catalog of L8 imagery.

    Data source for querying AWS PDS catalog of L8 imagery.

    Since

    9/28/17

  5. case class L8CatalogRelation(sqlContext: SQLContext, sceneListPath: Path) extends BaseRelation with TableScan with LazyLogging with Product with Serializable

    Permalink

    Schema definition and parser for AWS PDS L8 scene data.

    Schema definition and parser for AWS PDS L8 scene data.

    Since

    9/28/17

  6. class MODISCatalogDataSource extends DataSourceRegister with RelationProvider with LazyLogging

    Permalink

    DataSource over the catalog of AWS PDS for MODIS MCD43A4 Surface Reflectance data product Param

    DataSource over the catalog of AWS PDS for MODIS MCD43A4 Surface Reflectance data product Param

    See https://docs.opendata.aws/modis-pds/readme.html for details

    Since

    5/4/18

  7. case class MODISCatalogRelation(sqlContext: SQLContext, sceneList: Path) extends BaseRelation with TableScan with LazyLogging with Product with Serializable

    Permalink

    Constructs a dataframe from the available scenes

    Constructs a dataframe from the available scenes

    Since

    5/4/18

  8. trait ResourceCacheSupport extends DownloadSupport

    Permalink

    Support for downloading scene files from AWS PDS and caching them.

    Support for downloading scene files from AWS PDS and caching them.

    Since

    5/4/18

Value Members

  1. object L8CatalogDataSource extends LazyLogging with ResourceCacheSupport

    Permalink
  2. object MODISCatalogDataSource extends LazyLogging with ResourceCacheSupport

    Permalink
  3. def download(urlColumn: Column): TypedColumn[Any, Array[Byte]]

    Permalink
  4. def download_tiles(urlColumn: Column): Column

    Permalink
  5. def modis_band_url(bandID: String): TypedColumn[Any, String]

    Permalink

    Constructs link with the form: https://modis-pds.s3.amazonaws.com/MCD43A4.006/23/15/2013003/MCD43A4.A2013003.h23v15.006.2016125143738_${bandID}.TIF

    Constructs link with the form: https://modis-pds.s3.amazonaws.com/MCD43A4.006/23/15/2013003/MCD43A4.A2013003.h23v15.006.2016125143738_${bandID}.TIF

    bandID

    Band ID suffix, e.g. "B04"

Inherited from AnyRef

Inherited from Any

Ungrouped