Package

astraea.spark.rasterframes.experimental.datasource

awspds

Permalink

package awspds

Module support.

Since

5/4/18

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. awspds
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. trait CachedDatasetRelation extends ResourceCacheSupport

    Permalink

    Mix-in for a data source that is cached as a parquet file.

    Mix-in for a data source that is cached as a parquet file.

    Since

    8/24/18

  2. class L8CatalogDataSource extends DataSourceRegister with RelationProvider

    Permalink

    Data source for querying AWS PDS catalog of L8 imagery.

    Data source for querying AWS PDS catalog of L8 imagery.

    Since

    9/28/17

  3. case class L8CatalogRelation(sqlContext: SQLContext, sceneListPath: Path) extends BaseRelation with TableScan with CachedDatasetRelation with LazyLogging with Product with Serializable

    Permalink

    Schema definition and parser for AWS PDS L8 scene data.

    Schema definition and parser for AWS PDS L8 scene data.

    Since

    9/28/17

  4. class L8DataSource extends DataSourceRegister with RelationProvider

    Permalink

    Experiment in providing RasterFrames over whole PDS catalog.

    Experiment in providing RasterFrames over whole PDS catalog.

    Since

    8/21/18

  5. case class L8Relation(sqlContext: SQLContext, useTiling: Boolean, accumulator: Option[ReadCallback], filters: Seq[Filter] = Seq.empty) extends BaseRelation with PrunedFilteredScan with SpatialRelationReceiver[L8Relation] with LazyLogging with Product with Serializable

    Permalink

    Spark relation over AWS PDS Landsat 8 collection.

    Spark relation over AWS PDS Landsat 8 collection.

    Since

    8/21/18

  6. class MODISCatalogDataSource extends DataSourceRegister with RelationProvider with LazyLogging

    Permalink

    DataSource over the catalog of AWS PDS for MODIS MCD43A4 Surface Reflectance data product Param

    DataSource over the catalog of AWS PDS for MODIS MCD43A4 Surface Reflectance data product Param

    See https://docs.opendata.aws/modis-pds/readme.html for details

    Since

    5/4/18

  7. case class MODISCatalogRelation(sqlContext: SQLContext, sceneList: Path) extends BaseRelation with TableScan with CachedDatasetRelation with LazyLogging with Product with Serializable

    Permalink

    Constructs a dataframe from the available scenes

    Constructs a dataframe from the available scenes

    Since

    5/4/18

  8. trait PDSFields extends AnyRef

    Permalink

    Standard column names

    Standard column names

    Since

    8/21/18

  9. trait ResourceCacheSupport extends DownloadSupport

    Permalink

    Support for downloading scene files from AWS PDS and caching them.

    Support for downloading scene files from AWS PDS and caching them.

    Since

    5/4/18

Value Members

  1. object L8CatalogDataSource extends LazyLogging with ResourceCacheSupport

    Permalink
  2. object L8CatalogRelation extends PDSFields with Serializable

    Permalink
  3. object L8DataSource

    Permalink
  4. object L8Relation extends PDSFields with Serializable

    Permalink
  5. object MODISCatalogDataSource extends LazyLogging with ResourceCacheSupport

    Permalink
  6. object MODISCatalogRelation extends PDSFields with Serializable

    Permalink
  7. object PDSFields extends PDSFields

    Permalink
  8. def l8_band_url(bandID: String): TypedColumn[Any, String]

    Permalink

    Constructs link with the form: https://s3-us-west-2.amazonaws.com/landsat-pds/c1/L8/149/039/LC08_L1TP_149039_20170411_20170415_01_T1/LC08_L1TP_149039_20170411_20170415_01_T1_{bandId].TIF

    Constructs link with the form: https://s3-us-west-2.amazonaws.com/landsat-pds/c1/L8/149/039/LC08_L1TP_149039_20170411_20170415_01_T1/LC08_L1TP_149039_20170411_20170415_01_T1_{bandId].TIF

    bandID

    Band ID suffix, e.g. "B4"

Inherited from AnyRef

Inherited from Any

Ungrouped