Packages

package asn1

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Package Members

  1. package codec
  2. package model
  3. package parser
  4. package reader
  5. package schema
  6. package util
  7. package writer

Type Members

  1. class Asn1DataSource extends FileFormat with DataSourceRegister

    Spark FileFormat data source for ASN.1-encoded files.

    Spark FileFormat data source for ASN.1-encoded files.

    Usage:

    spark.read
  .format("asn1")
  .option("asn1.schema", "/path/to/Schema.asn1")
  .option("asn1.type", "MyMessage")
  .option("asn1.encoding", "ber")  // ber | der | per-aligned | per-unaligned | xer
  .load("/data/messages.ber")

    Splitting large files

    BER/DER files become splittable once a sidecar index is present:

    import io.github.sparkasn1.spark.asn1.util.Asn1Indexer
Asn1Indexer.buildIndex(new Path("/data/messages.ber"), spark.sparkContext.hadoopConfiguration)
// Now spark.read.format("asn1")…load("/data/messages.ber") uses multiple tasks

    PER fixed-length files are always splittable without an index.

Value Members

  1. object Asn1DataSourceOptions

    Keys and defaults for all spark-asn1 reader / writer options.

Ungrouped