Class

com.swoop.spark.records

CompositeRecordBuilder

Related Doc: package records

Permalink

abstract class CompositeRecordBuilder[BuildInput, RecordInput, Rec <: Record[_, _], Ctx <: JobContext] extends RecordBuilderLike[Rec, Ctx]

Base class for record builders that produce multiple records for one input.

BuildInput

The input type for the builder.

RecordInput

The input type records are built from.

Rec

The record type.

Ctx

The job context type

See also

NestedRecordBuilder

Composite Builders

Linear Supertypes
RecordBuilderLike[Rec, Ctx], ThrowsErrors, HasJobContext[Ctx], BuildsRecords[Rec], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CompositeRecordBuilder
  2. RecordBuilderLike
  3. ThrowsErrors
  4. HasJobContext
  5. BuildsRecords
  6. Serializable
  7. Serializable
  8. AnyRef
  9. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CompositeRecordBuilder(input: BuildInput, jobContext: Ctx)

    Permalink

    input

    The input data for building the record.

    jobContext

    the job context

Abstract Value Members

  1. abstract def buildRecords(fn: (RecordInput) ⇒ TraversableOnce[Rec]): TraversableOnce[Rec]

    Permalink

    Builds the records from the input by partitioning the build input and invoking the provided function, which builds each record.

    Builds the records from the input by partitioning the build input and invoking the provided function, which builds each record.

    Attributes
    protected

  2. abstract def errorRecord(issues: Seq[Issue]): Rec

    Permalink

    Builds an error record.

    Builds an error record. Should never throw an exception.

    Attributes
    protected
    Definition Classes
    RecordBuilderLike

  3. abstract def recordBuilder(singleRecordInput: RecordInput): BuildsRecords[Rec]

    Permalink

    Returns a record builder for building each record.

    Returns a record builder for building each record.

    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. def +(other: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to any2stringadd[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd

  4. def ->[B](y: B): (CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to ArrowAssoc[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()

  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  7. def build: TraversableOnce[Rec]

    Permalink

    Returns the records built from the input.

    Returns the records built from the input.

    This is the main public API for builder clients.

    Definition Classes
    CompositeRecordBuilder → BuildsRecords

  8. def buildPartition(recordInput: RecordInput): TraversableOnce[Rec]

    Permalink
    Attributes
    protected

  9. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  10. def collectInputStatistics(): Unit

    Permalink

    Called once for each top-level build() call for AnyRecordBuilder.

    Called once for each top-level build() call for AnyRecordBuilder.

    Attributes
    protected
    Definition Classes
    RecordBuilderLike

  11. def collectIssueStats(record: Rec): Unit

    Permalink

    Called every time a record is emitted, independent of whether it has data or not and whether it is an error or not.

    Called every time a record is emitted, independent of whether it has data or not and whether it is an error or not.

    Will not be called on skipped records.

    record

    The record about to be emitted.

    Attributes
    protected
    Definition Classes
    RecordBuilderLike

  12. def collectUnhandledExceptionStatistics(record: Rec, ex: Throwable): Unit

    Permalink

    Called when there is an internal error as part of record building.

    Called when there is an internal error as part of record building.

    An error issue will be created for this exception and collectIssueStats will take it into account. This method is called in order to specifically capture statistics about this internal error.

    record

    The record with the unhandled exception in issues.

    ex

    The unhandled exception.

    Attributes
    protected
    Definition Classes
    RecordBuilderLike

  13. def ensuring(cond: (CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]) ⇒ Boolean, msg: ⇒ Any): CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to Ensuring[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  14. def ensuring(cond: (CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]) ⇒ Boolean): CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to Ensuring[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  15. def ensuring(cond: Boolean, msg: ⇒ Any): CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to Ensuring[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  16. def ensuring(cond: Boolean): CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to Ensuring[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  17. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  18. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  19. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  20. def formatted(fmtstr: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to StringFormat[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()

  21. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  22. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  23. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  24. def jc: Ctx

    Permalink

    Shorthand for jobContext.

    Shorthand for jobContext.

    Definition Classes
    HasJobContext

  25. val jobContext: Ctx

    Permalink

    the job context

    the job context

    Definition Classes
    CompositeRecordBuilder → HasJobContext

  26. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  27. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  28. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  29. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  30. def throwError(message: String, messageId: Int, cause: Throwable): Nothing

    Permalink
    Definition Classes
    ThrowsErrors

  31. def throwError(message: String, detail: String, messageId: Int, cause: Throwable): Nothing

    Permalink
    Definition Classes
    ThrowsErrors

  32. def throwError(message: String, messageId: Int): Nothing

    Permalink
    Definition Classes
    ThrowsErrors

  33. def throwError(message: String, detail: String, messageId: Int): Nothing

    Permalink
    Definition Classes
    ThrowsErrors

  34. def throwError(message: String): Nothing

    Permalink
    Definition Classes
    ThrowsErrors

  35. def throwError(message: String, detail: String): Nothing

    Permalink
    Definition Classes
    ThrowsErrors

  36. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  37. def unhandledException(ex: Throwable): Rec

    Permalink

    Returns an error record for an unhandled exception.

    Returns an error record for an unhandled exception. Collects unhandled error metrics.

    Attributes
    protected
    Definition Classes
    CompositeRecordBuilder → RecordBuilderLike

  38. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  39. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  40. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  41. def →[B](y: B): (CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to ArrowAssoc[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from RecordBuilderLike[Rec, Ctx]

Inherited from ThrowsErrors

Inherited from HasJobContext[Ctx]

Inherited from BuildsRecords[Rec]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to any2stringadd[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]]

Inherited by implicit conversion StringFormat from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to StringFormat[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]]

Inherited by implicit conversion Ensuring from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to Ensuring[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]]

Inherited by implicit conversion ArrowAssoc from CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx] to ArrowAssoc[CompositeRecordBuilder[BuildInput, RecordInput, Rec, Ctx]]

Ungrouped