Skip to main content

Orchestration / ETL

CCC ETL Capabilities

Version: DEV

IDTitleDescriptionThreat Mappings
CCC.ETL.CP01Batch ProcessingSupports the processing of bounded (batch) data sources using a consistent programming model or engine.0
CCC.ETL.CP02Stream ProcessingSupports the processing of unbounded (streaming) data sources using a consistent programming model or engine.0
CCC.ETL.CP03Schema EvolutionAutomatically detects source data structures and manages changes in schema (e.g., column additions) over time without pipeline failure.0
CCC.ETL.CP04Distributed Data ShufflingProvides an internal service to re-partition and group data across distributed workers for complex operations like joins and aggregations.0
CCC.ETL.CP05Windowing and Event-Time ProcessingEnables grouping of data based on time attributes, supporting tumbling, hopping, and session windows with late-data handling (watermarking).0
CCC.ETL.CP06Change Data Capture (CDC) IntegrationSupports incremental data ingestion by tracking changes in source transaction logs rather than full table scans.0
CCC.ETL.CP07Connectivity and Connector LibraryProvides pre-built, managed connectors for a variety of sources and sinks (e.g., Object Storage, RDBMS, NoSQL, Pub/Sub).0
CCC.ETL.CP08Job BookmarksPersists the state of a processing job (e.g., checkpointing or bookmarks) to ensure exactly-once processing and fault tolerance.0
CCC.ETL.CP09Pushdown OptimizationThe ability to translate transformation logic into the native language of the source or sink (e.g., SQL) to minimize data movement.0
CCC.ETL.CP10Visual OrchestrationProvides a graphical interface to define dependencies between extraction, transformation, and loading tasks.0
CCC.ETL.CP11Data Lineage & Metadata TrackingCaptures and exports metadata regarding the data sources, the transformation steps, and the final destination (sink), showing the flow from source to destination for compliance and debugging.0
CCC.ETL.CP12User-Defined Function (UDF) SupportAllows developers to inject custom logic (Python, Java, SQL) into the managed processing pipeline for complex transformations.0
CCC.ETL.CP13Time-Based Job TriggeringSupports time-based (cron) mechanisms to initiate data processing workflows.0
CCC.ETL.CP14Event Based Job TriggeringSupports event-based (file arrival) mechanisms to initiate data processing workflows.0

Imports

IDRemarks
CCC.Core.CP01Encryption in Transit
CCC.Core.CP02Encryption at Rest
CCC.Core.CP03Access Log Publication
CCC.Core.CP06Access control
CCC.Core.CP07Event Publication
CCC.Core.CP09Metrics Publication
CCC.Core.CP10Log Publication
CCC.Core.CP14API Access
CCC.Core.CP18Resource Versioning
CCC.Core.CP20Resource Tagging
CCC.Core.CP23Network Access Rules
CCC.Core.CP28Command-line Interface
CCC.Core.CP29Active Ingestion
CCC.Core.CP31Elastic Scaling