Data Management (DM) Department

SLAC hosts multiple user facilities and participates in scientific collaborations which generate experimental data. SCS Data Management provides solutions to register, transport, archive, and distribute these data. Workflow management coordinates automated analysis both at SLAC’s S3DF and other DOE compute facilities like NERSC. These solutions are composable and scalable to the needs of the user or collaboration, and are designed to operate securely in multi-tenancy environments. To provide these tools, the SCS DM team has expertise in REST web services, database clusters, file catalogs (like iRods and Rucio), middleware like Kafka, and containers and container orchestration (Docker, Kubernetes, etc.)