Welcome to Data Engineering (Spring 2023)#

This book contains supplementary material for the CSCI 498A Special Topics course on Data Engineering taught in Spring 2023.

HPC Cluster#

The HPC cluster for class can be accessed at https://wendian-ondemand.mines.edu/

Course Python Package#

A Python package, mines-data-engineering, provides utilities for working with external and background services such as databases. The package is designed to work with the Mines HPC Services and may not work on local machines. It is highly recommended to use the mines-data-engineering package in conjunction with the provided Jupyter environment to complete assignments in this course.