Senior Databricks Data Engineer — Remote Lakehouse Builder

AgileEngine, LLC. is seeking an experienced Senior Data Engineer to help modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers.

You will use Claude and GitHub Copilot to accelerate development, write tests, and create documentation, while collaborating in Agile teams and with DevOps for observability and security.