The objective of the project is to refine the master data stored in Databricks into a format suitable for reporting and to build reports directly on top of Databricks. The source system is Autodesk Fusion Lifecycle Management, whose data has already been integrated into Databricks.
The data follows the Medallion model (Bronze–Silver–Gold). Bronze and Silver tables already exist, but Gold-level reporting views and models require further development. The data is sensitive/confidential and includes a broad product portfolio (~40,000 items), product structures, and pricing information, and it requires cleansing and standardization before broader reporting use.
There is a need for an experienced Databricks expert who can:
- refine the data for reporting use with Databricks Medallion (Bronze–Silver–Gold)
- build reports directly in Databricks or from Databricks to Power BI
- guide and train end users (engineers, business users, Excel-oriented users) in using the data and creating reports
- support the later use of AI/ML solutions in Databricks.