Notes
Performance of Showbie is what I’m concerning. Should raise this first to the team and ask for approach.
- Either we should be prepared for blaming question in worst case like why Holistics runs so slow?
- Raised this with anh Huy: https://holistics.slack.com/archives/C08EN0G719N/p1774609569429499
- We just wait for the next call and ask them, then spend time investigating later.
Tried Zed IDE, not supporting ampcode, and I’m more familiar with terminal-based IDE like neovim. Not suitable for me.
Tasks
Partly today
- DONE Eliminate bridge
DONE Ingest countries data into Retailers table
- Unused stored procedures on Redshift:
sp_load_price_history_by_partition(×2 overloads): Usesatc_price_history_partitions_to_load(48K rows) and writes toatc_price_history. Superseded bysp_refresh_daily_prices. Not called by any other SP. Not in local repo.sp_refresh_serving_from_rds: Wrapper calling Layer 0 transforms only (retailer, brand, pricing, master_product, ads, category, scopes). Subset ofsp_run_all. Not called by any SP. Not in local repo.sp_refresh_price_history_from_s3: Wrapper for daily prices + downstream. Now saved locally.
- Also found orphan tables not referenced by any SP:
PriceHistory,atc_price_history_native(21.4M rows),atc_price_history_tmp,atc_daily_min_price,retailer_current_pricing_backup,_brand_to_product_group,_prisma_migrations,ad_suggested_,match_suggestion,suggestion_details,mv_tbl__ - Running out of time (end of the day) and ampcode token (I use it for heavy tasks), delay to monday morning to be more productive.
- Ensure every SPs are analyzed.
- Progress update on [[2026-03-30]]:
- Done:
- Phase 0: Snapshot baseline tables (
_migration_baseline,_bridge_backup) created on Redshift - Phase 1: Added
retailer_id+retailer_current_pricing_skeycolumns toatc_price_history, backfilled ~27M rows (75.7% coverage). Bridge parity gap: 8,713 keys (all Chemist Disount Center near-miss — documented) - Phase 2: Deployed 5 updated SPs to Redshift (
sp_refresh_daily_prices,sp_refresh_atc_price_history_enrich,sp_run_all,sp_refresh_price_history_from_s3,sp_validate). Ransp_run_all()and validated — enriched table at 12.1M rows, join path works without bridge - Phase 3: 7 commits on
feat/eliminate-bridge-aml— removed bridge from all 4 datasets +market_price_rankmodel, added directrcp_skeyrelationships, deleted agg model, updatedAGENTS.md. - Pushed to Holistics, dashboards are rendered correctly.
- Phase 0: Snapshot baseline tables (
- Phase 4: Soak 1–2 days — monitor dashboards end-to-end through the bridgeless path
- Phase 5: Drop bridge/agg tables + SPs on Redshift, delete
public_bridge_product_retailer.model.aml, clean up migration artifacts.
- Done:
- ((69c2a77c-6fed-4d3b-a071-491d0d1505f0))
- Unused stored procedures on Redshift:
Done
- DONE Onboarding call 1 with innerspace.io
Prepare:
- Ask them provide a branding guideline for us to custom theme.
- Demo version control and branching, show the strength of as-code files compared to GoodData.
- Send custom chart library github link: https://github.com/holistics/custom-chart-library/tree/main
- Email subscription (not shown yet).
- Schedule next onboarding session in the call.
- Regarding JS event, this is in backlog and will push prioritization if they buy.
Debrief:
- The call went really smooth.
- I feel these people really know what they are doing. They dont ask us to explain again, but just ask things on high-level to evaluate the tool’s capabilities.
- Pretty impressive.
- My speaking and confidence increase after the call.