Chinh (lelouvincx) / 2026-03-27

Created Fri, 27 Mar 2026 00:00:00 +0000 Modified Mon, 25 May 2026 06:02:25 +0000
446 Words

Notes

  • Performance of Showbie is what I’m concerning. Should raise this first to the team and ask for approach.

  • Tried Zed IDE, not supporting ampcode, and I’m more familiar with terminal-based IDE like neovim. Not suitable for me.

  • Tasks

  • Partly today

    • DONE Eliminate bridge
  • DONE Ingest countries data into Retailers table

    • Unused stored procedures on Redshift:
      • sp_load_price_history_by_partition (×2 overloads): Uses atc_price_history_partitions_to_load (48K rows) and writes to atc_price_history. Superseded by sp_refresh_daily_prices. Not called by any other SP. Not in local repo.
      • sp_refresh_serving_from_rds: Wrapper calling Layer 0 transforms only (retailer, brand, pricing, master_product, ads, category, scopes). Subset of sp_run_all. Not called by any SP. Not in local repo.
      • sp_refresh_price_history_from_s3: Wrapper for daily prices + downstream. Now saved locally.
    • Also found orphan tables not referenced by any SP: PriceHistory, atc_price_history_native (21.4M rows), atc_price_history_tmp, atc_daily_min_price, retailer_current_pricing_backup, _brand_to_product_group, _prisma_migrations, ad_suggested_, match_suggestion, suggestion_details, mv_tbl__
    • Running out of time (end of the day) and ampcode token (I use it for heavy tasks), delay to monday morning to be more productive.
    • Ensure every SPs are analyzed.
    • Progress update on [[2026-03-30]]:
      • Done:
        • Phase 0: Snapshot baseline tables (_migration_baseline, _bridge_backup) created on Redshift
        • Phase 1: Added retailer_id + retailer_current_pricing_skey columns to atc_price_history, backfilled ~27M rows (75.7% coverage). Bridge parity gap: 8,713 keys (all Chemist Disount Center near-miss — documented)
        • Phase 2: Deployed 5 updated SPs to Redshift (sp_refresh_daily_prices, sp_refresh_atc_price_history_enrich, sp_run_all, sp_refresh_price_history_from_s3, sp_validate). Ran sp_run_all() and validated — enriched table at 12.1M rows, join path works without bridge
        • Phase 3: 7 commits on feat/eliminate-bridge-aml — removed bridge from all 4 datasets + market_price_rank model, added direct rcp_skey relationships, deleted agg model, updated AGENTS.md.
        • Pushed to Holistics, dashboards are rendered correctly.
      • Phase 4: Soak 1–2 days — monitor dashboards end-to-end through the bridgeless path
      • Phase 5: Drop bridge/agg tables + SPs on Redshift, delete public_bridge_product_retailer.model.aml, clean up migration artifacts.
    • ((69c2a77c-6fed-4d3b-a071-491d0d1505f0))
  • Done

    • DONE Onboarding call 1 with innerspace.io
  • Prepare:

    • Ask them provide a branding guideline for us to custom theme.
    • Demo version control and branching, show the strength of as-code files compared to GoodData.
    • Send custom chart library github link: https://github.com/holistics/custom-chart-library/tree/main
    • Email subscription (not shown yet).
    • Schedule next onboarding session in the call.
    • Regarding JS event, this is in backlog and will push prioritization if they buy.
  • Debrief:

    • The call went really smooth.
    • I feel these people really know what they are doing. They dont ask us to explain again, but just ask things on high-level to evaluate the tool’s capabilities.
    • Pretty impressive.
    • My speaking and confidence increase after the call.