EGTS Product & Operator Guide
Authoritative documentation for all 29 product areas: workflows, models, alert delivery, system architecture, and safety boundaries.
1. Getting Started
An introduction to the EGTS market intelligence platform, designed for institutional-grade screening and research across Indian equities without broker order execution.
Provides a structured starting point so new operators and analysts can navigate the platform safely and effectively.
- EGTS is strictly an analytical intelligence platform β NO broker order execution takes place.
- Model Setup Scores rank candidates by indicator confluence; they are NOT guaranteed win probabilities.
- Single-writer architecture: the Control Plane handles all autonomous data generation.
2. Daily Workflow
A standardized chronological 4-stage daily routine: Pre-Market (08:30β09:15), Intraday Monitoring (09:15β15:30), Post-Close Analysis (15:45β17:00), and Weekend Review.
Prevents reactive decision-making and ensures disciplined interaction with quantitative market intelligence.
- Autonomous EOD runs automatically post-close (16:00 IST) β manual pipeline execution is NOT required.
- Always check Market Breadth in Insights before initiating new aggressive swing setups.
3. Discover
The flagship opportunity discovery surface displaying precomputed, model-ranked candidate boards tailored for 4 distinct time horizons: Swing, Positional, Long Term, and Intraday.
Eliminates the need for manual parameter filtering by precomputing multi-factor technical setups across the entire 8,400+ equity universe.
- Discover vs Scanner: Discover is curated and precomputed; Scanner allows custom multi-parameter screening.
- Displayed Count (Top-N): Limits card display to the top 15 candidates; total candidates may be higher.
4. Scanner
Interactive quantitative screening engine allowing operators and analysts to customize strategy criteria, technical indicator thresholds, and sub-universe filters.
Empowers deep quantitative research by exposing underlying strategy rules, moving average filters, and momentum parameters.
- Evaluated Scope: Number of securities examined after universe eligibility gates.
- Hard Filter Qualified: Number of securities satisfying all mandatory technical criteria.
- Top-N Displayed: The subset of qualified candidates displayed on the page (default 20, 50, 100).
- Top-N limits UI rendering only; it never truncates universe evaluation!
5. Stock Intelligence
Deep-dive analytical intelligence dossier for an individual security, featuring multi-timeframe charts, technical indicators, pivot targets, invalidation stops, and corporate history.
Provides complete 360-degree technical and contextual diligence before committing capital.
- All levels (Target, Stop, Pivot) are analytical references, NOT trade recommendations.
- Dual-listed securities display unified company identity with NSE/BSE toggle.
6. Watchlists
User-curated portfolios and monitoring lists for organizing securities of interest.
Allows focused observation of prioritized candidates without searching repeatedly.
- CRITICAL INVARIANT: Adding a stock to a watchlist does NOT automatically deliver Telegram alerts!
- Telegram delivery requires configuring an alert rule or recipient group subscription.
7. Alerts
Centralized operational intelligence feed aggregating all quantitative signals, corporate filings, earnings announcements, corporate actions, and system health events.
Consolidates diverse market events into a single prioritized, searchable stream.
- Alert Generated != Telegram Sent: All alerts appear here in the web feed even when Telegram is in DRY_RUN!
- Mark Read (Acknowledgment) archives items from unread counts without deleting history.
8. Alert Types
Authoritative reference defining all 41 supported EGTS alert types across technical signals, financial results, corporate actions, and system health.
Eliminates ambiguity so analysts know exactly what generated an event, why it matters, and what to do next.
- MATERIAL_CORPORATE_EVENT: High-materiality disclosures passing regulatory significance gates.
- QUARTERLY_RESULT vs RESULTS_AVAILABLE: Result is the filing event; Available confirms normalized statements are parsed.
- DAILY_RECENT_TOP: Flags top setups in newly listed equities / IPOs.
9. Custom Rules
Interactive rule builder allowing operators and users to create personalized alert triggers based on setup board, score, volume, and moving averages.
Tailors intelligence delivery to individual trading styles and specific watchlist criteria.
- Rule evaluation is completely safe and operates in DRY_RUN baseline.
- Destructive action: Deleting a rule opens a confirmation dialog detailing permanent removal.
10. Telegram Recipients
Recipient management console for binding Telegram accounts, managing group memberships (TRADER, ADMIN, OPERATIONS), and setting quiet hours.
Ensures alerts reach the correct team members with appropriate severity filtering and zero notification spam.
- Zero Secret Leaks: Bot tokens and full chat IDs are never serialized to the client browser.
- Admin Mirror: Operators in group ADMIN automatically receive mirrored critical system alerts.
- Destructive action: Deleting a recipient prompts for confirmation stating delivery will cease.
11. Telegram Modes
Hierarchical 4-tier production delivery safety gate: DRY_RUN, TEST_RECIPIENT (Canary only), LIMITED_LIVE (Authoritative Dispatch to verified Admin/Operators), and LIVE (Full broadcast).
Prevents accidental notification blasts to traders or clients during testing, staging, and maintenance.
- DRY_RUN: Simulation mode. Evaluates rules, populates Outbox simulation, logs audit trail, but makes ZERO external network requests.
- TEST_RECIPIENT: Dispatches ONLY to recipients with is_test_recipient = True (Canary).
- LIMITED_LIVE (Authoritative): Dispatches critical operational alerts and qualified events strictly to verified Admin/Operator recipients.
- LIVE: Full multi-recipient broadcast mode.
- Legacy CP Adapter: Legacy control-plane notification adapter may still report DRY_RUN; do not confuse it with authoritative LIMITED_LIVE alert dispatch.
12. Delivery Outbox & Audit
Transactional FIFO delivery queue and historical audit ledger tracking every generated message, matched recipient, suppression reason, and dispatch attempt.
Provides complete forensic auditability for every notification generated by the platform.
- Pending Outbox in DRY_RUN: Items are staged for simulation. No external Telegram delivery occurs while mode is DRY_RUN.
- Suppression Reasons: Documented transparently (e.g. 'Below minimum severity', 'Quiet hours', 'Cooldown active').
- SAFETY DEFECT NOTE: Old pending items from dry runs must be cleared before mode promotion to prevent sudden dispatch.
13. Intelligence Digests
Scheduled consolidated briefing engine grouping multiple domain events into one structured report (Morning Brief, Hourly Market Movers, Daily EOD Summary).
Reduces notification fatigue by bundling hundreds of individual alerts into periodic high-level intelligence summaries.
- Digest vs Alert Feed: Feed is real-time and granular; Digest is scheduled and consolidated.
- Freshness Transparency: If the latest generated digest session is older than platform EOD, the UI explicitly displays a STALE warning badge.
14. Insights
Macro and market-wide intelligence cockpit featuring 7 specialized analytical panels: Market Regime, Sector Relative Strength, Advance-Decline Breadth, Volatility Regimes, Fundamentals Availability, Historical Simulation, and System Anomalies.
Prevents isolated stock picking by contextualizing setups within macro market breadth and sector flows.
- System Anomalies panel reports operational data and runtime anomalies β it is NOT a trading recommendation!
- Model Score is a ranking metric, NOT a calibrated win probability.
15. Fundamentals / Context Availability
Authoritative architectural explanation of the three distinct fundamentals and disclosure layers in EGTS.
Clarifies why 'Source Registry Not Configured' does NOT mean zero usable fundamentals exist in EGTS.
- Layer A (Live Streaming Provider Registry): NOT COMMISSIONED / SOURCE LIMITED (0/4 active streaming feeds in production baseline).
- Layer B (Materialized Offline Fundamentals): PARTIALLY AVAILABLE (Normalized financial statements, shareholdings, and ratios are preserved offline for covered equities like TCS).
- Layer C (Corporate Disclosure Stream): AVAILABLE (Filings, results, and corporate actions processed during scan passes).
16. System Overview
Executive operations cockpit displaying overall platform health, release SHA identity, session alignment, and subsystem statuses.
Provides single-pane-of-glass operational visibility for operators and system administrators.
- Frontend and Backend SHA must match for release consistency.
- Platform EOD session defines the canonical mathematical baseline for all scanner calculations.
17. Architecture
Architectural blueprint detailing the end-to-end data pipeline from Raw Exchange Feeds β Silver Parquet β Gold Analytics β PublicationCURRENT β FastAPI β Next.js Frontend.
Documents data immutability, directory isolation, and single-writer boundaries.
- Immutability: Parquet partitions are write-once per session.
- Atomic Publication: Data is promoted to `data/publication/CURRENT` atomically via manifest symlinks.
18. Dependencies / Lineage
Granular dependency graph and artifact lineage tracker showing which raw datasets produce which analytical outputs.
Ensures that if an upstream data defect occurs, operators can trace every affected downstream metric.
- Every candidate board traces back to specific parquet partitions and publication fingerprints.
19. Listings
Unified master equity taxonomy managing current and historical NSE/BSE listings through ISIN and company identity frameworks.
Prevents duplicate company accounting and handles dual-listed stocks without conflating security and company counts.
- Shared Company Entity: TCS on NSE and TCS on BSE map to canonical company entity `comp-tcs`.
- Dual-listed stocks share fundamental filings while maintaining independent exchange order books.
20. Operations & Control Plane
The single-writer autonomous operations daemon (`egts-control-plane`) responsible for scheduled pipeline execution, health monitoring, and session management.
Guarantees race-free data processing by enforcing single-writer locks across all data partitions.
- LEGACY SCHEDULER MASKED/OFF = GOOD: The legacy egts-scheduler systemd service is intentionally disabled to avoid dual-writer race conditions!
- NEVER instruct anyone to start egts-scheduler!
- Control Plane owns all internal scheduling autonomously.
21. System Alerts
Automated operational health and exception alerts generated by the platform watchdog (Pipeline failures, feed degradations, disk warnings, stale data).
Ensures operators are immediately alerted to infrastructure or data quality anomalies before users notice.
- System alerts are automatically mirrored to Admin Telegram recipients when configured.
- CRITICAL alerts indicate that operator intervention is required.
22. Runbook
Authoritative operator runbook containing standard operational procedures, diagnostic terminal commands, backup/restore sequences, and recovery actions.
Ensures consistent, safe operations without improvising terminal commands during incidents.
- Commands must be executed from the workspace root.
- Never run modifying commands without verifying current READ_ONLY and single-writer locks.
23. Data Freshness
Data freshness governance framework defining update SLAs, session schedules, and staleness detection across all data tiers.
Guarantees that users never make decisions on outdated or misleading historical prices.
- Platform EOD Session: The latest official exchange session incorporated into the analytical model.
- Closed Market: Over weekends and exchange holidays, data remains at the latest traded session β this is NORMAL and not a bug!
24. Sessions / CURRENT / LKG
Atomic publication and rollback architecture managing transitions between session publications, CURRENT pointers, and Last Known Good (LKG) states.
Ensures that a failed EOD pipeline never leaves the platform in a corrupted or half-baked state.
- CURRENT: The active verified publication manifest symlink serving production API requests.
- LKG (Last Known Good): The previous fully validated session preserved as a fallback rollback target.
- Publication Gate: Enforces 8 mathematical and taxonomy invariants before promoting new data to CURRENT.
25. Common Terms
Authoritative terminology glossary containing 42+ standardized definitions across quantitative modeling, data governance, operations, and Telegram routing.
Establishes a single unambiguous vocabulary for all engineers, operators, and quantitative analysts.
- Every term includes formal backend semantics explaining exactly how it is computed in the source code.
Interactive Glossary Explorer
The total canonical collection of all known listed equity securities across NSE and BSE.
Authoritative immutable parquet store tracking current and historical securities with distinct status populations.Listings that have verifiable source records present in active exchange master files or historical archives.
Securities having raw Bhavcopy archives or exchange master records present on disk.Active equity securities currently traded on the exchange with valid trading status.
Listings with active trading status, excluding suspended, delisted, or uncommissioned series.Securities meeting baseline operational and exchange requirements.
Active equity series (EQ, BE, A, B) with valid ISINs and sufficient historical depth.The deterministic subset of securities selected for evaluation under active filters.
Denominator of securities tested after applying exchange, board, instrument, and liquidity constraints.Securities possessing authentic historical and current OHLCV bars and required indicator arrays.
Securities with complete, continuous indicator cache on the requested timeframe.Candidates that strictly satisfy 100% of the active hard criteria.
Deterministic count of securities passing every active AST condition.The final list of candidate rows rendered in the UI, bounded by min(Qualified, Top-N).
Presentation limit only; does not affect or reduce underlying evaluation.A presentation-layer display limiter that caps the number of top-ranked rows rendered.
Slices ranked qualified results for UI rendering; never restricts universe evaluation.A recognized quantitative technical pattern satisfying deterministic mathematical rules.
Named pattern (e.g. EMA 55/144 Pullback, RSI > 50 Momentum) evaluated against OHLCV.A weighted multi-factor ranking index (0β100) combining trend, momentum, and volume.
Heuristic ranking metric used to order qualified candidates in read models.Invariant stating that a composite model score is a ranking index, not an empirical probability.
Uncalibrated heuristic setup scores are strictly forbidden from being displayed as percentage win odds.A quantitative resistance level (Classic Pivot R2/R3, Swing High, or ATR projection).
Analytical resistance price level used to measure upside distance.An objective structural invalidation level where the technical setup is invalidated.
Analytical invalidation price (swing low, EMA 55 baseline, or ATR buffer).The mathematical ratio of upside potential to structural target vs downside to stop loss.
Computed as (Target - Entry) / (Entry - Stop).The discrete bar aggregation interval used for calculation.
Supported: 5m, 15m, 1h, 4h (intraday); daily, weekly, monthly (macro).Multi-Timeframe analysis evaluating confluence across multiple bar regimes simultaneously.
Joint condition evaluation across higher, intermediate, and lower timeframe arrays.Strict temporal isolation preventing lookahead bias by evaluating models as of snapshot dates.
Calculations only ingest data timestamps strictly <= snapshot session timestamp.The authoritative active publication pointer designating the latest materialized session.
Symlink or atomic pointer pointing to the most recently completed EOD read model directory.Last Known Good publication artifact preserved as a fail-safe fallback.
Immutable backup snapshot retained to serve reads if current generation fails verification.The specific calendar trade date represented by the currently published read model.
Date string (YYYY-MM-DD) embedded in read model metadata.The calendar trade date of the most recent market trading session completed on the exchange.
Determined from official NSE/BSE trading calendars.An immutable cryptographic hash uniquely identifying dataset lineage and parameters.
SHA-256 hash computed over publication artifacts and code version.A precomputed, denormalized read-optimized data artifact designed for rapid querying.
JSON/Parquet file written to data/published/ and served directly by endpoints.Data artifacts precomputed and written to disk by the pipeline rather than generated on the fly.
Persisted files on disk ready for static reads.Status indicating external data sources did not provide complete records for a specific feed.
Handled gracefully with transparent limitation flags rather than fabrication.Component state indicating optional integration parameters are intentionally omitted.
Readiness checks return NOT_CONFIGURED without throwing fatal exceptions.Data or cache timestamp older than the expected update schedule or publication threshold.
Evaluated by comparing artifact timestamp with market close schedule.Truthful indicator that data does not exist or could not be loaded; never synthesized.
API returns structured UNAVAILABLE response with explicit reason.The authoritative autonomous automation daemon (egts-control-plane) for all pipelines.
Sole writer authority enforcing single-writer locks, session state machine, and scheduling.Legacy egts-scheduler systemd service intentionally INACTIVE and MASKED.
Masked to prevent dual-writer conflicts with the autonomous Control Plane.Safe notification dispatch mode evaluating rules and outbox audits without external sends.
Evaluates rules, logs outbox records, but makes zero network requests to Telegram.Controlled testing mode dispatching notifications exclusively to verified Canary/Admin recipients.
Filters outbox sends strictly to recipients with is_test_recipient == True.Gated live delivery mode restricting sends to specific critical channels or verified groups.
Restricts delivery to high-severity groups and verified members.Fully operational live delivery mode sending eligible alerts to all active verified recipients.
Dispatches to all matching recipients with verification_status == VERIFIED.A verified administrator designated to receive staging or pre-release notifications.
Recipient with is_test_recipient=True and groups=['ADMIN'].Safety routing rule where critical system notifications are mirrored to administrative recipients.
System operator alerts automatically append GRP_ADMIN to target recipient list.Time window (default 22:00β07:00 IST) suppressing non-critical notifications.
Alerts below CRITICAL severity are suppressed during configured hours.The minimum mandatory quiet interval between repeated alerts for the same symbol and rule.
Checked against alert history store; subsequent alerts within window are suppressed.The transactional queue where generated alerts are recorded before safe dispatch.
JSONL queue storing DeliveryOutboxItem instances with retry and attempt counters.Status of an alert withheld from external dispatch due to quiet hours, cooldown, or preferences.
Recorded in DeliveryAuditRecord with explicit suppression reason.Filter action that discards redundant identical alert events generated within an active window.
Identified via (symbol, rule_id, timeframe) fingerprint match.26. Normal User vs Operator Actions
Clear boundary separation distinguishing actions safe for normal market analysts versus privileged actions reserved exclusively for system operators.
Prevents unauthorized or accidental execution of maintenance, backup, or service modification commands.
- Normal User: Browse opportunities, filter candidates, manage personal watchlists, configure alert rules, view stock intelligence.
- Operator: Monitor Control Plane daemon, execute backup/restore verification, audit outbox queues, manage Telegram delivery modes.
27. Troubleshooting
Comprehensive diagnostic troubleshooting matrix covering common operational symptoms, root causes, and verified resolution steps.
Enables rapid self-service problem resolution without escalation to engineering.
- Scheduler Masked is NOT an error: Legacy scheduler must remain masked!
- Telegram not sending: In DRY_RUN mode, external sending is intentionally suppressed by design.
- Digest session older than EOD: Normal when new digest has not been generated post-close.
28. Production Safety / READ_ONLY
Production safety architecture enforcing strict READ_ONLY operational mode, zero external network calls, zero broker connectivity, and credential protection.
Guarantees that EGTS cannot execute unwanted financial orders, leak sensitive credentials, or mutate canonical market datasets.
- READ_ONLY: Canonical market data and publication partitions are strictly read-only for web processes.
- Broker Execution DISABLED: There are ZERO broker APIs, order placement endpoints, or financial execution hooks.
- Zero Secret Leaks: Bot tokens, chat IDs, and private keys are never exposed in API payloads or client code.
29. Production Closeout / Remaining Acceptance
Truthful operational status ledger detailing what is complete in this release versus the exact operational acceptance tasks remaining before full live production sign-off.
Prevents premature declaration of production readiness and maintains strict change-control transparency.
- COMPLETED IN THIS RELEASE: Application Code Complete, Website UX Complete, Scanner Accelerated, Discover First-Class Intraday, Insights Calibration Truth, Control Plane Active, Legacy Scheduler Masked/Off, READ_ONLY Active, Broker Disabled, Telegram Authoritative Dispatch LIMITED_LIVE (Legacy CP Adapter DRY_RUN).
- REMAINING OPERATIONAL ACCEPTANCE (17 Steps): Whole-universe product audit, surface audit, Telegram test recipient commissioning, Canary message test, delivery audit inspection, ordinary recipient verification, admin mirror proof, system routing isolation, LIMITED_LIVE promotion, LIVE promotion, critical backup, restore verification, off-host DR copy, next real trading session acceptance (5m, 15m, 1h, 4h), autonomous post-close EOD acceptance, publication rollover, final freeze.