{"repo":"lezwon/CatalystOps","free":true,"listed":false,"github":"https://github.com/lezwon/CatalystOps","clone":"git clone https://github.com/lezwon/CatalystOps.git","description":"Semantic cost-linting and performance warnings extension for Databricks in VS Code","language":"TypeScript","stars":28,"topics":["analysis","cost-optimization","data-engineering","databricks","finops","linter","pyspark","spark"],"license":null,"category":"dev-tools","readme_excerpt":"CatalystOps — PySpark Optimizer CatalystOps catches PySpark performance issues before they reach production. It runs 40+ anti-pattern checks instantly in the editor, validates schemas at edit time, analyzes Catalyst execution plans via Databricks dry run or SSH, inspects historical job runs from Spark event logs, and tracks Databricks spending in a built-in billing dashboard — without touching your data. Install from the VS Code Marketplace --- --- Features Local Analysis — No Cluster Required Runs instantly on every file open and save. Detects: Severity Examples ---------- --------- Critical collect() , crossJoin() , SQL injection via f-strings, for row in df.collect() , DLT CDC ordering bugs Warning toPandas() , coalesce(1) , global window functions, withColumn in loops, chained .withColumn() calls, streaming without watermark, UDFs in .filter() , .repartition(N) before write, repeated actions without .cache() Info Schema inference, SELECT , missing write mode, ZORDER (use Liquid Clustering), unnamed streaming queries, MERGE without Deletion Vectors Streaming, Delta, and DLT pipelines have dedicated rule sets. Add # noqa: catalystops to suppress a line. Hover cards — every issue shows a one-sentence explanation and a quick-fix code snippet on hover. --- Schema Validation — No Cluster Required When a StructType or DDL schema is defined in the same file, CatalystOps validates column references and types at edit time: - Unknown column names with \"did you mean?\" suggestions - T","default_branch":null,"files":null,"tree":[],"storefront":"/r/lezwon","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lezwon/CatalystOps/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}